Research Article

Assessing the Success of Chatgpt-4o in Oral Radiology Education and Practice: A Pioneering Research

Volume: 28 Number: 2 June 30, 2025
TR EN

Assessing the Success of Chatgpt-4o in Oral Radiology Education and Practice: A Pioneering Research

Abstract

Objectives: This study aims to assess the comprehension and interpretation performance of Chat Generative Pre-Train Omni (GPT-4o) in the context of oral radiology education and practice. Materials and Methods: Utilizing a set of 99 questions derived from the book "White and Pharoah's Oral Radiology: Principles and Interpretation 8th Edition," this study employed ChatGPT-4o to respond to these questions thrice daily at varying times over 10 days, generating a total of 60 responses for each question. Two oral radiologists independently answered the same questions and verified their answers with the relevant textbook. Responses were compared to those of ChatGPT-4o. Results: The study revealed that ChatGPT-4o's correct answer rate was 59.4%. Time-based analysis revealed performance differences across specific day periods. Specifically, during noon and evening sessions, the success rate on the first and seventh days was statistically significantly higher (p = 0.003 and p = 0.002, respectively), while morning performance on those days was significantly lower (p < 0.05), indicating that the time and day of the query may influence response accuracy. In contrast, no significant relationship was found between the difficulty level of the questions and the model's accuracy (p > 0.05). Conclusions: Presently, ChatGPT exhibits inadequacies in its application to oral radiology training and clinical practice. Despite this, expectations for platform improvement and expansion in utility persist, particularly with increased data input and advancements in artificial intelligence.

Keywords

Supporting Institution

There is no

Ethical Statement

Ethical approval There is no human as a participant in the study and ethical approval for this research was not required.

References

  1. 1. Rodrigues JA, Krois J, Schwendicke F. Demystifying artificial intelligence and deep learning in dentistry. Braz Oral Res 2021;35:e094.
  2. 2. Deng L. Artificial intelligence in the rising wave of deep learning: the historical path and futureoutlook. IEEE Signal Process Mag 2018;35(1):180-177.
  3. 3. Mogali SR. Initial impressions of ChatGPT for anatomy education. Anat Sci Educ 2024;17(2):444-447.
  4. 4. Abd-Alrazaq A, AlSaad R, Alhuwail D, Ahmed A, Healy PM, Latifi S, Aziz S, Damseh R, Alabed Alrazak S, Sheikh J. Large language models in medical education: opportunities, challenges, and future directions. JMIR Med Educ 2023;9:e48291.
  5. 5. Cadamuro J, Cabitza F, Debeljak Z, De Bruyne S, Frans G, Perez SM, Ozdemir H, Tolios A, Carobene A, Padoan A. Potentials and pitfalls of ChatGPT and natural-language artificial intelligence models for understanding laboratory medicine test results. Clin Chem Lab Med 2023;61(7):1158-1166.
  6. 6. Li H, Moon JT, Purkayastha S, Celi LA, Trivedi H, Gichoya JW. Ethics of large language models in medicine and medical research. Lancet Digit Health 2023;5(6):e333-e335.
  7. 7. Gilson A, Safranek CW, Huang T, Socrates V, Chi L, Taylor RA, Chartash D. How does ChatGPT perform on the United States Medical Licensing Examination? The implications of large language models for medical education and knowledge assessment. JMIR Med Educ 2023;9:e45312.
  8. 8. Arif TB, Munaf U, Ul-Haque I. The future of medical education and research: is ChatGPT a blessing or blight in disguise? Med Educ Online 2023;28(1):2181052.

Details

Primary Language

English

Subjects

Oral and Maxillofacial Radiology , Dentistry (Other)

Journal Section

Research Article

Publication Date

June 30, 2025

Submission Date

January 21, 2025

Acceptance Date

April 4, 2025

Published in Issue

Year 2025 Volume: 28 Number: 2

EndNote
Akkoca F, Özdede M, İlhan G, Koyuncu E, Ellidokuz H (June 1, 2025) Assessing the Success of Chatgpt-4o in Oral Radiology Education and Practice: A Pioneering Research. Cumhuriyet Dental Journal 28 2 210–215.

Cited By

Cumhuriyet Dental Journal (Cumhuriyet Dent J, CDJ) is the official publication of Cumhuriyet University Faculty of Dentistry. CDJ is an international journal dedicated to the latest advancement of dentistry. The aim of this journal is to provide a platform for scientists and academicians all over the world to promote, share, and discuss various new issues and developments in different areas of dentistry. First issue of the Journal of Cumhuriyet University Faculty of Dentistry was published in 1998. In 2010, journal's name was changed as Cumhuriyet Dental Journal. Journal’s publication language is English.


CDJ accepts articles in English. Submitting a paper to CDJ is free of charges. In addition, CDJ has not have article processing charges.

Frequency: Four times a year (March, June, September, and December)

IMPORTANT NOTICE

All users of Cumhuriyet Dental Journal should visit to their user's home page through the "https://dergipark.org.tr/tr/user" " or "https://dergipark.org.tr/en/user" links to update their incomplete information shown in blue or yellow warnings and update their e-mail addresses and information to the DergiPark system. Otherwise, the e-mails from the journal will not be seen or fall into the SPAM folder. Please fill in all missing part in the relevant field.

Please visit journal's AUTHOR GUIDELINE to see revised policy and submission rules to be held since 2020.