Öz
Aim: This study aimed to evaluate and compare the quality of chatGPT-3.5’s responses to frequently asked and undergraduate education-related questions provided by chatGPT-3.5 in the field of pediatric dentistry.
Materials and Methods: Frequently asked questions by patients about procedures in pediatric dentistry and questions for educational purposes were generated to be asked on ChatGPT-3.5. The questions were divided into two categories consisting of 14 Patient Questions and 18 Educational Questions. Specific topics covered: Oral hygiene and preventive dentistry, patient management, dental trauma, restorative dentistry and pulp therapy, orthodontics, dental pathology and dental radiology. ChatGPT-3.5 answered these questions on April 15, 2024. Responses were scored on a 1 to 5 scale by pediatric dentists using a modified global quality scale. All statistical calculations were performed using IBM SPSS Statistics version 25.0.
Results: Responses were scored by 25 pediatric dentists. The mean score for responses to Patient
Questions was 4.21±0.53, while the mean score for responses to Education Questions was 3.44±0.71. The
difference in scores between the two question categories and the subgroups of the categories was found to be statistically significant (p<0.001).
Conclusion: GPT-3.5 provided more reliable information on frequently asked questions by patients
in pediatric dentistry than on undergraduate educationrelated questions. Beyond being used for clinicians, ChatGPT may be more appropriate for patients to obtain general information in the field of pediatric dentistry
Anahtar Kelimeler
Kaynakça
- 1. Aggarwal A, Tam CC, Wu D, Li X, Qiao S. Artificial Intelligence-Based Chatbots for Promoting Health Behavioral Changes: Systematic Review. J Med Internet Res. 2023;25:e40789.
- 2. Mohammad-Rahimi H, Ourang SA, Pourhoseingholi MA, Dianat O, Dummer PMH, Nosrat A. Validity and reliability of artificial intelligence chatbots as public sources of information on endodontics. Int Endod J. 2024;57(3):305- 314.
- 3. Balel Y. Can ChatGPT-3.5 be used in oral and maxillofacial surgery?. J Stomatol Oral Maxillofac Surg. 2023;124(5):101471.
- 4. Tiwari A, Kumar A, Jain S, et al. Implications of ChatGPT-3.5 in Public Health Dentistry: A Systematic Review. Cureus. 2023;15(6):e40367.
- 5. Rokhshad R, Zhang P, Mohammad-Rahimi H, Pitchika V, Entezari N, Schwendicke F. Accuracy and consistency of chatbots versus clinicians for answering pediatric dentistry questions: A pilot study. J Dent. 2024;144:104938.
- 6. Xu L, Sanders L, Li K, Chow JCL. Chatbot for Health Care and Oncology Applications Using Artificial Intelligence and Machine Learning: Systematic Review. JMIR Cancer. 2021;7(4):e27850.
- 7. Dave T, Athaluri SA, Singh S. ChatGPT-3.5 in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations. Front Artif Intell. 2023;6:1169595.
- 8. Lee TJ, Rao AK, Campbell DJ, Radfar N, Dayal M, Khrais A. Evaluating ChatGPT-3.5 and ChatGPT-4.0 Responses on Hyperlipidemia for Patient Education. Cureus. 2024;16(5):e61067.
- 9. Lechien JR, Briganti G, Vaira LA. Accuracy of ChatGPT-3.5 and -4 in providing scientific references in otolaryngologyhead and neck surgery. Eur Arch Otorhinolaryngol. 2024;281(4):2159-2165.
- 10. Hirosawa T, Harada Y, Yokose M, Sakamoto T, Kawamura R, Shimizu T. Diagnostic Accuracy of Differential- Diagnosis Lists Generated by Generative Pretrained Transformer 3 Chatbot for Clinical Vignettes with Common Chief Complaints: A Pilot Study. Int J Environ Res Public Health. 2023;20(4):3378.
- 11. Massey PA, Montgomery C, Zhang AS. Comparison of ChatGPT-3.5, ChatGPT-4, and Orthopaedic Resident Performance on Orthopaedic Assessment Examinations. J Am Acad Orthop Surg. 2023;31(23):1173-1179.
- 12. Suárez A, Díaz-Flores García V, Algar J, Gómez Sánchez M, Llorente de Pedro M, Freire Y. Unveiling the ChatGPT phenomenon: Evaluating the consistency and accuracy of endodontic question answers. Int Endod J. 2024;57(1):108- 113.
- 13. Ozden I, Gokyar M, Ozden ME, Sazak Ovecoglu H. Assessment of artificial intelligence applications in responding to dental trauma. Dent Traumatol. 2024 Dec;40(6):722-729. Epub 2024 May 14. PMID: 38742754.
- 14. Schwendicke F, Chaurasia A, Wiegand T, et al. Artificial intelligence for oral and dental healthcare: Core education curriculum. J Dent. 2023;128:104363.
- 15. Li R, Kumar A, Chen JH. How Chatbots and Large Language Model Artificial Intelligence Systems Will Reshape Modern Medicine: Fountain of Creativity or Pandora’s Box?. JAMA Intern Med. 2023;183(6):596-597.
- 16. Ali K, Barhom N, Tamimi F, Duggal M. ChatGPT-A double-edged sword for healthcare education? Implications for assessments of dental students. Eur J Dent Educ. 2024;28(1):206-211.
- 17. Mago J, Sharma M. The Potential Usefulness of ChatGPT in Oral and Maxillofacial Radiology. Cureus. 2023;15(7):e42133.
- 18. Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023). How Does ChatGPT Perform on the United States Medical Licensing Examination (USMLE)? The Implications of Large Language Models for Medical Education and Knowledge Assessment. JMIR medical education, 9, e45312.
Öz
Amaç: Bu çalışmada çocuk diş hekimliği alanı ile ilgili sık sorulan ve lisans eğitimi ile ilgili sorulara chatGPT- 3.5’in sunduğu yanıtların kalitesinin değerlendirilmesi ve karşılaştırılması amaçlandı.
Gereç ve Yöntem: Hastaların çocuk diş hekimliğindeki işlemlerle ilgili sıklıkla sorduğu sorular ve eğitim
amaçlı sorular ChatGPT-3.5 üzerinden sorulmak üzere oluşturulmuştur. Sorular 14 Hasta Sorusu ve 18 Eğitim Sorusu olmak üzere iki kategoriye ayrıldı. Belirlenen spesifik konular: Ağız hijyeni ve koruyucu diş hekimliği, hasta yönetimi, diş travması, restoratif diş hekimliği ve pulpa tedavisi, ortodonti, diş patolojisi ve diş radyolojisi idi. ChatGPT-3.5, bu soruları 15 Nisan 2024’te yanıtladı. Yanıtlar, çocuk diş hekimleri tarafından modifiye edilmiş bir küresel kalite ölçeği kullanılarak 1 ila 5 arasında bir ölçekte puanlandı. Tüm istatistiksel hesaplamalar IBM SPSS Statistics sürüm 25.0 kullanılarak gerçekleştirildi.
Bulgular: Yanıtlar 25 pediatrik diş hekimi tarafından puanlandı. Hasta Sorularına verilen yanıtların ortalama puanı 4,21±0,53 iken Eğitim Sorularına verilen yanıtların ortalama puanı 3,44±0,71 idi. İki soru kategorisi ve kategorilerin alt grupları arasındaki puan farkı istatistiksel olarak anlamlı bulunmuştur (p<0,001).
Sonuç: GPT-3.5, çocuk diş hekimliği hastalarında sıklıkla sorulan sorular hakkında lisans eğitimi ile ilgili
sorulara göre daha güvenilir bilgi sağlamıştır. ChatGPT, klinisyenlerin kullanımı dışında, hastaların çocuk diş hekimliği alanında genel bilgi edinmeleri için daha uygun olabilir.
Anahtar Kelimeler
Etik Beyan
Hiçbir hasta verisi kullanılmadığı ve klinisyenlerin kendileri kayıt yaptırdığı için etik kurul onayı gerekmedi. (Balel Y. (2023). Can ChatGPT be used in oral and maxillofacial surgery?. Journal of stomatology, oral and maxillofacial surgery, 124(5), 101471. https://doi.org/10.1016/j.jormas.2023.101471)
Destekleyen Kurum
YOKTUR.
Teşekkür
Yazarlar, bu çalışmaya katkılarından dolayı kayıt yaptıran çocuk diş hekimlerine teşekkür ederiz.
Kaynakça
- 1. Aggarwal A, Tam CC, Wu D, Li X, Qiao S. Artificial Intelligence-Based Chatbots for Promoting Health Behavioral Changes: Systematic Review. J Med Internet Res. 2023;25:e40789.
- 2. Mohammad-Rahimi H, Ourang SA, Pourhoseingholi MA, Dianat O, Dummer PMH, Nosrat A. Validity and reliability of artificial intelligence chatbots as public sources of information on endodontics. Int Endod J. 2024;57(3):305- 314.
- 3. Balel Y. Can ChatGPT-3.5 be used in oral and maxillofacial surgery?. J Stomatol Oral Maxillofac Surg. 2023;124(5):101471.
- 4. Tiwari A, Kumar A, Jain S, et al. Implications of ChatGPT-3.5 in Public Health Dentistry: A Systematic Review. Cureus. 2023;15(6):e40367.
- 5. Rokhshad R, Zhang P, Mohammad-Rahimi H, Pitchika V, Entezari N, Schwendicke F. Accuracy and consistency of chatbots versus clinicians for answering pediatric dentistry questions: A pilot study. J Dent. 2024;144:104938.
- 6. Xu L, Sanders L, Li K, Chow JCL. Chatbot for Health Care and Oncology Applications Using Artificial Intelligence and Machine Learning: Systematic Review. JMIR Cancer. 2021;7(4):e27850.
- 7. Dave T, Athaluri SA, Singh S. ChatGPT-3.5 in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations. Front Artif Intell. 2023;6:1169595.
- 8. Lee TJ, Rao AK, Campbell DJ, Radfar N, Dayal M, Khrais A. Evaluating ChatGPT-3.5 and ChatGPT-4.0 Responses on Hyperlipidemia for Patient Education. Cureus. 2024;16(5):e61067.
- 9. Lechien JR, Briganti G, Vaira LA. Accuracy of ChatGPT-3.5 and -4 in providing scientific references in otolaryngologyhead and neck surgery. Eur Arch Otorhinolaryngol. 2024;281(4):2159-2165.
- 10. Hirosawa T, Harada Y, Yokose M, Sakamoto T, Kawamura R, Shimizu T. Diagnostic Accuracy of Differential- Diagnosis Lists Generated by Generative Pretrained Transformer 3 Chatbot for Clinical Vignettes with Common Chief Complaints: A Pilot Study. Int J Environ Res Public Health. 2023;20(4):3378.
- 11. Massey PA, Montgomery C, Zhang AS. Comparison of ChatGPT-3.5, ChatGPT-4, and Orthopaedic Resident Performance on Orthopaedic Assessment Examinations. J Am Acad Orthop Surg. 2023;31(23):1173-1179.
- 12. Suárez A, Díaz-Flores García V, Algar J, Gómez Sánchez M, Llorente de Pedro M, Freire Y. Unveiling the ChatGPT phenomenon: Evaluating the consistency and accuracy of endodontic question answers. Int Endod J. 2024;57(1):108- 113.
- 13. Ozden I, Gokyar M, Ozden ME, Sazak Ovecoglu H. Assessment of artificial intelligence applications in responding to dental trauma. Dent Traumatol. 2024 Dec;40(6):722-729. Epub 2024 May 14. PMID: 38742754.
- 14. Schwendicke F, Chaurasia A, Wiegand T, et al. Artificial intelligence for oral and dental healthcare: Core education curriculum. J Dent. 2023;128:104363.
- 15. Li R, Kumar A, Chen JH. How Chatbots and Large Language Model Artificial Intelligence Systems Will Reshape Modern Medicine: Fountain of Creativity or Pandora’s Box?. JAMA Intern Med. 2023;183(6):596-597.
- 16. Ali K, Barhom N, Tamimi F, Duggal M. ChatGPT-A double-edged sword for healthcare education? Implications for assessments of dental students. Eur J Dent Educ. 2024;28(1):206-211.
- 17. Mago J, Sharma M. The Potential Usefulness of ChatGPT in Oral and Maxillofacial Radiology. Cureus. 2023;15(7):e42133.
- 18. Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023). How Does ChatGPT Perform on the United States Medical Licensing Examination (USMLE)? The Implications of Large Language Models for Medical Education and Knowledge Assessment. JMIR medical education, 9, e45312.
Ayrıntılar
| Birincil Dil | İngilizce |
|---|---|
| Konular | Çocuk Diş Hekimliği |
| Bölüm | Araştırma Makaleleri |
| Yazarlar | |
| Yayımlanma Tarihi | 24 Nisan 2025 |
| Gönderilme Tarihi | 9 Temmuz 2024 |
| Kabul Tarihi | 12 Mart 2025 |
| Yayımlandığı Sayı | Yıl 2025 Cilt: 4 Sayı: 1 |
