Aims: Celiac disease is a significant autoimmune disorder that affects a substantial portion of the population, necessitating accurate and reliable information for effective management. Despite its importance, there are currently no studies assessing the performance of Artificial Intelligence (AI) language models, such as ChatGPT, in providing information on this condition. This study aims to evaluates the reliability and usefulness of ChatGPT's responses to frequently asked questions regarding celiac disease, thereby filling a critical gap in understanding the capabilities of AI in this important healthcare context.
Methods: A total of 20 questions (10 for patients/caregivers and 10 for healthcare professionals) were prepared based on the most frequently searched queries about celiac disease using Google Trends. Responses generated by ChatGPT and scored by two independent Likert raters.
Results: The analysis revealed strong inter-rater reliability, with Cronbach’s alpha values of α=0.839 for reliability and α=0.753 for usefulness, indicating robust agreement between raters. Notably, the highest reliability and usefulness scores for the patient and caregiver group were associated with questions on symptoms, the celiac disease diet, and gluten-free products. For the healthcare professionals group, key topics included diagnosis, pathological classification, and celiac disease comorbidities. Importantly, no significant differences were found between raters in the evaluation of reliability (p=0.939) and usefulness (p=0.102).
Conclusion: This study demonstrates that AI-based language models like ChatGPT can serve as reliable and useful resources for both patients and healthcare professionals seeking information about celiac disease. While the model excelled in addressing commonly discussed topics, it revealed limitations in handling complex issues, emphasizing the need for ongoing refinement of AI tools. These findings support the integration of AI in healthcare communication, highlighting its potential to enhance access to crucial health information while underscoring the importance of continual improvement to meet diverse user needs.
The study adhered to the ethical standards outlined in the Helsinki Declaration and complied with national regulations in the respective field. Since the study did not involve the use of human or animal data, ethics committee approval was not necessary.
The authors declared that this study has received no financial support.
Birincil Dil | İngilizce |
---|---|
Konular | Gastroenteroloji ve Hepatoloji |
Bölüm | Research Articles |
Yazarlar | |
Yayımlanma Tarihi | 30 Mayıs 2025 |
Gönderilme Tarihi | 1 Mart 2025 |
Kabul Tarihi | 28 Nisan 2025 |
Yayımlandığı Sayı | Yıl 2025 Cilt: 7 Sayı: 3 |
TR DİZİN ULAKBİM and International Indexes (1b)
Interuniversity Board (UAK) Equivalency: Article published in Ulakbim TR Index journal [10 POINTS], and Article published in other (excuding 1a, b, c) international indexed journal (1d) [5 POINTS]
Note: Our journal is not WOS indexed and therefore is not classified as Q.
You can download Council of Higher Education (CoHG) [Yüksek Öğretim Kurumu (YÖK)] Criteria) decisions about predatory/questionable journals and the author's clarification text and journal charge policy from your browser. https://dergipark.org.tr/tr/journal/3449/file/4924/show
Journal Indexes and Platforms:
TR Dizin ULAKBİM, Google Scholar, Crossref, Worldcat (OCLC), DRJI, EuroPub, OpenAIRE, Turkiye Citation Index, Turk Medline, ROAD, ICI World of Journal's, Index Copernicus, ASOS Index, General Impact Factor, Scilit.The indexes of the journal's are;
The platforms of the journal's are;
The indexes/platforms of the journal are;
TR Dizin Ulakbim, Crossref (DOI), Google Scholar, EuroPub, Directory of Research Journal İndexing (DRJI), Worldcat (OCLC), OpenAIRE, ASOS Index, ROAD, Turkiye Citation Index, ICI World of Journal's, Index Copernicus, Turk Medline, General Impact Factor, Scilit
Journal articles are evaluated as "Double-Blind Peer Review"
All articles published in this journal are licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0)