Accuracy of Information given by ChatGPT for Patients with Inflammatory Bowel Disease in Relation to ECCO Guidelines

炎症性肠病 医学 关系(数据库) 溃疡性结肠炎 炎症性肠病 胃肠病学 内科学 疾病 数据挖掘 计算机科学
作者
Martina Sciberras,Yvette Farrugia,Hannah Gordon,Federica Furfaro,Mariangela Allocca,Joana Torres,Naila Arebi,Gionata Fiorino,Marietta Iacucci,Bram Verstockt,Fernando Magro,Kostas Katsanos,Josef Busuttil,Katya De Giovanni,Valerie Anne Fenech,Stefania Chetcuti Zammit,Pierre Ellul
出处
期刊:Journal of Crohn's and Colitis [Oxford University Press]
卷期号:18 (8): 1215-1221 被引量:4
标识
DOI:10.1093/ecco-jcc/jjae040
摘要

Abstract Background As acceptance of artificial intelligence [AI] platforms increases, more patients will consider these tools as sources of information. The ChatGPT architecture utilizes a neural network to process natural language, thus generating responses based on the context of input text. The accuracy and completeness of ChatGPT3.5 in the context of inflammatory bowel disease [IBD] remains unclear. Methods In this prospective study, 38 questions worded by IBD patients were inputted into ChatGPT3.5. The following topics were covered: [1] Crohn’s disease [CD], ulcerative colitis [UC], and malignancy; [2] maternal medicine; [3] infection and vaccination; and [4] complementary medicine. Responses given by ChatGPT were assessed for accuracy [1—completely incorrect to 5—completely correct] and completeness [3-point Likert scale; range 1—incomplete to 3—complete] by 14 expert gastroenterologists, in comparison with relevant ECCO guidelines. Results In terms of accuracy, most replies [84.2%] had a median score of ≥4 (interquartile range [IQR]: 2) and a mean score of 3.87 [SD: ±0.6]. For completeness, 34.2% of the replies had a median score of 3 and 55.3% had a median score of between 2 and <3. Overall, the mean rating was 2.24 [SD: ±0.4, median: 2, IQR: 1]. Though groups 3 and 4 had a higher mean for both accuracy and completeness, there was no significant scoring variation between the four question groups [Kruskal–Wallis test p > 0.05]. However, statistical analysis for the different individual questions revealed a significant difference for both accuracy [p < 0.001] and completeness [p < 0.001]. The questions which rated the highest for both accuracy and completeness were related to smoking, while the lowest rating was related to screening for malignancy and vaccinations especially in the context of immunosuppression and family planning. Conclusion This is the first study to demonstrate the capability of an AI-based system to provide accurate and comprehensive answers to real-world patient queries in IBD. AI systems may serve as a useful adjunct for patients, in addition to standard of care in clinics and validated patient information resources. However, responses in specialist areas may deviate from evidence-based guidance and the replies need to give more firm advice.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
刚刚
Tim完成签到 ,获得积分10
1秒前
深情安青应助1998阿杰0526采纳,获得10
1秒前
1秒前
CodeCraft应助honphyjiang采纳,获得10
1秒前
莓啤汽发布了新的文献求助10
2秒前
NexusExplorer应助sumire采纳,获得10
2秒前
2秒前
2秒前
2秒前
丘比特应助zzznznnn采纳,获得10
2秒前
3秒前
小路静悄悄完成签到,获得积分10
3秒前
3秒前
科研通AI5应助XiroSphix采纳,获得10
4秒前
搞怪的太阳完成签到,获得积分10
4秒前
科目三应助蜜CC采纳,获得10
5秒前
杳鸢应助欣慰冰珍采纳,获得10
5秒前
橙子小zhu发布了新的文献求助10
6秒前
6秒前
风云发布了新的文献求助10
6秒前
科研通AI5应助iwhsgfes采纳,获得10
8秒前
建浩发布了新的文献求助20
8秒前
8秒前
小助应助西米采纳,获得20
9秒前
zyn发布了新的文献求助10
10秒前
10秒前
小二郎应助宇少爱学习哟采纳,获得10
10秒前
snow发布了新的文献求助10
10秒前
11秒前
sakura完成签到,获得积分10
11秒前
Akim应助SXYYY采纳,获得10
11秒前
共享精神应助待定采纳,获得10
11秒前
DJ完成签到,获得积分10
12秒前
12秒前
顾矜应助Emily采纳,获得30
12秒前
马楼完成签到,获得积分10
12秒前
13秒前
柯夫子发布了新的文献求助10
13秒前
慕青应助务实水绿采纳,获得10
13秒前
高分求助中
Continuum Thermodynamics and Material Modelling 3000
Production Logging: Theoretical and Interpretive Elements 2700
Les Mantodea de Guyane Insecta, Polyneoptera 1000
Conference Record, IAS Annual Meeting 1977 820
England and the Discovery of America, 1481-1620 600
Teaching language in context (Third edition) by Derewianka, Beverly; Jones, Pauline 550
Oligomycin, a new antifungal antibiotic 500
热门求助领域 (近24小时)
化学 材料科学 生物 医学 工程类 有机化学 生物化学 物理 纳米技术 计算机科学 内科学 化学工程 复合材料 基因 遗传学 物理化学 催化作用 量子力学 光电子学 冶金
热门帖子
关注 科研通微信公众号,转发送积分 3583447
求助须知:如何正确求助?哪些是违规求助? 3152668
关于积分的说明 9493793
捐赠科研通 2855215
什么是DOI,文献DOI怎么找? 1569480
邀请新用户注册赠送积分活动 735260
科研通“疑难数据库(出版商)”最低求助积分说明 721145