Accuracy of Information given by ChatGPT for Patients with Inflammatory Bowel Disease in Relation to ECCO Guidelines

炎症性肠病 医学 关系(数据库) 溃疡性结肠炎 炎症性肠病 胃肠病学 内科学 疾病 数据挖掘 计算机科学
作者
Martina Sciberras,Yvette Farrugia,Hannah Gordon,Federica Furfaro,Mariangela Allocca,Joana Torres,Naila Arebi,Gionata Fiorino,Marietta Iacucci,Bram Verstockt,Fernando Magro,Kostas Katsanos,Josef Busuttil,Katya De Giovanni,Valerie Anne Fenech,Stefania Chetcuti Zammit,Pierre Ellul
出处
期刊:Journal of Crohn's and Colitis [Oxford University Press]
卷期号:18 (8): 1215-1221 被引量:4
标识
DOI:10.1093/ecco-jcc/jjae040
摘要

Abstract Background As acceptance of artificial intelligence [AI] platforms increases, more patients will consider these tools as sources of information. The ChatGPT architecture utilizes a neural network to process natural language, thus generating responses based on the context of input text. The accuracy and completeness of ChatGPT3.5 in the context of inflammatory bowel disease [IBD] remains unclear. Methods In this prospective study, 38 questions worded by IBD patients were inputted into ChatGPT3.5. The following topics were covered: [1] Crohn’s disease [CD], ulcerative colitis [UC], and malignancy; [2] maternal medicine; [3] infection and vaccination; and [4] complementary medicine. Responses given by ChatGPT were assessed for accuracy [1—completely incorrect to 5—completely correct] and completeness [3-point Likert scale; range 1—incomplete to 3—complete] by 14 expert gastroenterologists, in comparison with relevant ECCO guidelines. Results In terms of accuracy, most replies [84.2%] had a median score of ≥4 (interquartile range [IQR]: 2) and a mean score of 3.87 [SD: ±0.6]. For completeness, 34.2% of the replies had a median score of 3 and 55.3% had a median score of between 2 and <3. Overall, the mean rating was 2.24 [SD: ±0.4, median: 2, IQR: 1]. Though groups 3 and 4 had a higher mean for both accuracy and completeness, there was no significant scoring variation between the four question groups [Kruskal–Wallis test p > 0.05]. However, statistical analysis for the different individual questions revealed a significant difference for both accuracy [p < 0.001] and completeness [p < 0.001]. The questions which rated the highest for both accuracy and completeness were related to smoking, while the lowest rating was related to screening for malignancy and vaccinations especially in the context of immunosuppression and family planning. Conclusion This is the first study to demonstrate the capability of an AI-based system to provide accurate and comprehensive answers to real-world patient queries in IBD. AI systems may serve as a useful adjunct for patients, in addition to standard of care in clinics and validated patient information resources. However, responses in specialist areas may deviate from evidence-based guidance and the replies need to give more firm advice.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
刚刚
刚刚
聪明纸飞机完成签到,获得积分10
1秒前
1秒前
润run发布了新的文献求助10
1秒前
微笑嵩发布了新的文献求助10
1秒前
GUO完成签到 ,获得积分10
1秒前
爆米花应助鲜艳的手链采纳,获得20
2秒前
S77应助羊咩咩采纳,获得10
2秒前
在水一方应助lj采纳,获得10
2秒前
2秒前
沸羊羊完成签到,获得积分10
3秒前
李白发布了新的文献求助10
3秒前
zhaxiao完成签到,获得积分10
3秒前
爆米花应助ZRZR采纳,获得10
4秒前
凌凌凌完成签到,获得积分10
4秒前
科研通AI5应助理li采纳,获得10
4秒前
4秒前
在水一方应助桃真心采纳,获得10
4秒前
RUOK发布了新的文献求助30
4秒前
科研通AI5应助病娇星期三采纳,获得10
5秒前
sunshine发布了新的文献求助10
5秒前
楚雨荨发布了新的文献求助10
6秒前
6秒前
6秒前
didi完成签到,获得积分10
6秒前
自然问柳应助liyanglin采纳,获得10
7秒前
xiaoxiaoli发布了新的文献求助10
7秒前
Akim应助小虫采纳,获得10
7秒前
NexusExplorer应助北海未暖采纳,获得10
7秒前
8秒前
标致的以寒关注了科研通微信公众号
8秒前
SciGPT应助雪落采纳,获得10
8秒前
9秒前
newplayer完成签到,获得积分10
9秒前
大模型应助火星上白安采纳,获得10
9秒前
hhh完成签到,获得积分10
9秒前
10秒前
enh发布了新的文献求助30
10秒前
大秋哥哈拉少完成签到,获得积分10
10秒前
高分求助中
Continuum Thermodynamics and Material Modelling 3000
Production Logging: Theoretical and Interpretive Elements 2700
Les Mantodea de Guyane Insecta, Polyneoptera 1000
Conference Record, IAS Annual Meeting 1977 820
England and the Discovery of America, 1481-1620 600
Teaching language in context (Third edition) by Derewianka, Beverly; Jones, Pauline 550
電気学会論文誌D(産業応用部門誌), 141 巻, 11 号 510
热门求助领域 (近24小时)
化学 材料科学 生物 医学 工程类 有机化学 生物化学 物理 纳米技术 计算机科学 内科学 化学工程 复合材料 基因 遗传学 物理化学 催化作用 量子力学 光电子学 冶金
热门帖子
关注 科研通微信公众号,转发送积分 3583231
求助须知:如何正确求助?哪些是违规求助? 3152508
关于积分的说明 9492920
捐赠科研通 2854882
什么是DOI,文献DOI怎么找? 1569373
邀请新用户注册赠送积分活动 735182
科研通“疑难数据库(出版商)”最低求助积分说明 721082