Experimenting With the New Frontier: Artificial Intelligence–Powered Chat Bots in Hand Surgery

医学 误传 等级间信度 手外科 介绍 完备性(序理论) 人工智能 医学教育 外科 家庭医学 心理学 计算机科学 评定量表 计算机安全 数学分析 发展心理学 数学
作者
Zayd M. Al Rawi,Benjamin J. Kirby,Peter Albrecht,Julia A.V. Nuelle,Daniel A. London
出处
期刊:Hand [SAGE]
被引量:2
标识
DOI:10.1177/15589447241238372
摘要

Background: Increased utilization of artificial intelligence (AI)-driven search and large language models by the lay and medical community requires us to evaluate the accuracy of AI responses to common hand surgery questions. We hypothesized that the answers to most hand surgery questions posed to an AI large language model would be correct. Methods: Using the topics covered in Green’s Operative Hand Surgery 8 th Edition as a guide, 56 hand surgery questions were compiled and posed to ChatGPT (OpenAI, San Francisco, CA). Two attending hand surgeons then independently reviewed ChatGPT’s answers for response accuracy, completeness, and usefulness. A Cohen’s kappa analysis was performed to assess interrater agreement. Results: An average of 45 of the 56 questions posed to ChatGPT were deemed correct (80%), 39 responses were deemed useful (70%), and 32 responses were deemed complete (57%) by the reviewers. Kappa analysis demonstrated “fair to moderate” agreement between the two raters. Reviewers disagreed on 11 questions regarding correctness, 16 questions regarding usefulness, and 19 questions regarding completeness. Conclusions: Large language models have the potential to both positively and negatively impact patient perceptions and guide referral patterns based on the accuracy, completeness, and usefulness of their responses. While most responses fit these criteria, more precise responses are needed to ensure patient safety and avoid misinformation. Individual hand surgeons and surgical societies must understand these technologies and interface with the companies developing them to provide our patients with the best possible care.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
更新
大幅提高文件上传限制,最高150M (2024-4-1)

科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
研友_LBaRl8完成签到,获得积分10
刚刚
yuhan完成签到,获得积分10
1秒前
瘦瘦白卉发布了新的文献求助10
1秒前
科研通AI2S应助逗号先生采纳,获得10
1秒前
爆米花应助怒发5篇sci采纳,获得10
1秒前
2秒前
2秒前
果粒橙完成签到 ,获得积分10
2秒前
ECG完成签到,获得积分10
2秒前
魏曼柔完成签到,获得积分10
2秒前
3秒前
3秒前
小马哥完成签到,获得积分10
4秒前
4秒前
疯狂老登发布了新的文献求助10
4秒前
Adler发布了新的文献求助10
7秒前
7秒前
laogao发布了新的文献求助10
7秒前
7秒前
大模型应助与其采纳,获得10
7秒前
7秒前
Lucas应助不想取名字采纳,获得10
7秒前
JamesPei应助李秋秋采纳,获得10
7秒前
伊小美发布了新的文献求助30
8秒前
iY发布了新的文献求助30
8秒前
章鱼完成签到,获得积分10
8秒前
9秒前
苏卿应助ds采纳,获得10
9秒前
科研通AI2S应助rita采纳,获得10
9秒前
10秒前
牛牛123完成签到 ,获得积分10
10秒前
Rikki发布了新的文献求助10
10秒前
10秒前
大个应助MRzzzzz采纳,获得30
10秒前
12秒前
12秒前
英姑应助1781266采纳,获得10
13秒前
13秒前
赘婿应助猫仔采纳,获得10
13秒前
香蕉觅云应助疯狂老登采纳,获得10
14秒前
高分求助中
Sustainability in Tides Chemistry 2800
The Young builders of New china : the visit of the delegation of the WFDY to the Chinese People's Republic 1000
Rechtsphilosophie 1000
Bayesian Models of Cognition:Reverse Engineering the Mind 888
Le dégorgement réflexe des Acridiens 800
Defense against predation 800
Very-high-order BVD Schemes Using β-variable THINC Method 568
热门求助领域 (近24小时)
化学 医学 生物 材料科学 工程类 有机化学 生物化学 物理 内科学 纳米技术 计算机科学 化学工程 复合材料 基因 遗传学 催化作用 物理化学 免疫学 量子力学 细胞生物学
热门帖子
关注 科研通微信公众号,转发送积分 3135702
求助须知:如何正确求助?哪些是违规求助? 2786585
关于积分的说明 7778267
捐赠科研通 2442686
什么是DOI,文献DOI怎么找? 1298616
科研通“疑难数据库(出版商)”最低求助积分说明 625205
版权声明 600866