Segment anything model for medical images?

计算机科学 分割 人工智能 对象(语法) 图像分割 随机性 计算机视觉 模态(人机交互) 图像(数学) 模式识别(心理学) 数学 统计
作者
Yuhao Huang,Xin Yang,Lian Liu,Han Zhou,Chang Ao,Xinrui Zhou,Rusi Chen,Junxuan Yu,Jiongquan Chen,Chaoyu Chen,Sijing Liu,Haozhe Chi,Xindi Hu,Kejuan Yue,Lei Li,Vicente Grau,Deng-Ping Fan,Fajin Dong,Dong Ni
出处
期刊:Medical Image Analysis [Elsevier BV]
卷期号:92: 103061-103061 被引量:353
标识
DOI:10.1016/j.media.2023.103061
摘要

The Segment Anything Model (SAM) is the first foundation model for general image segmentation. It has achieved impressive results on various natural image segmentation tasks. However, medical image segmentation (MIS) is more challenging because of the complex modalities, fine anatomical structures, uncertain and complex object boundaries, and wide-range object scales. To fully validate SAM's performance on medical data, we collected and sorted 53 open-source datasets and built a large medical segmentation dataset with 18 modalities, 84 objects, 125 object-modality paired targets, 1050K 2D images, and 6033K masks. We comprehensively analyzed different models and strategies on the so-called COSMOS 1050K dataset. Our findings mainly include the following: (1) SAM showed remarkable performance in some specific objects but was unstable, imperfect, or even totally failed in other situations. (2) SAM with the large ViT-H showed better overall performance than that with the small ViT-B. (3) SAM performed better with manual hints, especially box, than the Everything mode. (4) SAM could help human annotation with high labeling quality and less time. (5) SAM was sensitive to the randomness in the center point and tight box prompts, and may suffer from a serious performance drop. (6) SAM performed better than interactive methods with one or a few points, but will be outpaced as the number of points increases. (7) SAM's performance correlated to different factors, including boundary complexity, intensity differences, etc. (8) Finetuning the SAM on specific medical tasks could improve its average DICE performance by 4.39% and 6.68% for ViT-B and ViT-H, respectively. Codes and models are available at: https://github.com/yuhoo0302/Segment-Anything-Model-for-Medical-Images. We hope that this comprehensive report can help researchers explore the potential of SAM applications in MIS, and guide how to appropriately use and develop SAM.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
小蘑菇的应助被lhh采纳,获得10
刚刚
1秒前
wake发布了新的文献求助10
1秒前
杏仁发布了新的文献求助10
1秒前
Nole的应助被星辰坠于海采纳,获得10
2秒前
2秒前
ddwdwdwdddw发布了新的文献求助10
3秒前
Spring发布了新的文献求助10
3秒前
3秒前
JamesPei的应助被阿东采纳,获得10
4秒前
vino发布了新的文献求助10
4秒前
cy发布了新的文献求助10
5秒前
为什么要有昵称呢qwq完成签到,获得积分10
6秒前
一百关注了科研通微信公众号
6秒前
6秒前
如懿发布了新的文献求助10
6秒前
现代傲芙发布了新的文献求助10
7秒前
8秒前
xiao完成签到,获得积分20
8秒前
8秒前
chiyudawang发布了新的文献求助10
8秒前
8秒前
卡卡完成签到,获得积分10
9秒前
叶木完成签到 ,获得积分10
9秒前
10秒前
10秒前
11秒前
绵绵发布了新的文献求助10
11秒前
hhh发布了新的文献求助10
12秒前
igiss发布了新的文献求助10
12秒前
13秒前
lnn完成签到,获得积分20
13秒前
11发布了新的文献求助10
14秒前
anna521212完成签到 ,获得积分10
14秒前
细腻苑博完成签到,获得积分10
15秒前
15秒前
王明伟发布了新的文献求助10
15秒前
15秒前
拉长的小伙完成签到,获得积分10
18秒前
小画发布了新的文献求助10
19秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
plantTFDB 508
高分子基功能界面水蒸发材料与应用研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8177901
求助须知:如何正确求助?哪些是违规求助? 9568676
关于积分的说明 21800345
捐赠科研通 7772540
什么是DOI,文献DOI怎么找? 3432548
关于科研通互助平台的介绍 2556720
邀请新用户注册赠送积分活动 2478085