清晨好,您是今天最早来到科研通的研友!由于当前在线用户较少,发布求助请尽量完整地填写文献信息,科研通机器人24小时在线,伴您科研之路漫漫前行!

Guided image generation for improved surgical image segmentation

计算机科学 人工智能 分割 生成模型 生成语法 注释 模式识别(心理学) 图像分割 机器学习
作者
Emanuele Colleoni,Ricardo Sanchez Matilla,Imanol Luengo,Danail Stoyanov
出处
期刊:Medical Image Analysis [Elsevier BV]
卷期号:97: 103263-103263 被引量:4
标识
DOI:10.1016/j.media.2024.103263
摘要

The lack of large datasets and high-quality annotated data often limits the development of accurate and robust machine-learning models within the medical and surgical domains. In the machine learning community, generative models have recently demonstrated that it is possible to produce novel and diverse synthetic images that closely resemble reality while controlling their content with various types of annotations. However, generative models have not been yet fully explored in the surgical domain, partially due to the lack of large datasets and due to specific challenges present in the surgical domain such as the large anatomical diversity. We propose Surgery-GAN, a novel generative model that produces synthetic images from segmentation maps. Our architecture produces surgical images with improved quality when compared to early generative models thanks to the combination of channel- and pixel-level normalization layers that boost image quality while granting adherence to the input segmentation map. While state-of-the-art generative models often generate overfitted images, lacking diversity, or containing unrealistic artefacts such as cartooning; experiments demonstrate that Surgery-GAN is able to generate novel, realistic, and diverse surgical images in three different surgical datasets: cholecystectomy, partial nephrectomy, and radical prostatectomy. In addition, we investigate whether the use of synthetic images together with real ones can be used to improve the performance of other machine-learning models. Specifically, we use Surgery-GAN to generate large synthetic datasets which we then use to train five different segmentation models. Results demonstrate that using our synthetic images always improves the mean segmentation performance with respect to only using real images. For example, when considering radical prostatectomy, we can boost the mean segmentation performance by up to 5.43%. More interestingly, experimental results indicate that the performance improvement is larger in the set of classes that are under-represented in the training sets, where the performance boost of specific classes reaches up to 61.6%.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
幸福猎豹完成签到,获得积分10
15秒前
15秒前
20秒前
24秒前
cy0824完成签到 ,获得积分10
28秒前
复杂亦瑶完成签到,获得积分10
35秒前
肉袒牵洋完成签到 ,获得积分10
39秒前
小二郎的应助被兰斯洛特117采纳,获得10
41秒前
Criminology34的应助被科研通管家采纳,获得10
41秒前
Criminology34的应助被科研通管家采纳,获得10
41秒前
43秒前
俊秀的凡蕾完成签到,获得积分10
1分钟前
1分钟前
1分钟前
刻苦续完成签到,获得积分10
1分钟前
1分钟前
ZXneuro完成签到,获得积分10
1分钟前
1分钟前
TingtingGZ发布了新的文献求助10
1分钟前
在水一方的应助被WebCasa采纳,获得50
1分钟前
1分钟前
1分钟前
1分钟前
2分钟前
小巧慕儿完成签到,获得积分10
2分钟前
动听的山槐完成签到,获得积分10
2分钟前
2分钟前
Criminology34的应助被科研通管家采纳,获得10
2分钟前
Criminology34的应助被科研通管家采纳,获得10
2分钟前
Criminology34的应助被科研通管家采纳,获得10
2分钟前
小二郎的应助被科研通管家采纳,获得10
2分钟前
Criminology34的应助被科研通管家采纳,获得10
2分钟前
2分钟前
华仔的应助被xun采纳,获得10
2分钟前
2分钟前
正直的剑愁完成签到,获得积分10
2分钟前
WebCasa发布了新的文献求助50
3分钟前
3分钟前
3分钟前
sshh123发布了新的文献求助60
3分钟前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
plantTFDB 508
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8173194
求助须知:如何正确求助?哪些是违规求助? 9565558
关于积分的说明 21780461
捐赠科研通 7767279
什么是DOI,文献DOI怎么找? 3431542
关于科研通互助平台的介绍 2555697
邀请新用户注册赠送积分活动 2476682