MIST: multiple instance learning network based on Swin Transformer for whole slide image classification of colorectal adenomas

雾 人工智能 变压器 计算机科学 模式识别(心理学) 工程类 电压 电气工程 物理 气象学
作者
Hongbin Cai,Xiaobing Feng,Ruomeng Yin,Youcai Zhao,Lingchuan Guo,Xiangshan Fan,Jun Liao
出处
期刊: [Wiley]
卷期号:259 (2): 125-135 被引量:46
标识
DOI:10.1002/path.6027
摘要

Colorectal adenoma is a recognized precancerous lesion of colorectal cancer (CRC), and at least 80% of colorectal cancers are malignantly transformed from it. Therefore, it is essential to distinguish benign from malignant adenomas in the early screening of colorectal cancer. Many deep learning computational pathology studies based on whole slide images (WSIs) have been proposed. Most approaches require manual annotation of lesion regions on WSIs, which is time-consuming and labor-intensive. This study proposes a new approach, MIST - Multiple Instance learning network based on the Swin Transformer, which can accurately classify colorectal adenoma WSIs only with slide-level labels. MIST uses the Swin Transformer as the backbone to extract features of images through self-supervised contrastive learning and uses a dual-stream multiple instance learning network to predict the class of slides. We trained and validated MIST on 666 WSIs collected from 480 colorectal adenoma patients in the Department of Pathology, The Affiliated Drum Tower Hospital of Nanjing University Medical School. These slides contained six common types of colorectal adenomas. The accuracy of external validation on 273 newly collected WSIs from Nanjing First Hospital was 0.784, which was superior to the existing methods and reached a level comparable to that of the local pathologist's accuracy of 0.806. Finally, we analyzed the interpretability of MIST and observed that the lesion areas of interest in MIST were generally consistent with those of interest to local pathologists. In conclusion, MIST is a low-burden, interpretable, and effective approach that can be used in colorectal cancer screening and may lead to a potential reduction in the mortality of CRC patients by assisting clinicians in the decision-making process. © 2022 The Pathological Society of Great Britain and Ireland.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
1秒前
1秒前
上官若男的应助被呆鹅采纳,获得10
1秒前
GelatoYu发布了新的文献求助10
1秒前
Nuyoah发布了新的文献求助10
1秒前
anan完成签到,获得积分10
1秒前
雾扰沨完成签到,获得积分20
2秒前
迷人又晴完成签到,获得积分10
2秒前
必兮相语发布了新的文献求助10
3秒前
科研通AI6.4的应助被HHH采纳,获得10
3秒前
3秒前
4秒前
小丸子完成签到,获得积分10
4秒前
木子雨完成签到 ,获得积分10
4秒前
英俊的铭的应助被杨斤斤采纳,获得10
5秒前
5秒前
5秒前
zwhy发布了新的文献求助10
5秒前
fan的应助被逸一时误一世采纳,获得10
6秒前
Liang发布了新的文献求助10
6秒前
6秒前
CarryLJR发布了新的文献求助10
7秒前
8秒前
我是老大的应助被叶落孤城采纳,获得10
9秒前
被迫做科研的老登完成签到,获得积分10
10秒前
sufu_jony的应助被Jerry采纳,获得10
10秒前
八点必起完成签到,获得积分0
11秒前
陈平安发布了新的文献求助10
11秒前
Jasper的应助被茂飞采纳,获得10
11秒前
ssss发布了新的文献求助10
11秒前
12秒前
陈皮软糖发布了新的文献求助20
12秒前
12秒前
充电宝的应助被好日常在采纳,获得10
12秒前
Hello的应助被hhhhh采纳,获得10
12秒前
sdf发布了新的文献求助10
13秒前
谷之森完成签到,获得积分10
14秒前
luyiyi发布了新的文献求助10
14秒前
14秒前
15秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
plantTFDB 508
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8171556
求助须知:如何正确求助?哪些是违规求助? 9564290
关于积分的说明 21774363
捐赠科研通 7763124
什么是DOI,文献DOI怎么找? 3430998
关于科研通互助平台的介绍 2554820
邀请新用户注册赠送积分活动 2475918