D2-Net: Dual Disentanglement Network for Brain Tumor Segmentation With Missing Modalities

计算机科学 模式 人工智能 分割 图像分割 缺少数据 对偶(语法数字) 机器学习 计算机视觉 社会科学 文学类 艺术 社会学
作者
Qiushi Yang,Xiaoqing Guo,Zhen Chen,Peter Y. M. Woo,Yixuan Yuan
出处
期刊:IEEE Transactions on Medical Imaging [Institute of Electrical and Electronics Engineers]
卷期号:41 (10): 2953-2964 被引量:97
标识
DOI:10.1109/tmi.2022.3175478
摘要

Multi-modal Magnetic Resonance Imaging (MRI) can provide complementary information for automatic brain tumor segmentation, which is crucial for diagnosis and prognosis. While missing modality data is common in clinical practice and it can result in the collapse of most previous methods relying on complete modality data. Current state-of-the-art approaches cope with the situations of missing modalities by fusing multi-modal images and features to learn shared representations of tumor regions, which often ignore explicitly capturing the correlations among modalities and tumor regions. Inspired by the fact that modality information plays distinct roles to segment different tumor regions, we aim to explicitly exploit the correlations among various modality-specific information and tumor-specific knowledge for segmentation. To this end, we propose a Dual Disentanglement Network (D2-Net) for brain tumor segmentation with missing modalities, which consists of a modality disentanglement stage (MD-Stage) and a tumor-region disentanglement stage (TD-Stage). In the MD-Stage, a spatial-frequency joint modality contrastive learning scheme is designed to directly decouple the modality-specific information from MRI data. To decompose tumor-specific representations and extract discriminative holistic features, we propose an affinity-guided dense tumor-region knowledge distillation mechanism in the TD-Stage through aligning the features of a disentangled binary teacher network with a holistic student network. By explicitly discovering relations among modalities and tumor regions, our model can learn sufficient information for segmentation even if some modalities are missing. Extensive experiments on the public BraTS-2018 database demonstrate the superiority of our framework over state-of-the-art methods in missing modalities situations. Codes are available at https://github.com/CityU-AIM-Group/D2Net.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
刚刚
刚刚
刚刚
清脆乐曲发布了新的文献求助30
1秒前
臆想完成签到,获得积分10
1秒前
1秒前
魅力如风发布了新的文献求助10
1秒前
2秒前
2秒前
2秒前
2秒前
Kai发布了新的文献求助10
2秒前
2秒前
Srishti完成签到,获得积分10
3秒前
3秒前
3秒前
自己发布了新的文献求助10
3秒前
3秒前
3秒前
星星点发布了新的文献求助10
4秒前
sam0522完成签到,获得积分10
4秒前
NexusExplorer的应助被theverve采纳,获得10
4秒前
斯文败类的应助被LYY采纳,获得10
4秒前
Hello的应助被飘逸雨竹采纳,获得10
4秒前
4秒前
4秒前
MMM发布了新的文献求助30
4秒前
4秒前
顺心幻天发布了新的文献求助10
5秒前
臆想发布了新的文献求助10
5秒前
屁屁发布了新的文献求助10
5秒前
5秒前
LIzx发布了新的文献求助10
6秒前
马马马完成签到,获得积分10
6秒前
6秒前
仁爱千柳完成签到,获得积分10
6秒前
猪宝芊发布了新的文献求助10
6秒前
6秒前
wxx1发布了新的文献求助10
7秒前
lcy完成签到,获得积分20
7秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
Markov Decision Processes and Reinforcement Learning 700
八旗制度の研究 600
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8170166
求助须知:如何正确求助?哪些是违规求助? 9563213
关于积分的说明 21768986
捐赠科研通 7761665
什么是DOI,文献DOI怎么找? 3430630
关于科研通互助平台的介绍 2554458
邀请新用户注册赠送积分活动 2475393