Cascaded Inner-Outer Clip Retformer for Ultrasound Video Object Segmentation

计算机视觉 计算机科学 人工智能 分割 图像分割 对象(语法) 放射科 医学
作者
Jialu Li,Lei Zhu,Zhaohu Xing,Baoliang Zhao,Ying Hu,Faqin Lv,Q. Wang
出处
期刊:IEEE Journal of Biomedical and Health Informatics [Institute of Electrical and Electronics Engineers]
卷期号:29 (12): 8876-8889 被引量:3
标识
DOI:10.1109/jbhi.2024.3464732
摘要

Computer-aided ultrasound (US) imaging is an important prerequisite for early clinical diagnosis and treatment. Due to the harsh ultrasound (US) image quality and the blurry tumor area, recent memory-based video object segmentation models (VOS) achieve frame-level segmentation by performing intensive similarity matching among the past frames which could inevitably result in computational redundancy. In this paper, we first build a larger annotated benchmark dataset for breast lesion segmentation in ultrasound videos, then we propose a lightweight clip-level VOS framework for achieving higher segmentation accuracy while maintaining the speed. Then an Inner-Outer Clip Retformer is proposed to extract spatial-temporal tumor features in parallel. Specifically, the proposed Outer Clip Retformer extracts the tumor movement feature from past video clips to locate the current clip tumor position, while the Inner Clip Retformer detailedly extracts current tumor features that can produce more accurate segmentation results. Then a Clip Contrastive loss function is further proposed to align the extracted tumor features along both the spatial-temporal dimensions to improve the segmentation accuracy. In addition, the Global Retentive Memory is proposed to maintain the complementary tumor features with lower computing resources which can generate coherent temporal movement features. In this way, our model can significantly improve the spatial-temporal perception ability without increasing a large number of parameters, achieving more accurate segmentation results while maintaining a faster segmentation speed. Finally, we conduct extensive experiments to evaluate our proposed model on several video object segmentation datasets, the results show that our framework outperforms state-of-the-art segmentation methods.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
Twonej应助a海w采纳,获得30
刚刚
刚刚
如常发布了新的文献求助10
刚刚
仙女发布了新的文献求助10
1秒前
rocky发布了新的文献求助10
1秒前
岁月轮回发布了新的文献求助10
1秒前
慕青应助啦啦啦啦采纳,获得10
1秒前
科目三应助卫三采纳,获得10
2秒前
bkagyin应助大力的依丝采纳,获得10
2秒前
小蘑菇应助YANG采纳,获得10
2秒前
2秒前
2秒前
3秒前
wanci应助jinhaisong采纳,获得30
3秒前
木木酱完成签到,获得积分10
3秒前
3秒前
充电宝应助瘦瘦麦片采纳,获得10
3秒前
ding应助笨笨如之采纳,获得10
3秒前
五仁月饼完成签到,获得积分10
4秒前
4秒前
干酪蛋糕发布了新的文献求助30
4秒前
5秒前
5秒前
5秒前
传奇3应助熊熊冲冲冲采纳,获得10
5秒前
5秒前
5秒前
huyz发布了新的文献求助10
5秒前
5秒前
5秒前
善学以致用应助qupei采纳,获得10
7秒前
8秒前
Tcell完成签到,获得积分10
8秒前
hhhh发布了新的文献求助10
8秒前
yuan发布了新的文献求助10
9秒前
9秒前
酷波er应助没意思的意思采纳,获得10
9秒前
9秒前
xsir完成签到 ,获得积分10
9秒前
gao发布了新的文献求助10
9秒前
高分求助中
卤化钙钛矿人工突触的研究 1000
Engineering for calcareous sediments : proceedings of the International Conference on Calcareous Sediments, Perth 15-18 March 1988 / edited by R.J. Jewell, D.C. Andrews 1000
Wolffs Headache and Other Head Pain 9th Edition 1000
Continuing Syntax 1000
Signals, Systems, and Signal Processing 510
Cardiac structure and function of elite volleyball players across different playing positions 500
CLSI H26-A2 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 物理 内科学 复合材料 催化作用 物理化学 光电子学 电极 细胞生物学 基因 无机化学
热门帖子
关注 科研通微信公众号,转发送积分 6241623
求助须知:如何正确求助?哪些是违规求助? 8065629
关于积分的说明 16833904
捐赠科研通 5319893
什么是DOI,文献DOI怎么找? 2832856
邀请新用户注册赠送积分活动 1810295
关于科研通互助平台的介绍 1666793