DSC-Net: A Novel Interactive Two-Stream Network by Combining Transformer and CNN for Ultrasound Image Segmentation

Ultrasound imaging is one of the most widely used medical imaging techniques for visualizing human tissue due to its economical, convenient, practical, and safe advantages. Automatic segmentation of regions of interest in ultrasound images is of great significance in improving the clinical efficiency of ultrasound images and the accuracy of disease diagnosis. However, this task has been challenging due to speckle noise, low contrast, and blurred boundaries in ultrasound images. To address these problems, this paper proposes an interactive two-stream network based on detail screening and compensation called DSC-Net for ultrasound image segmentation. Unlike previous ultrasound image segmentation methods, our DSC-Net combines the Transformer and Convolutional Neural Network to perform accurate ultrasound image segmentation. Specifically, DSC-Net utilizes a Transformer Stream to obtain multi-scale detailed features and a Convolutional Neural Network Stream to extract body features with less noise. Then, the body features guide multi-scale detailed features to filter out noise through the Detail Screening Module. The filtered detail features are applied to Detail Compensation Module to supplement rich details for the Convolutional Neural Network Stream. With such interactions, DSC-Net ensures that more noise-free details are extracted. Extensive experiments on three datasets, including two publicly available datasets and one private dataset, demonstrate that the proposed DSC-Net achieves higher performance and superior robustness than state-of-the-art ultrasound image segmentation methods. Our code is publicly available at https://github.com/MLMIP/DSC-Net.