Whole‐body tumor segmentation from PET/CT images using a two‐stage cascaded neural network with camouflaged object detection mechanisms

Abstract Background Whole‐body Metabolic Tumor Volume (MTVwb) is an independent prognostic factor for overall survival in lung cancer patients. Automatic segmentation methods have been proposed for MTV calculation. Nevertheless, most of existing methods for patients with lung cancer only segment tumors in the thoracic region. Purpose In this paper, we present a Two‐Stage cascaded neural network integrated with Camouflaged Object Detection mEchanisms (TS‐Code‐Net) for automatic segmenting tumors from whole‐body PET/CT images. Methods Firstly, tumors are detected from the Maximum Intensity Projection (MIP) images of PET/CT scans, and tumors' approximate localizations along z ‐axis are identified. Secondly, the segmentations are performed on PET/CT slices that contain tumors identified by the first step. Camouflaged object detection mechanisms are utilized to distinguish the tumors from their surrounding regions that have similar Standard Uptake Values (SUV) and texture appearance. Finally, the TS‐Code‐Net is trained by minimizing the total loss that incorporates the segmentation accuracy loss and the class imbalance loss. Results The performance of the TS‐Code‐Net is tested on a whole‐body PET/CT image data‐set including 480 Non‐Small Cell Lung Cancer (NSCLC) patients with five‐fold cross‐validation using image segmentation metrics. Our method achieves 0.70, 0.76, and 0.70, for Dice, Sensitivity and Precision, respectively, which demonstrates the superiority of the TS‐Code‐Net over several existing methods related to metastatic lung cancer segmentation from whole‐body PET/CT images. Conclusions The proposed TS‐Code‐Net is effective for whole‐body tumor segmentation of PET/CT images. Codes for TS‐Code‐Net are available at: https://github.com/zyj19/TS‐Code‐Net .