Intelligent skin lesion segmentation using deformable attention Transformer U‐Net with bidirectional attention mechanism in skin cancer images

Abstract Background In recent years, the increasing prevalence of skin cancers, particularly malignant melanoma, has become a major concern for public health. The development of accurate automated segmentation techniques for skin lesions holds immense potential in alleviating the burden on medical professionals. It is of substantial clinical importance for the early identification and intervention of skin cancer. Nevertheless, the irregular shape, uneven color, and noise interference of the skin lesions have presented significant challenges to the precise segmentation. Therefore, it is crucial to develop a high‐precision and intelligent skin lesion segmentation framework for clinical treatment. Methods A precision‐driven segmentation model for skin cancer images is proposed based on the Transformer U‐Net, called BiADATU‐Net, which integrates the deformable attention Transformer and bidirectional attention blocks into the U‐Net. The encoder part utilizes deformable attention Transformer with dual attention block, allowing adaptive learning of global and local features. The decoder part incorporates specifically tailored scSE attention modules within skip connection layers to capture image‐specific context information for strong feature fusion. Additionally, deformable convolution is aggregated into two different attention blocks to learn irregular lesion features for high‐precision prediction. Results A series of experiments are conducted on four skin cancer image datasets (i.e., ISIC2016, ISIC2017, ISIC2018, and PH2). The findings show that our model exhibits satisfactory segmentation performance, all achieving an accuracy rate of over 96%. Conclusion Our experiment results validate the proposed BiADATU‐Net achieves competitive performance supremacy compared to some state‐of‐the‐art methods. It is potential and valuable in the field of skin lesion segmentation.