Transformer in image interpretation

Different from convolutional neural network, transformer is able to model the long-distance relationship between the image pixels, thus it is now widely used in computer vision and remote sensing community. This paper comprehensively reviews the development of transformer models in automatic image interpretation tasks, especially the applications in image classification, object detection and semantic segmentation. Specifically, the popular transformer models are thoroughly analyzed and compared to acquire their advantages and limitations. Finally, current challenges and future works are concluded.