MSWAGAN: Multi-spectral Remote Sensing Image Super Resolution Based on Multi-Scale Window Attention Transformer

Remote Sensing Image Super-Resolution (RSISR) techniques play a crucial role in various remote sensing applications. However, deep learning-based methods applied to RSISR encounter difficulties in learning complex features of remote sensing images and modeling long-term correlations between pixels. This study proposes a Multi-Scale Sliding Window Attention Generation Adversarial Network (MSWAGAN) , which combines the advantages of Convolutional Neural Networks (CNN) and Transformers to overcome these limitations. The MSWAGAN consists of three main parts. In the shallow feature extraction part, CNN is used to extract shallow features from remote sensing images. The deep feature extraction part is divided into two stages. Firstly, a multi-scale sliding window attention (MSWA) is designed to replace the multi-head attention (MHA) in the Transformer. MSWA can learn local multi-scale complex features of remote sensing images without increasing the number of parameters in MHA. Then, the Transformer is utilized to learn global image features and model the long-range correlations between pixels. The image reconstruction part utilizes sub-pixel convolution for feature upsampling. Furthermore, in order to extend the application of super-resolution remote sensing images, a cross-sensor real multi-spectral RSISR dataset consisting of Landsat-8 (L8) and Sentinel-2 (S2) images was constructed, and a series of experiments to improve the spatial resolution of L8 images from 30m to 10m in B, G, R and Near Infrared (NIR) bands were conducted. Experimental results demonstrate that our method outperforms some of the latest SR methods.