Multisource Feature Embedding and Interaction Fusion Network for Coastal Wetland Classification With Hyperspectral and LiDAR Data

With the development of earth observation technology, hyperspectral image (HSI) and light detection and ranging (LiDAR) data collaborative monitoring has shown great potential in the ecological protection and restoration of coastal wetlands. However, due to the different working principle adopted by the HSI sensor and LiDAR sensor, the data obtained by them has different distribution characteristics. The distribution difference limits the fusion of HSI and LiDAR data, bringing a great challenge for coastal wetland classification. To tackle this problem, a multi-source feature embedding and interaction fusion network is proposed for coastal wetland classification, named MsFE-IFN. First, the HSI and LiDAR data are embedded in the same feature space, where the feature distribution of multi-source remote sensing are aligned to alleviate data distribution differences. Second, the aligned HSI and LiDAR features interact information in channels and pixels, which is able to establish the relationship of spectral, elevation and geospatial. Third, the HSI and LiDAR feature are sent into the feature fusion network, in which the low-frequency residual is retained to enrich intra-class features. Finally, the fused feature is applied for final class prediction. Experiments conducted on three coastal wetland HSI-LiDAR datasets created by ourselves demonstrate the superiority of the proposed MsFE-IFN for coastal wetland classification. The codes will be available from the website:https://github.com/bigshot-g/IEEE_TGRS_MsFE-IFN.