全色胶片
人工智能
计算机科学
模式识别(心理学)
图像(数学)
块(置换群论)
多光谱图像
图像分辨率
计算机视觉
相似性(几何)
特征(语言学)
深度学习
公制(单位)
特征检测(计算机视觉)
比例(比率)
人工神经网络
图像处理
数学
地理
地图学
语言学
哲学
运营管理
几何学
经济
作者
Kai Zhang,Guishuo Yang,Feng Zhang,Wenbo Wan,Man Zhou,Jiande Sun,Huaxiang Zhang
出处
期刊:IEEE Transactions on Geoscience and Remote Sensing
[Institute of Electrical and Electronics Engineers]
日期:2023-01-01
卷期号:61: 1-15
标识
DOI:10.1109/tgrs.2023.3303336
摘要
Various deep neural networks (DNNs) have been constructed to inject the spatial information of the panchromatic (PAN) image into the low spatial resolution multispectral (LR MS) image. However, most of them ignore the local dissimilarity (LD) prior between MS and PAN images, which has a negative influence on the fused image. Considering the above-mentioned issues, we propose a deep multiscale local dissimilarity network (DMLD-Net) to learn the LD prior at different scales and enhance the spatial and spectral information in the fused image better. Specifically, we first synthesize a downsampled PAN image from the original PAN image to match the scale of the LR MS image. Then, a LD metric is designed to calculate the dissimilarity map between the two images in feature space. According to the learned dissimilarity map, we utilize a LD-guided attention block (LDGAB) to suppress the impact of LD, which filters out the dissimilar information in the features of the PAN image. To learn the LD prior between MS and PAN images sufficiently, the multiscale architecture is considered and we infer the dissimilar maps hierarchically and inject filtered features into the LR MS image progressively. Finally, the fused image is generated by a reconstruction block. Through the LD learning at different scales, reasonable spatial information is extracted from the PAN image, by which the distortions in the fused image caused by LD can be reduced efficiently. Extensive experiments are conducted on GeoEye-1 and WorldView-2 datasets and the results demonstrate the effectiveness of the proposed DMLD-Net in terms of spatial and spectral preservation. The code is available at https://github.com/RSMagneto/DMLD-Net.
科研通智能强力驱动
Strongly Powered by AbleSci AI