计算机科学
多光谱图像
锐化
人工智能
高光谱成像
图像融合
图像(数学)
领域(数学)
调制(音乐)
模式识别(心理学)
计算机视觉
数学
哲学
纯数学
美学
作者
Zihan Cao,Shiqi Cao,Liang-Jian Deng,Xiao Wu,Junming Hou,Gemine Vivone
标识
DOI:10.1016/j.inffus.2023.102158
摘要
The denoising diffusion model has received increasing attention in the field of image generation in recent years, thanks to its powerful generation capability. However, diffusion models should be deeply investigated in the field of multi-source image fusion, such as remote sensing pansharpening and multispectral and hyperspectral image fusion (MHIF). In this paper, we introduce a novel supervised diffusion model with two conditional modulation modules, specifically designed for the task of multi-source image fusion. These modules mainly consist of a coarse-grained style modulation (CSM) and a fine-grained wavelet modulation (FWM), which aim to disentangle coarse-grained style information and fine-grained frequency information, respectively, thereby generating competitive fused images. Moreover, some essential strategies for the training of the given diffusion model are well discussed, e.g., the selection of training objectives. The superiority of the proposed method is verified compared with recent state-of-the-art (SOTA) techniques by extensive experiments on two multi-source image fusion benchmarks, i.e., pansharpening and MHIF. In addition, sufficient discussions and ablation studies in the experiments are involved to demonstrate the effectiveness of our approach. Code will be available after possible acceptance.
科研通智能强力驱动
Strongly Powered by AbleSci AI