图像融合
人工智能
相互信息
计算机科学
融合
模式识别(心理学)
图像(数学)
图像质量
最大化
公制(单位)
相似性(几何)
忠诚
代表(政治)
计算机视觉
数学
数学优化
哲学
语言学
电信
运营管理
政治
政治学
法学
经济
作者
Aiqing Fang,Junsheng Wu,Ying Li,Ruimin Qiao
标识
DOI:10.1016/j.cviu.2023.103683
摘要
Traditional image fusion methods based on deep learning generally measure the similarity between the fusion results and the source images, ignoring the harmful information of source images. This paper presents a simple-yet-effective self-supervised image fusion optimization mechanism via directly maximizing the mutual information between the fused image and image samples, including positive and negative samples. The fusion optimization of positive samples has three steps, including visual fidelity item, quality perception item, and semantic perception item loss functions, aiming to reduce the distance between the fused representation and the real image quality. The fusion optimization of negative samples aims to enlarge the distance between the fusion results and the degraded image. Following InfoNCE, our framework is optimized via a surrogate contrastive loss, where the positive and negative selection underpins the real quality and visual fidelity information of fusion representation learning. Therefore, the stumbling blocks of deep learning in image fusion, i.e., similarity fusion optimization problems, are significantly mitigated. Extensive experiments demonstrate that fusion results neatly outperforms the state-of-the-art fusion optimization mechanisms in most metrics.
科研通智能强力驱动
Strongly Powered by AbleSci AI