保险丝(电气)
RGB颜色模型
人工智能
计算机科学
鉴别器
计算机视觉
色空间
发电机(电路理论)
色彩平衡
模式识别(心理学)
彩色图像
图像(数学)
图像处理
工程类
物理
电气工程
探测器
功率(物理)
电信
量子力学
作者
Sen Xiang,Zheng Hu,Deng Hu,Jin Wu
标识
DOI:10.1109/ccdc58219.2023.10327440
摘要
Fusing the RGB and NIR images can improve the visibility and perception quality. In this task, enhancing details and keeping color fidelity are of the most importance. To achieve this goal, in this paper, an unsupervised dual-branch GAN model is proposed. In the generator, two branches are introduced to fuse texture and color information, respectively. Specifically, the upper branch uses full-scale skip connections to fuse texture details, while the lower branch learns color features within and across image channels to keep color fidelity. The features of the two branches are merged via cross-space attention blocks. As to discrimination, two discriminators are utilized to fully integrate and balance the contributions of the RGB map and the NIR map. Last but not the least, unsupervised loss functions are proposed in considerations of color, texture and adversary between the generator and the discriminator. The network is trained with a public dataset and a self-collected RGB-NIR dataset. Experimental results demonstrate that the algorithm fully fuses RGB and NIR images with fine details and plausible color, which is superior to most existing algorithms.
科研通智能强力驱动
Strongly Powered by AbleSci AI