RGB颜色模型
人工智能
计算机科学
突出
编码器
计算机视觉
光学(聚焦)
模式识别(心理学)
对象(语法)
融合
语言学
哲学
物理
光学
操作系统
作者
Biao Deng,Di Liu,Yang Cao,Hong Liu,Zhiguo Yan,Hu Chen
出处
期刊:Sensors
[Multidisciplinary Digital Publishing Institute]
日期:2024-11-07
卷期号:24 (22): 7146-7146
被引量:1
摘要
Existing deep learning-based RGB-T salient object detection methods often struggle with effectively fusing RGB and thermal features. Therefore, obtaining high-quality features and fully integrating these two modalities are central research focuses. We developed an illumination prior-based coefficient predictor (MICP) to determine optimal interaction weights. We then designed a saliency-guided encoder (SG Encoder) to extract multi-scale thermal features incorporating saliency information. The SG Encoder guides the extraction of thermal features by leveraging their correlation with RGB features, particularly those with strong semantic relationships to salient object detection tasks. Finally, we employed a Cross-attention-based Fusion and Refinement Module (CrossFRM) to refine the fused features. The robust thermal features help refine the spatial focus of the fused features, aligning them more closely with salient objects. Experimental results demonstrate that our proposed approach can more accurately locate salient objects, significantly improving performance compared to 11 state-of-the-art methods.
科研通智能强力驱动
Strongly Powered by AbleSci AI