计算机科学
先验与后验
情态动词
歧管对齐
分级(工程)
对抗制
变压器
歧管(流体力学)
人工智能
模式识别(心理学)
非线性降维
电气工程
工程类
机械工程
降维
电压
哲学
化学
土木工程
认识论
高分子化学
作者
Pan Huang,Chentao Li,Peng He,Hualiang Xiao,Yi‐Fang Ping,Peng Feng,Sukun Tian,Hu Chen,Francesco Mercaldo,Antonella Santone,Hui‐Yuan Yeh,Jing Qin
标识
DOI:10.1016/j.inffus.2024.102333
摘要
Pathologic grading of laryngeal squamous cell carcinoma (LSCC) plays a crucial role in diagnosis, prognosis, and migration. However, the grading performance and interpretability of the intelligent grading model based on LSCC low magnification images are poor. This is because it lacks the delicate nuclear information and information more relevant to grading contained in the high magnification images labeled by pathologists. Yet, low magnification images have information such as tissue texture and contours. Thus, we proposed an end-to-end transformer network with manifold adversarial multi-modal learning (MamlFormer). It effectively fuses and learns LSCC high and low magnification pathology image modalities. Firstly, we demonstrate the feasibility and sufficient conditions for modal fusion of LSCC high and low magnification images from Hoeffding's inequality and multimodal co-regularization. Secondly, we design a new manifold block. It constructs the manifold subspace by some principles. Those principles are divisibility, recoverability, and local distance closest of the feature matrix before and after the mapping of the LSCC each magnification image modalities. Meanwhile it can well solve the problems of redundant feature matrix information and weak modal semantic consistency after multimodal learning. Thirdly, we utilize the encoder and the adversarial loss function to implement adversarial block. It can adaptively learn the latent metrics of the modal distributions of LSCC high and low magnification images. Therefore, it also enhances the complementarity of LSCC high and low magnification image modalities. Then, numerous experiments show that MamlFormer outperforms other SOTA models in both grading performance and interpretability. Finally, we also performed generalization experiments on highly prevalent cervix squamous cell carcinoma. The MamlFormer over is superior to other SOTA models in terms of grading performance and interpretability. This indicates its excellent generalization performance and clinical practicability.
科研通智能强力驱动
Strongly Powered by AbleSci AI