蒸馏
计算机科学
异常检测
人工智能
背景(考古学)
机器学习
判别式
模式识别(心理学)
化学
古生物学
有机化学
生物
作者
Yuan Jing He,Hua Yang,Zhouping Yin
出处
期刊:IEEE Transactions on Instrumentation and Measurement
[Institute of Electrical and Electronics Engineers]
日期:2023-11-28
卷期号:73: 1-15
标识
DOI:10.1109/tim.2023.3336758
摘要
Image anomaly detection is extremely challenging in industrial manufacturing processes due to unforeseen and diversified anomalies. Recently, unsupervised anomaly detection methods based on knowledge distillation (KD) have been developed and have shown remarkable potential. While most existing methods are devoted to knowledge generalization, they are inadequate for the fine-grained detection task. To address this issue, we propose a novel adaptive context-aware distillation (ACAD) paradigm that gives due consideration to distillation component dependencies and knowledge transfer optimization. Technically, a novel adaptive distillation module (ADM) is proposed for optimal context-aware knowledge transfer, which consists of contrastive decoupling distillation (CDD) and masked perceiving distillation (MPD). The proposed CDD helps to constrain the distribution of different semantic patterns and strengthen the discriminative capability. Vanilla methods treat every pixel as an equal contribution and fail to focus on critical information. To this end, the MPD is proposed to weigh different contextual knowledge adaptively. Extensive experiments with mainstream anomaly detection datasets show that ACAD outperforms state-of-the-art competitors in accuracy and efficiency. In addition, the experimental results with a real-world inkjet printing organic electroluminescence display (OLED) panel dataset further demonstrate the effectiveness of our method.
科研通智能强力驱动
Strongly Powered by AbleSci AI