亲爱的研友该休息了!由于当前在线用户较少,发布求助请尽量完整地填写文献信息,科研通机器人24小时在线,伴您度过漫漫科研夜!身体可是革命的本钱,早点休息,好梦!

A Survey on Learning to Reject

正确性 计算机科学 校准 过度自信效应 人工智能 过程(计算) 低信心 机器学习 匹配(统计) 心理学 社会心理学 统计 算法 数学 操作系统
作者
Xu-Yao Zhang,Guo-Sen Xie,Xiuli Li,Tao Mei,Cheng‐Lin Liu
出处
期刊:Proceedings of the IEEE [Institute of Electrical and Electronics Engineers]
卷期号:111 (2): 185-215 被引量:26
标识
DOI:10.1109/jproc.2023.3238024
摘要

Learning to reject is a special kind of self-awareness (the ability to know what you do not know), which is an essential factor for humans to become smarter. Although machine intelligence has become very accurate nowadays, it lacks such kind of self-awareness and usually acts as omniscient, resulting in overconfident errors. This article presents a comprehensive overview of this topic from three perspectives: confidence, calibration, and discrimination. Confidence is an important measurement for the reliability of model predictions. Rejection can be realized by setting thresholds on confidence. However, most models, especially modern deep neural networks, are usually overconfident. Therefore, calibration is a process to ensure confidence matching the actual likelihood of correctness, including two approaches: post-calibration and self-calibration. Calibration reflects the global characteristic of confidence, and the local distinguishing property of confidence is also important. In light of this, discrimination focuses on the performance of accepting positive samples while rejecting negative samples. As a binary classification problem, the challenge of discrimination comes from the missing and nonrepresentativeness of the negative data. Three discrimination tasks are comprehensively analyzed and discussed: failure rejection, unknown rejection, and fake rejection. By rejecting failures, the risk could be controlled especially for mission-critical applications. By rejecting unknowns, the awareness of the knowledge blind zone would be enhanced. By rejecting fakes, security and privacy could be protected. We provide a general taxonomy, organization, and discussion of the methods for solving these problems, which are studied separately in the literature. The connections between different approaches and future directions that are worth further investigation are also presented. With a discriminative and calibrated confidence, learning to reject will let the decision-making process be more practical, reliable, and secure.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
xiaoxingxing完成签到,获得积分10
2秒前
张北海发布了新的文献求助10
2秒前
可可完成签到,获得积分10
3秒前
慕青的应助被streetlight采纳,获得10
5秒前
红墨发布了新的文献求助30
7秒前
Nicu完成签到,获得积分10
10秒前
evans完成签到,获得积分10
10秒前
13秒前
重要盼易完成签到,获得积分10
14秒前
邋遢大王发布了新的文献求助10
20秒前
田f完成签到 ,获得积分10
22秒前
29秒前
盐焗小星球完成签到 ,获得积分10
33秒前
Brain完成签到 ,获得积分10
35秒前
37秒前
庾傀斗发布了新的文献求助10
38秒前
www发布了新的文献求助20
38秒前
gly完成签到,获得积分10
39秒前
Jazz5688的应助被科研通管家采纳,获得10
40秒前
40秒前
369ninja的应助被科研通管家采纳,获得10
40秒前
40秒前
41秒前
迷人白桃完成签到,获得积分10
45秒前
sugar发布了新的文献求助10
47秒前
Reed完成签到 ,获得积分10
47秒前
mc完成签到,获得积分10
50秒前
52秒前
53秒前
生命科学完成签到 ,获得积分10
55秒前
简柠发布了新的文献求助10
1分钟前
1分钟前
李健的应助被蓝天上的流云采纳,获得10
1分钟前
streetlight发布了新的文献求助10
1分钟前
上官若男的应助被zyyyyyy采纳,获得30
1分钟前
AAZI完成签到 ,获得积分10
1分钟前
邓布利利完成签到,获得积分10
1分钟前
邓布利利发布了新的文献求助20
1分钟前
精明魔镜完成签到,获得积分10
1分钟前
wjmIT完成签到 ,获得积分10
1分钟前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 2000
Handbook of Sport Coaching Research 1000
Orthognathic Surgery - 2 Volume Set 500
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
基于结构调控的功能化水诱导发电材料与器件研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8194990
求助须知:如何正确求助?哪些是违规求助? 9580729
关于积分的说明 21872527
捐赠科研通 7794694
什么是DOI,文献DOI怎么找? 3437819
关于科研通互助平台的介绍 2561149
邀请新用户注册赠送积分活动 2484526