An Ensemble Learning Approach with Gradient Resampling for Class-Imbalance Problems

重采样 Boosting(机器学习) 计算机科学 机器学习 人工智能 集成学习 采样(信号处理) 班级(哲学) 样品(材料) 集合(抽象数据类型) 滤波器(信号处理) 算法 化学 色谱法 计算机视觉 程序设计语言
作者
Hongke Zhao,Chuang Zhao,Xi Zhang,Nanlin Liu,Hengshu Zhu,Qi Liu,Hui Xiong
出处
期刊:Informs Journal on Computing [Institute for Operations Research and the Management Sciences]
卷期号:35 (4): 747-763 被引量:9
标识
DOI:10.1287/ijoc.2023.1274
摘要

Imbalanced classification is widely referred in many real-world applications and has been extensively studied. Most existing algorithms consider alleviating the imbalance by sampling or guiding ensemble learners with punishments. The combination of ensemble learning and sampling strategy at class level has achieved great progress. Actually, specific hard examples have little benefit for model learning and even degrade the performance. From the view of identifying classification difficulty of samples, one important motivation is to design algorithms to finely equip different samples with progressive learning. Unfortunately, how to perfectly configure the sampling and learning strategies under ensemble principles at the sample level remains a research gap. In this paper, we propose a new view from the sample level rather than class level in existing studies. We design an ensemble approach in pipe with sample-level gradient resampling, that is, balanced cascade with filters (BCWF). Before that, as a preliminary exploration, we first design a hard examples mining algorithm to explore the gradient distribution of classification difficulty of samples and identify the hard examples. Specifically, BCWF uses an under-sampling strategy and a boosting manner to train T predictive classifiers and reidentify hard examples. In BCWF, moreover, we design two types of filters: the first is assembled with a hard filter (BCWF_h), whereas the second is assembled with a soft filter (BCWF_s). In each round of boosting, BCWF_h strictly removes a gradient/set of the hardest examples from both classes, whereas BCWF_s removes a larger number of harder and easy examples simultaneously for final balanced-class retention. Consequently, the well-trained T predictive classifiers can be used with two ensemble voting strategies: average probability and majority vote. To evaluate the proposed approach, we conduct intensive experiments on 10 benchmark data sets and apply our algorithms to perform default user detection on a real-world peer to peer lending data set. The experimental results fully demonstrate the effectiveness and the managerial implications of our approach when compared with 11 competitive algorithms. History: Accepted by Ram Ramesh, Area Editor for Data Science & Machine Learning. Funding: This work was supported by the National Natural Science Foundation of China [Grants 72101176, 71722005, and 72241432], the National Key R&D program of China [Grant 2020YFA0908600] and the Natural Science Foundation of Tianjin City [Grant 18JCJQJC45900]. Supplemental Material: The software that supports the findings of this study is available within the paper and its Supplemental Information ( https://pubsonline.informs.org/doi/suppl/10.1287/ijoc.2023.1274 ) as well as from the IJOC GitHub software repository ( https://github.com/INFORMSJoC/2021.0104 ) at ( http://dx.doi.org/10.5281/zenodo.6360996 ).
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
李爱国的应助被科研通管家采纳,获得10
刚刚
斯文败类的应助被4ll采纳,获得10
刚刚
orixero的应助被科研通管家采纳,获得10
刚刚
思源的应助被科研通管家采纳,获得10
刚刚
科目三的应助被科研通管家采纳,获得10
刚刚
赘婿的应助被科研通管家采纳,获得10
刚刚
彭于晏的应助被科研通管家采纳,获得10
刚刚
高大的映波完成签到 ,获得积分10
刚刚
脑洞疼的应助被科研通管家采纳,获得10
刚刚
桐桐的应助被科研通管家采纳,获得10
刚刚
丘比特的应助被科研通管家采纳,获得10
1秒前
张灬小胖发布了新的文献求助10
1秒前
大模型的应助被科研通管家采纳,获得10
1秒前
乐乐的应助被科研通管家采纳,获得10
1秒前
1秒前
orixero的应助被科研通管家采纳,获得10
1秒前
乐乐的应助被科研通管家采纳,获得10
1秒前
领导范儿的应助被GS采纳,获得10
1秒前
FashionBoy的应助被科研通管家采纳,获得10
1秒前
Julo发布了新的文献求助10
1秒前
1秒前
极限001的应助被科研通管家采纳,获得30
2秒前
丘比特的应助被科研通管家采纳,获得10
2秒前
orixero的应助被科研通管家采纳,获得10
2秒前
华仔的应助被科研通管家采纳,获得10
2秒前
英俊的铭的应助被科研通管家采纳,获得10
2秒前
Akim的应助被科研通管家采纳,获得30
2秒前
斯文败类的应助被科研通管家采纳,获得10
2秒前
隐形曼青的应助被科研通管家采纳,获得10
2秒前
烟花的应助被科研通管家采纳,获得10
3秒前
今后的应助被科研通管家采纳,获得30
3秒前
Lucas的应助被科研通管家采纳,获得10
3秒前
wu完成签到 ,获得积分10
3秒前
3秒前
研友_VZG7GZ的应助被科研通管家采纳,获得10
3秒前
3秒前
3秒前
xxcub发布了新的文献求助10
3秒前
Ava的应助被科研通管家采纳,获得10
3秒前
3秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
plantTFDB 508
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8171477
求助须知:如何正确求助?哪些是违规求助? 9564248
关于积分的说明 21774106
捐赠科研通 7763073
什么是DOI,文献DOI怎么找? 3430972
关于科研通互助平台的介绍 2554805
邀请新用户注册赠送积分活动 2475887