Calibration set reduction by the selection of a subset containing the best fitting samples showing optimally predictive ability

化学 校准 选择(遗传算法) 还原(数学) 集合(抽象数据类型) 色谱法 生物系统 统计 人工智能 数学 计算机科学 程序设计语言 几何学 生物
作者
Jan P.M. Andries,Yvan Vander Heyden
出处
期刊:Talanta [Elsevier BV]
卷期号:266: 124943-124943 被引量:9
标识
DOI:10.1016/j.talanta.2023.124943
摘要

Near-infrared (NIR) spectroscopy is a rapid, non-invasive and cost-effective technique, for which sample pre-treatment is often not required. It is applied for both qualitative and quantitative analyses in various application fields. Often, large calibration sets are used, from which informative subsets can be selected without a loss of meaningful information. In this study, a new approach for sample subset selection is proposed and evaluated. The global PLS model, obtained with the original large global calibration set after FCAM-SIG variable selection, is used for the selection of the best fitting subset of calibration samples with optimally predictive ability. This best fitting calibration subset is called the optimally predictive calibration subset (OPCS). After ranking the global calibration samples according to increasing residuals, different enlarging fractions of the ranked calibration set are selected. For each fraction, the optimal predictive ability and the corresponding optimal PLS complexity are determined by cross model validation (CMV). After performing CMV with all fractions, the fraction with the best fitting samples and optimally predictive ability, i.e. the OPCS, is determined. The use of the best fitting samples from the global PLS model results in an OPCS-based model which is similar to the global PLS model and has a similar predictive ability. Because the best fitting samples do not need to be representative for the global calibration set, but only need to support the OPCS-based model, the number of samples in the OPCS model is mostly smaller than that selected by a traditional representative sample subset selection method. The new OPCS approach is tested on three real life NIR data sets with twelve X-y combinations to model. The results show that the number of selected samples obtained by the OPCS approach is statistically significantly lower than (i) that of the most suitable and widely used representative sample selection method of Kennard and Stone, and (ii) that suggested by the guideline that the optimal sample size N for reduced calibration sets should surpass the PLS model complexity A by a factor 12. An additional advantage of the OPCS approach is that no outliers are included in the subset because only the best fitting calibration samples are selected. In the new OPCS approach, two additional innovations are built in: (i) CMV is for the first time applied for sample selection and (ii) in CMV, the "one standard error rule", adopted from "Repeated Double Cross Validation", is for the first time used for the determination of the optimal PLS complexity of the OPCS-based models.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
科研小哥的应助被potatobo采纳,获得10
刚刚
1秒前
xilla完成签到,获得积分10
1秒前
syvshc的应助被zik采纳,获得10
2秒前
viviyoung完成签到,获得积分10
3秒前
刘芋叶完成签到,获得积分10
3秒前
3秒前
3秒前
跳跃以山完成签到 ,获得积分10
3秒前
4秒前
琳穆完成签到 ,获得积分10
4秒前
5秒前
penguin完成签到,获得积分10
5秒前
靓丽懿轩发布了新的文献求助10
5秒前
5秒前
吉吉国王完成签到 ,获得积分10
6秒前
6秒前
王霖发布了新的文献求助20
7秒前
324完成签到 ,获得积分10
7秒前
kfy发布了新的文献求助10
7秒前
在水一方的应助被标致鹤轩采纳,获得10
7秒前
结实的胡萝卜完成签到,获得积分10
7秒前
哦哦啊啊啊完成签到,获得积分10
7秒前
NexusExplorer的应助被viviyoung采纳,获得10
8秒前
luo完成签到 ,获得积分10
8秒前
Jessica完成签到,获得积分10
8秒前
mm发布了新的文献求助30
8秒前
syvshc的应助被hahahaha采纳,获得10
9秒前
马宇恒发布了新的文献求助10
9秒前
英俊的铭的应助被happy采纳,获得10
9秒前
小豆爱科研完成签到,获得积分10
9秒前
武丝丝完成签到,获得积分10
10秒前
奇点完成签到 ,获得积分10
10秒前
鱼鱼完成签到 ,获得积分10
11秒前
2425完成签到,获得积分10
11秒前
11秒前
科研通AI6.4的应助被桩桩采纳,获得10
11秒前
流云完成签到,获得积分10
12秒前
12秒前
youyou完成签到,获得积分10
12秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
八旗制度の研究 600
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8185801
求助须知:如何正确求助?哪些是违规求助? 9574479
关于积分的说明 21836390
捐赠科研通 7783594
什么是DOI,文献DOI怎么找? 3434671
关于科研通互助平台的介绍 2559029
邀请新用户注册赠送积分活动 2481466