计算机科学
样本量测定
学习曲线
机器学习
单调多边形
功能(生物学)
曲线拟合
样品(材料)
上下界
计算
人工智能
数据挖掘
统计
算法
数学
进化生物学
生物
操作系统
色谱法
数学分析
化学
几何学
作者
Jeroen M. Goedhart,Thomas Klausch,Mark A. van de Wiel
标识
DOI:10.1016/j.csda.2022.107622
摘要
In high-dimensional prediction settings, it remains challenging to reliably estimate the test performance. To address this challenge, a novel performance estimation framework is presented. This framework, called Learn2Evaluate, is based on learning curves by fitting a smooth monotone curve depicting test performance as a function of the sample size. Learn2Evaluate has several advantages compared to commonly applied performance estimation methodologies. Firstly, a learning curve offers a graphical overview of a learner. This overview assists in assessing the potential benefit of adding training samples and it provides a more complete comparison between learners than performance estimates at a fixed subsample size. Secondly, a learning curve facilitates in estimating the performance at the total sample size rather than a subsample size. Thirdly, Learn2Evaluate allows the computation of a theoretically justified and useful lower confidence bound. Furthermore, this bound may be tightened by performing a bias correction. The benefits of Learn2Evaluate are illustrated by a simulation study and applications to omics data.
科研通智能强力驱动
Strongly Powered by AbleSci AI