亲爱的研友该休息了!由于当前在线用户较少,发布求助请尽量完整地填写文献信息,科研通机器人24小时在线,伴您度过漫漫科研夜!身体可是革命的本钱,早点休息,好梦!

A general sample size framework for developing or updating a predictive algorithm: with application to clinical prediction models

计算机科学 样本量测定 人工智能 样品(材料) 数据挖掘 统计 机器学习 长期预测 贝叶斯概率 数学
作者
Richard D Riley,Rebecca Whittle,Mohsen Sadatsafavi,Glen Philip Martin,Alexander Pate,Professor Gary S. Collins,Joie Ensor
出处
期刊:BMC Medical Research Methodology [BioMed Central]
卷期号:26 (1) 被引量:12
标识
DOI:10.1186/s12874-026-02856-7
摘要

BACKGROUND: When developing or updating a predictive algorithm to make predictions (e.g., risk estimates) in individuals, the sample size of the development (training) dataset is an important consideration. Small datasets reduce a model's predictive performance, generalisability and fairness, and may lead to harm. To help identify (minimum) sample sizes required for model development or updating, various sample size calculations exist but their underlying theory is based on standard (unpenalised) regression and focus on minimising overfitting. To address this, we propose a more general approach, which allows extension to any machine learning or AI-based modelling method, and to any performance metric (estimand) of interest. METHODS: The proposed approach draws samples from anticipated posterior distributions to examine the impact on degradation in a model's predictive performance compared to a reference model. It requires researchers to provide candidate predictors (features), a reference model (e.g., based on mean outcome incidence, predictor weights and c-statistics of previous models), and a (existing, synthetic or pilot) dataset reflecting the joint distribution of candidate predictors in the target population. A fully simulation-based approach then generates thousands of models conditional on a chosen sample size and model development strategy, to produce posterior distributions of individual predictions and model performance (degradation) metrics, to inform required sample sizes. To improve computational speed for penalised regression, we also propose a one-sample Bayesian approximation that combines shrinkage priors with a likelihood decomposed into sample size and Fisher's unit information. RESULTS: The approaches are illustrated when developing models for pre-eclampsia using logistic regression (unpenalised, uniform shrinkage, lasso or ridge) and random forests; and are shown to encompass existing sample size calculation criteria whilst also providing model assurance probabilities, instability metrics, and degradation statistics about calibration, discrimination, clinical utility, prediction error and fairness. Uncertainty in the reference model can also be accounted for in the calculations. CONCLUSIONS: Our approach provides a general framework for (minimum) sample size calculations for developing or updating a prediction model, and is applicable for any statistical, machine learning or AI-based development method for supervised learning. Crucially, the recommended (minimum) sample size will depend on users' chosen estimands and model development (or updating) approach. Example R and Stata code is provided.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
null的应助被teyr采纳,获得10
2秒前
彭于晏的应助被笑点低的咖啡采纳,获得10
3秒前
christy完成签到,获得积分20
7秒前
9秒前
null的应助被teyr采纳,获得10
11秒前
15秒前
Owen的应助被小黑桃采纳,获得10
25秒前
嘻嘻哈哈的应助被科研通管家采纳,获得10
26秒前
JamesPei的应助被科研通管家采纳,获得10
26秒前
null的应助被科研通管家采纳,获得20
26秒前
null的应助被科研通管家采纳,获得10
26秒前
香蕉觅云的应助被科研通管家采纳,获得10
27秒前
28秒前
33秒前
38秒前
waui完成签到 ,获得积分10
39秒前
45秒前
小巧的寒烟完成签到,获得积分10
45秒前
Rain完成签到,获得积分20
45秒前
Rain发布了新的文献求助10
49秒前
无极微光的应助被难过花瓣采纳,获得20
49秒前
49秒前
55秒前
眼中星光完成签到,获得积分10
56秒前
1分钟前
cc对应助文件撤销了驳回
1分钟前
1分钟前
停騮_ 完成签到,获得积分10
1分钟前
搜集达人的应助被锅包肉采纳,获得10
1分钟前
危机的奄完成签到,获得积分10
1分钟前
成就书雪完成签到,获得积分0
1分钟前
1分钟前
哇二木耶完成签到,获得积分10
1分钟前
1分钟前
hogjluo完成签到,获得积分10
1分钟前
追寻书本完成签到,获得积分10
1分钟前
1分钟前
锅包肉发布了新的文献求助10
1分钟前
chen01hang的应助被EShiroYuki采纳,获得120
1分钟前
星空完成签到 ,获得积分20
1分钟前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
Hidden Empire of Finance: How Wall Street Profits from Our Cities and Fuels Global Inequality 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8165954
求助须知:如何正确求助?哪些是违规求助? 9559332
关于积分的说明 21749951
捐赠科研通 7756726
什么是DOI,文献DOI怎么找? 3429092
关于科研通互助平台的介绍 2553386
邀请新用户注册赠送积分活动 2473657