Evaluating the clinical readiness of artificial intelligence in EEG-Based epilepsy diagnosis

作者
Suman Kushwaha
出处
期刊:Journal of Neural Engineering [IOP Publishing]
标识
DOI:10.1088/1741-2552/ae2714
摘要

Abstract Objective
Automated EEG-based epilepsy diagnosis has reported near-perfect accuracies for almost two decades on a benchmark dataset, yet virtually no system is used in routine care. We critically re-examined this translation gap by reproducing five widely cited AI models spanning statistical feature extraction, classical machine-learning and deep-learning paradigms, and assessed their ability to generalise from the benchmark dataset to a newly curated, clinically verified scalp-EEG cohort. 

Approach
All models were implemented as originally described and trained with 10-fold cross-validation on the benchmark dataset. External validation was performed on our independently curated dataset made publicly available, comprising 30 subjects (15 epilepsy, 15 healthy) recorded with 19-channel scalp EEG under standard clinical protocols. We further examined the influence of subject-level data leakage by contrasting performance when training/testing samples overlapped with those when completely independent patient partitions were enforced. Accuracy, sensitivity, specificity, and AUC of ROC (with 95% Confidence Intervals) were the primary metrics. 

Main results

When transferred unchanged to the external cohort, overall accuracy fell from >= 94% on the benchmark dataset to 42-53%, with sensitivities as low as 0.97% for the deep CNN and specificities dropping to 4% for time-frequency methods. Permitting subject overlap artificially elevated accuracy to 59-96%, whereas strict patient separation reduced it to 41-53% in 95% Confidence Interval. Deep-learning models exhibited the steepest decline, confirming over-fitting to subject-specific artefacts. Statistical feature-based approaches, though less affected, still under-performed clinically acceptable thresholds.

Significance
Our results expose key translational barriers in AI for EEG-based epilepsy diagnosis--data leakage, acquisition bias, and overfitting to patient idiosyncrasies--leading to severe performance erosion on clinical data. Rigorous patient-independent validation, transparent reporting (aligned with CARE principles), and well-curated multi-channel scalp-EEG datasets are essential to ensure clinically dependable AI tools for epilepsy diagnosis.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
未来完成签到 ,获得积分10
2秒前
星宇完成签到 ,获得积分10
5秒前
星辰大海的应助被Brave采纳,获得10
6秒前
隐形期待完成签到,获得积分10
10秒前
陶醉静竹发布了新的文献求助10
11秒前
zhao完成签到,获得积分10
11秒前
小墨墨完成签到 ,获得积分10
14秒前
锂电说完成签到 ,获得积分10
16秒前
16秒前
独指蜗牛完成签到 ,获得积分10
17秒前
Brave完成签到,获得积分10
18秒前
maclogos完成签到,获得积分10
21秒前
Brave发布了新的文献求助10
21秒前
李希完成签到 ,获得积分10
23秒前
阿俊1212完成签到 ,获得积分10
23秒前
chenpy1990完成签到 ,获得积分10
25秒前
科研菜鸡完成签到 ,获得积分10
25秒前
佳言2009完成签到 ,获得积分10
26秒前
小丽酱完成签到 ,获得积分10
27秒前
zz6532完成签到 ,获得积分10
30秒前
漂亮夏兰完成签到 ,获得积分10
31秒前
旺旺雪饼完成签到 ,获得积分10
31秒前
友好沛槐完成签到,获得积分10
38秒前
45秒前
之昂完成签到 ,获得积分10
46秒前
漂亮忆曼完成签到,获得积分10
48秒前
Flora完成签到 ,获得积分10
50秒前
shg完成签到,获得积分10
52秒前
豆豆发布了新的文献求助10
52秒前
hikc完成签到 ,获得积分10
54秒前
懒猫完成签到,获得积分10
56秒前
我是老大的应助被科研通管家采纳,获得10
56秒前
cssc完成签到,获得积分10
56秒前
彩色从雪完成签到 ,获得积分10
59秒前
小耳朵完成签到 ,获得积分10
1分钟前
aRuuuu完成签到 ,获得积分10
1分钟前
江水边完成签到 ,获得积分10
1分钟前
仰望星空jiang完成签到,获得积分10
1分钟前
1分钟前
safeandsound完成签到 ,获得积分10
1分钟前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
Social Psychology in the Real World 600
八旗制度の研究 600
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8180068
求助须知:如何正确求助?哪些是违规求助? 9570224
关于积分的说明 21808724
捐赠科研通 7776054
什么是DOI,文献DOI怎么找? 3433261
关于科研通互助平台的介绍 2557425
邀请新用户注册赠送积分活动 2479012