计算机科学
统计假设检验
威尔科克森符号秩检验
机器学习
人工智能
数据集
多重比较问题
集合(抽象数据类型)
参数统计
简单(哲学)
统计学习
训练集
事后
数据挖掘
数学
统计
哲学
曼惠特尼U检验
牙科
程序设计语言
认识论
医学
摘要
While methods for comparing two learning algorithms on a single data set have been scrutinized for quite some time already, the issue of statistical tests for comparisons of more algorithms on multiple data sets, which is even more essential to typical machine learning studies, has been all but ignored. This article reviews the current practice and then theoretically and empirically examines several suitable tests. Based on that, we recommend a set of simple, yet safe and robust non-parametric tests for statistical comparisons of classifiers: the Wilcoxon signed ranks test for comparison of two classifiers and the Friedman test with the corresponding post-hoc tests for comparison of more classifiers over multiple data sets. Results of the latter can also be neatly presented with the newly introduced CD (critical difference) diagrams.
科研通智能强力驱动
Strongly Powered by AbleSci AI