估计员
统计
差异(会计)
等级间信度
可靠性(半导体)
卡帕
独立性(概率论)
数学
置信区间
科恩卡帕
蒙特卡罗方法
计量经济学
协议
物理
评定量表
经济
量子力学
会计
语言学
功率(物理)
几何学
哲学
标识
DOI:10.1348/000711006x126600
摘要
Pi (pi) and kappa (kappa) statistics are widely used in the areas of psychiatry and psychological testing to compute the extent of agreement between raters on nominally scaled data. It is a fact that these coefficients occasionally yield unexpected results in situations known as the paradoxes of kappa. This paper explores the origin of these limitations, and introduces an alternative and more stable agreement coefficient referred to as the AC1 coefficient. Also proposed are new variance estimators for the multiple-rater generalized pi and AC1 statistics, whose validity does not depend upon the hypothesis of independence between raters. This is an improvement over existing alternative variances, which depend on the independence assumption. A Monte-Carlo simulation study demonstrates the validity of these variance estimators for confidence interval construction, and confirms the value of AC1 as an improved alternative to existing inter-rater reliability statistics.
科研通智能强力驱动
Strongly Powered by AbleSci AI