Missing data, part 2. Missing data mechanisms: Missing completely at random, missing at random, missing not at random, and why they matter

缺少数据 插补(统计学) 统计 计算机科学 数据挖掘 数学
作者
Tra My Pham,Nikolaos Pandis,Ian R. White
出处
期刊:American Journal of Orthodontics and Dentofacial Orthopedics [Elsevier BV]
卷期号:162 (1): 138-139 被引量:24
标识
DOI:10.1016/j.ajodo.2022.04.001
摘要

In the first article,1Pham T.M. Pandis N. White I.R. Missing data, Part 1. Why missing data are a problem.Am J Orthod Dentofac Orthop. 2022; 161: 888-889Abstract Full Text Full Text PDF Scopus (2) Google Scholar we demonstrated that any analysis with missing data makes untestable assumptions about the missing values. The use of different statistical methods rests on different missing data assumptions, and it is important to be transparent about which assumption we are making when implementing a given method. As we will see in article 5, multiple imputation,2Rubin D.B. Multiple Imputation for Nonresponse in Surveys. Wiley, New York1987Crossref Google Scholar a popular approach for handling missing data, is typically performed assuming data are missing at random (described below). Rubin3Rubin D.B. Inference and missing data.Biometrika. 1976; 63: 581-592Crossref Scopus (5722) Google Scholar formally introduced the concept of the missingness mechanism, which describes how the chance of data being missing is associated with the values of the variables included in our analysis. Missingness is commonly categorized into missing completely at random (MCAR), missing at random (MAR), and missing not at random (MNAR). We will now illustrate these 3 missingness mechanisms in the example described in article 1. The example was created using data from a randomized controlled trial comparing how probing depth on the mandibular anterior teeth evolves between 2 types of lingual retainers.4Węgrodzka E. Kornatowska K. Pandis N. Fudalej P.S. A comparative assessment of failures and periodontal health between 2 mandibular lingual retainers in orthodontic patients. A 2-year follow-up, single practice-based randomized trial.Am J Orthod Dentofacial Orthop. 2021; 160: 494-502.e1Abstract Full Text Full Text PDF PubMed Scopus (6) Google Scholar Our data set contains data on individuals age at baseline (age25), which is fully observed with no missing values, and mean probing depth across 6 teeth at time point 1 (mean_pd1), which has some missing values. Here, the missingness mechanism refers to how the chance of mean_pd1 being missing depends on age25 (aged <25/≥25 years, fully observed) and the value (partially observed) of mean_pd1. These relationships can be presented graphically using directed acyclic graphs (DAGs), as illustrated in the Figure. A DAG displays assumptions about the relationships between variables. The assumptions are represented by lines that connect one variable to another. These lines are directed, with a single arrowhead indicating the direction of their effects. DAGs are acyclic, meaning they cannot contain any loops in which a variable causes itself.5Greenland S. Pearl J. Robins J.M. Causal diagrams for epidemiologic research.Epidemiology. 1999; 10: 37-48Crossref PubMed Scopus (2333) Google Scholar We create a variable mean_pd1_miss, a binary indicator of missingness in mean_pd1 (ie, mean_pd1_miss takes value 1 if mean_pd1 is observed and 0 if mean_pd1 is missing). We can now describe the 3 missingness mechanisms.1.MCAR: mean_pd1 is MCAR if the chance of mean_pd1 being missing is independent of age25 and the (possibly missing) value of mean_pd1. This assumption is illustrated in the Figure, A, in which no arrows are pointing to mean_pd1_miss from either age25 or mean_pd1. This assumption means that the missing data are fully comparable to the observed data.2.MAR: mean_pd1 is MAR conditional on age25 if the chance of mean_pd1 being missing is independent of the (possibly missing) value of mean_pd1 after controlling for age25 (Fig, B). This means the chance of mean_pd1 being missing can vary with age25, but within each age group, the chance of mean_pd1 being missing is the same for all individuals. In the Figure, B, both mean_pd1 and mean_pd1_miss are influenced by age25 (represented by 2 arrows going from age25), implying mean_pd1_miss is associated with mean_pd1 if we do not control for age25. Controlling for age25 (the common cause of mean_pd1 and mean_pd1_miss) removes the association between mean_pd1_miss and mean_pd1 (ie, mean_pd1_miss is independent of mean_pd1, conditional on age25). This assumption means that the missing data in a given age group are fully comparable to the observed data in the same age group.3.MNAR: mean_pd1 is MNAR given age25 if the chance of mean_pd1 being missing still depends on the (possibly missing) value of mean_pd1, even after we have controlled for age25 (Fig, C). This means that within each age group, the chance of mean_pd1 being missing may still vary with the values of mean_pd1 (eg, mean_pd1 might be missing more frequently for individuals with greater probing depth values compared with those with lower probing depth values who are in the same age group). As seen in the Figure, C, in addition to the arrow from age25 to mean_pd1_miss, another arrow goes directly from mean_pd1 to mean_pd1_miss. Hence, mean_pd1_miss is not independent of mean_pd1, even after controlling for age25. This assumption means that the missing data in a given age group are not comparable to the observed data, even in the same age group. Of these categorizations, MCAR is the most restrictive assumption, under which the missingness of the data does not relate to any values in the data set, whether observed or missing. This assumption is seldom plausible in practice because there is likely other information collected in the data set that explains how values in a variable have become missing. MNAR is the least restrictive assumption and the trickiest to deal with, as in practice, we rarely know what the appropriate model for the missingness mechanism looks like. MAR is the assumption used by the standard implementation of multiple imputation (as will be seen in article 5). In the above example, we described MAR using just a single variable, age25, but the definition extends to multiple variables. MAR can therefore be made more plausible by collecting data on additional explanatory variables that may explain the missing values. The next article in this series will explain how we can explore the missing data in order to decide which assumption is reasonable (MCAR, MAR, or MNAR) and plan analysis. The authors would like to thank Jadbinder Seehra for reviewing and commenting on draft versions of these articles.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
刚刚
1秒前
3921337477发布了新的文献求助10
1秒前
2秒前
2秒前
人间枝头发布了新的文献求助10
2秒前
Linzi发布了新的文献求助10
3秒前
zombie发布了新的文献求助10
3秒前
3921337477发布了新的文献求助10
4秒前
5秒前
rrl发布了新的文献求助10
5秒前
6秒前
xiaozhang发布了新的文献求助10
6秒前
Jackpu完成签到,获得积分10
6秒前
6秒前
3921337477发布了新的文献求助10
8秒前
8秒前
Lucas的应助被小卢采纳,获得10
8秒前
Linzi完成签到,获得积分10
9秒前
吴大振完成签到,获得积分10
9秒前
然目之绮发布了新的文献求助10
9秒前
祝诗蕍发布了新的文献求助10
9秒前
上官若男的应助被叉叉采纳,获得30
10秒前
飘逸的山柏完成签到,获得积分10
10秒前
10秒前
qin202569发布了新的文献求助30
11秒前
12秒前
air-yi完成签到,获得积分0
13秒前
思源的应助被带着星星旅行采纳,获得10
14秒前
张伟平发布了新的文献求助10
14秒前
14秒前
852的应助被younger采纳,获得10
14秒前
透明的世界的应助被369ninja采纳,获得10
15秒前
sunshine完成签到,获得积分10
15秒前
天真的冬瓜完成签到,获得积分10
16秒前
青柠空发布了新的文献求助10
16秒前
dxftx发布了新的文献求助10
18秒前
Uzma发布了新的文献求助10
19秒前
19秒前
赘婿的应助被空集采纳,获得10
19秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
八旗制度の研究 600
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8184508
求助须知:如何正确求助?哪些是违规求助? 9573478
关于积分的说明 21831914
捐赠科研通 7781737
什么是DOI,文献DOI怎么找? 3434372
关于科研通互助平台的介绍 2558482
邀请新用户注册赠送积分活动 2480962