A systematic review of machine learning-based missing value imputation techniques

插补(统计学) 缺少数据 计算机科学 数据挖掘 聚类分析 均方误差 机器学习 人工智能 情报检索 统计 数学
作者
Tressy Thomas,Enayat Rajabi
出处
期刊:Data technologies and applications [Emerald Publishing Limited]
卷期号:55 (4): 558-585 被引量:97
标识
DOI:10.1108/dta-12-2020-0298
摘要

Purpose The primary aim of this study is to review the studies from different dimensions including type of methods, experimentation setup and evaluation metrics used in the novel approaches proposed for data imputation, particularly in the machine learning (ML) area. This ultimately provides an understanding about how well the proposed framework is evaluated and what type and ratio of missingness are addressed in the proposals. The review questions in this study are (1) what are the ML-based imputation methods studied and proposed during 2010–2020? (2) How the experimentation setup, characteristics of data sets and missingness are employed in these studies? (3) What metrics were used for the evaluation of imputation method? Design/methodology/approach The review process went through the standard identification, screening and selection process. The initial search on electronic databases for missing value imputation (MVI) based on ML algorithms returned a large number of papers totaling at 2,883. Most of the papers at this stage were not exactly an MVI technique relevant to this study. The literature reviews are first scanned in the title for relevancy, and 306 literature reviews were identified as appropriate. Upon reviewing the abstract text, 151 literature reviews that are not eligible for this study are dropped. This resulted in 155 research papers suitable for full-text review. From this, 117 papers are used in assessment of the review questions. Findings This study shows that clustering- and instance-based algorithms are the most proposed MVI methods. Percentage of correct prediction (PCP) and root mean square error (RMSE) are most used evaluation metrics in these studies. For experimentation, majority of the studies sourced the data sets from publicly available data set repositories. A common approach is that the complete data set is set as baseline to evaluate the effectiveness of imputation on the test data sets with artificially induced missingness. The data set size and missingness ratio varied across the experimentations, while missing datatype and mechanism are pertaining to the capability of imputation. Computational expense is a concern, and experimentation using large data sets appears to be a challenge. Originality/value It is understood from the review that there is no single universal solution to missing data problem. Variants of ML approaches work well with the missingness based on the characteristics of the data set. Most of the methods reviewed lack generalization with regard to applicability. Another concern related to applicability is the complexity of the formulation and implementation of the algorithm. Imputations based on k -nearest neighbors (kNN) and clustering algorithms which are simple and easy to implement make it popular across various domains.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
彭彭发布了新的文献求助10
2秒前
13508104971完成签到,获得积分10
3秒前
负责音响完成签到,获得积分10
3秒前
3秒前
bam发布了新的文献求助10
4秒前
5秒前
5秒前
勇猛的小qin完成签到 ,获得积分10
5秒前
5秒前
Maestro_S的应助被111采纳,获得10
6秒前
易迅发布了新的文献求助10
6秒前
万能图书馆的应助被柯迎南采纳,获得10
6秒前
6秒前
6秒前
6秒前
搜集达人的应助被安哥拉兔采纳,获得30
7秒前
7895764发布了新的文献求助10
7秒前
羞涩的恋风完成签到,获得积分10
7秒前
雷丹完成签到,获得积分20
7秒前
彭彭完成签到,获得积分10
7秒前
博客语法完成签到 ,获得积分10
7秒前
8秒前
ahfl发布了新的文献求助10
9秒前
lz发布了新的文献求助10
9秒前
9秒前
火花完成签到,获得积分10
10秒前
无花果的应助被JJKK采纳,获得10
10秒前
宇文念真完成签到,获得积分10
10秒前
凉宫半夏发布了新的文献求助10
10秒前
Atom发布了新的文献求助10
11秒前
11秒前
LLL发布了新的文献求助30
12秒前
夏侯乘风发布了新的文献求助10
12秒前
虚拟的信封完成签到,获得积分10
13秒前
在水一方的应助被一只彩虹驴采纳,获得10
13秒前
14秒前
lz完成签到,获得积分20
14秒前
amandaL完成签到,获得积分10
14秒前
14秒前
雪白小丸子完成签到,获得积分10
15秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 2000
Agyptische Geschichte der 21.30. Dynastie 510
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
基于结构调控的功能化水诱导发电材料与器件研究 500
基于界面调控的高效湿气发电材料与器件研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8192209
求助须知:如何正确求助?哪些是违规求助? 9578801
关于积分的说明 21861940
捐赠科研通 7791695
什么是DOI,文献DOI怎么找? 3436846
关于科研通互助平台的介绍 2560562
邀请新用户注册赠送积分活动 2483617