Litcius/Paper detail

Missing data imputation using classification and regression trees

Cheng-Yang Chen, Yu‐Wei Chang

2024PeerJ Computer Science12 citationsDOIOpen Access PDF

Abstract

Background Missing data are common when analyzing real data. One popular solution is to impute missing data so that one complete dataset can be obtained for subsequent data analysis. In the present study, we focus on missing data imputation using classification and regression trees (CART). Methods We consider a new perspective on missing data in a CART imputation problem and realize the perspective through some resampling algorithms. Several existing missing data imputation methods using CART are compared through simulation studies, and we aim to investigate the methods with better imputation accuracy under various conditions. Some systematic findings are demonstrated and presented. These imputation methods are further applied to two real datasets: Hepatitis data and Credit approval data for illustration. Results The method that performs the best strongly depends on the correlation between variables. For imputing missing ordinal categorical variables, the rpart package with surrogate variables is recommended under correlations larger than 0 with missing completely at random (MCAR) and missing at random (MAR) conditions. Under missing not at random (MNAR), chi-squared test methods and the rpart package with surrogate variables are suggested. For imputing missing quantitative variables, the iterative imputation method is most recommended under moderate correlation conditions.

Topics & Concepts

Missing dataImputation (statistics)RegressionCartStatisticsRegression analysisComputer scienceData miningMathematicsGeographyArchaeologyBayesian Methods and Mixture ModelsStatistical Methods and Bayesian InferenceStatistical Methods and Inference