The Optimal Machine Learning-Based Missing Data Imputation for the Cox Proportional Hazard Model
Bibliographic Data
| ID | 22079570 |
|---|---|
| Authors | Chao‐Yu Guo (0000-0002-9066-9933, National Yang Ming Chiao Tung University, corresponding author), Chao-Yu Guo (0000-0002-1872-7860), Ying-Chen Yang (0000-0002-8116-663X, National Yang Ming Chiao Tung University), Yi-Hau Chen, Yi‐Hau Chen (0000-0003-4038-9439, Institute of Statistical Science, Academia Sinica) |
| Year | 2021 |
| Volume | 9 |
| Pages | 680054-680054 |
| Publication date | 2021-07-05 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Frontiers in Public Health (JOURNAL) |
| Journal identifiers | ISSN: 2296-2565 • E-ISSN: 2296-2565 |
| Publisher | Frontiers Media SA (PUBLISHER • CH) |
| DOI | 10.3389/fpubh.2021.680054 |
| PMID | 34291028 |
| OpenAlex | W3184084406 |
| Language | EN |
| Citations received | 1 |
| References cited | 12 |
An adequate imputation of missing data would significantly preserve the statistical power and avoid erroneous conclusions. In the era of big data, machine learning is a great tool to infer the missing values. The root means square error (RMSE) and the proportion of falsely classified entries (PFC) are two standard statistics to evaluate imputation accuracy. However, the Cox proportional hazards model using various types requires deliberate study, and the validity under different missing mechanisms is unknown. In this research, we propose supervised and unsupervised imputations and examine four machine learning-based imputation strategies. We conducted a simulation study under various scenarios with several parameters, such as sample size, missing rate, and different missing mechanisms. The results revealed the type-I errors according to different imputation techniques in the survival data. The simulation results show that the non-parametric “missForest” based on the unsupervised imputation is the only robust method without inflated type-I errors under all missing mechanisms. In contrast, other methods are not valid to test when the missing pattern is informative. Statistical analysis, which is improperly conducted, with missing data may lead to erroneous conclusions. This research provides a clear guideline for a valid survival analysis using the Cox proportional hazard model with machine learning-based imputations
Data mining · Machine learning · Mean squared error · Missing data · Parametric statistics · Proportional hazards model · Statistics · Computer Science · Mathematics · Statistical Methods and Bayesian Inference · Statistical Methods and Inference · Statistical Methods in Clinical Trials · Artificial Intelligence
| Citations per year | 0.25 |
|---|---|
| Citation span | 2022 - 2022 (1) |
| Highly cited | No |