The Optimal Machine Learning-Based Missing Data Imputation for the Cox Proportional Hazard Model

Chao Yu Guo*, Ying Chen Yang, Yi Hau Chen

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

21 Scopus citations

Abstract

An adequate imputation of missing data would significantly preserve the statistical power and avoid erroneous conclusions. In the era of big data, machine learning is a great tool to infer the missing values. The root means square error (RMSE) and the proportion of falsely classified entries (PFC) are two standard statistics to evaluate imputation accuracy. However, the Cox proportional hazards model using various types requires deliberate study, and the validity under different missing mechanisms is unknown. In this research, we propose supervised and unsupervised imputations and examine four machine learning-based imputation strategies. We conducted a simulation study under various scenarios with several parameters, such as sample size, missing rate, and different missing mechanisms. The results revealed the type-I errors according to different imputation techniques in the survival data. The simulation results show that the non-parametric “missForest” based on the unsupervised imputation is the only robust method without inflated type-I errors under all missing mechanisms. In contrast, other methods are not valid to test when the missing pattern is informative. Statistical analysis, which is improperly conducted, with missing data may lead to erroneous conclusions. This research provides a clear guideline for a valid survival analysis using the Cox proportional hazard model with machine learning-based imputations.

Original languageEnglish
Article number680054
JournalFrontiers in Public Health
Volume9
DOIs
StatePublished - 5 Jul 2021

Keywords

  • cox proportional hazard model
  • k-nearest neighbors imputation
  • machine learning
  • random forest imputation
  • survival data simulation

Fingerprint

Dive into the research topics of 'The Optimal Machine Learning-Based Missing Data Imputation for the Cox Proportional Hazard Model'. Together they form a unique fingerprint.

Cite this