IDEAS home Printed from https://ideas.repec.org/a/gam/jdataj/v2y2017i1p8-d88768.html
   My bibliography  Save this article

An Overview and Evaluation of Recent Machine Learning Imputation Methods Using Cardiac Imaging Data

Author

Listed:
  • Yuzhe Liu

    (Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA 15260, USA
    Medical Scientist Training Program, University of Pittsburgh, Pittsburgh, PA 15260, USA)

  • Vanathi Gopalakrishnan

    (Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA 15260, USA
    Medical Scientist Training Program, University of Pittsburgh, Pittsburgh, PA 15260, USA
    Department of Computational and Systems Biology, University of Pittsburgh, Pittsburgh, PA 15260, USA
    Intelligent Systems Program, University of Pittsburgh, Pittsburgh, PA 15260, USA)

Abstract

Many clinical research datasets have a large percentage of missing values that directly impacts their usefulness in yielding high accuracy classifiers when used for training in supervised machine learning. While missing value imputation methods have been shown to work well with smaller percentages of missing values, their ability to impute sparse clinical research data can be problem specific. We previously attempted to learn quantitative guidelines for ordering cardiac magnetic resonance imaging during the evaluation for pediatric cardiomyopathy, but missing data significantly reduced our usable sample size. In this work, we sought to determine if increasing the usable sample size through imputation would allow us to learn better guidelines. We first review several machine learning methods for estimating missing data. Then, we apply four popular methods (mean imputation, decision tree, k-nearest neighbors, and self-organizing maps) to a clinical research dataset of pediatric patients undergoing evaluation for cardiomyopathy. Using Bayesian Rule Learning (BRL) to learn ruleset models, we compared the performance of imputation-augmented models versus unaugmented models. We found that all four imputation-augmented models performed similarly to unaugmented models. While imputation did not improve performance, it did provide evidence for the robustness of our learned models.

Suggested Citation

  • Yuzhe Liu & Vanathi Gopalakrishnan, 2017. "An Overview and Evaluation of Recent Machine Learning Imputation Methods Using Cardiac Imaging Data," Data, MDPI, vol. 2(1), pages 1-15, January.
  • Handle: RePEc:gam:jdataj:v:2:y:2017:i:1:p:8-:d:88768
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2306-5729/2/1/8/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2306-5729/2/1/8/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Geert Molenberghs & Caroline Beunckens & Cristina Sotto & Michael G. Kenward, 2008. "Every missingness not at random model has a missingness at random counterpart with equal fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(2), pages 371-388, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sadaf Kabir & Leily Farrokhvar, 2022. "Non-linear missing data imputation for healthcare data via index-aware autoencoders," Health Care Management Science, Springer, vol. 25(3), pages 484-497, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yekun Qin & Shanminhui Yin & Fang Liu, 2024. "Navigating Criminal Responsibility in the Digital Marketplace: Implications of Network-Neutral Help Behavior and Beyond-5G Networks in E-Commerce Transactions," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(3), pages 10667-10695, September.
    2. Brenden Bishop & Minjeong Jeon, 2016. "Book Review," Psychometrika, Springer;The Psychometric Society, vol. 81(4), pages 1164-1167, December.
    3. Morten Overgaard & Stefan Nygaard Hansen, 2021. "On the assumption of independent right censoring," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 48(4), pages 1234-1255, December.
    4. Shu Xu & Shelley A. Blozis, 2011. "Sensitivity Analysis of Mixed Models for Incomplete Longitudinal Data," Journal of Educational and Behavioral Statistics, , vol. 36(2), pages 237-256, April.
    5. Bian, Yuan & Yi, Grace Y. & He, Wenqing, 2024. "A unified framework of analyzing missing data and variable selection using regularized likelihood," Computational Statistics & Data Analysis, Elsevier, vol. 194(C).
    6. Kott Phillip S. & Liao Dan, 2018. "Calibration Weighting for Nonresponse with Proxy Frame Variables (So that Unit Nonresponse Can Be Not Missing at Random)," Journal of Official Statistics, Sciendo, vol. 34(1), pages 107-120, March.
    7. Caroline Beunckens & Cristina Sotto & Geert Molenberghs & Geert Verbeke, 2009. "A multifaceted sensitivity analysis of the Slovenian public opinion survey data," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 58(2), pages 171-196, May.
    8. Marco Doretti & Sara Geneletti & Elena Stanghellini, 2018. "Missing Data: A Unified Taxonomy Guided by Conditional Independence," International Statistical Review, International Statistical Institute, vol. 86(2), pages 189-204, August.
    9. Heyna, Philipp, 2024. "Can TikTok Drive Support for Populist Radical Right Parties? Causal Evidence From Germany," OSF Preprints yju9n, Center for Open Science.
    10. Hairu Wang & Zhiping Lu & Yukun Liu, 2023. "Score test for missing at random or not under logistic missingness models," Biometrics, The International Biometric Society, vol. 79(2), pages 1268-1279, June.
    11. Andrew T. Karl & Yan Yang & Sharon L. Lohr, 2013. "A Correlated Random Effects Model for Nonignorable Missing Data in Value-Added Assessment of Teacher Effects," Journal of Educational and Behavioral Statistics, , vol. 38(6), pages 577-603, December.
    12. Rianne Margaretha Schouten & Gerko Vink, 2021. "The Dance of the Mechanisms: How Observed Information Influences the Validity of Missingness Assumptions," Sociological Methods & Research, , vol. 50(3), pages 1243-1258, August.
    13. Daniel, Rhian M. & Kenward, Michael G., 2012. "A method for increasing the robustness of multiple imputation," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 1624-1643.
    14. Geert Molenberghs, 2012. "Discussion Contribution to 091037PR4 (Ghosh, Taylor, and Sargent)," Biometrics, The International Biometric Society, vol. 68(1), pages 233-235, March.
    15. Janicki, Ryan & Malec, Donald, 2013. "A Bayesian model averaging approach to analyzing categorical data with nonignorable nonresponse," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 600-614.
    16. Kim, Seongyong & Park, Yousung & Kim, Daeyoung, 2015. "On missing-at-random mechanism in two-way incomplete contingency tables," Statistics & Probability Letters, Elsevier, vol. 96(C), pages 196-203.
    17. Wan-Lun Wang & Min Liu & Tsung-I Lin, 2017. "Robust skew-t factor analysis models for handling missing data," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 26(4), pages 649-672, November.
    18. Anna Ivanova & Geert Molenberghs & Geert Verbeke, 2017. "Mechanism for missing data incorporated in joint modelling of ordinal responses," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(5), pages 1049-1064, November.
    19. D. M. Farewell & C. Huang & V. Didelez, 2017. "Ignorability for general longitudinal data," Biometrika, Biometrika Trust, vol. 104(2), pages 317-326.
    20. Yuan, Ke-Hai, 2009. "Normal distribution based pseudo ML for missing data: With applications to mean and covariance structure analysis," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 1900-1918, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jdataj:v:2:y:2017:i:1:p:8-:d:88768. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.