IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0237419.html
   My bibliography  Save this article

Development and validation of a model for individualized prediction of hospitalization risk in 4,536 patients with COVID-19

Author

Listed:
  • Lara Jehi
  • Xinge Ji
  • Alex Milinovich
  • Serpil Erzurum
  • Amy Merlino
  • Steve Gordon
  • James B Young
  • Michael W Kattan

Abstract

Background: Coronavirus Disease 2019 is a pandemic that is straining healthcare resources, mainly hospital beds. Multiple risk factors of disease progression requiring hospitalization have been identified, but medical decision-making remains complex. Objective: To characterize a large cohort of patients hospitalized with COVID-19, their outcomes, develop and validate a statistical model that allows individualized prediction of future hospitalization risk for a patient newly diagnosed with COVID-19. Design: Retrospective cohort study of patients with COVID-19 applying a least absolute shrinkage and selection operator (LASSO) logistic regression algorithm to retain the most predictive features for hospitalization risk, followed by validation in a temporally distinct patient cohort. The final model was displayed as a nomogram and programmed into an online risk calculator. Setting: One healthcare system in Ohio and Florida. Participants: All patients infected with SARS-CoV-2 between March 8, 2020 and June 5, 2020. Those tested before May 1 were included in the development cohort, while those tested May 1 and later comprised the validation cohort. Measurements: Demographic, clinical, social influencers of health, exposure risk, medical co-morbidities, vaccination history, presenting symptoms, medications, and laboratory values were collected on all patients, and considered in our model development. Results: 4,536 patients tested positive for SARS-CoV-2 during the study period. Of those, 958 (21.1%) required hospitalization. By day 3 of hospitalization, 24% of patients were transferred to the intensive care unit, and around half of the remaining patients were discharged home. Ten patients died. Hospitalization risk was increased with older age, black race, male sex, former smoking history, diabetes, hypertension, chronic lung disease, poor socioeconomic status, shortness of breath, diarrhea, and certain medications (NSAIDs, immunosuppressive treatment). Hospitalization risk was reduced with prior flu vaccination. Model discrimination was excellent with an area under the curve of 0.900 (95% confidence interval of 0.886–0.914) in the development cohort, and 0.813 (0.786, 0.839) in the validation cohort. The scaled Brier score was 42.6% (95% CI 37.8%, 47.4%) in the development cohort and 25.6% (19.9%, 31.3%) in the validation cohort. Calibration was very good. The online risk calculator is freely available and found at https://riskcalc.org/COVID19Hospitalization/. Limitation: Retrospective cohort design. Conclusion: Our study crystallizes published risk factors of COVID-19 progression, but also provides new data on the role of social influencers of health, race, and influenza vaccination. In a context of a pandemic and limited healthcare resources, individualized outcome prediction through this nomogram or online risk calculator can facilitate complex medical decision-making.

Suggested Citation

  • Lara Jehi & Xinge Ji & Alex Milinovich & Serpil Erzurum & Amy Merlino & Steve Gordon & James B Young & Michael W Kattan, 2020. "Development and validation of a model for individualized prediction of hospitalization risk in 4,536 patients with COVID-19," PLOS ONE, Public Library of Science, vol. 15(8), pages 1-15, August.
    • Handle: RePEc:plo:pone00:0237419
    DOI: 10.1371/journal.pone.0237419
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0237419
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0237419&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0237419?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. van Buuren, Stef & Groothuis-Oudshoorn, Karin, 2011. "mice: Multivariate Imputation by Chained Equations in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 45(i03).
    2. Editors The, 2007. "From the Editors," Basic Income Studies, De Gruyter, vol. 2(1), pages 1-5, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Isabella Sala & Carlotta Micaela Jarach & Vincenzo Bagnardi & Maria Sofia Cattaruzza & Michela Morri & Paolo Ottogalli & Vincenzo Zagà & Silvano Gallus & Antonio Boschini, 2023. "SARS-CoV-2 Infection in San Patrignano, the Largest European Drug Rehabilitation Community," IJERPH, MDPI, vol. 20(3), pages 1-9, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Noémi Kreif & Richard Grieve & Iván Díaz & David Harrison, 2015. "Evaluation of the Effect of a Continuous Treatment: A Machine Learning Approach with an Application to Treatment for Traumatic Brain Injury," Health Economics, John Wiley & Sons, Ltd., vol. 24(9), pages 1213-1228, September.
    2. Eloi Laurent, 2010. "Environmental justice and environmental inequalities: A European perspective," Working Papers hal-01069412, HAL.
    3. Abhilash Bandam & Eedris Busari & Chloi Syranidou & Jochen Linssen & Detlef Stolten, 2022. "Classification of Building Types in Germany: A Data-Driven Modeling Approach," Data, MDPI, vol. 7(4), pages 1-23, April.
    4. Sylvester Ngome Chisika & Chunho Yeom, 2021. "Enhancing Sustainable Management of Public Natural Forests Through Public Private Partnerships in Kenya," SAGE Open, , vol. 11(4), pages 21582440211, October.
    5. Laurent, Catherine E. & Berriet-Solliec, Marielle & Kirsch, Marc & Labarthe, Pierre & Trouve, Aurelie, 2010. "Multifunctionality Of Agriculture, Public Policies And Scientific Evidences: Some Critical Issues Of Contemporary Controversies," APSTRACT: Applied Studies in Agribusiness and Commerce, AGRIMBA, vol. 4(1-2), pages 1-6.
    6. Boonstra Philip S. & Little Roderick J.A. & West Brady T. & Andridge Rebecca R. & Alvarado-Leiton Fernanda, 2021. "A Simulation Study of Diagnostics for Selection Bias," Journal of Official Statistics, Sciendo, vol. 37(3), pages 751-769, September.
    7. Juan Carlos Conesa & Timothy J. Kehoe & Kim J. Ruhl, 2007. "Modeling great depressions: the depression in Finland in the 1990s," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 31(Nov), pages 16-44.
    8. Fabio Salamanca-Buentello & Mary V Seeman & Abdallah S Daar & Ross E G Upshur, 2020. "The ethical, social, and cultural dimensions of screening for mental health in children and adolescents of the developing world," PLOS ONE, Public Library of Science, vol. 15(8), pages 1-25, August.
    9. Adilson Carlos Yoshikuni & José Eduardo Ricciardi Favaretto & Alberto Luiz Albertin & Fernando de Souza Meirelles, 2022. "How can Strategy-as-Practice Enable Innovation under the Influence of Environmental Dynamism?," RAC - Revista de Administração Contemporânea (Journal of Contemporary Administration), ANPAD - Associação Nacional de Pós-Graduação e Pesquisa em Administração, vol. 26(1), pages 200131-2001.
    10. Paola Gatti & Chiara Ghislieri & Claudio G Cortese, 2017. "Relationships between followers’ behaviors and job satisfaction in a sample of nurses," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-16, October.
    11. Christopher J Greenwood & George J Youssef & Primrose Letcher & Jacqui A Macdonald & Lauryn J Hagg & Ann Sanson & Jenn Mcintosh & Delyse M Hutchinson & John W Toumbourou & Matthew Fuller-Tyszkiewicz &, 2020. "A comparison of penalised regression methods for informing the selection of predictive markers," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-14, November.
    12. Liangyuan Hu & Lihua Li, 2022. "Using Tree-Based Machine Learning for Health Studies: Literature Review and Case Series," IJERPH, MDPI, vol. 19(23), pages 1-13, December.
    13. Norah Alyabs & Sy Han Chiou, 2022. "The Missing Indicator Approach for Accelerated Failure Time Model with Covariates Subject to Limits of Detection," Stats, MDPI, vol. 5(2), pages 1-13, May.
    14. repec:spo:wpmain:info:hdl:2441/eu4vqp9ompqllr09hi4ijb1r1 is not listed on IDEAS
    15. Feldkircher, Martin, 2014. "The determinants of vulnerability to the global financial crisis 2008 to 2009: Credit growth and other sources of risk," Journal of International Money and Finance, Elsevier, vol. 43(C), pages 19-49.
    16. Eunsil Seok & Akhgar Ghassabian & Yuyan Wang & Mengling Liu, 2024. "Statistical Methods for Modeling Exposure Variables Subject to Limit of Detection," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 16(2), pages 435-458, July.
    17. Ida Kubiszewski & Kenneth Mulder & Diane Jarvis & Robert Costanza, 2022. "Toward better measurement of sustainable development and wellbeing: A small number of SDG indicators reliably predict life satisfaction," Sustainable Development, John Wiley & Sons, Ltd., vol. 30(1), pages 139-148, February.
    18. Georges Steffgen & Philipp E. Sischka & Martha Fernandez de Henestrosa, 2020. "The Quality of Work Index and the Quality of Employment Index: A Multidimensional Approach of Job Quality and Its Links to Well-Being at Work," IJERPH, MDPI, vol. 17(21), pages 1-31, October.
    19. Peter Kuhn & Marie-Claire Villeval, 2011. "Do Women Prefer a Co-operative Work Environment?," Working Papers 1127, Groupe d'Analyse et de Théorie Economique Lyon St-Étienne (GATE Lyon St-Étienne), Université de Lyon.
    20. Christopher Kath & Florian Ziel, 2018. "The value of forecasts: Quantifying the economic gains of accurate quarter-hourly electricity price forecasts," Papers 1811.08604, arXiv.org.
    21. Esef Hakan Toytok & Sungur Gürel, 2019. "Does Project Children’s University Increase Academic Self-Efficacy in 6th Graders? A Weak Experimental Design," Sustainability, MDPI, vol. 11(3), pages 1-12, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0237419. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.