IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v341y2024i1d10.1007_s10479-024-06008-2.html
   My bibliography  Save this article

COVID-19 vaccination performance of the U.S. states: a hybrid model of DEA and ensemble machine learning methods

Author

Listed:
  • Ozlem Cosgun

    (Montclair State University)

  • Gamze Ogcu Kaya

    (Sampoerna University)

  • Cumhur Cosgun

    (Pennsylvania Department of Transportation, Bureau of Construction and Materials)

Abstract

Vaccination is seen as the most promising one among the efforts to stop COVID-19 and the U.S. government has given great importance to vaccination. However, which states have performed well in administering COVID-19 vaccines and which have not is an open significant question. Another important question is what makes a state more successful than others when evaluating vaccination performance. To answer both of these questions, we proposed a hybrid method that consists of Data Envelopment Analysis and Ensemble ML Methods. DEA was employed to find the vaccine efficiency of the states using the data aggregated from counties. ML techniques are then applied for the vaccine efficiency prediction and understanding the significance of the variables in the prediction. Our findings revealed that there are considerable differences between U.S. States’ performance and only 16 of the states were efficient in terms of their vaccination performance. Furthermore, Light GBM, Random Forest and XGBoost models provided the best results among the five ensemble machine learning methods that were applied. Therefore, an information fusion-based sensitivity analysis method was used to combine the results of each ML technique and ascertain the relative significance of the factors in the prediction of the efficiency. As the findings for factors affecting vaccination performance, percentage of vaccine doses delivered and COVID-19 deaths were found to be the major influential factors on the prediction of the efficiency and percentage of fully vaccinated people, the number of healthcare employees and human development index followed these variables.

Suggested Citation

  • Ozlem Cosgun & Gamze Ogcu Kaya & Cumhur Cosgun, 2024. "COVID-19 vaccination performance of the U.S. states: a hybrid model of DEA and ensemble machine learning methods," Annals of Operations Research, Springer, vol. 341(1), pages 699-729, October.
  • Handle: RePEc:spr:annopr:v:341:y:2024:i:1:d:10.1007_s10479-024-06008-2
    DOI: 10.1007/s10479-024-06008-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-024-06008-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10479-024-06008-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Krauss, Christopher & Do, Xuan Anh & Huck, Nicolas, 2017. "Deep neural networks, gradient-boosted trees, random forests: Statistical arbitrage on the S&P 500," European Journal of Operational Research, Elsevier, vol. 259(2), pages 689-702.
    2. Zehra Önen & Serpil Sayın, 2018. "Evaluating Healthcare System Efficiency of OECD Countries: A DEA-Based Study," International Series in Operations Research & Management Science, in: Cengiz Kahraman & Y. Ilker Topcu (ed.), Operations Research Applications in Health Care Management, chapter 0, pages 141-158, Springer.
    3. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    4. Nahra, Tammie A. & Mendez, David & Alexander, Jeffrey A., 2009. "Employing super-efficiency analysis as an alternative to DEA: An application in outpatient substance abuse treatment," European Journal of Operational Research, Elsevier, vol. 196(3), pages 1097-1106, August.
    5. Ya Chen & Justin Wang & Joe Zhu & H. David Sherman & Shin-Yi Chou, 2019. "How the Great Recession affects performance: a case of Pennsylvania hospitals using DEA," Annals of Operations Research, Springer, vol. 278(1), pages 77-99, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ozlem Cosgun & Amjad Umar & Dursun Delen, 2024. "Operational assessment of nursing homes at times of pandemic: an integrated DEA and machine learning approach," Operational Research, Springer, vol. 24(4), pages 1-40, December.
    2. Baldin, Andrea, 2017. "A DEA approach for selecting a bundle of tickets for performing arts events," Journal of Retailing and Consumer Services, Elsevier, vol. 39(C), pages 190-200.
    3. Kai Xu & Lawrence Loh & Qiang Chen, 2020. "Sustainable Innovation Governance: An Analysis of Regional Innovation with a Super Efficiency Slack-Based Measure Model," Sustainability, MDPI, vol. 12(7), pages 1-19, April.
    4. Wen-Min Lu & Qian Long Kweh & Kai-Chu Yang, 2022. "Multiplicative efficiency aggregation to evaluate Taiwanese local auditing institutions performance," Annals of Operations Research, Springer, vol. 315(2), pages 1243-1262, August.
    5. Tsolas, Ioannis E., 2014. "Precious metal mutual fund performance appraisal using DEA modeling," Resources Policy, Elsevier, vol. 39(C), pages 54-60.
    6. Fragoudaki, Alexandra & Giokas, Dimitris, 2016. "Airport performance in a tourism receiving country: Evidence from Greece," Journal of Air Transport Management, Elsevier, vol. 52(C), pages 80-89.
    7. Huang, Chao & Dai, Chong & Guo, Miao, 2015. "A hybrid approach using two-level DEA for financial failure prediction and integrated SE-DEA and GCA for indicators selection," Applied Mathematics and Computation, Elsevier, vol. 251(C), pages 431-441.
    8. Chen Kaihua & Kou Mingting, 2014. "Staged efficiency and its determinants of regional innovation systems: a two-step analytical procedure," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 52(2), pages 627-657, March.
    9. Cayir Ervural, Beyzanur & Zaim, Selim & Delen, Dursun, 2018. "A two-stage analytical approach to assess sustainable energy efficiency," Energy, Elsevier, vol. 164(C), pages 822-836.
    10. Friesner, Daniel & Mittelhammer, Ron & Rosenman, Robert, 2013. "Inferring the incidence of industry inefficiency from DEA estimates," European Journal of Operational Research, Elsevier, vol. 224(2), pages 414-424.
    11. Yang, Wen-Chi & Lee, Yuh-Ming & Hu, Jin-Li, 2016. "Urban sustainability assessment of Taiwan based on data envelopment analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 61(C), pages 341-353.
    12. Weiguang Han & Boyi Zhang & Qianqian Xie & Min Peng & Yanzhao Lai & Jimin Huang, 2023. "Select and Trade: Towards Unified Pair Trading with Hierarchical Reinforcement Learning," Papers 2301.10724, arXiv.org, revised Feb 2023.
    13. Khezrimotlagh, Dariush & Kaffash, Sepideh & Zhu, Joe, 2022. "U.S. airline mergers’ performance and productivity change," Journal of Air Transport Management, Elsevier, vol. 102(C).
    14. Christian Growitsch & Tooraj Jamasb & Christine Müller & Matthias Wissner, 2016. "Social Cost Efficient Service Quality: Integrating Customer Valuation in Incentive Regulation—Evidence from the Case of Norway," International Series in Operations Research & Management Science, in: Joe Zhu (ed.), Data Envelopment Analysis, chapter 0, pages 71-91, Springer.
    15. Franz R. Hahn, 2007. "Determinants of Bank Efficiency in Europe. Assessing Bank Performance Across Markets," WIFO Studies, WIFO, number 31499.
    16. Alperovych, Yan & Hübner, Georges & Lobet, Fabrice, 2015. "How does governmental versus private venture capital backing affect a firm's efficiency? Evidence from Belgium," Journal of Business Venturing, Elsevier, vol. 30(4), pages 508-525.
    17. Baoqiang Zhan & Shu Zhang & Helen S. Du & Xiaoguang Yang, 2022. "Exploring Statistical Arbitrage Opportunities Using Machine Learning Strategy," Computational Economics, Springer;Society for Computational Economics, vol. 60(3), pages 861-882, October.
    18. Wang, Zhao-Hua & Zeng, Hua-Lin & Wei, Yi-Ming & Zhang, Yi-Xiang, 2012. "Regional total factor energy efficiency: An empirical analysis of industrial sector in China," Applied Energy, Elsevier, vol. 97(C), pages 115-123.
    19. repec:lan:wpaper:1115 is not listed on IDEAS
    20. Azarnoosh Kafi & Behrouz Daneshian & Mohsen Rostamy-Malkhalifeh, 2021. "Forecasting the confidence interval of efficiency in fuzzy DEA," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 31(1), pages 41-59.
    21. Ruiqing Yuan & Xiangyang Xu & Yanli Wang & Jiayi Lu & Ying Long, 2024. "Evaluating Carbon-Emission Efficiency in China’s Construction Industry: An SBM-Model Analysis of Interprovincial Building Heating," Sustainability, MDPI, vol. 16(6), pages 1-16, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:341:y:2024:i:1:d:10.1007_s10479-024-06008-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.