IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v309y2023i2p795-818.html
   My bibliography  Save this article

A multiple criteria approach for building a pandemic impact assessment composite indicator: The case of COVID-19 in Portugal

Author

Listed:
  • Figueira, José Rui
  • Oliveira, Henrique M.
  • Serro, Ana Paula
  • Colaço, Rogério
  • Froes, Filipe
  • Robalo Cordeiro, Carlos
  • Diniz, António
  • Guimarães, Miguel

Abstract

The COVID-19 pandemic has caused major damage and disruption to social, economic, and health systems (among others). In addition, it has posed unprecedented challenges to public health and policy/decision-makers who have been responsible for designing and implementing measures to mitigate its strong negative impact. The Portuguese health authorities have used decision analysis techniques to assess the impact of the pandemic and implemented measures for counties, regions, or across the entire country. These decision tools have been subject to some criticism and many stakeholders requested novel approaches. In particular, those which considered the dynamic changes in the pandemic’s behaviour due to new virus variants and vaccines. A multidisciplinary team formed by researchers from the COVID-19 Committee of Instituto Superior Técnico at the University of Lisbon (CCIST analyst team) and physicians from the Crisis Office of the Portuguese Medical Association (GCOM expert team) collaborated to create a new tool to help politicians and decision-makers to fight the pandemic. This paper presents the main steps that led to the building of a pandemic impact assessment composite indicator applied to the specific case of COVID-19 in Portugal. A multiple criteria approach based on an additive multi-attribute value theory aggregation model was used to build the pandemic assessment composite indicator. The parameters of the additive model were devised based on an interactive socio-technical and co-constructive process between the CCIST and GCOM team members. The deck of cards method was the adopted technical tool to assist in the assessment the value functions as well as in the assessment of the criteria weights. The final tool was presented at a press conference and had a powerful impact on the Portuguese media and on the main health decision-making stakeholders in the country. In this paper, a completed mathematical and graphical description of this tool is presented.

Suggested Citation

  • Figueira, José Rui & Oliveira, Henrique M. & Serro, Ana Paula & Colaço, Rogério & Froes, Filipe & Robalo Cordeiro, Carlos & Diniz, António & Guimarães, Miguel, 2023. "A multiple criteria approach for building a pandemic impact assessment composite indicator: The case of COVID-19 in Portugal," European Journal of Operational Research, Elsevier, vol. 309(2), pages 795-818.
    • Handle: RePEc:eee:ejores:v:309:y:2023:i:2:p:795-818
    DOI: 10.1016/j.ejor.2023.01.025
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221723000450
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2023.01.025?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Salvatore Greco & Benedetto Matarazzo & Roman Słowiński, 2016. "Decision Rule Approach," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 497-552, Springer.
    2. Thomas Hale & Noam Angrist & Rafael Goldszmidt & Beatriz Kira & Anna Petherick & Toby Phillips & Samuel Webster & Emily Cameron-Blake & Laura Hallas & Saptarshi Majumdar & Helen Tatlow, 2021. "A global panel database of pandemic policies (Oxford COVID-19 Government Response Tracker)," Nature Human Behaviour, Nature, vol. 5(4), pages 529-538, April.
    3. Helen Moshkovich & Alexander Mechitov & David Olson, 2016. "Verbal Decision Analysis," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 605-636, Springer.
    4. Zopounidis, Constantin & Doumpos, Michael, 2002. "Multicriteria classification and sorting methods: A literature review," European Journal of Operational Research, Elsevier, vol. 138(2), pages 229-246, April.
    5. Haghighat, Fatemeh, 2021. "Predicting the trend of indicators related to Covid-19 using the combined MLP-MC model," Chaos, Solitons & Fractals, Elsevier, vol. 152(C).
    6. N. Tsotsolas & A. Spyridakos & E. Siskos & I. Salmon, 2019. "Criteria weights assessment through prioritizations (WAP) using linear programming techniques and visualizations," Operational Research, Springer, vol. 19(1), pages 135-150, March.
    7. Pictet, Jacques & Bollinger, Dominique, 2008. "Extended use of the cards procedure as a simple elicitation technique for MAVT. Application to public procurement in Switzerland," European Journal of Operational Research, Elsevier, vol. 185(3), pages 1300-1307, March.
    8. Denis Bouyssou & Marc Pirlot, 2016. "Conjoint Measurement Tools for MCDM," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 97-151, Springer.
    9. Michel Grabisch & Christophe Labreuche, 2016. "Fuzzy Measures and Integrals in MCDA," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 553-603, Springer.
    10. James S. Dyer, 2016. "Multiattribute Utility Theory (MAUT)," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 285-314, Springer.
    11. Figueira, José Rui & Greco, Salvatore & Slowinski, Roman, 2009. "Building a set of additive value functions representing a reference preorder and intensities of preference: GRIP method," European Journal of Operational Research, Elsevier, vol. 195(2), pages 460-486, June.
    12. Roy, B. & Figueira, J.R. & Almeida-Dias, J., 2014. "Discriminating thresholds as a tool to cope with imperfect knowledge in multiple criteria decision aiding: Theoretical results and practical issues," Omega, Elsevier, vol. 43(C), pages 9-20.
    13. James S. Dyer & Rakesh K. Sarin, 1979. "Measurable Multiattribute Value Functions," Operations Research, INFORMS, vol. 27(4), pages 810-822, August.
    14. Keeney,Ralph L. & Raiffa,Howard, 1993. "Decisions with Multiple Objectives," Cambridge Books, Cambridge University Press, number 9780521438834, September.
    15. Corrente, S. & Figueira, J.R. & Greco, S., 2021. "Pairwise comparison tables within the deck of cards method in multiple criteria decision aiding," European Journal of Operational Research, Elsevier, vol. 291(2), pages 738-756.
    16. Siskos, Eleftherios & Tsotsolas, Nikos, 2015. "Elicitation of criteria importance weights through the Simos method: A robustness concern," European Journal of Operational Research, Elsevier, vol. 246(2), pages 543-553.
    17. Mousseau, Vincent & Figueira, Jose & Dias, Luis & Gomes da Silva, Carlos & Climaco, Joao, 2003. "Resolving inconsistencies among constraints on the parameters of an MCDA model," European Journal of Operational Research, Elsevier, vol. 147(1), pages 72-93, May.
    18. Bottero, M. & Ferretti, V. & Figueira, J.R. & Greco, S. & Roy, B., 2018. "On the Choquet multiple criteria preference aggregation model: Theoretical and practical insights from a real-world application," European Journal of Operational Research, Elsevier, vol. 271(1), pages 120-140.
    19. Jean-M. Martel & Benedetto Matarazzo, 2016. "Other Outranking Approaches," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 221-282, Springer.
    20. Figueira, Jose & Roy, Bernard, 2002. "Determining the weights of criteria in the ELECTRE type methods with a revised Simos' procedure," European Journal of Operational Research, Elsevier, vol. 139(2), pages 317-326, June.
    21. Didier Dubois & Patrice Perny, 2016. "A Review of Fuzzy Sets in Decision Sciences: Achievements, Limitations and Perspectives," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 637-691, Springer.
    22. Carlos A. Bana e Costa & Jean-Marie De Corte & Jean-Claude Vansnick, 2016. "On the Mathematical Foundations of MACBETH," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 421-463, Springer.
    23. Samira El Gibari & Trinidad Gómez & Francisco Ruiz, 2019. "Building composite indicators using multicriteria methods: a review," Journal of Business Economics, Springer, vol. 89(1), pages 1-24, February.
    24. Li, Tao & Rong, Lili & Zhang, Anming, 2021. "Assessing regional risk of COVID-19 infection from Wuhan via high-speed rail," Transport Policy, Elsevier, vol. 106(C), pages 226-238.
    25. Thomas L. Saaty, 2016. "The Analytic Hierarchy and Analytic Network Processes for the Measurement of Intangible Criteria and for Decision-Making," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 363-419, Springer.
    26. Roy, Bernard, 2010. "Robustness in operational research and decision aiding: A multi-faceted issue," European Journal of Operational Research, Elsevier, vol. 200(3), pages 629-638, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dinis, Duarte Caldeira & Figueira, José Rui & Teixeira, Ângelo Palos, 2023. "A multiple criteria approach for ship risk classification: An alternative to the Paris MoU Ship Risk Profile," Socio-Economic Planning Sciences, Elsevier, vol. 90(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dinis, Duarte Caldeira & Figueira, José Rui & Teixeira, Ângelo Palos, 2023. "A multiple criteria approach for ship risk classification: An alternative to the Paris MoU Ship Risk Profile," Socio-Economic Planning Sciences, Elsevier, vol. 90(C).
    2. Bottero, M. & Ferretti, V. & Figueira, J.R. & Greco, S. & Roy, B., 2018. "On the Choquet multiple criteria preference aggregation model: Theoretical and practical insights from a real-world application," European Journal of Operational Research, Elsevier, vol. 271(1), pages 120-140.
    3. Siskos, Eleftherios & Burgherr, Peter, 2022. "Multicriteria decision support for the evaluation of electricity supply resilience: Exploration of interacting criteria," European Journal of Operational Research, Elsevier, vol. 298(2), pages 611-626.
    4. Ru, Zice & Liu, Jiapeng & Kadziński, Miłosz & Liao, Xiuwu, 2022. "Bayesian ordinal regression for multiple criteria choice and ranking," European Journal of Operational Research, Elsevier, vol. 299(2), pages 600-620.
    5. Cinelli, Marco & Kadziński, Miłosz & Gonzalez, Michael & Słowiński, Roman, 2020. "How to support the application of multiple criteria decision analysis? Let us start with a comprehensive taxonomy," Omega, Elsevier, vol. 96(C).
    6. Ana Sara Costa & José Rui Figueira & José Borbinha, 2022. "A multiple criteria socio-technical approach for the Portuguese Army Special Forces recruitment," 4OR, Springer, vol. 20(2), pages 289-331, June.
    7. Costa, Ana Sara & Figueira, José Rui & Borbinha, José, 2018. "A multiple criteria nominal classification method based on the concepts of similarity and dissimilarity," European Journal of Operational Research, Elsevier, vol. 271(1), pages 193-209.
    8. Corrente, S. & Figueira, J.R. & Greco, S., 2021. "Pairwise comparison tables within the deck of cards method in multiple criteria decision aiding," European Journal of Operational Research, Elsevier, vol. 291(2), pages 738-756.
    9. Doumpos, Michael & Zopounidis, Constantin & Galariotis, Emilios, 2014. "Inferring robust decision models in multicriteria classification problems: An experimental analysis," European Journal of Operational Research, Elsevier, vol. 236(2), pages 601-611.
    10. Greco, Salvatore & Mousseau, Vincent & Slowinski, Roman, 2010. "Multiple criteria sorting with a set of additive value functions," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1455-1470, December.
    11. Doumpos, Michael & Zopounidis, Constantin, 2011. "Preference disaggregation and statistical learning for multicriteria decision support: A review," European Journal of Operational Research, Elsevier, vol. 209(3), pages 203-214, March.
    12. Barbati, M. & Figueira, J.R. & Greco, S. & Ishizaka, A. & Panaro, S., 2023. "A multiple criteria methodology for priority based portfolio selection," Socio-Economic Planning Sciences, Elsevier, vol. 88(C).
    13. Cinelli, Marco & Kadziński, Miłosz & Miebs, Grzegorz & Gonzalez, Michael & Słowiński, Roman, 2022. "Recommending multiple criteria decision analysis methods with a new taxonomy-based decision support system," European Journal of Operational Research, Elsevier, vol. 302(2), pages 633-651.
    14. Figueira, José Rui & Greco, Salvatore & Roy, Bernard, 2022. "Electre-Score: A first outranking based method for scoring actions," European Journal of Operational Research, Elsevier, vol. 297(3), pages 986-1005.
    15. Govindan, Kannan & Kadziński, Miłosz & Ehling, Ronja & Miebs, Grzegorz, 2019. "Selection of a sustainable third-party reverse logistics provider based on the robustness analysis of an outranking graph kernel conducted with ELECTRE I and SMAA," Omega, Elsevier, vol. 85(C), pages 1-15.
    16. Corrente, Salvatore & Figueira, José Rui & Greco, Salvatore & Słowiński, Roman, 2017. "A robust ranking method extending ELECTRE III to hierarchy of interacting criteria, imprecise weights and stochastic analysis," Omega, Elsevier, vol. 73(C), pages 1-17.
    17. Hurson, Christian & Siskos, Yannis, 2014. "A synergy of multicriteria techniques to assess additive value models," European Journal of Operational Research, Elsevier, vol. 238(2), pages 540-551.
    18. Arcidiacono, Sally Giuseppe & Corrente, Salvatore & Greco, Salvatore, 2021. "Robust stochastic sorting with interacting criteria hierarchically structured," European Journal of Operational Research, Elsevier, vol. 292(2), pages 735-754.
    19. Fernando A. F. Ferreira & Sérgio P. Santos, 2021. "Two decades on the MACBETH approach: a bibliometric analysis," Annals of Operations Research, Springer, vol. 296(1), pages 901-925, January.
    20. Rodrigues, Teresa C. & Montibeller, Gilberto & Oliveira, Mónica D. & Bana e Costa, Carlos A., 2017. "Modelling multicriteria value interactions with Reasoning Maps," European Journal of Operational Research, Elsevier, vol. 258(3), pages 1054-1071.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:309:y:2023:i:2:p:795-818. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.