IDEAS home Printed from https://ideas.repec.org/a/eee/soceps/v93y2024ics0038012124000983.html
   My bibliography  Save this article

Enhancing hospital benchmarking: A multidimensional approach to quality assessment in Portugal

Author

Listed:
  • Ricardo, Alexandre Vilar
  • Costa, Ana Sara
  • Figueira, José Rui

Abstract

The healthcare policy reforms implemented in Portugal in recent years significantly impacted the quality of health care provided to Portuguese citizens. Since public hospitals play a pivotal role as secondary care providers within the National Health Service (NHS), it is essential to assess their quality. However, a generalized assessment of this multidimensional concept is insufficient to differentiate hospitals across different quality dimensions, limiting the efficiency of benchmarking processes. The conjoint use of the Electre Tri-nC method with the Multiple Criteria Hierarchy Process (MCHP) allowed us to assess quality in Portuguese public hospitals by encompassing dimension-based analysis and a holistic perspective. Electre Tri-nC is a multiple criteria sorting method that categorizes each alternative (in this case, a public hospital in Portugal) into pre-defined and ordered categories representing quality levels. The hospitals are assessed based on four non-elementary criteria (Timeliness, Effectiveness, Safety and Efficiency) structured hierarchically in logical subsets of elementary criteria, allowing MCHP to evaluate each hospital based on specific criteria subsets or the comprehensive level. The sample size is 25 hospitals, and the analysis period includes the years from 2019 to 2022. The results evidence a general downward trend in quality, culminating in poor quality levels in most public hospitals in 2022, particularly in the Effectiveness dimension. A robustness analysis was conducted to examine the resilience and reliability of the model. By establishing a framework for assessing quality assessment across different critical dimensions, this work provides an enhanced hospital benchmarking process for healthcare policymakers. This process can serve as a reference for implementing new hospital reforms based on replicating the successful practices adopted by the healthcare facilities that demonstrate superior quality results in specific dimensions or even allocating resources more efficiently across the entire network by identifying dimensions in which hospitals are performing poorly.

Suggested Citation

  • Ricardo, Alexandre Vilar & Costa, Ana Sara & Figueira, José Rui, 2024. "Enhancing hospital benchmarking: A multidimensional approach to quality assessment in Portugal," Socio-Economic Planning Sciences, Elsevier, vol. 93(C).
    • Handle: RePEc:eee:soceps:v:93:y:2024:i:c:s0038012124000983
    DOI: 10.1016/j.seps.2024.101899
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0038012124000983
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.seps.2024.101899?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Henriques, C.O. & Gouveia, M.C., 2022. "Assessing the impact of COVID-19 on the efficiency of Portuguese state-owned enterprise hospitals," Socio-Economic Planning Sciences, Elsevier, vol. 84(C).
    2. Qureshi, M. E. & Harrison, S. R. & Wegener, M. K., 1999. "Validation of multicriteria analysis models," Agricultural Systems, Elsevier, vol. 62(2), pages 105-116, November.
    3. Alexandre Morais Nunes & Diogo Cunha Ferreira, 2019. "The health care reform in Portugal: Outcomes from both the New Public Management and the economic crisis," International Journal of Health Planning and Management, Wiley Blackwell, vol. 34(1), pages 196-215, January.
    4. Almeida-Dias, J. & Figueira, J.R. & Roy, B., 2010. "Electre Tri-C: A multiple criteria sorting method based on characteristic reference actions," European Journal of Operational Research, Elsevier, vol. 204(3), pages 565-580, August.
    5. Pinho, Margarida & Costa, Ana Sara & Meneses, Marta & Manso, Joana, 2023. "A multiple criteria sorting method for supporting the maintenance management of medical ventilators: The case of Hospital da Luz Lisboa," Socio-Economic Planning Sciences, Elsevier, vol. 86(C).
    6. Campbell, S. M. & Roland, M. O. & Buetow, S. A., 2000. "Defining quality of care," Social Science & Medicine, Elsevier, vol. 51(11), pages 1611-1625, December.
    7. Miika Linna & Unto Häkkinen, 2007. "Chapter 10 Benchmarking Finnish Hospitals," Advances in Health Economics and Health Services Research, in: Evaluating Hospital Policy and Performance: Contributions from Hospital Policy and Productivity Research, pages 179-190, Emerald Group Publishing Limited.
    8. Corrente, Salvatore & Greco, Salvatore & Słowiński, Roman, 2016. "Multiple Criteria Hierarchy Process for ELECTRE Tri methods," European Journal of Operational Research, Elsevier, vol. 252(1), pages 191-203.
    9. H. Roland Weistroffer & Yan Li, 2016. "Multiple Criteria Decision Analysis Software," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 1301-1341, Springer.
    10. Ferreira, D.C. & Marques, R.C., 2021. "Public-private partnerships in health care services: Do they outperform public hospitals regarding quality and access? Evidence from Portugal," Socio-Economic Planning Sciences, Elsevier, vol. 73(C).
    11. Lahdelma, Risto & Hokkanen, Joonas & Salminen, Pekka, 1998. "SMAA - Stochastic multiobjective acceptability analysis," European Journal of Operational Research, Elsevier, vol. 106(1), pages 137-143, April.
    12. Almeida-Dias, J. & Figueira, J.R. & Roy, B., 2012. "A multiple criteria sorting method where each category is characterized by several reference actions: The Electre Tri-nC method," European Journal of Operational Research, Elsevier, vol. 217(3), pages 567-579.
    13. Pereira, Miguel Alves & Machete, Inês Freire & Ferreira, Diogo Cunha & Marques, Rui Cunha, 2020. "Using multi-criteria decision analysis to rank European health systems: The Beveridgian financing case," Socio-Economic Planning Sciences, Elsevier, vol. 72(C).
    14. Alexandre Morais Nunes & Diogo Cunha Ferreira, 2019. "Reforms in the Portuguese health care sector: Challenges and proposals," International Journal of Health Planning and Management, Wiley Blackwell, vol. 34(1), pages 21-33, January.
    15. Zhang, Cai Wen & Yang, Yuanhui, 2023. "Appraisal of regional hospital efficiency and healthcare quality in China: Impacts of subsidies and marketization," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    16. Rocha, António & Costa, Ana Sara & Figueira, José Rui & Ferreira, Diogo Cunha & Marques, Rui Cunha, 2021. "Quality assessment of the Portuguese public hospitals: A multiple criteria approach," Omega, Elsevier, vol. 105(C).
    17. Pereira, Miguel Alves & Marques, Rui Cunha, 2022. "Is sunshine regulation the new prescription to brighten up public hospitals in Portugal?," Socio-Economic Planning Sciences, Elsevier, vol. 84(C).
    18. Ferreira, Diogo Cunha & Marques, Rui Cunha & Nunes, Alexandre Morais & Figueira, José Rui, 2021. "Customers satisfaction in pediatric inpatient services: A multiple criteria satisfaction analysis," Socio-Economic Planning Sciences, Elsevier, vol. 78(C).
    19. Dan Lupu & Ramona Tiganasu, 2022. "COVID-19 and the efficiency of health systems in Europe," Health Economics Review, Springer, vol. 12(1), pages 1-15, December.
    20. Figueira, Jose & Roy, Bernard, 2002. "Determining the weights of criteria in the ELECTRE type methods with a revised Simos' procedure," European Journal of Operational Research, Elsevier, vol. 139(2), pages 317-326, June.
    21. Lockamy Iii, Archie, 2021. "Benchmarking healthcare quality in the United States," Management in Healthcare: A Peer-Reviewed Journal, Henry Stewart Publications, vol. 6(1), pages 70-100, September.
    22. Roy, Bernard, 2010. "Robustness in operational research and decision aiding: A multi-faceted issue," European Journal of Operational Research, Elsevier, vol. 200(3), pages 629-638, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rocha, António & Costa, Ana Sara & Figueira, José Rui & Ferreira, Diogo Cunha & Marques, Rui Cunha, 2021. "Quality assessment of the Portuguese public hospitals: A multiple criteria approach," Omega, Elsevier, vol. 105(C).
    2. Pereira, Miguel Alves & Marques, Rui Cunha, 2022. "Is sunshine regulation the new prescription to brighten up public hospitals in Portugal?," Socio-Economic Planning Sciences, Elsevier, vol. 84(C).
    3. Pinho, Margarida & Costa, Ana Sara & Meneses, Marta & Manso, Joana, 2023. "A multiple criteria sorting method for supporting the maintenance management of medical ventilators: The case of Hospital da Luz Lisboa," Socio-Economic Planning Sciences, Elsevier, vol. 86(C).
    4. Arandarenko, Mihail & Corrente, Salvatore & Jandrić, Maja & Stamenković, Mladen, 2020. "Multiple criteria decision aiding as a prediction tool for migration potential of regions," European Journal of Operational Research, Elsevier, vol. 284(3), pages 1154-1166.
    5. Gregório, Beatriz Cagigal & Pereira, Miguel Alves & Costa, Ana Sara, 2024. "Multi-criteria decision-aiding for public hospitals: The role of interactions among pairs of access and quality criteria," Omega, Elsevier, vol. 126(C).
    6. Fernández, Eduardo & Figueira, José Rui & Navarro, Jorge & Solares, Efrain, 2022. "Handling imperfect information in multiple criteria decision-making through a comprehensive interval outranking approach," Socio-Economic Planning Sciences, Elsevier, vol. 82(PB).
    7. Barbati, M. & Figueira, J.R. & Greco, S. & Ishizaka, A. & Panaro, S., 2023. "A multiple criteria methodology for priority based portfolio selection," Socio-Economic Planning Sciences, Elsevier, vol. 88(C).
    8. Khaled Belahcène & Vincent Mousseau & Wassila Ouerdane & Marc Pirlot & Olivier Sobrie, 2023. "Multiple criteria sorting models and methods—Part I: survey of the literature," 4OR, Springer, vol. 21(1), pages 1-46, March.
    9. Arcidiacono, Sally Giuseppe & Corrente, Salvatore & Greco, Salvatore, 2021. "Robust stochastic sorting with interacting criteria hierarchically structured," European Journal of Operational Research, Elsevier, vol. 292(2), pages 735-754.
    10. Cinelli, Marco & Kadziński, Miłosz & Miebs, Grzegorz & Gonzalez, Michael & Słowiński, Roman, 2022. "Recommending multiple criteria decision analysis methods with a new taxonomy-based decision support system," European Journal of Operational Research, Elsevier, vol. 302(2), pages 633-651.
    11. Miłosz Kadziński & Lucia Rocchi & Grzegorz Miebs & David Grohmann & Maria Elena Menconi & Luisa Paolotti, 2018. "Multiple Criteria Assessment of Insulating Materials with a Group Decision Framework Incorporating Outranking Preference Model and Characteristic Class Profiles," Group Decision and Negotiation, Springer, vol. 27(1), pages 33-59, February.
    12. Paulo Caldas & Miguel Varela, 2023. "The Portuguese Public Hospitals Performance Evolution before and during the SARS-CoV-2 Pandemic (2017–2022)," Sustainability, MDPI, vol. 15(15), pages 1-31, July.
    13. Corrente, Salvatore & Figueira, José Rui & Greco, Salvatore & Słowiński, Roman, 2017. "A robust ranking method extending ELECTRE III to hierarchy of interacting criteria, imprecise weights and stochastic analysis," Omega, Elsevier, vol. 73(C), pages 1-17.
    14. Eduardo Fernández & José Rui Figueira & Jorge Navarro, 2023. "A theoretical look at ordinal classification methods based on comparing actions with limiting boundaries between adjacent classes," Annals of Operations Research, Springer, vol. 325(2), pages 819-843, June.
    15. Govindan, Kannan & Jepsen, Martin Brandt, 2016. "ELECTRE: A comprehensive literature review on methodologies and applications," European Journal of Operational Research, Elsevier, vol. 250(1), pages 1-29.
    16. Fernández, Eduardo & Figueira, José Rui & Navarro, Jorge & Solares, Efrain, 2023. "A generalized approach to ordinal classification based on the comparison of actions with either limiting or characteristic profiles," European Journal of Operational Research, Elsevier, vol. 305(3), pages 1309-1322.
    17. Fernández, Eduardo & Navarro, Jorge & Solares, Efrain, 2022. "A hierarchical interval outranking approach with interacting criteria," European Journal of Operational Research, Elsevier, vol. 298(1), pages 293-307.
    18. Vincent Mousseau & Özgür Özpeynirci & Selin Özpeynirci, 2018. "Inverse multiple criteria sorting problem," Annals of Operations Research, Springer, vol. 267(1), pages 379-412, August.
    19. Pelissari, Renata & Oliveira, Maria Célia & Ben Amor, Sarah & Abackerli, Alvaro José, 2019. "A new FlowSort-based method to deal with information imperfections in sorting decision-making problems," European Journal of Operational Research, Elsevier, vol. 276(1), pages 235-246.
    20. Dias, Luis C. & Antunes, Carlos Henggeler & Dantas, Guilherme & de Castro, Nivalde & Zamboni, Lucca, 2018. "A multi-criteria approach to sort and rank policies based on Delphi qualitative assessments and ELECTRE TRI: The case of smart grids in Brazil," Omega, Elsevier, vol. 76(C), pages 100-111.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceps:v:93:y:2024:i:c:s0038012124000983. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/seps .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.