Assessing the performance of Portuguese public hospitals before and during COVID-19 outbreak, with optimistic and pessimistic benchmarking approaches

The COVID-19 pandemic had a profound impact on the tertiary sector, particularly in healthcare, which faced unprecedented demand despite the existence of limited resources, such as hospital beds, staffing resources, and funding. The magnitude and global scale of this crisis provide a compelling incentive to thoroughly analyse its effects. This study aims to identify best practices within the Portuguese national healthcare service, with the goal of improving preparedness for future crises and informing policy decisions. Using a Benefit-of-the-Doubt (BoD) approach, this research constructs composite indicators to assess the pandemic's impact on the Portuguese public hospitals. The study analyzes monthly data from 2017 to May 2022, highlighting critical trends and performance fluctuations during this period. The findings reveal that each COVID-19 wave led to a decline in hospital performance, with the first wave being the most severe due to a lack of preparedness. Furthermore, the pandemic worsened the disparities among examined hospitals. Pre-pandemic top performers in each group improved their performance and were more consistently recognized as benchmarks, with their average benchmark frequency increasing from 66.5% to 83.5%. These top entities demonstrated greater resilience and adaptability, further distancing themselves from underperforming hospitals, which saw declines in both performance scores and benchmark frequency, widening the performance gap. The superior performance of top entities can be attributed to pre-existing strategic tools and contextual factors that enabled them to withstand the pandemic's challenges more effectively. Highlights • The pandemic aggravated the differences between the hospitals examined. • The top-performing entities further distanced themselves from the remaining entities after the pandemic • Entities considered benchmarks before the pandemic remained the same, and became even more consistent during the pandemic. • The top-performing entities achieved higher scores than their pre-pandemic performance levels. • Benchmarking models for composite indicators with diverse decision-making preferences, and treatment of imperfect knowledge of data.