IDEAS home Printed from https://ideas.repec.org/a/eee/hepoli/v124y2020i5p501-510.html
   My bibliography  Save this article

Steering by their own lights: Why regulators across Europe use different indicators to measure healthcare quality

Author

Listed:
  • Beaussier, Anne-Laure
  • Demeritt, David
  • Griffiths, Alex
  • Rothstein, Henry

Abstract

Despite widespread faith that quality indicators are key to healthcare improvement and regulation, surprisingly little is known about what is actually measured in different countries, nor how, nor why. To address that gap, this article compares the official indicator sets--comprising some 1100 quality measures-- used by statutory hospital regulators in England, Germany, France, and the Netherlands. The findings demonstrate that those countries’ regulators strike very different balances in: the dimensions of quality they assess (e.g. between safety, effectiveness, and patient-centredness); the hospital activities they target (e.g. between clinical and non-clinical activities and management); and the ‘Donabedian’ measurement style of their indicators (between structure, process and outcome indicators). We argue that these contrasts reflect: i) how the distinctive problems facing each country’s healthcare system create different ‘demand-side’ pressures on what national indicator sets measure; and ii) how the configuration of national healthcare systems and governance traditions create ‘supply-side’ constraints on the kinds of data that regulators can use for indicator construction. Our analysis suggests fundamental differences in the meaning of quality and its measurement across countries that are likely to impede international efforts to benchmark quality and identify best practice.

Suggested Citation

  • Beaussier, Anne-Laure & Demeritt, David & Griffiths, Alex & Rothstein, Henry, 2020. "Steering by their own lights: Why regulators across Europe use different indicators to measure healthcare quality," Health Policy, Elsevier, vol. 124(5), pages 501-510.
  • Handle: RePEc:eee:hepoli:v:124:y:2020:i:5:p:501-510
    DOI: 10.1016/j.healthpol.2020.02.012
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0168851020300476
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.healthpol.2020.02.012?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Soeren Mattke & Edward Kelley & Peter Scherer & Jeremy Hurst & Maria Luisa Gil Lapetra & HCQI Expert Group Members, 2006. "Health Care Quality Indicators Project: Initial Indicators Report," OECD Health Working Papers 22, OECD Publishing.
    2. Wilsford, David, 1994. "Path Dependency, or Why History Makes It Difficult but Not Impossible to Reform Health Care Systems in a Big Way," Journal of Public Policy, Cambridge University Press, vol. 14(3), pages 251-283, July.
    3. Rodwin, V.G., 2003. "The health care system under French national health insurance: Lessons for health reform in the United States," American Journal of Public Health, American Public Health Association, vol. 93(1), pages 31-37.
    4. Bramesfeld, Anke & Wensing, Michel & Bartels, Paul & Bobzin, Henning & Grenier, Catherine & Heugren, Mona & Hirschfield, Dena Jaffe & Langenegger, Manfred & Lindelius, Birgitta & Lucet, Bruno & Manor,, 2016. "Mandatory national quality improvement systems using indicators: An initial assessment in Europe and Israel," Health Policy, Elsevier, vol. 120(11), pages 1256-1269.
    5. Sanjay Basu & Jason Andrews & Sandeep Kishore & Rajesh Panjabi & David Stuckler, 2012. "Comparative Performance of Private and Public Healthcare Systems in Low- and Middle-Income Countries: A Systematic Review," PLOS Medicine, Public Library of Science, vol. 9(6), pages 1-14, June.
    6. Veillard, Jeremy & Moses McKeag, Alexandra & Tipper, Brenda & Krylova, Olga & Reason, Ben, 2013. "Methods to stimulate national and sub-national benchmarking through international health system performance comparisons: A Canadian approach," Health Policy, Elsevier, vol. 112(1), pages 141-147.
    7. de Vos, M.L.G. & Graafmans, W.C. & Kooistra, M. & Meijboom, B.R. & van der Voort, P.H. & Westert, G.P., 2009. "Using quality indicators to improve hospital care : A review of the literature," Other publications TiSEM 5f462bc9-0ac0-47f7-8f97-7, Tilburg University, School of Economics and Management.
    8. David Spiegelhalter & Christopher Sherlaw‐Johnson & Martin Bardsley & Ian Blunt & Christopher Wood & Olivia Grigg, 2012. "Statistical methods for healthcare regulation: rating, screening and surveillance," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(1), pages 1-47, January.
    9. Perera, Roshan & Dowell, Anthony & Crampton, Peter, 2012. "Painting by numbers: A guide for systematically developing indicators of performance at any level of health care," Health Policy, Elsevier, vol. 108(1), pages 49-59.
    10. Kodate, Naonori, 2010. "Events, Public Discourses and Responsive Government: Quality Assurance in Health Care in England, Sweden and Japan," Journal of Public Policy, Cambridge University Press, vol. 30(3), pages 263-289, December.
    11. Berg, Marc & Meijerink, Yvonne & Gras, Marit & Goossensen, Anne & Schellekens, Wim & Haeck, Jan & Kallewaard, Marjon & Kingma, Herre, 2005. "Feasibility first: Developing public performance indicators on patient safety and clinical effectiveness for Dutch hospitals," Health Policy, Elsevier, vol. 75(1), pages 59-73, December.
    12. Oliver, Adam, 2012. "The folly of cross-country ranking exercises," Health Economics, Policy and Law, Cambridge University Press, vol. 7(01), pages 15-17, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Olivier Borraz & Anne‐Laure Beaussier & Mara Wesseling & David Demeritt & Henry Rothstein & Marijke Hermans & Michael Huber & Regine Paul, 2022. "Why regulators assess risk differently: Regulatory style, business organization, and the varied practice of risk‐based food safety inspections across the EU," Regulation & Governance, John Wiley & Sons, vol. 16(1), pages 274-292, January.
    2. Vidoli, F.; & Fusco, E.; & Pignataro, G.; & Guccio, C.;, 2023. "Multi-directional Robust Benefit of the Doubt model: a comprehensive measure for the quality of health care in OECD countries," Health, Econometrics and Data Group (HEDG) Working Papers 23/14, HEDG, c/o Department of Economics, University of York.
    3. Vidoli, F. & Fusco, E. & Pignataro, G. & Guccio, C., 2024. "Multi-directional Robust Benefit of the Doubt model: An application to the measurement of the quality of acute care services in OECD countries," Socio-Economic Planning Sciences, Elsevier, vol. 93(C).
    4. Pereira, Miguel Alves & Marques, Rui Cunha, 2022. "Is sunshine regulation the new prescription to brighten up public hospitals in Portugal?," Socio-Economic Planning Sciences, Elsevier, vol. 84(C).
    5. Jamieson Gilmore, Kendall & Corazza, Ilaria & Coletta, Lucrezia & Allin, Sara, 2023. "The uses of Patient Reported Experience Measures in health systems: A systematic narrative review," Health Policy, Elsevier, vol. 128(C), pages 1-10.
    6. Tetiana Vasylieva & Beata Gavurova & Tetiana Dotsenko & Svitlana Bilan & Marcin Strzelec & Samer Khouri, 2023. "The Behavioral and Social Dimension of the Public Health System of European Countries: Descriptive, Canonical, and Factor Analysis," IJERPH, MDPI, vol. 20(5), pages 1-35, March.
    7. Klein, Silvia & Rauh, Johannes & Pauletzki, Jürgen & Klakow-Franck, Regina & Zander-Jentsch, Britta, 2023. "Introduction of quality indicators in German hospital capacity planning – Do results show an improvement in quality?," Health Policy, Elsevier, vol. 133(C).
    8. Johannes Hengelbrock & Johannes Rauh & Jona Cederbaum & Maximilian Kähler & Michael Höhle, 2023. "Hospital profiling using Bayesian decision theory," Biometrics, The International Biometric Society, vol. 79(3), pages 2757-2769, September.
    9. Li Wang & David Demeritt & Henry Rothstein, 2023. "“Carrying the black pot”: Food safety and risk in China's reactive regulatory state," Regulation & Governance, John Wiley & Sons, vol. 17(2), pages 469-490, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. El-Jardali, Fadi & Saleh, Shadi & Ataya, Nour & Jamal, Diana, 2011. "Design, implementation and scaling up of the balanced scorecard for hospitals in Lebanon: Policy coherence and application lessons for low and middle income countries," Health Policy, Elsevier, vol. 103(2), pages 305-314.
    2. Emma Akpan & Surajudeen Abiola Abdulrahman & Nne Pepple, 2020. "Comparison of the Level of Adherence to Laboratory Quality Management System between Public and Private Secondary Health Facilities in Southern Nigeria," Global Journal of Health Science, Canadian Center of Science and Education, vol. 12(12), pages 1-27, November.
    3. Leonard, David K. & Bloom, Gerald & Hanson, Kara & O’Farrell, Juan & Spicer, Neil, 2013. "Institutional Solutions to the Asymmetric Information Problem in Health and Development Services for the Poor," World Development, Elsevier, vol. 48(C), pages 71-87.
    4. Farshad Behrouzi & Azanizawati Ma'aram, 2019. "Identification and ranking of specific balanced scorecard performance measures for hospitals: A case study of private hospitals in the Klang Valley area, Malaysia," International Journal of Health Planning and Management, Wiley Blackwell, vol. 34(4), pages 1364-1376, October.
    5. Alex R. Horenstein & Manuel S. Santos, 2012. "A Cross-Country Analysis of Health Care Expenditures," Working Papers 2013-05, University of Miami, Department of Economics.
    6. Anne-Laure Feral-Pierssens & Claire Rives-Lange & Joane Matta & Victor G. Rodwin & Marcel Goldberg & Philippe Juvin & Marie Zins & Claire Carette & Sebastien Czernichow, 2020. "Forgoing health care under universal health insurance: the case of France," International Journal of Public Health, Springer;Swiss School of Public Health (SSPH+), vol. 65(5), pages 617-625, June.
    7. Zec, Dejan & Rüling, Charles-Clemens & Wang, Tao, 2020. "Parliament in action: Drug withdrawals and policy changes in the U.K," Health Policy, Elsevier, vol. 124(9), pages 984-990.
    8. Jacob Assa & Cecilia Calderon, 2020. "Privatization and Pandemic: A Cross-Country Analysis of COVID-19 Rates and Health-Care Financing Structures," Working Papers 2008, New School for Social Research, Department of Economics.
    9. Zhichao Wang & Bao Hoang Nguyen & Valentin Zelenyuk, 2024. "Performance analysis of hospitals in Australia and its peers: a systematic and critical review," Journal of Productivity Analysis, Springer, vol. 62(2), pages 139-173, October.
    10. Böhm, Katharina & Schmid, Achim & Götze, Ralf & Landwehr, Claudia & Rothgang, Heinz, 2013. "Five types of OECD healthcare systems: Empirical results of a deductive classification," Health Policy, Elsevier, vol. 113(3), pages 258-269.
    11. Schwartz, Robert & Deber, Raisa, 2016. "The performance measurement–management divide in public health," Health Policy, Elsevier, vol. 120(3), pages 273-280.
    12. Anne-Laure Feral-Pierssens & Claire Rives-Lange & Joane Matta & Victor G. Rodwin & Marcel Goldberg & Philippe Juvin & Marie Zins & Claire Carette & Sebastien Czernichow, 0. "Forgoing health care under universal health insurance: the case of France," International Journal of Public Health, Springer;Swiss School of Public Health (SSPH+), vol. 0, pages 1-9.
    13. Andrew McNee, 2012. "Illuminating the local: can non-formal institutions be complementary to health system development in Papua New Guinea?," Development Policy Centre Discussion Papers 1215, Development Policy Centre, Crawford School of Public Policy, The Australian National University.
    14. Tafesse, Wiktoria & Chalkley, Martin, 2021. "Faith-based provision of sexual and reproductive healthcare in Malawi," Social Science & Medicine, Elsevier, vol. 282(C).
    15. Solomon, Josie & Knapp, Peter & Raynor, D.K. & Atkin, Karl, 2013. "Worlds apart? An exploration of prescribing and medicine-taking decisions by patients, GPs and local policy makers," Health Policy, Elsevier, vol. 112(3), pages 264-272.
    16. Harmeet Kaur Kang & Bandana Bisht & Manmeet Kaur & Obrey Alexis & Aaron Worsley & Denny John, 2024. "Effectiveness of interpersonal psychotherapy in comparison to other psychological and pharmacological interventions for reducing depressive symptoms in women diagnosed with postpartum depression in lo," Campbell Systematic Reviews, John Wiley & Sons, vol. 20(2), June.
    17. Marianna Mauro & Monica Giancotti & Giovanna Talarico, 2017. "Mapping the field: A bibliometric analysis of accountability literature in healthcare," MECOSAN, FrancoAngeli Editore, vol. 2017(101), pages 7-30.
    18. Mesman, Roos & Faber, Marjan J. & Berden, Bart J.J.M. & Westert, Gert P., 2017. "Evaluation of minimum volume standards for surgery in the Netherlands (2003–2017): A successful policy?," Health Policy, Elsevier, vol. 121(12), pages 1263-1273.
    19. Gort, Marjan & Broekhuis, Manda & Regts, Gerdien, 2013. "How teams use indicators for quality improvement – A multiple-case study on the use of multiple indicators in multidisciplinary breast cancer teams," Social Science & Medicine, Elsevier, vol. 96(C), pages 69-77.
    20. Choi, Jaerim & Lim, Sunghun, 2023. "Ostrom Meets the Pandemic: Lessons from Asian Rice Farming Traditions," 97th Annual Conference, March 27-29, 2023, Warwick University, Coventry, UK 334543, Agricultural Economics Society - AES.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:hepoli:v:124:y:2020:i:5:p:501-510. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu or the person in charge (email available below). General contact details of provider: http://www.elsevier.com/locate/healthpol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.