IDEAS home Printed from https://ideas.repec.org/a/wly/hlthec/v34y2025i1p175-199.html
   My bibliography  Save this article

Do health care quality improvement policies work for all? Distributional effects by baseline quality in South Africa

Author

Listed:
  • Finn McGuire
  • Peter C. Smith
  • Nicholas Stacey
  • Ijeoma Edoka
  • Noemi Kreif

Abstract

Health care quality improvement (QI) initiatives are being implemented by a number of low‐ and middle‐income countries. However, there is concern that these policies may not reduce, or may even worsen, inequities in access to high‐quality care. Few studies have examined the distributional impact of QI programmes. We study the Ideal Clinic Realization and Maintenance program implemented in health facilities in South Africa, assessing whether the effects of the program are sensitive to previous quality performance. Implementing difference‐in‐difference‐in‐difference and changes‐in‐changes approaches we estimate the effect of the program on quality across the distribution of past facility quality performance. We find that the largest gains are realized by facilities with higher baseline quality, meaning this policy may have led to a worsening of pre‐existing inequity in health care quality. Our study highlights that the full consequences of QI programmes cannot be gauged solely from examination of the mean impact.

Suggested Citation

  • Finn McGuire & Peter C. Smith & Nicholas Stacey & Ijeoma Edoka & Noemi Kreif, 2025. "Do health care quality improvement policies work for all? Distributional effects by baseline quality in South Africa," Health Economics, John Wiley & Sons, Ltd., vol. 34(1), pages 175-199, January.
  • Handle: RePEc:wly:hlthec:v:34:y:2025:i:1:p:175-199
    DOI: 10.1002/hec.4899
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/hec.4899
    Download Restriction: no

    File URL: https://libkey.io/10.1002/hec.4899?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2006. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," American Economic Review, American Economic Association, vol. 96(4), pages 988-1012, September.
    2. Laurence Lannes & Bruno Meessen & Agnes Soucat & Paulin Basinga, 2016. "Can performance-based financing help reaching the poor with maternal and child health services? The experience of rural Rwanda," International Journal of Health Planning and Management, Wiley Blackwell, vol. 31(3), pages 309-348, July.
    3. Samantha Y Rowe & David H Peters & Kathleen A Holloway & John Chalker & Dennis Ross-Degnan & Alexander K Rowe, 2019. "A systematic review of the effectiveness of strategies to improve health care provider performance in low- and middle-income countries: Methods and descriptive results," PLOS ONE, Public Library of Science, vol. 14(5), pages 1-29, May.
    4. Günther Fink & Eeshani Kandpal & Gil Shapira, 2022. "Inequality in the Quality of Health Services: Wealth, Content of Care, and the Price of Antenatal Consultations in the Democratic Republic of Congo," Economic Development and Cultural Change, University of Chicago Press, vol. 70(3), pages 1295-1336.
    5. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    6. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 487-535.
    7. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    8. Aaron S. Yelowitz, 1995. "The Medicaid Notch, Labor Supply, and Welfare Participation: Evidence from Eligibility Expansions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(4), pages 909-939.
    9. David Powell, 2020. "Quantile Treatment Effects in the Presence of Covariates," The Review of Economics and Statistics, MIT Press, vol. 102(5), pages 994-1005, December.
    10. Wagstaff, Adam & van Doorslaer, Eddy & Paci, Pierella, 1991. "Horizontal equity in the delivery of health care," Journal of Health Economics, Elsevier, vol. 10(2), pages 251-256, July.
    11. Ding, Peng & Li, Fan, 2019. "A Bracketing Relationship between Difference-in-Differences and Lagged-Dependent-Variable Adjustment," Political Analysis, Cambridge University Press, vol. 27(4), pages 605-615, October.
    12. Callaway, Brantly & Li, Tong & Oka, Tatsushi, 2018. "Quantile treatment effects in difference in differences models under dependence restrictions and with only two time periods," Journal of Econometrics, Elsevier, vol. 206(2), pages 395-413.
    13. Gibbons Charles E. & Suárez Serrato Juan Carlos & Urbancic Michael B., 2019. "Broken or Fixed Effects?," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-12, January.
    14. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    15. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    16. Catherine Linard & Marius Gilbert & Robert W Snow & Abdisalan M Noor & Andrew J Tatem, 2012. "Population Distribution, Settlement Patterns and Accessibility across Africa in 2010," PLOS ONE, Public Library of Science, vol. 7(2), pages 1-8, February.
    17. Sascha O. Becker & Andrea Ichino, 2002. "Estimation of average treatment effects based on propensity scores," Stata Journal, StataCorp LP, vol. 2(4), pages 358-377, November.
    18. Manski, Charles F, 1990. "Nonparametric Bounds on Treatment Effects," American Economic Review, American Economic Association, vol. 80(2), pages 319-323, May.
    19. Sharon K. Long & Alshadye Yemane & Karen Stockley, 2010. "Disentangling the Effects of Health Reform in Massachusetts: How Important Are the Special Provisions for Young Adults?," American Economic Review, American Economic Association, vol. 100(2), pages 297-302, May.
    20. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    21. Djebbari, Habiba & Smith, Jeffrey, 2008. "Heterogeneous impacts in PROGRESA," Journal of Econometrics, Elsevier, vol. 145(1-2), pages 64-80, July.
    22. Nicholas Stacey & Andrew Mirelman & Noemi Kreif & Marc Suhrcke & Karen Hofman & Ijeoma Edoka, 2021. "Facility standards and the quality of public sector primary care: Evidence from South Africa's “Ideal Clinics” program," Health Economics, John Wiley & Sons, Ltd., vol. 30(7), pages 1543-1558, July.
    23. Frank Eijkenaar, 2013. "Key issues in the design of pay for performance programs," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 14(1), pages 117-131, February.
    24. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    25. Yoko Akachi & Margaret E. Kruk, 2017. "Quality of care: Measuring a neglected driver of improved health," WIDER Working Paper Series wp-2017-135, World Institute for Development Economic Research (UNU-WIDER).
    26. Hainmueller, Jens & Mummolo, Jonathan & Xu, Yiqing, 2019. "How Much Should We Trust Estimates from Multiplicative Interaction Models? Simple Tools to Improve Empirical Practice," Political Analysis, Cambridge University Press, vol. 27(2), pages 163-192, April.
    27. Nickell, Stephen J, 1981. "Biases in Dynamic Models with Fixed Effects," Econometrica, Econometric Society, vol. 49(6), pages 1417-1426, November.
    28. Yoko Akachi & Margaret E. Kruk, 2017. "Quality of care: Measuring a neglected driver of improved health," WIDER Working Paper Series 135, World Institute for Development Economic Research (UNU-WIDER).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Jones A.M & Rice N, 2009. "Econometric Evaluation of Health Policies," Health, Econometrics and Data Group (HEDG) Working Papers 09/09, HEDG, c/o Department of Economics, University of York.
    3. Callaway, Brantly, 2021. "Bounds on distributional treatment effect parameters using panel data with an application on job displacement," Journal of Econometrics, Elsevier, vol. 222(2), pages 861-881.
    4. Słoczyński, Tymon, 2012. "New Evidence on Linear Regression and Treatment Effect Heterogeneity," MPRA Paper 39524, University Library of Munich, Germany.
    5. Christian Volpe Martincus & Jerónimo Carballo, 2010. "Is Export Promotion Effective in Developing Countries? Firm-Level Evidence on the Intensive and Extensive Margins of Exports," IDB Publications (Working Papers) 36763, Inter-American Development Bank.
    6. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    7. Buhl-Wiggers, Julie & Kerwin, Jason T. & Muñoz-Morales, Juan & Smith, Jeffrey & Thornton, Rebecca, 2024. "Some children left behind: Variation in the effects of an educational intervention," Journal of Econometrics, Elsevier, vol. 243(1).
    8. Christian Volpe Martincus & Jerónimo Carballo & Pablo M. Garcia, 2012. "Public programmes to promote firms’ exports in developing countries: are there heterogeneous effects by size categories?," Applied Economics, Taylor & Francis Journals, vol. 44(4), pages 471-491, February.
    9. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    10. Volpe Martincus, Christian & Carballo, Jerónimo, 2008. "Is export promotion effective in developing countries? Firm-level evidence on the intensive and the extensive margins of exports," Journal of International Economics, Elsevier, vol. 76(1), pages 89-106, September.
    11. Black, Dan A. & Joo, Joonhwi & LaLonde, Robert & Smith, Jeffrey A. & Taylor, Evan J., 2022. "Simple Tests for Selection: Learning More from Instrumental Variables," Labour Economics, Elsevier, vol. 79(C).
    12. Li, Linjie & Liu, Xiaming & Yuan, Dong & Yu, Miaojie, 2017. "Does outward FDI generate higher productivity for emerging economy MNEs? – Micro-level evidence from Chinese manufacturing firms," International Business Review, Elsevier, vol. 26(5), pages 839-854.
    13. Burt S. Barnow & Jeffrey Smith, 2015. "Employment and Training Programs," NBER Chapters, in: Economics of Means-Tested Transfer Programs in the United States, Volume 2, pages 127-234, National Bureau of Economic Research, Inc.
    14. Alberto Abadie & Guido W. Imbens, 2002. "Simple and Bias-Corrected Matching Estimators for Average Treatment Effects," NBER Technical Working Papers 0283, National Bureau of Economic Research, Inc.
    15. Sakos, Grayson & Cerulli, Giovanni & Garbero, Alessandra, 2021. "Beyond the ATE: Idiosyncratic Effect Estimation to Uncover Distributional Impacts Results from 17 Impact Evaluations," 2021 Annual Meeting, August 1-3, Austin, Texas 314017, Agricultural and Applied Economics Association.
    16. Themann, Michael & Koch, Nicolas, 2021. "Catching up and falling behind: Cross-country evidence on the impact of the EU ETS on firm productivity," Ruhr Economic Papers 904, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    17. Flores, Carlos A. & Flores-Lagunes, Alfonso, 2009. "Identification and Estimation of Causal Mechanisms and Net Effects of a Treatment under Unconfoundedness," IZA Discussion Papers 4237, Institute of Labor Economics (IZA).
    18. Rahel Aichele, 2013. "Trade, Climate Policy and Carbon Leakage - Theory and Empirical Evidence," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 49, March.
    19. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    20. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Jun 2024.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:hlthec:v:34:y:2025:i:1:p:175-199. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.