IDEAS home Printed from https://ideas.repec.org/a/wly/jpamgt/v41y2022i4p1090-1117.html
   My bibliography  Save this article

Value‐Based Payments in Health Care: Evidence from a Nationwide Randomized Experiment in the Home Health Sector

Author

Listed:
  • Jun Li

Abstract

Value‐based payment programs, also known as pay‐for‐performance, use financial incentives to motivate providers to invest in quality and are a critical part of Medicare health care reform. This study examines the first year of the Home Health Value‐Based Purchasing program, a nationally representative cluster randomized experiment implemented by the Centers for Medicare & Medicaid Services in 2016. The goal of the program is to achieve better home health care quality. Home health agencies in treatment states were rewarded or penalized based on their performance on agency‐reported and non‐agency‐reported quality measures. The program improved agency‐reported measures by approximately one percentage point, and performance gains suggest a dose‐response relationship with respect to incentive size. However, the performance gains in agency‐reported measures did not reflect true quality improvement. I find evidence that agencies manipulated their coding of patients and inflated their performance. Coding manipulation explains the entirety of the program's impact on agency‐reported measures.

Suggested Citation

  • Jun Li, 2022. "Value‐Based Payments in Health Care: Evidence from a Nationwide Randomized Experiment in the Home Health Sector," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 41(4), pages 1090-1117, September.
    • Handle: RePEc:wly:jpamgt:v:41:y:2022:i:4:p:1090-1117
    DOI: 10.1002/pam.22415
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/pam.22415
    Download Restriction: no
    File URL: https://libkey.io/10.1002/pam.22415?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. James J. Heckman & Carolyn Heinrich & Jeffrey Smith, 2002. "The Performance of Performance Standards," Journal of Human Resources, University of Wisconsin Press, vol. 37(4), pages 778-811.
    2. Miriam Bruhn & David McKenzie, 2009. "In Pursuit of Balance: Randomization in Practice in Development Field Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 200-232, October.
    3. Pascal Courty & Gerald Marschke, 2004. "An Empirical Investigation of Gaming Responses to Explicit Performance Incentives," Journal of Labor Economics, University of Chicago Press, vol. 22(1), pages 23-56, January.
    4. Prashant C. Fuloria & Stefanos A. Zenios, 2001. "Outcomes-Adjusted Reimbursement in a Health-Care Delivery System," Management Science, INFORMS, vol. 47(6), pages 735-751, June.
    5. Figlio, David N., 2006. "Testing, crime and punishment," Journal of Public Economics, Elsevier, vol. 90(4-5), pages 837-851, May.
    6. Edward C. Norton & Emily J. Lawton & Jun Li, 2023. "Moneyball in Medicare," American Journal of Health Economics, University of Chicago Press, vol. 9(1), pages 96-126.
    7. Pierre Koning & Carolyn J. Heinrich, 2013. "Cream‐Skimming, Parking and Other Intended and Unintended Effects of High‐Powered, Performance‐Based Contracts," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 32(3), pages 461-483, June.
    8. Carolyn J. Heinrich & Gerald Marschke, 2010. "Incentives and their dynamics in public sector performance management systems," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 29(1), pages 183-208.
    9. C. Kirabo Jackson & Jonah E. Rockoff & Douglas O. Staiger, 2014. "Teacher Effects and Teacher-Related Policies," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 801-825, August.
    10. Eric A. Hanushek & Margaret E. Raymond, 2005. "Does school accountability lead to improved student performance?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 24(2), pages 297-327.
    11. Young, Alwyn, 2019. "Channeling Fisher: randomization tests and the statistical insignificance of seemingly significant experimental results," LSE Research Online Documents on Economics 101401, London School of Economics and Political Science, LSE Library.
    12. David N. Figlio & Lawrence S. Getzler, 2002. "Accountability , Ability and Disability: Gaming the System," NBER Working Papers 9307, National Bureau of Economic Research, Inc.
    13. Alwyn Young, 2019. "Channeling Fisher: Randomization Tests and the Statistical Insignificance of Seemingly Significant Experimental Results," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(2), pages 557-598.
    14. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    15. Julie Berry Cullen & Randall Reback, 2006. "Tinkering Toward Accolades: School Gaming Under a Performance Accountability System," NBER Working Papers 12286, National Bureau of Economic Research, Inc.
    16. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, January.
    17. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    18. Kostas Selviaridis & Finn Wynstra, 2015. "Performance-based contracting: a literature review and future research directions," International Journal of Production Research, Taylor & Francis Journals, vol. 53(12), pages 3505-3540, June.
    19. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    20. Burt S Barnow, 2000. "Exploring the relationship between performance management and program impact: A case study of the job training partnership act," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 19(1), pages 118-141.
    21. Margaret E. Brehm, 2018. "The Effects of Federal Adoption Incentive Awards for Older Children on Adoptions From U.S. Foster Care," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 37(2), pages 301-330, March.
    22. Frank A. Sloan & Hirschel Kasper (ed.), 2008. "Incentives and Choice in Health Care," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262693658, December.
    23. Weisbrod, Burton A, 1991. "The Health Care Quadrilemma: An Essay on Technological Change, Insurance, Quality of Care, and Cost Containment," Journal of Economic Literature, American Economic Association, vol. 29(2), pages 523-552, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Reback, Randall, 2008. "Teaching to the rating: School accountability and the distribution of student achievement," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1394-1415, June.
    2. Cardim, Joana & Molina-Millán, Teresa & Vicente, Pedro C., 2023. "Can technology improve the classroom experience in primary education? An African experiment on a worldwide program," Journal of Development Economics, Elsevier, vol. 164(C).
    3. Pirog, Maureen & Gerrish, Ed, 2015. "Impact of the Child Support Performance and Incentive Act on child support order establishment," Children and Youth Services Review, Elsevier, vol. 58(C), pages 104-117.
    4. Anell, Anders & Dietrichson, Jens & Ellegård, Lina Maria & Kjellsson, Gustav, 2021. "Information, switching costs, and consumer choice: Evidence from two randomised field experiments in Swedish primary health care," Journal of Public Economics, Elsevier, vol. 196(C).
    5. Rezende, Marcelo, 2010. "The effects of accountability on higher education," Economics of Education Review, Elsevier, vol. 29(5), pages 842-856, October.
    6. Yitayew, Asresu & Abdulai, Awudu & Yigezu, Yigezu A. & Deneke, Tilaye T. & Kassie, Girma T., 2021. "Impact of agricultural extension services on the adoption of improved wheat variety in Ethiopia: A cluster randomized controlled trial," World Development, Elsevier, vol. 146(C).
    7. Jeffrey D. Michler & Anna Josephson, 2022. "Recent developments in inference: practicalities for applied economics," Chapters, in: A Modern Guide to Food Economics, chapter 11, pages 235-268, Edward Elgar Publishing.
    8. Bruno Caprettini, 2021. "Team Visibility and City Travel: Evidence From the UEFA Champions' League Random Draw," Journal of Sports Economics, , vol. 22(1), pages 85-114, January.
    9. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    10. Gonzalez, Felipe & Prem, Mounu, 2020. "Police Repression and Protest Behavior: Evidence from Student Protests in Chile," SocArXiv 3xk5r, Center for Open Science.
    11. Seth Gershenson, 2016. "Performance Standards and Employee Effort: Evidence From Teacher Absences," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 35(3), pages 615-638, June.
    12. Pierre Koning & Karen Wiel, 2012. "School Responsiveness to Quality Rankings: An Empirical Analysis of Secondary Education in the Netherlands," De Economist, Springer, vol. 160(4), pages 339-355, December.
    13. Pascal Courty & Gerald Marschke, 2003. "Making Government Accountable: Lessons from a Federal Job Training Program," The Centre for Market and Public Organisation 03/083, The Centre for Market and Public Organisation, University of Bristol, UK.
    14. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    15. Lubega, Patrick & Nakakawa, Frances & Narciso, Gaia & Newman, Carol & Kaaya, Archileo N. & Kityo, Cissy & Tumuhimbise, Gaston A., 2021. "Body and mind: Experimental evidence from women living with HIV," Journal of Development Economics, Elsevier, vol. 150(C).
    16. Figlio, David N. & Rouse, Cecilia Elena, 2006. "Do accountability and voucher threats improve low-performing schools?," Journal of Public Economics, Elsevier, vol. 90(1-2), pages 239-255, January.
    17. Sevim, Dilek & Baranov, Victoria & Bhalotra, Sonia R. & Maselko, Joanna & Biroli, Pietro, 2023. "Socioemotional Skills in Early Childhood: Evidence from a Maternal Psychosocial Intervention," IZA Discussion Papers 15925, Institute of Labor Economics (IZA).
    18. James J. Heckman & Ganesh Karapakula, 2019. "The Perry Preschoolers at Late Midlife: A Study in Design-Specific Inference," Working Papers 2019-034, Human Capital and Economic Opportunity Working Group.
    19. Rajashri Chakrabarti, 2013. "Vouchers, Public School Response, And The Role Of Incentives: Evidence From Florida," Economic Inquiry, Western Economic Association International, vol. 51(1), pages 500-526, January.
    20. Cecilia Elena Rouse & Jane Hannaway & Dan Goldhaber & David Figlio, 2013. "Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 251-281, May.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jpamgt:v:41:y:2022:i:4:p:1090-1117. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/journal/34787/home .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.