IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v68y2022i5p3680-3702.html
   My bibliography  Save this article

Focusing Provider Attention: An Empirical Examination of Incentives and Feedback in Flu Vaccinations

Author

Listed:
  • Robert J. Niewoehner

    (Kenan-Flagler Business School, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina 27599)

  • Bradley R. Staats

    (Kenan-Flagler Business School, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina 27599)

Abstract

Background. Influenza imposes heavy societal costs through healthcare expenditures, missed days of work, and numerous hospitalizations each year. Considering these costs, the healthcare and behavioral science literature offers suggestions on increasing demand for flu vaccinations. Yet, the adult flu vaccination rate fluctuated between 37% and 46% between 2010 and 2019. Aim. Although a demand-side approach represents one viable strategy, an operations management approach would also highlight the need to consider a supply-side approach. In this paper, we investigate how to improve clinic vaccination rates by altering provider behavior. Methodology. We implement and study a flu vaccine intervention among 145 clinics from nine different states. This intervention randomly assigned these clinics to a control group or one of two separate treatment arms that received either relative performance feedback or financial incentives. Results. We find clinics that received relative performance feedback outperformed all others: Our intervention led to a 12% increase in flu shots for this group of clinics. Moreover, we also find clinics in this group exhibit rank response behavior, specifically last-place aversion; in particular, clinics near last place outperform the corresponding control clinics by 23% points. Conclusion. Overall, we find that clinic-level performance feedback can effectively drive operational improvement. Even a small increase in the U.S. adult flu vaccination rate might confer hundreds of millions of dollars in societal benefits and prevents thousands of hospitalizations. We discuss the implications of our work for healthcare operations theory, healthcare providers, and healthcare administrators.

Suggested Citation

  • Robert J. Niewoehner & Bradley R. Staats, 2022. "Focusing Provider Attention: An Empirical Examination of Incentives and Feedback in Flu Vaccinations," Management Science, INFORMS, vol. 68(5), pages 3680-3702, May.
  • Handle: RePEc:inm:ormnsc:v:68:y:2022:i:5:p:3680-3702
    DOI: 10.1287/mnsc.2021.4051
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2021.4051
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2021.4051?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Azmat, Ghazala & Iriberri, Nagore, 2010. "The importance of relative performance feedback information: Evidence from a natural experiment using high school students," Journal of Public Economics, Elsevier, vol. 94(7-8), pages 435-452, August.
    2. Kenan Arifoglu & Sarang Deo & Seyed M. R. Iravani, 2012. "Consumption Externality and Yield Uncertainty in the Influenza Vaccine Supply Chain: Interventions in Demand and Supply Sides," Management Science, INFORMS, vol. 58(6), pages 1072-1091, June.
    3. Karel H. van Donselaar & Vishal Gaur & Tom van Woensel & Rob A. C. M. Broekmeulen & Jan C. Fransoo, 2010. "Ordering Behavior in Retail Stores and Implications for Automated Replenishment," Management Science, INFORMS, vol. 56(5), pages 766-784, May.
    4. David Gill & Zdenka Kissová & Jaesun Lee & Victoria Prowse, 2019. "First-Place Loving and Last-Place Loathing: How Rank in the Distribution of Performance Affects Effort Provision," Management Science, INFORMS, vol. 65(2), pages 494-507, February.
    5. Guido Friebel & Matthias Heinz & Miriam Krueger & Nikolay Zubanov, 2017. "Team Incentives and Performance: Evidence from a Retail Chain," American Economic Review, American Economic Association, vol. 107(8), pages 2168-2203, August.
    6. Canice Prendergast, 1999. "The Provision of Incentives in Firms," Journal of Economic Literature, American Economic Association, vol. 37(1), pages 7-63, March.
    7. Gary Charness & David Masclet & Marie Claire Villeval, 2014. "The Dark Side of Competition for Status," Management Science, INFORMS, vol. 60(1), pages 38-55, January.
    8. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2013. "Team Incentives: Evidence From A Firm Level Experiment," Journal of the European Economic Association, European Economic Association, vol. 11(5), pages 1079-1114, October.
    9. Dennis Campbell & Frances Frei, 2011. "Market Heterogeneity and Local Capacity Decisions in Services," Manufacturing & Service Operations Management, INFORMS, vol. 13(1), pages 2-19, April.
    10. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    11. Corey White, 2021. "Measuring Social and Externality Benefits of Influenza Vaccination," Journal of Human Resources, University of Wisconsin Press, vol. 56(3), pages 749-785.
    12. Guillaume Roels & Xuanming Su, 2014. "Optimal Design of Social Comparison Effects: Setting Reference Groups and Reference Points," Management Science, INFORMS, vol. 60(3), pages 606-627, March.
    13. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    14. Ashraf, Nava & Bandiera, Oriana & Lee, Scott S., 2014. "Awards unbundled: Evidence from a natural field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 100(C), pages 44-63.
    15. Jordi Blanes i Vidal & Mareike Nossol, 2011. "Tournaments Without Prizes: Evidence from Personnel Records," Management Science, INFORMS, vol. 57(10), pages 1721-1736, October.
    16. Abadie, Alberto & Imbens, Guido W., 2011. "Bias-Corrected Matching Estimators for Average Treatment Effects," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 1-11.
    17. Josse Delfgaauw & Robert Dur & Joeri Sol & Willem Verbeke, 2013. "Tournament Incentives in the Field: Gender Differences in the Workplace," Journal of Labor Economics, University of Chicago Press, vol. 31(2), pages 305-326.
    18. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2007. "Incentives for Managers and Inequality among Workers: Evidence from a Firm-Level Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(2), pages 729-773.
    19. Emmanuel Dechenaux & Dan Kovenock & Roman Sheremeta, 2015. "A survey of experimental research on contests, all-pay auctions and tournaments," Experimental Economics, Springer;Economic Science Association, vol. 18(4), pages 609-669, December.
    20. Charles J. Corbett & María J. Montes-Sancho & David A. Kirsch, 2005. "The Financial Impact of ISO 9000 Certification in the United States: An Empirical Analysis," Management Science, INFORMS, vol. 51(7), pages 1046-1059, July.
    21. Steven Blader & Claudine Gartenberg & Andrea Prat, 2020. "The Contingent Effect of Management Practices," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(2), pages 721-749.
    22. Soo-Haeng Cho, 2010. "The Optimal Composition of Influenza Vaccines Subject to Random Production Yields," Manufacturing & Service Operations Management, INFORMS, vol. 12(2), pages 256-277, November.
    23. Gary Charness & David Masclet & Marie Claire Villeval, 2014. "The Dark Side of Competition for Status (preprint)," Working Papers halshs-01090241, HAL.
    24. Delfgaauw, Josse & Dur, Robert & Non, Arjan & Verbeke, Willem, 2014. "Dynamic incentive effects of relative performance pay: A field experiment," Labour Economics, Elsevier, vol. 28(C), pages 1-13.
    25. Barry Alan Pasternack, 1985. "Optimal Pricing and Return Policies for Perishable Commodities," Marketing Science, INFORMS, vol. 4(2), pages 166-176.
    26. Claire Senot & Aravind Chandrasekaran & Peter T. Ward & Anita L. Tucker & Susan D. Moffatt-Bruce, 2016. "The Impact of Combining Conformance and Experiential Quality on Hospitals’ Readmissions and Cost Performance," Management Science, INFORMS, vol. 62(3), pages 829-848, March.
    27. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    28. Dimitrios Andritsos & Christopher S. Tang, 2014. "Linking Process Quality and Resource Usage: An Empirical Analysis," Post-Print hal-01099628, HAL.
    29. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    30. Song-Hee Kim & Jordan Tong & Carol Peden, 2020. "Admission Control Biases in Hospital Unit Capacity Management: How Occupancy Information Hurdles and Decision Noise Impact Utilization," Management Science, INFORMS, vol. 66(11), pages 5151-5170, November.
    31. Tinglong Dai & Mustafa Akan & Sridhar Tayur, 2017. "Imaging Room and Beyond: The Underlying Economics Behind Physicians’ Test-Ordering Behavior in Outpatient Services," Manufacturing & Service Operations Management, INFORMS, vol. 19(1), pages 99-113, February.
    32. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, April.
    33. Ryan W. Buell, 2021. "Last-Place Aversion in Queues," Management Science, INFORMS, vol. 67(3), pages 1430-1452, March.
    34. Hummy Song & Anita L. Tucker & Karen L. Murrell & David R. Vinsonc, 2018. "Closing the Productivity Gap: Improving Worker Productivity Through Public Relative Performance Feedback and Validation of Best Practices," Management Science, INFORMS, vol. 64(6), pages 2628-2649, June.
    35. Maria R. Ibanez & Jonathan R. Clark & Robert S. Huckman & Bradley R. Staats, 2018. "Discretionary Task Ordering: Queue Management in Radiological Services," Management Science, INFORMS, vol. 64(9), pages 4389-4407, September.
    36. Dimitrios A. Andritsos & Christopher S. Tang, 2014. "Linking Process Quality and Resource Usage: An Empirical Analysis," Production and Operations Management, Production and Operations Management Society, vol. 23(12), pages 2163-2177, December.
    37. Anita L. Tucker, 2007. "An Empirical Study of System Improvement by Frontline Employees in Hospital Units," Manufacturing & Service Operations Management, INFORMS, vol. 9(4), pages 492-505, April.
    38. Maria R. Ibanez & Michael W. Toffel, 2020. "How Scheduling Can Bias Quality Assessment: Evidence from Food-Safety Inspections," Management Science, INFORMS, vol. 66(6), pages 2396-2416, June.
    39. Yarnall, K.S.H. & Pollak, K.I. & Østbye, T. & Krause, K.M. & Michener, J.L., 2003. "Primary care: Is there enough time for prevention?," American Journal of Public Health, American Public Health Association, vol. 93(4), pages 635-641.
    40. William Ocasio, 1997. "Towards An Attention‐Based View Of The Firm," Strategic Management Journal, Wiley Blackwell, vol. 18(S1), pages 187-206, July.
    41. Vishal Gupta & Brian Rongqing Han & Song-Hee Kim & Hyung Paek, 2020. "Maximizing Intervention Effectiveness," Management Science, INFORMS, vol. 66(12), pages 5576-5598, December.
    42. William Ocasio & John Joseph, 2018. "The Attention-Based View of Great Strategies," Strategy Science, INFORMS, vol. 3(1), pages 289-294, March.
    43. Edward P. Lazear, 2018. "Compensation and Incentives in the Workplace," Journal of Economic Perspectives, American Economic Association, vol. 32(3), pages 195-214, Summer.
    44. Song-Hee Kim & Carri W. Chan & Marcelo Olivares & Gabriel Escobar, 2015. "ICU Admission Control: An Empirical Study of Capacity Allocation and Its Implication for Patient Outcomes," Management Science, INFORMS, vol. 61(1), pages 19-38, January.
    45. Heckman, James J. & Robb, Richard Jr., 1985. "Alternative methods for evaluating the impact of interventions : An overview," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 239-267.
    46. Michael Freeman & Nicos Savva & Stefan Scholtes, 2017. "Gatekeepers at Work: An Empirical Analysis of a Maternity Unit," Management Science, INFORMS, vol. 63(10), pages 3147-3167, October.
    47. Bradley R. Staats & Hengchen Dai & David Hofmann & Katherine L. Milkman, 2017. "Motivating Process Compliance Through Individual Electronic Monitoring: An Empirical Examination of Hand Hygiene in Healthcare," Management Science, INFORMS, vol. 63(5), pages 1563-1585, May.
    48. Tinglong Dai & Mustafa Akan & Sridhar Tayur, 2017. "Imaging Room and Beyond: The Underlying Economics Behind Physicians’ Test-Ordering Behavior in Outpatient Services," Manufacturing & Service Operations Management, INFORMS, vol. 19(1), pages 99-113, February.
    49. Dennis J. Zhang & Itai Gurvich & Jan A. Van Mieghem & Eric Park & Robert S. Young & Mark V. Williams, 2016. "Hospital Readmissions Reduction Program: An Economic and Operational Analysis," Management Science, INFORMS, vol. 62(11), pages 3351-3371, November.
    50. Bandiera, Oriana & Barankay, Iwan & Rasul, Imran, 2013. "Team incentives: evidence from a firm level," LSE Research Online Documents on Economics 53141, London School of Economics and Political Science, LSE Library.
    51. Song, Hummy & Tucker, Anita, 2016. "Performance Improvement in Health Care Organizations," Foundations and Trends(R) in Technology, Information and Operations Management, now publishers, vol. 9(3-4), pages 153-309, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hummy Song & Anita L. Tucker & Karen L. Murrell & David R. Vinsonc, 2018. "Closing the Productivity Gap: Improving Worker Productivity Through Public Relative Performance Feedback and Validation of Best Practices," Management Science, INFORMS, vol. 64(6), pages 2628-2649, June.
    2. Selay Sahan & Euan Phimister, 2022. "Worker Incentives in the Banking Industry," Journal of Financial Services Research, Springer;Western Finance Association, vol. 61(2), pages 259-284, April.
    3. David Gill & Zdenka Kissová & Jaesun Lee & Victoria Prowse, 2019. "First-Place Loving and Last-Place Loathing: How Rank in the Distribution of Performance Affects Effort Provision," Management Science, INFORMS, vol. 65(2), pages 494-507, February.
    4. Delfgaauw, Josse & Dur, Robert & Souverijn, Michiel, 2017. "Team Incentives, Task Assignment, and Performance: A Field Experiment," IZA Discussion Papers 11228, Institute of Labor Economics (IZA).
    5. Gosnell, Greer & Metcalfe, Robert & List, John A, 2016. "A new approach to an age-old problem: solving externalities by incenting workers directly," LSE Research Online Documents on Economics 84331, London School of Economics and Political Science, LSE Library.
    6. Josse Delfgaauw & Robert Dur & Oke Onemu & Joeri Sol, 2022. "Team Incentives, Social Cohesion, and Performance: A Natural Field Experiment," Management Science, INFORMS, vol. 68(1), pages 230-256, January.
    7. Brade, Raphael & Himmler, Oliver & Jäckle, Robert, 2022. "Relative performance feedback and the effects of being above average — field experiment and replication," Economics of Education Review, Elsevier, vol. 89(C).
    8. Michael Kirchler & Florian Lindner & Utz Weitzel, 2018. "Delegated Decision Making and Social Competition in the Finance Industry," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2018_08, Max Planck Institute for Research on Collective Goods.
    9. Lindner, Florian & Kirchler, Michael & Rosenkranz, Stephanie & Weitzel, Utz, 2021. "Social Motives and Risk-Taking in Investment Decisions," Journal of Economic Dynamics and Control, Elsevier, vol. 127(C).
    10. Gjedrem, William Gilje, 2018. "Relative performance feedback: Effective or dismaying?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 74(C), pages 1-16.
    11. Delfgaauw, Josse & Dur, Robert & Non, Arjan & Verbeke, Willem, 2014. "Dynamic incentive effects of relative performance pay: A field experiment," Labour Economics, Elsevier, vol. 28(C), pages 1-13.
    12. Florian Englmaier & Stefan Grimm & Dominik Grothe & David Schindler & Simeon Schudy, 2024. "The Efficacy of Tournaments for Nonroutine Team Tasks," Journal of Labor Economics, University of Chicago Press, vol. 42(4), pages 921-948.
    13. Josse Delfgaauw & Robert Dur & Arjan Non & Willem Verbeke, 2015. "The Effects of Prize Spread and Noise in Elimination Tournaments: A Natural Field Experiment," Journal of Labor Economics, University of Chicago Press, vol. 33(3), pages 521-569.
    14. Michael Kirchler & Florian Lindner & Utz Weitzel, 2018. "Rankings and Risk‐Taking in the Finance Industry," Journal of Finance, American Finance Association, vol. 73(5), pages 2271-2302, October.
    15. Diwas Singh KC & Stefan Scholtes & Christian Terwiesch, 2020. "Empirical Research in Healthcare Operations: Past Research, Present Understanding, and Future Opportunities," Manufacturing & Service Operations Management, INFORMS, vol. 22(1), pages 73-83, January.
    16. Florian Lindner & Michael Kirchler & Stephanie Rosenkranz & Utz Weitzel, 2019. "Social Status and Risk-Taking in Investment Decisions," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2019_07, Max Planck Institute for Research on Collective Goods.
    17. Kirchler, Michael & Lindner, Florian & Weitzel, Utz, 2020. "Delegated investment decisions and rankings," Journal of Banking & Finance, Elsevier, vol. 120(C).
    18. Kathrin Manthei & Dirk Sliwka & Timo Vogelsang, 2023. "Talking About Performance or Paying for It? A Field Experiment on Performance Reviews and Incentives," Management Science, INFORMS, vol. 69(4), pages 2198-2216, April.
    19. Delavallade,Clara Anne, 2021. "Motivating Teams : Private Feedback and Public Recognition at Work," Policy Research Working Paper Series 9621, The World Bank.
    20. Jeworrek, Sabrina & Mertins, Vanessa & Vlassopoulos, Michael, 2018. ""The good news about bad news": Feedback about past organisational failure and its impact on worker productivity," IWH Discussion Papers 1/2018, Halle Institute for Economic Research (IWH).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:68:y:2022:i:5:p:3680-3702. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.