IDEAS home Printed from https://ideas.repec.org/p/bdp/dpaper/0027.html
   My bibliography  Save this paper

Machine predictions and human decisions with variation in payoffs and skill: the case of antibiotic prescribing

Author

Listed:
  • Hannes Ullrich
  • Michael Allan Ribers

Abstract

We analyze how machine learning predictions may improve antibiotic prescribing in the context of the global health policy challenge of increasing antibiotic resistance. Estimating a binary antibiotic treatment choice model, we find variation in the skill to diagnose bacterial urinary tract infections and in how general practitioners trade off the expected cost of resistance against antibiotic curative benefits. In counterfactual analyses we find that providing machine learning predictions of bacterial infections to physicians increases prescribing efficiency. However, to achieve the policy objective of reducing antibiotic prescribing, physicians must also be incentivized. Our results highlight the potential misalignment of social and heterogeneous individual objectives in utilizing machine learning for prediction policy problems.

Suggested Citation

  • Hannes Ullrich & Michael Allan Ribers, 2023. "Machine predictions and human decisions with variation in payoffs and skill: the case of antibiotic prescribing," Berlin School of Economics Discussion Papers 0027, Berlin School of Economics.
  • Handle: RePEc:bdp:dpaper:0027
    DOI: 10.48462/opus4-5111
    as

    Download full text from publisher

    File URL: https://opus4.kobv.de/opus4-hsog/files/5111/BSE_DP_0027.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.48462/opus4-5111?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Aaron Chalfin & Oren Danieli & Andrew Hillis & Zubin Jelveh & Michael Luca & Jens Ludwig & Sendhil Mullainathan, 2016. "Productivity and Selection of Human Capital with Machine Learning," American Economic Review, American Economic Association, vol. 106(5), pages 124-127, May.
    2. Mohsen Bayati & Mark Braverman & Michael Gillam & Karen M Mack & George Ruiz & Mark S Smith & Eric Horvitz, 2014. "Data-Driven Decisions for Reducing Readmissions for Heart Failure: General Methodology and Case Study," PLOS ONE, Public Library of Science, vol. 9(10), pages 1-9, October.
    3. Michael Allan Ribers & Hannes Ullrich, 2023. "Machine learning and physician prescribing: a path to reduced antibiotic use," Berlin School of Economics Discussion Papers 0019, Berlin School of Economics.
    4. Will Dobbie & Andres Liberman & Daniel Paravisini & Vikram Pathania, 2021. "Measuring Bias in Consumer Lending [Loan Prospecting and the Loss of Soft Information]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(6), pages 2799-2832.
    5. Kwon, Illoong & Jun, Daesung, 2015. "Information disclosure and peer effects in the use of antibiotics," Journal of Health Economics, Elsevier, vol. 42(C), pages 1-16.
    6. Manski, Charles F., 2023. "Probabilistic prediction for binary treatment choice: With focus on personalized medicine," Journal of Econometrics, Elsevier, vol. 234(2), pages 647-663.
    7. Amy Finkelstein & Matthew Gentzkow & Heidi Williams, 2016. "Sources of Geographic Variation in Health Care: Evidence From PatientMigration," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1681-1726.
    8. Sergei Koulayev & Emilia Simeonova & Niels Skipper, 2017. "Can Physicians Affect Patient Adherence With Medication?," Health Economics, John Wiley & Sons, Ltd., vol. 26(6), pages 779-794, June.
    9. Daniel Bennett & Che-Lun Hung & Tsai-Ling Lauderdale, 2015. "Health Care Competition and Antibiotic Use in Taiwan," Journal of Industrial Economics, Wiley Blackwell, vol. 63(2), pages 371-393, June.
    10. Jason Abaluck & Leila Agha & Chris Kabrhel & Ali Raja & Arjun Venkatesh, 2016. "The Determinants of Productivity in Medical Testing: Intensity and Allocation of Care," American Economic Review, American Economic Association, vol. 106(12), pages 3730-3764, December.
    11. Currie, Janet & MacLeod, W. Bentley & Van Parys, Jessica, 2016. "Provider practice style and patient health outcomes: The case of heart attacks," Journal of Health Economics, Elsevier, vol. 47(C), pages 64-80.
    12. Dubois, Pierre & Gokkoca, Gokce, 2023. "Antibiotic Demand in the Presence of Antimicrobial Resistance," TSE Working Papers 23-1457, Toulouse School of Economics (TSE).
    13. Epstein, Andrew J. & Nicholson, Sean, 2009. "The formation and evolution of physician treatment styles: An application to cesarean sections," Journal of Health Economics, Elsevier, vol. 28(6), pages 1126-1140, December.
    14. Nikhil Agarwal & Alex Moehring & Pranav Rajpurkar & Tobias Salz, 2023. "Combining Human Expertise with Artificial Intelligence: Experimental Evidence from Radiology," NBER Working Papers 31422, National Bureau of Economic Research, Inc.
    15. Janet Currie & W. Bentley MacLeod, 2017. "Diagnosing Expertise: Human Capital, Decision Making, and Performance among Physicians," Journal of Labor Economics, University of Chicago Press, vol. 35(1), pages 1-43.
    16. Jishnu Das & Alaka Holla & Aakash Mohpal & Karthik Muralidharan, 2016. "Quality and Accountability in Health Care Delivery: Audit-Study Evidence from Primary Care in India," American Economic Review, American Economic Association, vol. 106(12), pages 3765-3799, December.
    17. Jason Abaluck & Leila Agha & David C. Chan Jr & Daniel Singer & Diana Zhu, 2020. "Fixing Misallocation with Guidelines: Awareness vs. Adherence," NBER Working Papers 27467, National Bureau of Economic Research, Inc.
    18. Currie, Janet & Lin, Wanchuan & Meng, Juanjuan, 2014. "Addressing antibiotic abuse in China: An experimental audit study," Journal of Development Economics, Elsevier, vol. 110(C), pages 39-51.
    19. Amitabh Chandra & Douglas O. Staiger, 2007. "Productivity Spillovers in Health Care: Evidence from the Treatment of Heart Attacks," Journal of Political Economy, University of Chicago Press, vol. 115(1), pages 103-140.
    20. Jon Kleinberg & Jens Ludwig & Sendhil Mullainathan & Ziad Obermeyer, 2015. "Prediction Policy Problems," American Economic Review, American Economic Association, vol. 105(5), pages 491-495, May.
    21. Ida Lykke Kristiansen & Sophie Yanying Sheng, 2022. "Doctor Who? The Effect of Physician-Patient Match on The SES-Health Gradient," CEBI working paper series 22-05, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    22. David C Chan & Matthew Gentzkow & Chuan Yu, 2022. "Selection with Variation in Diagnostic Skill: Evidence from Radiologists [The Determinants of Productivity in Medical Testing: Intensity and Allocation of Care]," The Quarterly Journal of Economics, Oxford University Press, vol. 137(2), pages 729-783.
    23. Jon Kleinberg & Himabindu Lakkaraju & Jure Leskovec & Jens Ludwig & Sendhil Mullainathan, 2018. "Human Decisions and Machine Predictions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 237-293.
    24. Andini, Monica & Ciani, Emanuele & de Blasio, Guido & D'Ignazio, Alessio & Salvestrini, Viola, 2018. "Targeting with machine learning: An application to a tax rebate program in Italy," Journal of Economic Behavior & Organization, Elsevier, vol. 156(C), pages 86-102.
    25. Ashesh Rambachan, 2022. "Identifying Prediction Mistakes in Observational Data," NBER Chapters, in: Economics of Artificial Intelligence, National Bureau of Economic Research, Inc.
    26. Sendhil Mullainathan & Ziad Obermeyer, 2022. "Diagnosing Physician Error: A Machine Learning Approach to Low-Value Health Care [“The Determinants of Productivity in Medical Testing: Intensity and Allocation of Care,”]," The Quarterly Journal of Economics, Oxford University Press, vol. 137(2), pages 679-727.
    27. Shan Huang & Hannes Ullrich, 2023. "Provider effects in antibiotic prescribing: Evidence from physician exits," Berlin School of Economics Discussion Papers 0018, Berlin School of Economics.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Allan Ribers & Hannes Ullrich, 2020. "Machine Predictions and Human Decisions with Variation in Payoffs and Skill," Papers 2011.11017, arXiv.org.
    2. Michael Allan Ribers & Hannes Ullrich, 2023. "Machine learning and physician prescribing: a path to reduced antibiotic use," Berlin School of Economics Discussion Papers 0019, Berlin School of Economics.
    3. Michael Allan Ribers & Hannes Ullrich, 2019. "Battling Antibiotic Resistance: Can Machine Learning Improve Prescribing?," Papers 1906.03044, arXiv.org.
    4. Shan Huang & Hannes Ullrich, 2023. "Provider effects in antibiotic prescribing: Evidence from physician exits," Berlin School of Economics Discussion Papers 0018, Berlin School of Economics.
    5. Attema, Arthur E. & Galizzi, Matteo M. & Groß, Mona & Hennig-Schmidt, Heike & Karay, Yassin & L’Haridon, Olivier & Wiesen, Daniel, 2023. "The formation of physician altruism," Journal of Health Economics, Elsevier, vol. 87(C).
    6. Shan Huang & Hannes Ullrich, 2021. "Physician Effects in Antibiotic Prescribing: Evidence from Physician Exits," CESifo Working Paper Series 9204, CESifo.
    7. Avdic, Daniel & Ivets, Maryna & Lagerqvist, Bo & Sriubaite, Ieva, 2023. "Providers, peers and patients. How do physicians’ practice environments affect patient outcomes?," Journal of Health Economics, Elsevier, vol. 89(C).
    8. Tafti, Elena Ashtari, 2023. "Technology, Skills, and Performance: The Case of Robots in Surgery," CINCH Working Paper Series (since 2020) 78746, Duisburg-Essen University Library, DuEPublico.
    9. Christian Posso & Jorge Tamayo & Arlen Guarin & Estefania Saravia, 2024. "Luck of the Draw: The Causal Effect of Physicians on Birth Outcomes," Borradores de Economia 1269, Banco de la Republica de Colombia.
    10. Diego A. Comin & Jonathan S. Skinner & Douglas O. Staiger, 2022. "Overconfidence and Technology Adoption in Health Care," NBER Working Papers 30345, National Bureau of Economic Research, Inc.
    11. Gautam Gowrisankaran & Keith Joiner & Pierre Thomas Léger, 2023. "Physician Practice Style and Healthcare Costs: Evidence from Emergency Departments," Management Science, INFORMS, vol. 69(6), pages 3202-3219, June.
    12. Ivan Badinski & Amy Finkelstein & Matthew Gentzkow & Peter Hull, 2023. "Geographic Variation in Healthcare Utilization: The Role of Physicians," NBER Working Papers 31749, National Bureau of Economic Research, Inc.
    13. Elena Ashtari Tafti, 2022. "Technology, skills, and performance: the case of robots in surgery," IFS Working Papers W22/46, Institute for Fiscal Studies.
    14. Simonsen, Marianne & Skipper, Lars & Skipper, Niels & Thingholm, Peter Rønø, 2021. "Discontinuity in care: Practice closures among primary care providers and patient health care utilization," Journal of Health Economics, Elsevier, vol. 80(C).
    15. Garbero, Alessandra & Sakos, Grayson & Cerulli, Giovanni, 2023. "Towards data-driven project design: Providing optimal treatment rules for development projects," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    16. Fadlon, Itzik & Van Parys, Jessica, 2020. "Primary care physician practice styles and patient care: Evidence from physician exits in Medicare," Journal of Health Economics, Elsevier, vol. 71(C).
    17. Shan Huang & Michael Allan Ribers & Hannes Ullrich, 2021. "The Value of Data for Prediction Policy Problems: Evidence from Antibiotic Prescribing," Discussion Papers of DIW Berlin 1939, DIW Berlin, German Institute for Economic Research.
    18. Barili, Emilia & Bertoli, Paola & Grembi, Veronica, 2021. "Neighborhoods, networks, and delivery methods," Journal of Health Economics, Elsevier, vol. 80(C).
    19. Peter Rønø Thingholm, 2023. "Provider Spill-Overs in Opioid Prescription Leniency and Patient – Labor Market Outcomes," Economics Working Papers 2023-05, Department of Economics and Business Economics, Aarhus University.
    20. Barrenho, Eliana & Miraldo, Marisa & Propper, Carol & Walsh, Brendan, 2021. "The importance of surgeons and their peers in adoption and diffusion of innovation: An observational study of laparoscopic colectomy adoption and diffusion in England," Social Science & Medicine, Elsevier, vol. 272(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bdp:dpaper:0027. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christian Reiter (email available below). General contact details of provider: https://edirc.repec.org/data/bdpemde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.