IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v70y2024i11p7617-7643.html
   My bibliography  Save this article

How Do Consumers Interact with Digital Expert Advice? Experimental Evidence from Health Insurance

Author

Listed:
  • M. Kate Bundorf

    (Duke University, Durham, North Carolina 27708; National Bureau of Economic Research, Cambridge, Massachusetts 02138)

  • Maria Polyakova

    (National Bureau of Economic Research, Cambridge, Massachusetts 02138; Stanford University, Stanford, California 94305)

  • Ming Tai-Seale

    (University of California San Diego, La Jolla, California 92093)

Abstract

Consumers increasingly use digital advice when making purchasing decisions. How do such tools change consumer behavior and what types of consumers are likely to use them? We examine these questions with a randomized controlled trial of digital expert advice in the context of prescription drug insurance. The intervention we study was effective at changing consumer choices. We propose that, conceptually, expert advice can affect consumer choices through two distinct channels: by updating consumer beliefs about product features (learning) and by influencing how much consumers value product features (interpretation). Using our trial data to estimate a model of consumer demand, we find that both channels are quantitatively important. Digital expert advice tools not only provide consumers with information, but also alter how consumers value product features. For example, consumers are willing to pay 14% less for a plan with the most popular brand and 37% less for an extra star rating when they incorporate digital expert advice on plan choice relative to only having information about product features. Further, we document substantial selection into the use of digital advice on two margins. Consumers who are inherently less active shoppers and those who we predict would have responded to advice more were less likely to demand it. Our results raise concerns regarding the ability of digital advice to alter consumer preferences as well as the distributional implications of greater access to digital expert advice.

Suggested Citation

  • M. Kate Bundorf & Maria Polyakova & Ming Tai-Seale, 2024. "How Do Consumers Interact with Digital Expert Advice? Experimental Evidence from Health Insurance," Management Science, INFORMS, vol. 70(11), pages 7617-7643, November.
  • Handle: RePEc:inm:ormnsc:v:70:y:2024:i:11:p:7617-7643
    DOI: 10.1287/mnsc.2020.02453
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2020.02453
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2020.02453?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kate Ho & Joseph Hogan & Fiona Scott Morton, 2017. "The impact of consumer inattention on insurer pricing in the Medicare Part D program," RAND Journal of Economics, RAND Corporation, vol. 48(4), pages 877-905, December.
    2. repec:mpr:mprres:7375 is not listed on IDEAS
    3. John P. Lightle, 2014. "The Paternalistic Bias of Expert Advice," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 23(4), pages 876-898, December.
    4. Loewenstein, George & Friedman, Joelle Y. & McGill, Barbara & Ahmad, Sarah & Linck, Suzanne & Sinkula, Stacey & Beshears, John & Choi, James J. & Kolstad, Jonathan & Laibson, David & Madrian, Brigitte, 2013. "Consumers’ misunderstanding of health insurance," Journal of Health Economics, Elsevier, vol. 32(5), pages 850-862.
    5. Jason Abaluck & Jonathan Gruber, 2011. "Choice Inconsistencies among the Elderly: Evidence from Plan Choice in the Medicare Part D Program," American Economic Review, American Economic Association, vol. 101(4), pages 1180-1210, June.
    6. Raluca M. Ursu, 2018. "The Power of Rankings: Quantifying the Effect of Rankings on Online Consumer Search and Purchase Decisions," Marketing Science, INFORMS, vol. 37(4), pages 530-552, August.
    7. Jeffrey R. Kling & Sendhil Mullainathan & Eldar Shafir & Lee C. Vermeulen & Marian V. Wrobel, 2012. "Comparison Friction: Experimental Evidence from Medicare Drug Plans," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(1), pages 199-235.
    8. Jason Abaluck & Jonathan Gruber, 2011. "Heterogeneity in Choice Inconsistencies among the Elderly: Evidence from Prescription Drug Plan Choice," American Economic Review, American Economic Association, vol. 101(3), pages 377-381, May.
    9. Jonathan D. Ketcham & Claudio Lucarelli & Eugenio J. Miravete & M. Christopher Roebuck, 2012. "Sinking, Swimming, or Learning to Swim in Medicare Part D," American Economic Review, American Economic Association, vol. 102(6), pages 2639-2673, October.
    10. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    11. Heiss, Florian & Leive, Adam & McFadden, Daniel & Winter, Joachim, 2013. "Plan selection in Medicare Part D: Evidence from administrative data," Journal of Health Economics, Elsevier, vol. 32(6), pages 1325-1344.
    12. Amy Finkelstein & Matthew J Notowidigdo, 2019. "Take-Up and Targeting: Experimental Evidence from SNAP," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1505-1556.
    13. Jonathan D. Ketcham & Claudio Lucarelli & Christopher A. Powers, 2015. "Paying Attention or Paying Too Much in Medicare Part D," American Economic Review, American Economic Association, vol. 105(1), pages 204-233, January.
    14. Stefano DellaVigna & Matthew Gentzkow, 2010. "Persuasion: Empirical Evidence," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 643-669, September.
    15. Nitin Mehta & Jian Ni & Kannan Srinivasan & Baohong Sun, 2017. "A Dynamic Model of Health Insurance Choices and Healthcare Consumption Decisions," Marketing Science, INFORMS, vol. 36(3), pages 338-360, May.
    16. Keane, Michael & Ketcham, Jonathan & Kuminoff, Nicolai & Neal, Timothy, 2021. "Evaluating consumers’ choices of Medicare Part D plans: A study in behavioral welfare economics," Journal of Econometrics, Elsevier, vol. 222(1), pages 107-140.
    17. Loewenstein, George & Friedman, Joelle Y. & McGill, Barbara & Ahmad, Sarah & Linck, Suzanne & Sinkula, Stacey & Beshears, John Leonard & Choi, James J. & Kolstad, Jonathan & Laibson, David I. & Madria, 2013. "Consumers’ Misunderstanding of Health Insurance," Scholarly Articles 17190506, Harvard University Department of Economics.
    18. Keith M. Marzilli Ericson, 2014. "Consumer Inertia and Firm Pricing in the Medicare Part D Prescription Drug Insurance Exchange," American Economic Journal: Economic Policy, American Economic Association, vol. 6(1), pages 38-64, February.
    19. Jonathan D. Ketcham & Nicolai V. Kuminoff & Christopher A. Powers, 2016. "Choice Inconsistencies among the Elderly: Evidence from Plan Choice in the Medicare Part D Program: Comment," American Economic Review, American Economic Association, vol. 106(12), pages 3932-3961, December.
    20. Benjamin R. Handel & Jonathan T. Kolstad, 2015. "Health Insurance for "Humans": Information Frictions, Plan Choice, and Consumer Welfare," American Economic Review, American Economic Association, vol. 105(8), pages 2449-2500, August.
    21. Maria Polyakova, 2016. "Regulation of Insurance with Adverse Selection and Switching Costs: Evidence from Medicare Part D," American Economic Journal: Applied Economics, American Economic Association, vol. 8(3), pages 165-195, July.
    22. Richard Domurat & Isaac Menashe & Wesley Yin, 2021. "The Role of Behavioral Frictions in Health Insurance Marketplace Enrollment and Risk: Evidence from a Field Experiment," American Economic Review, American Economic Association, vol. 111(5), pages 1549-1574, May.
    23. Fadlon, Itzik & Laibson, David, 2022. "Paternalism and pseudo-rationality: An illustration based on retirement savings," Journal of Public Economics, Elsevier, vol. 216(C).
    24. Sinaiko, Anna D. & Hirth, Richard A., 2011. "Consumers, health insurance and dominated choices," Journal of Health Economics, Elsevier, vol. 30(2), pages 450-457, March.
    25. Florian Heiss & Daniel McFadden & Joachim Winter & Amelie Wuppermann & Bo Zhou, 2021. "Inattention and Switching Costs as Sources of Inertia in Medicare Part D," American Economic Review, American Economic Association, vol. 111(9), pages 2737-2781, September.
    26. Jason Abaluck & Jonathan Gruber, 2016. "Evolving Choice Inconsistencies in Choice of Prescription Drug Insurance," American Economic Review, American Economic Association, vol. 106(8), pages 2145-2184, August.
    27. Saurabh Bhargava & George Loewenstein & Justin Sydnor, 2017. "Choose to Lose: Health Plan Choices from a Menu with Dominated Option," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(3), pages 1319-1372.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. M. Kate Bundorf & Maria Polyakova & Ming Tai-Seale, 2019. "How do Humans Interact with Algorithms? Experimental Evidence from Health Insurance," NBER Working Papers 25976, National Bureau of Economic Research, Inc.
    2. Kaufmann, Cornel & Müller, Tobias & Hefti, Andreas & Boes, Stefan, 2018. "Does personalized information improve health plan choices when individuals are distracted?," Journal of Economic Behavior & Organization, Elsevier, vol. 149(C), pages 197-214.
    3. Drake, Coleman & Ryan, Conor & Dowd, Bryan, 2022. "Sources of inertia in the individual health insurance market," Journal of Public Economics, Elsevier, vol. 208(C).
    4. Martin Gaynor & Kate Ho & Robert J. Town, 2015. "The Industrial Organization of Health-Care Markets," Journal of Economic Literature, American Economic Association, vol. 53(2), pages 235-284, June.
    5. Florian Heiss & Daniel McFadden & Joachim Winter & Amelie Wuppermann & Bo Zhou, 2016. "Inattention and Switching Costs as Sources of Inertia in Medicare Part D," NBER Working Papers 22765, National Bureau of Economic Research, Inc.
    6. Nathan Kettlewell, 2020. "Policy Choice and Product Bundling in a Complicated Health Insurance Market: Do People Get It Right?," Journal of Human Resources, University of Wisconsin Press, vol. 55(2), pages 566-610.
    7. Nathaniel Hendren & Camille Landais & Johannes Spinnewijn, 2021. "Choice in Insurance Markets: A Pigouvian Approach to Social Insurance Design," Annual Review of Economics, Annual Reviews, vol. 13(1), pages 457-486, August.
    8. Tomas Pedro Sanguinetti, 2019. "How Do Couples Choose Individual Insurance Plans? Evidence from Medicare Part D," 2019 Papers psa1760, Job Market Papers.
    9. Anell, Anders & Dietrichson, Jens & Ellegård, Lina Maria & Kjellsson, Gustav, 2021. "Information, switching costs, and consumer choice: Evidence from two randomised field experiments in Swedish primary health care," Journal of Public Economics, Elsevier, vol. 196(C).
    10. Keane, Michael & Ketcham, Jonathan & Kuminoff, Nicolai & Neal, Timothy, 2021. "Evaluating consumers’ choices of Medicare Part D plans: A study in behavioral welfare economics," Journal of Econometrics, Elsevier, vol. 222(1), pages 107-140.
    11. Christian Biener & Lan Zou, 2024. "More options, more problems? Lost in the health insurance maze," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 91(1), pages 5-35, March.
    12. Abaluck, Jason & Gruber, Jonathan & Swanson, Ashley, 2018. "Prescription drug use under Medicare Part D: A linear model of nonlinear budget sets," Journal of Public Economics, Elsevier, vol. 164(C), pages 106-138.
    13. Dahl, Gordon B. & Forbes, Silke J., 2023. "Doctor switching costs," Journal of Public Economics, Elsevier, vol. 221(C).
    14. Jonathan D. Ketcham & Nicolai V. Kuminoff & Christopher A. Powers, 2016. "Estimating the Heterogeneous Welfare Effects of Choice Architecture: An Application to the Medicare Prescription Drug Insurance Market," NBER Working Papers 22732, National Bureau of Economic Research, Inc.
    15. Tamara Bischof & Michael Gerfin & Tobias Mueller, 2021. "Attention Please! Health Plan Choice and (In-)Attention," Diskussionsschriften dp2111, Universitaet Bern, Departement Volkswirtschaft.
    16. Francesco Decarolis & Maria Polyakova & Stephen P. Ryan, 2020. "Subsidy Design in Privately Provided Social Insurance: Lessons from Medicare Part D," Journal of Political Economy, University of Chicago Press, vol. 128(5), pages 1712-1752.
    17. Kate Ho & Joseph Hogan & Fiona Scott Morton, 2017. "The impact of consumer inattention on insurer pricing in the Medicare Part D program," RAND Journal of Economics, RAND Corporation, vol. 48(4), pages 877-905, December.
    18. Francesco Decarolis & Andrea Guglielmo & Clavin Luscombe, 2020. "Open enrollment periods and plan choices," Health Economics, John Wiley & Sons, Ltd., vol. 29(7), pages 733-747, July.
    19. Chorniy, Anna & Miller, Daniel & Tang, Tilan, 2020. "Mergers in Medicare Part D: Assessing market power, cost efficiencies, and bargaining power," International Journal of Industrial Organization, Elsevier, vol. 68(C).
    20. Abeler, Johannes & Huffman, David B. & Raymond, Collin, 2023. "Incentive Complexity, Bounded Rationality and Effort Provision," IZA Discussion Papers 16284, Institute of Labor Economics (IZA).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:70:y:2024:i:11:p:7617-7643. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.