IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v13y2022i1d10.1038_s41467-022-33417-3.html
   My bibliography  Save this article

Public attitudes value interpretability but prioritize accuracy in Artificial Intelligence

Author

Listed:
  • Anne-Marie Nussberger

    (Max Planck Institute for Human Development)

  • Lan Luo

    (Columbia Business School)

  • L. Elisa Celis

    (Yale University)

  • M. J. Crockett

    (Princeton University)

Abstract

As Artificial Intelligence (AI) proliferates across important social institutions, many of the most powerful AI systems available are difficult to interpret for end-users and engineers alike. Here, we sought to characterize public attitudes towards AI interpretability. Across seven studies (N = 2475), we demonstrate robust and positive attitudes towards interpretable AI among non-experts that generalize across a variety of real-world applications and follow predictable patterns. Participants value interpretability positively across different levels of AI autonomy and accuracy, and rate interpretability as more important for AI decisions involving high stakes and scarce resources. Crucially, when AI interpretability trades off against AI accuracy, participants prioritize accuracy over interpretability under the same conditions driving positive attitudes towards interpretability in the first place: amidst high stakes and scarce resources. These attitudes could drive a proliferation of AI systems making high-impact ethical decisions that are difficult to explain and understand.

Suggested Citation

  • Anne-Marie Nussberger & Lan Luo & L. Elisa Celis & M. J. Crockett, 2022. "Public attitudes value interpretability but prioritize accuracy in Artificial Intelligence," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
  • Handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-33417-3
    DOI: 10.1038/s41467-022-33417-3
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-022-33417-3
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-022-33417-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. John Horton & David Rand & Richard Zeckhauser, 2011. "The online laboratory: conducting experiments in a real labor market," Experimental Economics, Springer;Economic Science Association, vol. 14(3), pages 399-425, September.
    2. Jon Kleinberg & Jens Ludwig & Sendhil Mullainathan & Cass R. Sunstein, 2019. "Discrimination In The Age Of Algorithms," NBER Working Papers 25548, National Bureau of Economic Research, Inc.
    3. Hsee, Christopher K., 1996. "The Evaluability Hypothesis: An Explanation for Preference Reversals between Joint and Separate Evaluations of Alternatives," Organizational Behavior and Human Decision Processes, Elsevier, vol. 67(3), pages 247-257, September.
    4. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    5. Edmond Awad & Sohan Dsouza & Richard Kim & Jonathan Schulz & Joseph Henrich & Azim Shariff & Jean-François Bonnefon & Iyad Rahwan, 2018. "The Moral Machine experiment," Nature, Nature, vol. 563(7729), pages 59-64, November.
    6. Romain Cadario & Chiara Longoni & Carey K. Morewedge, 2021. "Understanding, explaining, and utilizing medical artificial intelligence," Nature Human Behaviour, Nature, vol. 5(12), pages 1636-1642, December.
    7. Logg, Jennifer M. & Minson, Julia A. & Moore, Don A., 2019. "Algorithm appreciation: People prefer algorithmic to human judgment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 90-103.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sun, Weixin & Zhang, Xuantao & Li, Minghao & Wang, Yong, 2023. "Interpretable high-stakes decision support system for credit default forecasting," Technological Forecasting and Social Change, Elsevier, vol. 196(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Charles Changchuan Jiang & Liana Fraenkel, 2017. "The Influence of Varying Cost Formats on Preferences," Medical Decision Making, , vol. 37(1), pages 17-26, January.
    2. Bryce McLaughlin & Jann Spiess, 2022. "Algorithmic Assistance with Recommendation-Dependent Preferences," Papers 2208.07626, arXiv.org, revised Jan 2024.
    3. Klockmann, Victor & von Schenk, Alicia & Villeval, Marie Claire, 2022. "Artificial intelligence, ethics, and intergenerational responsibility," Journal of Economic Behavior & Organization, Elsevier, vol. 203(C), pages 284-317.
    4. Thomas Kourouxous & Thomas Bauer, 2019. "Violations of dominance in decision-making," Business Research, Springer;German Academic Association for Business Research, vol. 12(1), pages 209-239, April.
    5. A. Peter McGraw & Eldar Shafir & Alexander Todorov, 2010. "Valuing Money and Things: Why a $20 Item Can Be Worth More and Less Than $20," Management Science, INFORMS, vol. 56(5), pages 816-830, May.
    6. Ronayne, David & Sgroi, Daniel & Tuckwell, Anthony, 2021. "Evaluating the sunk cost effect," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 318-327.
    7. Huber, Joel & Viscusi, W. Kip & Bell, Jason, 2008. "Reference dependence in iterative choices," Organizational Behavior and Human Decision Processes, Elsevier, vol. 106(2), pages 143-152, July.
    8. Garbarino, Ellen & Slonim, Robert & Villeval, Marie Claire, 2019. "Loss aversion and lying behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 158(C), pages 379-393.
    9. repec:cup:judgdm:v:3:y:2008:i::p:425-434 is not listed on IDEAS
    10. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    11. Wells, Rachael E. & Iyengar, Sheena S., 2005. "Positive illusions of preference consistency: When remaining eluded by one's preferences yields greater subjective well-being and decision outcomes," Organizational Behavior and Human Decision Processes, Elsevier, vol. 98(1), pages 66-87, September.
    12. Jonathan de Quidt, 2018. "Your Loss Is My Gain: A Recruitment Experiment with Framed Incentives," Journal of the European Economic Association, European Economic Association, vol. 16(2), pages 522-559.
    13. Shai Davidai & Thomas Gilovich, 2018. "How should we think about Americans’ beliefs about economic mobility?," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 13(3), pages 297-304, May.
    14. France Leclerc & Christopher K. Hsee & Joseph C. Nunes, 2005. "Narrow Focusing: Why the Relative Position of a Good in Its Category Matters More Than It Should," Marketing Science, INFORMS, vol. 24(2), pages 194-205, August.
    15. Ellen Garbarino & Robert Slonim & Marie Claire Villeval, 2016. "Loss Aversion and lying behavior: Theory, estimation and empirical evidence," Working Papers halshs-01404333, HAL.
    16. Fehr, Ernst & Hoff, Karla, 2011. "Tastes, castes, and culture : the influence of society on preferences," Policy Research Working Paper Series 5760, The World Bank.
    17. Weber, Bethany J. & Chapman, Gretchen B., 2005. "The combined effects of risk and time on choice: Does uncertainty eliminate the immediacy effect? Does delay eliminate the certainty effect?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 96(2), pages 104-118, March.
    18. Johannes G. Jaspersen & Marc A. Ragin & Justin R. Sydnor, 2022. "Insurance demand experiments: Comparing crowdworking to the lab," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 89(4), pages 1077-1107, December.
    19. Charness, Gary & Gneezy, Uri & Kuhn, Michael A., 2012. "Experimental methods: Between-subject and within-subject design," Journal of Economic Behavior & Organization, Elsevier, vol. 81(1), pages 1-8.
    20. Gerrit Antonides & Lies Hovestadt, 2021. "Product Attributes, Evaluability, and Consumer Satisfaction," Sustainability, MDPI, vol. 13(22), pages 1-20, November.
    21. de Quidt, Jonathan, 2014. "Your loss is my gain: a recruitment experiment with framed incentives," LSE Research Online Documents on Economics 58208, London School of Economics and Political Science, LSE Library.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-33417-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.