IDEAS home Printed from https://ideas.repec.org/a/zbw/espost/250060.html
   My bibliography  Save this article

People underestimate the errors made by algorithms for credit scoring and recidivism prediction but accept even fewer errors

Author

Listed:
  • Rebitschek, Felix G.
  • Gigerenzer, Gerd
  • Wagner, Gert G.

Abstract

This study provides the first representative analysis of error estimations and willingness to accept errors in a Western country (Germany) with regards to algorithmic decision-making systems (ADM). We examine people's expectations about the accuracy of algorithms that predict credit default, recidivism of an offender, suitability of a job applicant, and health behavior. Also, we ask whether expectations about algorithm errors vary between these domains and how they differ from expectations about errors made by human experts. In a nationwide representative study (N = 3086) we find that most respondents underestimated the actual errors made by algorithms and are willing to accept even fewer errors than estimated. Error estimates and error acceptance did not differ consistently for predictions made by algorithms or human experts, but people's living conditions (e.g. unemployment, household income) affected domain-specific acceptance (job suitability, credit defaulting) of misses and false alarms. We conclude that people have unwarranted expectations about the performance of ADM systems and evaluate errors in terms of potential personal consequences. Given the general public's low willingness to accept errors, we further conclude that acceptance of ADM appears to be conditional to strict accuracy requirements.

Suggested Citation

  • Rebitschek, Felix G. & Gigerenzer, Gerd & Wagner, Gert G., 2021. "People underestimate the errors made by algorithms for credit scoring and recidivism prediction but accept even fewer errors," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 11, pages 1-11.
  • Handle: RePEc:zbw:espost:250060
    DOI: 10.1038/s41598-021-99802-y
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/250060/1/s41598-021-99802-y.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41598-021-99802-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Chiara Longoni & Andrea Bonezzi & Carey K Morewedge, 2019. "Resistance to Medical Artificial Intelligence," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 46(4), pages 629-650.
    2. Victoria A. Shaffer & C. Adam Probst & Edgar C. Merkle & Hal R. Arkes & Mitchell A. Medow, 2013. "Why Do Patients Derogate Physicians Who Use a Computer-Based Diagnostic Support System?," Medical Decision Making, , vol. 33(1), pages 108-118, January.
    3. repec:cup:judgdm:v:3:y:2008:i::p:111-120 is not listed on IDEAS
    4. David Richter & Jürgen Schupp, 2015. "The SOEP Innovation Sample (SOEP IS)," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 135(3), pages 389-400.
    5. Logg, Jennifer M. & Minson, Julia A. & Moore, Don A., 2019. "Algorithm appreciation: People prefer algorithmic to human judgment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 90-103.
    6. Frey, Carl Benedikt & Osborne, Michael A., 2017. "The future of employment: How susceptible are jobs to computerisation?," Technological Forecasting and Social Change, Elsevier, vol. 114(C), pages 254-280.
    7. Stevenson, Megan T. & Doleac, Jennifer, 2019. "Algorithmic Risk Assessment in the Hands of Humans," IZA Discussion Papers 12853, Institute of Labor Economics (IZA).
    8. Esther Kaufmann & Werner W Wittmann, 2016. "The Success of Linear Bootstrapping Models: Decision Domain-, Expertise-, and Criterion-Specific Meta-Analysis," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-21, June.
    9. Jon Kleinberg & Himabindu Lakkaraju & Jure Leskovec & Jens Ludwig & Sendhil Mullainathan, 2018. "Human Decisions and Machine Predictions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 237-293.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ekaterina Novozhilova & Kate Mays & James E. Katz, 2024. "Looking towards an automated future: U.S. attitudes towards future artificial intelligence instantiations and their effect," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-11, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chugunova, Marina & Sele, Daniela, 2022. "We and It: An interdisciplinary review of the experimental evidence on how humans interact with machines," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 99(C).
    2. Ekaterina Jussupow & Kai Spohrer & Armin Heinzl & Joshua Gawlitza, 2021. "Augmenting Medical Diagnosis Decisions? An Investigation into Physicians’ Decision-Making Process with Artificial Intelligence," Information Systems Research, INFORMS, vol. 32(3), pages 713-735, September.
    3. Huang, Xiaozhi & Wu, Xitong & Cao, Xin & Wu, Jifei, 2023. "The effect of medical artificial intelligence innovation locus on consumer adoption of new products," Technological Forecasting and Social Change, Elsevier, vol. 197(C).
    4. Huang, Ming-Hui & Rust, Roland T., 2022. "A Framework for Collaborative Artificial Intelligence in Marketing," Journal of Retailing, Elsevier, vol. 98(2), pages 209-223.
    5. Siliang Tong & Nan Jia & Xueming Luo & Zheng Fang, 2021. "The Janus face of artificial intelligence feedback: Deployment versus disclosure effects on employee performance," Strategic Management Journal, Wiley Blackwell, vol. 42(9), pages 1600-1631, September.
    6. Bryce McLaughlin & Jann Spiess, 2022. "Algorithmic Assistance with Recommendation-Dependent Preferences," Papers 2208.07626, arXiv.org, revised Jan 2024.
    7. repec:cup:judgdm:v:15:y:2020:i:3:p:449-451 is not listed on IDEAS
    8. Kevin Bauer & Andrej Gill, 2024. "Mirror, Mirror on the Wall: Algorithmic Assessments, Transparency, and Self-Fulfilling Prophecies," Information Systems Research, INFORMS, vol. 35(1), pages 226-248, March.
    9. Chiara Longoni & Andrea Bonezzi & Carey K. Morewedge, 2020. "Resistance to medical artificial intelligence is an attribute in a compensatory decision process: response to Pezzo and Becksted (2020)," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 15(3), pages 446-448, May.
    10. Chen Yang & Jing Hu, 2022. "When do consumers prefer AI-enabled customer service? The interaction effect of brand personality and service provision type on brand attitudes and purchase intentions," Journal of Brand Management, Palgrave Macmillan, vol. 29(2), pages 167-189, March.
    11. Zhang, Lixuan & Yencha, Christopher, 2022. "Examining perceptions towards hiring algorithms," Technology in Society, Elsevier, vol. 68(C).
    12. Manav Raj & Robert Seamans, 2019. "Primer on artificial intelligence and robotics," Journal of Organization Design, Springer;Organizational Design Community, vol. 8(1), pages 1-14, December.
    13. Talia Gillis & Bryce McLaughlin & Jann Spiess, 2021. "On the Fairness of Machine-Assisted Human Decisions," Papers 2110.15310, arXiv.org, revised Sep 2023.
    14. Ming-Hui Huang & Roland T. Rust, 2021. "A strategic framework for artificial intelligence in marketing," Journal of the Academy of Marketing Science, Springer, vol. 49(1), pages 30-50, January.
    15. Yoan Hermstrüwer & Pascal Langenbach, 2022. "Fair Governance with Humans and Machines," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2022_04, Max Planck Institute for Research on Collective Goods, revised 01 Mar 2023.
    16. Said Kaawach & Oskar Kowalewski & Oleksandr Talavera, 2023. "Automatic vs Manual Investing: Role of Past Performance," Discussion Papers 23-04, Department of Economics, University of Birmingham.
    17. Sarah Spiekermann & Hanna Krasnova & Oliver Hinz & Annika Baumann & Alexander Benlian & Henner Gimpel & Irina Heimbach & Antonia Köster & Alexander Maedche & Björn Niehaves & Marten Risius & Manuel Tr, 2022. "Values and Ethics in Information Systems," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 64(2), pages 247-264, April.
    18. Martin Adam & Konstantin Roethke & Alexander Benlian, 2023. "Human vs. Automated Sales Agents: How and Why Customer Responses Shift Across Sales Stages," Information Systems Research, INFORMS, vol. 34(3), pages 1148-1168, September.
    19. Marina Chugunova & Wolfgang J. Luhan, 2022. "Ruled by robots: Preference for algorithmic decision makers and perceptions of their choices," Working Papers in Economics & Finance 2022-03, University of Portsmouth, Portsmouth Business School, Economics and Finance Subject Group.
    20. Wang, Cuicui & Li, Yiyang & Fu, Weizhong & Jin, Jia, 2023. "Whether to trust chatbots: Applying the event-related approach to understand consumers’ emotional experiences in interactions with chatbots in e-commerce," Journal of Retailing and Consumer Services, Elsevier, vol. 73(C).
    21. Bauer, Kevin & von Zahn, Moritz & Hinz, Oliver, 2022. "Expl(AI)ned: The impact of explainable Artificial Intelligence on cognitive processes," SAFE Working Paper Series 315, Leibniz Institute for Financial Research SAFE, revised 2022.

    More about this item

    Keywords

    Human behaviour; Information technolgy;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:espost:250060. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/zbwkide.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.