IDEAS home Printed from https://ideas.repec.org/a/spr/binfse/v64y2022i3d10.1007_s12599-021-00716-w.html
   My bibliography  Save this article

The Cost of Fairness in AI: Evidence from E-Commerce

Author

Listed:
  • Moritz Zahn

    (Goethe University Frankfurt
    ETH Zurich)

  • Stefan Feuerriegel

    (ETH Zurich)

  • Niklas Kuehl

    (Karlsruhe Institute of Technology)

Abstract

Contemporary information systems make widespread use of artificial intelligence (AI). While AI offers various benefits, it can also be subject to systematic errors, whereby people from certain groups (defined by gender, age, or other sensitive attributes) experience disparate outcomes. In many AI applications, disparate outcomes confront businesses and organizations with legal and reputational risks. To address these, technologies for so-called “AI fairness” have been developed, by which AI is adapted such that mathematical constraints for fairness are fulfilled. However, the financial costs of AI fairness are unclear. Therefore, the authors develop AI fairness for a real-world use case from e-commerce, where coupons are allocated according to clickstream sessions. In their setting, the authors find that AI fairness successfully manages to adhere to fairness requirements, while reducing the overall prediction performance only slightly. However, they find that AI fairness also results in an increase in financial cost. Thus, in this way the paper’s findings contribute to designing information systems on the basis of AI fairness.

Suggested Citation

  • Moritz Zahn & Stefan Feuerriegel & Niklas Kuehl, 2022. "The Cost of Fairness in AI: Evidence from E-Commerce," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 64(3), pages 335-348, June.
    • Handle: RePEc:spr:binfse:v:64:y:2022:i:3:d:10.1007_s12599-021-00716-w
    DOI: 10.1007/s12599-021-00716-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s12599-021-00716-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s12599-021-00716-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. repec:nas:journl:v:115:y:2018:p:e3635-e3644 is not listed on IDEAS
    2. Alexander Maedche & Christine Legner & Alexander Benlian & Benedikt Berger & Henner Gimpel & Thomas Hess & Oliver Hinz & Stefan Morana & Matthias Söllner, 2019. "AI-Based Digital Assistants," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 61(4), pages 535-544, August.
    3. Alan L. Montgomery & Shibo Li & Kannan Srinivasan & John C. Liechty, 2004. "Modeling Online Browsing and Path Analysis Using Clickstream Data," Marketing Science, INFORMS, vol. 23(4), pages 579-595, November.
    4. Anja Lambrecht & Catherine Tucker, 2019. "Algorithmic Bias? An Empirical Study of Apparent Gender-Based Discrimination in the Display of STEM Career Ads," Management Science, INFORMS, vol. 65(7), pages 2966-2981, July.
    5. Kraus, Mathias & Feuerriegel, Stefan & Oztekin, Asil, 2020. "Deep learning in business analytics and operations research: Models, applications and managerial implications," European Journal of Operational Research, Elsevier, vol. 281(3), pages 628-641.
    6. Annika Baumann & Johannes Haupt & Fabian Gebert & Stefan Lessmann, 2019. "The Price of Privacy," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 61(4), pages 413-431, August.
    7. Amy Wenxuan Ding & Shibo Li & Patrali Chatterjee, 2015. "Learning User Real-Time Intent for Optimal Dynamic Web Page Transformation," Information Systems Research, INFORMS, vol. 26(2), pages 339-359, June.
    8. K. W. De Bock & D. Van Den Poel & S. Manigart, 2009. "Predicting web site audience demographics for web advertising targeting using multi-web site clickstream data," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 09/618, Ghent University, Faculty of Economics and Business Administration.
    9. McDowell, William C. & Wilson, Rachel C. & Kile, Charles Owen, 2016. "An examination of retail website design and conversion rate," Journal of Business Research, Elsevier, vol. 69(11), pages 4837-4842.
    10. Imke Reimers & Claire (Chunying) Xie, 2019. "Do Coupons Expand or Cannibalize Revenue? Evidence from an e-Market," Management Science, INFORMS, vol. 65(1), pages 286-300, January.
    11. Veale, Michael & Binns, Reuben, 2017. "Fairer machine learning in the real world: Mitigating discrimination without collecting sensitive data," SocArXiv ustxg, Center for Open Science.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ana Alina Tudoran, 2022. "A machine learning approach to identifying decision-making styles for managing customer relationships," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(1), pages 351-374, March.
    2. Alina Köchling & Marius Claus Wehner, 2020. "Discriminated by an algorithm: a systematic review of discrimination and fairness by algorithmic decision-making in the context of HR recruitment and HR development," Business Research, Springer;German Academic Association for Business Research, vol. 13(3), pages 795-848, November.
    3. Shaohui Wu & Yong Tan & Yubo Chen & Yitian (Sky) Liang, 2022. "How Is Mobile User Behavior Different? A Hidden Markov Model of Cross-Mobile Application Usage Dynamics," Information Systems Research, INFORMS, vol. 33(3), pages 1002-1022, September.
    4. Christof Naumzik & Stefan Feuerriegel & Markus Weinmann, 2022. "I Will Survive: Predicting Business Failures from Customer Ratings," Marketing Science, INFORMS, vol. 41(1), pages 188-207, January.
    5. Chenshuo Sun & Panagiotis Adamopoulos & Anindya Ghose & Xueming Luo, 2022. "Predicting Stages in Omnichannel Path to Purchase: A Deep Learning Model," Information Systems Research, INFORMS, vol. 33(2), pages 429-445, June.
    6. Sheng, Jie & Amankwah-Amoah, Joseph & Wang, Xiaojun, 2019. "Technology in the 21st century: New challenges and opportunities," Technological Forecasting and Social Change, Elsevier, vol. 143(C), pages 321-335.
    7. Morgan Swink & Kejia Hu & Xiande Zhao, 2022. "Analytics applications, limitations, and opportunities in restaurant supply chains," Production and Operations Management, Production and Operations Management Society, vol. 31(10), pages 3710-3726, October.
    8. Felix Chopra & Ingar Haaland, 2023. "Conducting qualitative interviews with AI," CEBI working paper series 23-06, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    9. Babur De los Santos & Sergei Koulayev, 2017. "Optimizing Click-Through in Online Rankings with Endogenous Search Refinement," Marketing Science, INFORMS, vol. 36(4), pages 542-564, July.
    10. Otis, Nicholas G. & Cranney, Katelyn & Delecourt, Solene & Koning, Rembrand, 2024. "Global Evidence on Gender Gaps and Generative AI," OSF Preprints h6a7c, Center for Open Science.
    11. Bauer, Kevin & Gill, Andrej, 2021. "Mirror, mirror on the wall: Machine predictions and self-fulfilling prophecies," SAFE Working Paper Series 313, Leibniz Institute for Financial Research SAFE.
    12. Carattini, Stefano & Gillingham, Kenneth & Meng, Xiangyu & Yoeli, Erez, 2024. "Peer-to-peer solar and social rewards: Evidence from a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 219(C), pages 340-370.
    13. Martinovici, A., 2019. "Revealing attention - how eye movements predict brand choice and moment of choice," Other publications TiSEM 7dca38a5-9f78-4aee-bd81-c, Tilburg University, School of Economics and Management.
    14. Stefan Feuerriegel & Mateusz Dolata & Gerhard Schwabe, 2020. "Fair AI," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 62(4), pages 379-384, August.
    15. Yanwen Wang & Chunhua Wu & Ting Zhu, 2019. "Mobile Hailing Technology and Taxi Driving Behaviors," Marketing Science, INFORMS, vol. 38(5), pages 734-755, September.
    16. Roy, Gobinda & Sharma, Swati, 2021. "Measuring the role of factors on website effectiveness using vector autoregressive model," Journal of Retailing and Consumer Services, Elsevier, vol. 62(C).
    17. Amy Wenxuan Ding & Shibo Li & Patrali Chatterjee, 2015. "Learning User Real-Time Intent for Optimal Dynamic Web Page Transformation," Information Systems Research, INFORMS, vol. 26(2), pages 339-359, June.
    18. Philippe Jardin, 2023. "Designing topological data to forecast bankruptcy using convolutional neural networks," Annals of Operations Research, Springer, vol. 325(2), pages 1291-1332, June.
    19. Laura Abrardi & Carlo Cambini & Laura Rondi, 2022. "Artificial intelligence, firms and consumer behavior: A survey," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 969-991, September.
    20. Gahm, Christian & Uzunoglu, Aykut & Wahl, Stefan & Ganschinietz, Chantal & Tuma, Axel, 2022. "Applying machine learning for the anticipation of complex nesting solutions in hierarchical production planning," European Journal of Operational Research, Elsevier, vol. 296(3), pages 819-836.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:binfse:v:64:y:2022:i:3:d:10.1007_s12599-021-00716-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.