IDEAS home Printed from https://ideas.repec.org/a/kap/jbuset/v178y2022i4d10.1007_s10551-022-05055-8.html
   My bibliography  Save this article

From Reality to World. A Critical Perspective on AI Fairness

Author

Listed:
  • Jean-Marie John-Mathews

    (Université Paris-Saclay, Univ Evry, IMT-BS, LITEM)

  • Dominique Cardon

    (Sciences Po)

  • Christine Balagué

    (Université Paris-Saclay, Univ Evry, IMT-BS, LITEM)

Abstract

Fairness of Artificial Intelligence (AI) decisions has become a big challenge for governments, companies, and societies. We offer a theoretical contribution to consider AI ethics outside of high-level and top-down approaches, based on the distinction between “reality” and “world” from Luc Boltanski. To do so, we provide a new perspective on the debate on AI fairness and show that criticism of ML unfairness is “realist”, in other words, grounded in an already instituted reality based on demographic categories produced by institutions. Second, we show that the limits of “realist” fairness corrections lead to the elaboration of “radical responses” to fairness, that is, responses that radically change the format of data. Third, we show that fairness correction is shifting to a “domination regime” that absorbs criticism, and we provide some theoretical and practical avenues for further development in AI ethics. Using an ad hoc critical space stabilized by reality tests alongside the algorithm, we build a shared responsibility model which is compatible with the radical response to fairness issues. Finally, this paper shows the fundamental contribution of pragmatic sociology theories, insofar as they afford a social and political perspective on AI ethics by giving an active role to material actors such as database formats on ethical debates. In a context where data are increasingly numerous, granular, and behavioral, it is essential to renew our conception of AI ethics on algorithms in order to establish new models of responsibility for companies that take into account changes in the computing paradigm.

Suggested Citation

  • Jean-Marie John-Mathews & Dominique Cardon & Christine Balagué, 2022. "From Reality to World. A Critical Perspective on AI Fairness," Journal of Business Ethics, Springer, vol. 178(4), pages 945-959, July.
  • Handle: RePEc:kap:jbuset:v:178:y:2022:i:4:d:10.1007_s10551-022-05055-8
    DOI: 10.1007/s10551-022-05055-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10551-022-05055-8
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s10551-022-05055-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. D. J. Hand & W. E. Henley, 1997. "Statistical Classification Methods in Consumer Credit Scoring: a Review," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 160(3), pages 523-541, September.
    2. Anja Lambrecht & Catherine Tucker, 2019. "Algorithmic Bias? An Empirical Study of Apparent Gender-Based Discrimination in the Display of STEM Career Ads," Management Science, INFORMS, vol. 65(7), pages 2966-2981, July.
    3. Hamsa Bastani & Mohsen Bayati, 2020. "Online Decision Making with High-Dimensional Covariates," Operations Research, INFORMS, vol. 68(1), pages 276-294, January.
    4. Pascal Dey & Othmar Lehner, 2017. "Registering Ideology in the Creation of Social Entrepreneurs: Intermediary Organizations, ‘Ideal Subject’ and the Promise of Enjoyment," Journal of Business Ethics, Springer, vol. 142(4), pages 753-767, June.
    5. Mireille Mercier-Roy & Chantale Mailhot, 2019. "What’s in an App? Investigating the Moral Struggles Behind a Sharing Economy Device," Journal of Business Ethics, Springer, vol. 159(4), pages 977-996, November.
    6. Kirsten Martin & R. Freeman, 2004. "The Separation of Technology and Ethics in Business Ethics," Journal of Business Ethics, Springer, vol. 53(4), pages 353-364, September.
    7. Kate Crawford & Ryan Calo, 2016. "There is a blind spot in AI research," Nature, Nature, vol. 538(7625), pages 311-313, October.
    8. Kirsten Martin, 2019. "Ethical Implications and Accountability of Algorithms," Journal of Business Ethics, Springer, vol. 160(4), pages 835-850, December.
    9. Aurélie Leclercq-Vandelannoitte & Emmanuel Bertin, 2018. "From sovereign IT governance to liberal IT governmentality? A Foucauldian analogy," European Journal of Information Systems, Taylor & Francis Journals, vol. 27(3), pages 326-346, May.
    10. Jean-Marie John-Mathews, 2022. "Some critical and ethical perspectives on the empirical turn of AI interpretability," Post-Print hal-03395823, HAL.
    11. Ulrich Leicht-Deobald & Thorsten Busch & Christoph Schank & Antoinette Weibel & Simon Schafheitle & Isabelle Wildhaber & Gabriel Kasper, 2019. "The Challenges of Algorithm-Based HR Decision-Making for Personal Integrity," Journal of Business Ethics, Springer, vol. 160(2), pages 377-392, December.
    12. Jon Kleinberg & Himabindu Lakkaraju & Jure Leskovec & Jens Ludwig & Sendhil Mullainathan, 2018. "Human Decisions and Machine Predictions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 237-293.
    13. John-Mathews, Jean-Marie, 2022. "Some critical and ethical perspectives on the empirical turn of AI interpretability," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maude Lavanchy & Patrick Reichert & Jayanth Narayanan & Krishna Savani, 2023. "Applicants’ Fairness Perceptions of Algorithm-Driven Hiring Procedures," Journal of Business Ethics, Springer, vol. 188(1), pages 125-150, November.
    2. Benjamin Semujanga & Xavier Parent-Rocheleau, 2024. "Time-Based Stress and Procedural Justice: Can Transparency Mitigate the Effects of Algorithmic Compensation in Gig Work?," IJERPH, MDPI, vol. 21(1), pages 1-16, January.
    3. Manis, K.T. & Madhavaram, Sreedhar, 2023. "AI-Enabled marketing capabilities and the hierarchy of capabilities: Conceptualization, proposition development, and research avenues," Journal of Business Research, Elsevier, vol. 157(C).
    4. Zirar, Araz & Ali, Syed Imran & Islam, Nazrul, 2023. "Worker and workplace Artificial Intelligence (AI) coexistence: Emerging themes and research agenda," Technovation, Elsevier, vol. 124(C).
    5. Chen, Xun-Qi & Ma, Chao-Qun & Ren, Yi-Shuai & Lei, Yu-Tian & Huynh, Ngoc Quang Anh & Narayan, Seema, 2023. "Explainable artificial intelligence in finance: A bibliometric review," Finance Research Letters, Elsevier, vol. 56(C).
    6. Behera, Rajat Kumar & Bala, Pradip Kumar & Rana, Nripendra P. & Irani, Zahir, 2023. "Responsible natural language processing: A principlist framework for social benefits," Technological Forecasting and Social Change, Elsevier, vol. 188(C).
    7. Clément Dubreuil & Delphine Dion & Stéphane Borraz, 2023. "For the Love of the Game: Moral Ambivalence and Justification Work in Consuming Violence," Journal of Business Ethics, Springer, vol. 186(3), pages 675-694, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maria Figueroa-Armijos & Brent B. Clark & Serge P. da Motta Veiga, 2023. "Ethical Perceptions of AI in Hiring and Organizational Trust: The Role of Performance Expectancy and Social Influence," Journal of Business Ethics, Springer, vol. 186(1), pages 179-197, August.
    2. Maude Lavanchy & Patrick Reichert & Jayanth Narayanan & Krishna Savani, 2023. "Applicants’ Fairness Perceptions of Algorithm-Driven Hiring Procedures," Journal of Business Ethics, Springer, vol. 188(1), pages 125-150, November.
    3. Chenfeng Yan & Quan Chen & Xinyue Zhou & Xin Dai & Zhilin Yang, 2024. "When the Automated fire Backfires: The Adoption of Algorithm-based HR Decision-making Could Induce Consumer’s Unfavorable Ethicality Inferences of the Company," Journal of Business Ethics, Springer, vol. 190(4), pages 841-859, April.
    4. Sarah Spiekermann & Hanna Krasnova & Oliver Hinz & Annika Baumann & Alexander Benlian & Henner Gimpel & Irina Heimbach & Antonia Köster & Alexander Maedche & Björn Niehaves & Marten Risius & Manuel Tr, 2022. "Values and Ethics in Information Systems," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 64(2), pages 247-264, April.
    5. Lily Morse & Mike Horia M. Teodorescu & Yazeed Awwad & Gerald C. Kane, 2022. "Do the Ends Justify the Means? Variation in the Distributive and Procedural Fairness of Machine Learning Algorithms," Journal of Business Ethics, Springer, vol. 181(4), pages 1083-1095, December.
    6. Florian Pethig & Julia Kroenung, 2023. "Biased Humans, (Un)Biased Algorithms?," Journal of Business Ethics, Springer, vol. 183(3), pages 637-652, March.
    7. Stephanie Kelley, 2022. "Employee Perceptions of the Effective Adoption of AI Principles," Journal of Business Ethics, Springer, vol. 178(4), pages 871-893, July.
    8. Klockmann, Victor & von Schenk, Alicia & Villeval, Marie Claire, 2022. "Artificial intelligence, ethics, and intergenerational responsibility," Journal of Economic Behavior & Organization, Elsevier, vol. 203(C), pages 284-317.
    9. Chen, Xun-Qi & Ma, Chao-Qun & Ren, Yi-Shuai & Lei, Yu-Tian & Huynh, Ngoc Quang Anh & Narayan, Seema, 2023. "Explainable artificial intelligence in finance: A bibliometric review," Finance Research Letters, Elsevier, vol. 56(C).
    10. Alina Köchling & Marius Claus Wehner, 2020. "Discriminated by an algorithm: a systematic review of discrimination and fairness by algorithmic decision-making in the context of HR recruitment and HR development," Business Research, Springer;German Academic Association for Business Research, vol. 13(3), pages 795-848, November.
    11. Wencheng Lu, 2024. "Inevitable challenges of autonomy: ethical concerns in personalized algorithmic decision-making," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-9, December.
    12. Suen, Hung-Yue & Hung, Kuo-En, 2024. "Revealing the influence of AI and its interfaces on job candidates' honest and deceptive impression management in asynchronous video interviews," Technological Forecasting and Social Change, Elsevier, vol. 198(C).
    13. Behera, Rajat Kumar & Bala, Pradip Kumar & Rana, Nripendra P. & Irani, Zahir, 2023. "Responsible natural language processing: A principlist framework for social benefits," Technological Forecasting and Social Change, Elsevier, vol. 188(C).
    14. Runshan Fu & Ginger Zhe Jin & Meng Liu, 2022. "Does Human-algorithm Feedback Loop Lead to Error Propagation? Evidence from Zillow’s Zestimate," NBER Working Papers 29880, National Bureau of Economic Research, Inc.
    15. Bauer, Kevin & Pfeuffer, Nicolas & Abdel-Karim, Benjamin M. & Hinz, Oliver & Kosfeld, Michael, 2020. "The terminator of social welfare? The economic consequences of algorithmic discrimination," SAFE Working Paper Series 287, Leibniz Institute for Financial Research SAFE.
    16. Peter Seele & Mario D. Schultz, 2022. "From Greenwashing to Machinewashing: A Model and Future Directions Derived from Reasoning by Analogy," Journal of Business Ethics, Springer, vol. 178(4), pages 1063-1089, July.
    17. Maria De‐Arteaga & Stefan Feuerriegel & Maytal Saar‐Tsechansky, 2022. "Algorithmic fairness in business analytics: Directions for research and practice," Production and Operations Management, Production and Operations Management Society, vol. 31(10), pages 3749-3770, October.
    18. Marie-Pierre Dargnies & Rustamdjan Hakimov & Dorothea Kübler, 2022. "Aversion to Hiring Algorithms: Transparency, Gender Profiling, and Self-Confidence," CESifo Working Paper Series 9968, CESifo.
    19. Jean-Philippe Deranty & Thomas Corbin, 2022. "Artificial Intelligence and work: a critical review of recent research from the social sciences," Papers 2204.00419, arXiv.org.
    20. Aurélie Leclercq-Vandelannoitte, 2019. "Is Employee Technological “Ill-Being” Missing from Corporate Responsibility? The Foucauldian Ethics of Ubiquitous IT Uses in Organizations," Journal of Business Ethics, Springer, vol. 160(2), pages 339-361, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:jbuset:v:178:y:2022:i:4:d:10.1007_s10551-022-05055-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.