IDEAS home Printed from https://ideas.repec.org/p/zbw/itsb21/238032.html
   My bibliography  Save this paper

Bias in Algorithms: On the trade-off between accuracy and fairness

Author

Listed:
  • Janssen, Patrick
  • Sadowski, Bert M.

Abstract

Within the discussion on bias in algorithmic selection, fairness interventions are increasingly becoming a popular means to generate more socially responsible outcomes. The paper uses a modified framework based on Rambachan et. al. (2020) to empirically investigate the extent to which bias mitigation techniques can provide a more socially responsible outcome and prevent bias in algorithms. In using the algorithmic auditing tool AI Fairness 360 on a synthetically biased dataset, the paper applies different bias mitigation techniques at the preprocessing, inprocessing and postprocessing stage of algorithmic selection to account for fairness. The data analysis has been aimed at detecting violations of group fairness definitions in trained classifiers. In contrast to previous research, the empirical analysis focusses on the outcomes produced by decisions and the incentives problems behind fairness. The paper showed that binary classifiers trained on synthetically generated biased data while treating algorithms with bias mitigation techniques leads to a decrease in both social welfare and predictive accuracy in 43% of the cases tested. The results of our empirical study demonstrated that fairness interventions, which are designed to correct for bias often lead to worse societal outcomes. Based on these results, we propose that algorithmic selection involves a trade-between accuracy of prediction and fairness of outcomes. Furthermore, we suggest that bias mitigation techniques surely have to be included in algorithm selection but they have to be evaluated in the context of welfare economics.

Suggested Citation

  • Janssen, Patrick & Sadowski, Bert M., 2021. "Bias in Algorithms: On the trade-off between accuracy and fairness," 23rd ITS Biennial Conference, Online Conference / Gothenburg 2021. Digital societies and industrial transformations: Policies, markets, and technologies in a post-Covid world 238032, International Telecommunications Society (ITS).
  • Handle: RePEc:zbw:itsb21:238032
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/238032/1/Janssen-Sadowski.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ashesh Rambachan & Jon Kleinberg & Jens Ludwig & Sendhil Mullainathan, 2020. "An Economic Perspective on Algorithmic Fairness," AEA Papers and Proceedings, American Economic Association, vol. 110, pages 91-95, May.
    2. Edmond Awad & Sohan Dsouza & Richard Kim & Jonathan Schulz & Joseph Henrich & Azim Shariff & Jean-François Bonnefon & Iyad Rahwan, 2018. "The Moral Machine experiment," Nature, Nature, vol. 563(7729), pages 59-64, November.
    3. Malhotra, Rashmi & Malhotra, D. K., 2003. "Evaluating consumer loans using neural networks," Omega, Elsevier, vol. 31(2), pages 83-96, April.
    4. Edwards, Lilian & Veale, Michael, 2017. "Slave to the Algorithm? Why a 'right to an explanation' is probably not the remedy you are looking for," LawArXiv 97upg, Center for Open Science.
    5. Kristof Coussement & Stefan Lessmann & Geert Verstraeten, 2017. "A comparative analysis of data preparation algorithms for customer churn prediction: A case study in the telecommunication industry," Post-Print hal-01745261, HAL.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kira J.M. Matus & Michael Veale, 2022. "Certification systems for machine learning: Lessons from sustainability," Regulation & Governance, John Wiley & Sons, vol. 16(1), pages 177-196, January.
    2. Matus, Kira & Veale, Michael, 2021. "Certification Systems for Machine Learning: Lessons from Sustainability," SocArXiv pm3wy, Center for Open Science.
    3. He, Ni & Yongqiao, Wang & Tao, Jiang & Zhaoyu, Chen, 2022. "Self-Adaptive bagging approach to credit rating," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    4. Qian, Lixian & Yin, Juelin & Huang, Youlin & Liang, Ya, 2023. "The role of values and ethics in influencing consumers’ intention to use autonomous vehicle hailing services," Technological Forecasting and Social Change, Elsevier, vol. 188(C).
    5. Shorouq Fathi Eletter & Saad Ghaleb Yaseen & Ghaleb Awad Elrefae, 2010. "Neuro-Based Artificial Intelligence Model for Loan Decisions," American Journal of Economics and Business Administration, Science Publications, vol. 2(1), pages 27-34, March.
    6. Kassens-Noor, Eva & Cai, Meng & Kotval-Karamchandani, Zeenat & Decaminada, Travis, 2021. "Autonomous vehicles and mobility for people with special needs," Transportation Research Part A: Policy and Practice, Elsevier, vol. 150(C), pages 385-397.
    7. Tseng, Chih-Hsiung & Cheng, Sheng-Tzong & Wang, Yi-Hsien & Peng, Jin-Tang, 2008. "Artificial neural network model of the hybrid EGARCH volatility of the Taiwan stock index option prices," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 387(13), pages 3192-3200.
    8. Joanna Sleigh & Shannon Hubbs & Alessandro Blasimme & Effy Vayena, 2024. "Can digital tools foster ethical deliberation?," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-10, December.
    9. Klockmann, Victor & von Schenk, Alicia & Villeval, Marie Claire, 2022. "Artificial intelligence, ethics, and intergenerational responsibility," Journal of Economic Behavior & Organization, Elsevier, vol. 203(C), pages 284-317.
    10. König, Pascal D. & Wenzelburger, Georg, 2021. "The legitimacy gap of algorithmic decision-making in the public sector: Why it arises and how to address it," Technology in Society, Elsevier, vol. 67(C).
    11. Yu, Lean & Wang, Shouyang & Lai, Kin Keung, 2009. "An intelligent-agent-based fuzzy group decision making model for financial multicriteria decision support: The case of credit scoring," European Journal of Operational Research, Elsevier, vol. 195(3), pages 942-959, June.
    12. Vasiliki Koniakou, 2023. "From the “rush to ethics” to the “race for governance” in Artificial Intelligence," Information Systems Frontiers, Springer, vol. 25(1), pages 71-102, February.
    13. De Caigny, Arno & Coussement, Kristof & De Bock, Koen W., 2018. "A new hybrid classification algorithm for customer churn prediction based on logistic regression and decision trees," European Journal of Operational Research, Elsevier, vol. 269(2), pages 760-772.
    14. Zhang, Qiyuan & Wallbridge, Christopher D. & Jones, Dylan M. & Morgan, Phillip L., 2024. "Public perception of autonomous vehicle capability determines judgment of blame and trust in road traffic accidents," Transportation Research Part A: Policy and Practice, Elsevier, vol. 179(C).
    15. Arno de Caigny & Kristof Coussement & Koen W. de Bock & Stefan Lessmann, 2019. "Incorporating textual information in customer churn prediction models based on a convolutional neural network," Post-Print hal-02275958, HAL.
    16. Staněk, Rostislav & Krčál, Ondřej & Čellárová, Katarína, 2022. "Pull yourself up by your bootstraps: Identifying procedural preferences against helping others in the presence of moral hazard," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).
    17. MARTENS, David, 2020. "FAT Flow: A data science ethics framework," Working Papers 2020004, University of Antwerp, Faculty of Business and Economics.
    18. Hensel, Lukas & Witte, Marc & Caria, A. Stefano & Fetzer, Thiemo & Fiorin, Stefano & Götz, Friedrich M. & Gomez, Margarita & Haushofer, Johannes & Ivchenko, Andriy & Kraft-Todd, Gordon & Reutskaja, El, 2022. "Global Behaviors, Perceptions, and the Emergence of Social Norms at the Onset of the COVID-19 Pandemic," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 473-496.
    19. Matthias Bogaert & Lex Delaere, 2023. "Ensemble Methods in Customer Churn Prediction: A Comparative Analysis of the State-of-the-Art," Mathematics, MDPI, vol. 11(5), pages 1-28, February.
    20. De Caigny, Arno & Coussement, Kristof & De Bock, Koen W. & Lessmann, Stefan, 2020. "Incorporating textual information in customer churn prediction models based on a convolutional neural network," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1563-1578.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:itsb21:238032. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: http://www.itsworld.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.