IDEAS home Printed from https://ideas.repec.org/p/ehl/lserod/120114.html
   My bibliography  Save this paper

Model-agnostic auditing: a lost cause?

Author

Listed:
  • Hansen, Sakina
  • Loftus, Joshua

Abstract

Tools for interpretable machine learning (IML) or explainable artificial intelligence (xAI) can be used to audit algorithms for fairness or other desiderata. In a black-box setting without access to the algorithm’s internal structure an auditor may be limited to methods that are model-agnostic. These methods have severe limitations with important consequences for outcomes such as fairness. Among model-agnostic IML methods, visualizations such as the partial dependence plot (PDP) or individual conditional expectation (ICE) plots are popular and useful for displaying qualitative relationships. Although we focus on fairness auditing with PDP/ICE plots, the consequences we highlight generalize to other auditing or IML/xAI applications. This paper questions the validity of auditing in high-stakes settings with contested values or conflicting interests if the audit methods are model-agnostic.

Suggested Citation

  • Hansen, Sakina & Loftus, Joshua, 2023. "Model-agnostic auditing: a lost cause?," LSE Research Online Documents on Economics 120114, London School of Economics and Political Science, LSE Library.
  • Handle: RePEc:ehl:lserod:120114
    as

    Download full text from publisher

    File URL: http://eprints.lse.ac.uk/120114/
    File Function: Open access version.
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. David M. Cutler & Adriana Lleras-Muney & Tom Vogl, 2008. "Socioeconomic Status and Health: Dimensions and Mechanisms," NBER Working Papers 14333, National Bureau of Economic Research, Inc.
    2. Aislinn Kelly-Lyth, 2021. "Challenging Biased Hiring Algorithms," Oxford Journal of Legal Studies, Oxford University Press, vol. 41(4), pages 899-928.
    3. Qingyuan Zhao & Trevor Hastie, 2021. "Causal Interpretations of Black-Box Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 272-281, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stefan Angel & Benjamin Bittschi, 2019. "Housing and Health," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 65(3), pages 495-513, September.
    2. Raquel Fonseca Benito & Yuhui Zheng, 2011. "The Effect of Education on Health Cross-Country Evidence," Working Papers WR-864, RAND Corporation.
    3. Gerdtham, Ulf-G & Lundborg, Petter & Lyttkens, Carl Hampus & Nystedt, Paul, 2012. "Do Socioeconomic Factors Really Explain Income-Related Inequalities in Health? Applying a Twin Design to Standard Decomposition Analysis," Working Papers 2012:21, Lund University, Department of Economics.
    4. Anthony Lepinteur, 2021. "The asymmetric experience of gains and losses in job security on health," Health Economics, John Wiley & Sons, Ltd., vol. 30(9), pages 2217-2229, September.
    5. Giorgio Brunello & Margherita Fort & Nicole Schneeweis & Rudolf Winter‐Ebmer, 2016. "The Causal Effect of Education on Health: What is the Role of Health Behaviors?," Health Economics, John Wiley & Sons, Ltd., vol. 25(3), pages 314-336, March.
    6. Liping Fu & Ya’nan Fang & Yongqing Dong, 2022. "The healthcare inequality among middle-aged and older adults in China: a comparative analysis between the full samples and the homogeneous population," Health Economics Review, Springer, vol. 12(1), pages 1-17, December.
    7. Madadkhani, Shiva & Ikonnikova, Svetlana, 2024. "Toward high-resolution projection of electricity prices: A machine learning approach to quantifying the effects of high fuel and CO2 prices," Energy Economics, Elsevier, vol. 129(C).
    8. Shoji, Masahiro & Cato, Susumu & Iida, Takashi & Ishida, Kenji & Ito, Asei & McElwain, Kenneth, 2020. "COVID-19 and Social Distancing in the Absence of Legal Enforcement: Survey Evidence from Japan," MPRA Paper 101968, University Library of Munich, Germany.
    9. Tuan-Anh Tran & Sushmita Sridhar & Stephen T. Reece & Octavie Lunguya & Jan Jacobs & Sandra Puyvelde & Florian Marks & Gordon Dougan & Nicholas R. Thomson & Binh T. Nguyen & Pham The Bao & Stephen Bak, 2024. "Combining machine learning with high-content imaging to infer ciprofloxacin susceptibility in isolates of Salmonella Typhimurium," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    10. Erkin Altuntas & Peter A. Gloor & Pascal Budner, 2022. "Measuring Ethical Values with AI for Better Teamwork," Future Internet, MDPI, vol. 14(5), pages 1-28, April.
    11. Laura Rodríguez, 2022. "Violence and newborn health: Estimates for Colombia," Health Economics, John Wiley & Sons, Ltd., vol. 31(1), pages 112-136, January.
    12. Pakpahan, Eduwin & Hoffmann, Rasmus & Kröger, Hannes, 2017. "The long arm of childhood circumstances on health in old age: Evidence from SHARELIFE," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 31, pages 1-10.
    13. Lin Zhang & Suhong Zhou & Lanlan Qi & Yue Deng, 2022. "Nonlinear Effects of the Neighborhood Environments on Residents’ Mental Health," IJERPH, MDPI, vol. 19(24), pages 1-17, December.
    14. Li Yao & He Ni, 2023. "Prediction of patent grant and interpreting the key determinants: an application of interpretable machine learning approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(9), pages 4933-4969, September.
    15. Cavaco, Sandra & Eriksson, Tor & Skalli, Ali, 2011. "Life Cycle Development of Obesity and Its Determinants," Working Papers 11-7, University of Aarhus, Aarhus School of Business, Department of Economics.
    16. Aizawa, Toshiaki, 2019. "Ex-ante Inequality of Opportunity in Child Malnutrition: New Evidence from Ten Developing Countries in Asia," Economics & Human Biology, Elsevier, vol. 35(C), pages 144-161.
    17. Schade, Philipp & Schuhmacher, Monika C., 2023. "Predicting entrepreneurial activity using machine learning," Journal of Business Venturing Insights, Elsevier, vol. 19(C).
    18. Kurt R. Brekke & Tor Helge Holmås & Karin Monstad & Odd Rune Straume, 2018. "Socio‐economic status and physicians' treatment decisions," Health Economics, John Wiley & Sons, Ltd., vol. 27(3), pages 77-89, March.
    19. Ayala, Luis & Rodríguez, Magdalena, 2013. "Health-related effects of welfare-to-work policies," Social Science & Medicine, Elsevier, vol. 93(C), pages 103-112.
    20. Raquel Fonseca & Pierre-Carl Michaud & Yuhui Zheng, 2020. "The effect of education on health: evidence from national compulsory schooling reforms," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 11(1), pages 83-103, March.

    More about this item

    Keywords

    artificial intelligence; black-box auditing; causal models; CEUR Workshop Proceedings (CEUR-WS.org); counterfactual fairness; individual conditional expectation; machine learning; partial dependence plots; supervised learning; visualization;
    All these keywords.

    JEL classification:

    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ehl:lserod:120114. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: LSERO Manager (email available below). General contact details of provider: https://edirc.repec.org/data/lsepsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.