IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1910.04123.html
   My bibliography  Save this paper

The Disparate Equilibria of Algorithmic Decision Making when Individuals Invest Rationally

Author

Listed:
  • Lydia T. Liu
  • Ashia Wilson
  • Nika Haghtalab
  • Adam Tauman Kalai
  • Christian Borgs
  • Jennifer Chayes

Abstract

The long-term impact of algorithmic decision making is shaped by the dynamics between the deployed decision rule and individuals' response. Focusing on settings where each individual desires a positive classification---including many important applications such as hiring and school admissions, we study a dynamic learning setting where individuals invest in a positive outcome based on their group's expected gain and the decision rule is updated to maximize institutional benefit. By characterizing the equilibria of these dynamics, we show that natural challenges to desirable long-term outcomes arise due to heterogeneity across groups and the lack of realizability. We consider two interventions, decoupling the decision rule by group and subsidizing the cost of investment. We show that decoupling achieves optimal outcomes in the realizable case but has discrepant effects that may depend on the initial conditions otherwise. In contrast, subsidizing the cost of investment is shown to create better equilibria for the disadvantaged group even in the absence of realizability.

Suggested Citation

  • Lydia T. Liu & Ashia Wilson & Nika Haghtalab & Adam Tauman Kalai & Christian Borgs & Jennifer Chayes, 2019. "The Disparate Equilibria of Algorithmic Decision Making when Individuals Invest Rationally," Papers 1910.04123, arXiv.org.
  • Handle: RePEc:arx:papers:1910.04123
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1910.04123
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Card, David & Rothstein, Jesse, 2007. "Racial segregation and the black-white test score gap," Journal of Public Economics, Elsevier, vol. 91(11-12), pages 2158-2184, December.
    2. Andreas Fuster & Paul Goldsmith‐Pinkham & Tarun Ramadorai & Ansgar Walther, 2022. "Predictably Unequal? The Effects of Machine Learning on Credit Markets," Journal of Finance, American Finance Association, vol. 77(1), pages 5-47, February.
    3. Lily Hu & Yiling Chen, 2017. "A Short-term Intervention for Long-term Fairness in the Labor Market," Papers 1712.00064, arXiv.org, revised Feb 2018.
    4. Kenneth J. Arrow, 1998. "What Has Economics to Say about Racial Discrimination?," Journal of Economic Perspectives, American Economic Association, vol. 12(2), pages 91-100, Spring.
    5. Ehud Kalai, 2004. "Large Robust Games," Econometrica, Econometric Society, vol. 72(6), pages 1631-1665, November.
    6. Raj Chetty & Nathaniel Hendren & Lawrence F. Katz, 2016. "The Effects of Exposure to Better Neighborhoods on Children: New Evidence from the Moving to Opportunity Experiment," American Economic Review, American Economic Association, vol. 106(4), pages 855-902, April.
    7. Phelps, Edmund S, 1972. "The Statistical Theory of Racism and Sexism," American Economic Review, American Economic Association, vol. 62(4), pages 659-661, September.
    8. Caroline Hoxby & Christopher Avery, 2013. "The Missing "One-Offs": The Hidden Supply of High-Achieving, Low-Income Students," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 44(1 (Spring), pages 1-65.
    9. Coate, Stephen & Loury, Glenn C, 1993. "Will Affirmative-Action Policies Eliminate Negative Stereotypes?," American Economic Review, American Economic Association, vol. 83(5), pages 1220-1240, December.
    10. SCHMEIDLER, David, 1973. "Equilibrium points of nonatomic games," LIDAM Reprints CORE 146, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sampath Kannan & Mingzi Niu & Aaron Roth & Rakesh Vohra, 2021. "Best vs. All: Equity and Accuracy of Standardized Test Score Reporting," Papers 2102.07809, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dianat, Ahrash & Echenique, Federico & Yariv, Leeat, 2022. "Statistical discrimination and affirmative action in the lab," Games and Economic Behavior, Elsevier, vol. 132(C), pages 41-58.
    2. Ross Levine & Alexey Levkov & Yona Rubinstein, 2008. "Racial Discrimination and Competition," NBER Working Papers 14273, National Bureau of Economic Research, Inc.
    3. Dequiedt, Vianney & Zenou, Yves, 2013. "International migration, imperfect information, and brain drain," Journal of Development Economics, Elsevier, vol. 102(C), pages 62-78.
    4. Caterina Calsamiglia & Francisco Martínez-Mora & Antonio Miralles, 2021. "School Choice Design, Risk Aversion and Cardinal Segregation," The Economic Journal, Royal Economic Society, vol. 131(635), pages 1081-1104.
    5. Méon, Pierre-Guillaume & Szafarz, Ariane, 2011. "The modern corporation as a safe haven for taste-based discrimination: An agency model of hiring decisions," Labour Economics, Elsevier, vol. 18(4), pages 487-497, August.
    6. repec:spo:wpmain:info:hdl:2441/8984 is not listed on IDEAS
    7. Jacques-François Thisse & Etienne Wasmer & Yves Zenou, 2003. "Ségrégation urbaine, logement et marchés du travail," Revue Française d'Économie, Programme National Persée, vol. 17(4), pages 85-129.
    8. Kevin Lang & Jee-Yeon K. Lehmann, 2012. "Racial Discrimination in the Labor Market: Theory and Empirics," Journal of Economic Literature, American Economic Association, vol. 50(4), pages 959-1006, December.
    9. repec:spo:wpecon:info:hdl:2441/8984 is not listed on IDEAS
    10. Pierre-Guillaume Méon & Ariane Szafarz, 2008. "Labor market discrimination as an agency cost," DULBEA Working Papers 08-19.RS, ULB -- Universite Libre de Bruxelles.
    11. Barr & Oduro, Abena, 2000. "Ethnicity and wage determination in Ghana," Policy Research Working Paper Series 2506, The World Bank.
    12. Paul Frijters & Michael A. Shields & Stephen Wheatley Price & Nikolaos Theodoropoulos, 2006. "Testing for Employee Discrimination in Britain using Matched Employer-Employee Data," University of Cyprus Working Papers in Economics 8-2006, University of Cyprus Department of Economics.
    13. Batsaikhan, Mongoljin & Gørtz, Mette & Kennes, John & Lyng, Ran Sun & Monte, Daniel & Tumennasan, Norovsambuu, 2021. "Discrimination and Daycare Choice: Evidence from a Randomized Survey," IZA Discussion Papers 14874, Institute of Labor Economics (IZA).
    14. Kahanec, M., 2004. "Social Interaction and the Minority-Majority Earnings Inequality : Why Being a Minority Hurts but being a big Minority Hurts More," Discussion Paper 2004-41, Tilburg University, Center for Economic Research.
    15. repec:hal:wpspec:info:hdl:2441/8984 is not listed on IDEAS
    16. Kahanec, Martin, 2006. "Ethnic Specialization and Earnings Inequality: Why Being a Minority Hurts but Being a Big Minority Hurts More," IZA Discussion Papers 2050, Institute of Labor Economics (IZA).
    17. John Morgan & Felix Várdy, 2009. "Diversity in the Workplace," American Economic Review, American Economic Association, vol. 99(1), pages 472-485, March.
    18. Frijters, Paul & Shields, Michael A. & Theodoropoulos, Nikolaos & Wheatley Price, Stephen, 2003. "Testing for Employee Discrimination Using Matched Employer-Employee Data: Theory and Evidence," IZA Discussion Papers 807, Institute of Labor Economics (IZA).
    19. repec:hal:spmain:info:hdl:2441/8984 is not listed on IDEAS
    20. repec:ebl:ecbull:v:10:y:2008:i:5:p:1-6 is not listed on IDEAS
    21. Balsa, Ana I. & McGuire, Thomas G., 2003. "Prejudice, clinical uncertainty and stereotyping as sources of health disparities," Journal of Health Economics, Elsevier, vol. 22(1), pages 89-116, January.
    22. Xiao Lin & Mark J. Browne & Annette Hofmann, 2022. "Race discrimination in the adjudication of claims: Evidence from earthquake insurance," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 89(3), pages 553-580, September.
    23. Mongoljin Batsaikhan & Mette Gørtz & John Kennes & Ran Sun Lyng & Daniel Monte & Norovsambuu Tumennasan, 2019. "Daycare Choice and Ethnic Diversity: Evidence from a Randomized Survey," Economics Working Papers 2019-02, Department of Economics and Business Economics, Aarhus University.
    24. Julien Picault, 2013. "Unionization and Labour-market Discrimination: A Closer Look at Non-unionized Workers," LABOUR, CEIS, vol. 27(3), pages 272-287, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1910.04123. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.