IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1910.04123.html
   My bibliography  Save this paper

The Disparate Equilibria of Algorithmic Decision Making when Individuals Invest Rationally

Author

Listed:
  • Lydia T. Liu
  • Ashia Wilson
  • Nika Haghtalab
  • Adam Tauman Kalai
  • Christian Borgs
  • Jennifer Chayes

Abstract

The long-term impact of algorithmic decision making is shaped by the dynamics between the deployed decision rule and individuals' response. Focusing on settings where each individual desires a positive classification---including many important applications such as hiring and school admissions, we study a dynamic learning setting where individuals invest in a positive outcome based on their group's expected gain and the decision rule is updated to maximize institutional benefit. By characterizing the equilibria of these dynamics, we show that natural challenges to desirable long-term outcomes arise due to heterogeneity across groups and the lack of realizability. We consider two interventions, decoupling the decision rule by group and subsidizing the cost of investment. We show that decoupling achieves optimal outcomes in the realizable case but has discrepant effects that may depend on the initial conditions otherwise. In contrast, subsidizing the cost of investment is shown to create better equilibria for the disadvantaged group even in the absence of realizability.

Suggested Citation

  • Lydia T. Liu & Ashia Wilson & Nika Haghtalab & Adam Tauman Kalai & Christian Borgs & Jennifer Chayes, 2019. "The Disparate Equilibria of Algorithmic Decision Making when Individuals Invest Rationally," Papers 1910.04123, arXiv.org.
  • Handle: RePEc:arx:papers:1910.04123
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1910.04123
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. David Card & Jesse Rothstein, 2005. "Racial Segregation and the Black-White Test Score Gap," Working Papers 879, Princeton University, Department of Economics, Industrial Relations Section..
    2. Lily Hu & Yiling Chen, 2017. "A Short-term Intervention for Long-term Fairness in the Labor Market," Papers 1712.00064, arXiv.org, revised Feb 2018.
    3. Card, David & Rothstein, Jesse, 2007. "Racial segregation and the black-white test score gap," Journal of Public Economics, Elsevier, vol. 91(11-12), pages 2158-2184, December.
    4. Caroline Hoxby & Christopher Avery, 2013. "The Missing "One-Offs": The Hidden Supply of High-Achieving, Low-Income Students," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 44(1 (Spring), pages 1-65.
    5. SCHMEIDLER, David, 1973. "Equilibrium points of nonatomic games," LIDAM Reprints CORE 146, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    6. Andreas Fuster & Paul Goldsmith‐Pinkham & Tarun Ramadorai & Ansgar Walther, 2022. "Predictably Unequal? The Effects of Machine Learning on Credit Markets," Journal of Finance, American Finance Association, vol. 77(1), pages 5-47, February.
    7. Kenneth J. Arrow, 1998. "What Has Economics to Say about Racial Discrimination?," Journal of Economic Perspectives, American Economic Association, vol. 12(2), pages 91-100, Spring.
    8. Ehud Kalai, 2004. "Large Robust Games," Econometrica, Econometric Society, vol. 72(6), pages 1631-1665, November.
    9. Raj Chetty & Nathaniel Hendren & Lawrence F. Katz, 2016. "The Effects of Exposure to Better Neighborhoods on Children: New Evidence from the Moving to Opportunity Experiment," American Economic Review, American Economic Association, vol. 106(4), pages 855-902, April.
    10. Phelps, Edmund S, 1972. "The Statistical Theory of Racism and Sexism," American Economic Review, American Economic Association, vol. 62(4), pages 659-661, September.
    11. Coate, Stephen & Loury, Glenn C, 1993. "Will Affirmative-Action Policies Eliminate Negative Stereotypes?," American Economic Review, American Economic Association, vol. 83(5), pages 1220-1240, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sampath Kannan & Mingzi Niu & Aaron Roth & Rakesh Vohra, 2021. "Best vs. All: Equity and Accuracy of Standardized Test Score Reporting," Papers 2102.07809, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Caterina Calsamiglia & Francisco Martínez-Mora & Antonio Miralles, 2021. "School Choice Design, Risk Aversion and Cardinal Segregation," The Economic Journal, Royal Economic Society, vol. 131(635), pages 1081-1104.
    2. Kevin Lang & Jee-Yeon K. Lehmann, 2012. "Racial Discrimination in the Labor Market: Theory and Empirics," Journal of Economic Literature, American Economic Association, vol. 50(4), pages 959-1006, December.
    3. Batsaikhan, Mongoljin & Gørtz, Mette & Kennes, John & Lyng, Ran Sun & Monte, Daniel & Tumennasan, Norovsambuu, 2021. "Discrimination and Daycare Choice: Evidence from a Randomized Survey," IZA Discussion Papers 14874, Institute of Labor Economics (IZA).
    4. Mongoljin Batsaikhan & Mette Gørtz & John Kennes & Ran Sun Lyng & Daniel Monte & Norovsambuu Tumennasan, 2019. "Daycare Choice and Ethnic Diversity: Evidence from a Randomized Survey," Economics Working Papers 2019-02, Department of Economics and Business Economics, Aarhus University.
    5. Tito Boeri & Marta De Philippis & Eleonora Patacchini & Michele Pellizzari, 2015. "Immigration, Housing Discrimination and Employment," Economic Journal, Royal Economic Society, vol. 125(586), pages 82-114, August.
    6. Dianat, Ahrash & Echenique, Federico & Yariv, Leeat, 2022. "Statistical discrimination and affirmative action in the lab," Games and Economic Behavior, Elsevier, vol. 132(C), pages 41-58.
    7. Nicodemo, Catia & Raya, Josep M., 2018. "Does Juan Carlos or Nelson Obtain a Larger Price Cut in the Spanish Housing Market?," IZA Discussion Papers 11811, Institute of Labor Economics (IZA).
    8. Ross Levine & Alexey Levkov & Yona Rubinstein, 2008. "Racial Discrimination and Competition," NBER Working Papers 14273, National Bureau of Economic Research, Inc.
    9. Dequiedt, Vianney & Zenou, Yves, 2013. "International migration, imperfect information, and brain drain," Journal of Development Economics, Elsevier, vol. 102(C), pages 62-78.
    10. Méon, Pierre-Guillaume & Szafarz, Ariane, 2011. "The modern corporation as a safe haven for taste-based discrimination: An agency model of hiring decisions," Labour Economics, Elsevier, vol. 18(4), pages 487-497, August.
    11. Kulkarni, Nirupama & Malmendier, Ulrike, 2022. "Homeownership segregation," Journal of Monetary Economics, Elsevier, vol. 129(C), pages 123-149.
    12. repec:spo:wpmain:info:hdl:2441/8984 is not listed on IDEAS
    13. Jacques-François Thisse & Etienne Wasmer & Yves Zenou, 2003. "Ségrégation urbaine, logement et marchés du travail," Revue Française d'Économie, Programme National Persée, vol. 17(4), pages 85-129.
    14. repec:spo:wpecon:info:hdl:2441/8984 is not listed on IDEAS
    15. Pierre-Guillaume Méon & Ariane Szafarz, 2008. "Labor market discrimination as an agency cost," DULBEA Working Papers 08-19.RS, ULB -- Universite Libre de Bruxelles.
    16. Barr & Oduro, Abena, 2000. "Ethnicity and wage determination in Ghana," Policy Research Working Paper Series 2506, The World Bank.
    17. Roland G. Fryer, Jr, 2010. "The Importance of Segregation, Discrimination, Peer Dynamics, and Identity in Explaining Trends in the Racial Achievement Gap," NBER Working Papers 16257, National Bureau of Economic Research, Inc.
    18. Paul Frijters & Michael A. Shields & Stephen Wheatley Price & Nikolaos Theodoropoulos, 2006. "Testing for Employee Discrimination in Britain using Matched Employer-Employee Data," University of Cyprus Working Papers in Economics 8-2006, University of Cyprus Department of Economics.
    19. Bergman, Peter, 2018. "The Risks and Benefits of School Integration for Participating Students: Evidence from a Randomized Desegregation Program," IZA Discussion Papers 11602, Institute of Labor Economics (IZA).
    20. Mohit Agrawal & Joseph G. Altonji & Richard K. Mansfield, 2019. "Quantifying Family, School, and Location Effects in the Presence of Complementarities and Sorting," Journal of Labor Economics, University of Chicago Press, vol. 37(S1), pages 11-83.
    21. Kahanec, M., 2004. "Social Interaction and the Minority-Majority Earnings Inequality : Why Being a Minority Hurts but being a big Minority Hurts More," Other publications TiSEM b005ba00-ef9c-42bb-b5c5-7, Tilburg University, School of Economics and Management.
    22. repec:hal:wpspec:info:hdl:2441/8984 is not listed on IDEAS
    23. Wodtke, Geoffrey T & Yildirim, Ugur & Harding, David J & Elwert, Felix, 2020. "Are Neighborhood Effects Explained by Differences in School Quality?," Institute for Research on Labor and Employment, Working Paper Series qt95251521, Institute of Industrial Relations, UC Berkeley.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1910.04123. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.