IDEAS home Printed from https://ideas.repec.org/a/kap/qmktec/v22y2024i4d10.1007_s11129-024-09286-z.html
   My bibliography  Save this article

Apparent algorithmic discrimination and real-time algorithmic learning in digital search advertising

Author

Listed:
  • Anja Lambrecht

    (London Business School)

  • Catherine Tucker

    (MIT Sloan School of Management
    NBER)

Abstract

Digital algorithms try to display content that engages consumers. To do this, algorithms need to overcome a ‘cold-start problem’ by swiftly learning whether content engages users. This requires feedback from users. The algorithm targets segments of users. However, if there are fewer individuals in a targeted segment of users, simply because this group is rarer in the population, this could lead to uneven outcomes for minority relative to majority groups. This is because individuals in a minority segment are proportionately more likely to be test subjects for experimental content that may ultimately be rejected by the platform. We explore in the context of ads that are displayed following searches on Google whether this is indeed the case. Previous research has documented that searches for names associated in a US context with Black people on search engines were more likely to return ads that highlighted the need for a criminal background check than was the case for searches for white people. We implement search advertising campaigns that target ads to searches for Black and white names. Our ads are indeed more likely to be displayed following a search for a Black name, even though the likelihood of clicking was similar. Since Black names are less common, the algorithm learns about the quality of the underlying ad more slowly. As a result, an ad is more likely to persist for searches next to Black names than next to white names. Proportionally more Black name searches are likely to have a low-quality ad shown next to them, even though eventually the ad will be rejected. A second study where ads are placed following searches for terms related to religious discrimination confirms this empirical pattern. Our results suggest that as a practical matter, real-time algorithmic learning can lead minority segments to be more likely to see content that will ultimately be rejected by the algorithm.

Suggested Citation

  • Anja Lambrecht & Catherine Tucker, 2024. "Apparent algorithmic discrimination and real-time algorithmic learning in digital search advertising," Quantitative Marketing and Economics (QME), Springer, vol. 22(4), pages 357-387, December.
  • Handle: RePEc:kap:qmktec:v:22:y:2024:i:4:d:10.1007_s11129-024-09286-z
    DOI: 10.1007/s11129-024-09286-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11129-024-09286-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11129-024-09286-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jon Kleinberg & Jens Ludwig & Sendhil Mullainathan & Ziad Obermeyer, 2015. "Prediction Policy Problems," American Economic Review, American Economic Association, vol. 105(5), pages 491-495, May.
    2. Benjamin Edelman & Michael Ostrovsky & Michael Schwarz, 2007. "Internet Advertising and the Generalized Second-Price Auction: Selling Billions of Dollars Worth of Keywords," American Economic Review, American Economic Association, vol. 97(1), pages 242-259, March.
    3. Roland G. Fryer & Steven D. Levitt, 2004. "The Causes and Consequences of Distinctively Black Names," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 767-805.
    4. Anja Lambrecht & Catherine Tucker, 2019. "Algorithmic Bias? An Empirical Study of Apparent Gender-Based Discrimination in the Display of STEM Career Ads," Management Science, INFORMS, vol. 65(7), pages 2966-2981, July.
    5. Avi Goldfarb & Catherine Tucker, 2011. "Search Engine Advertising: Channel Substitution When Pricing Ads to Context," Management Science, INFORMS, vol. 57(3), pages 458-470, March.
    6. Marianne Bertrand & Sendhil Mullainathan, 2004. "Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination," American Economic Review, American Economic Association, vol. 94(4), pages 991-1013, September.
    7. Alessandro Acquisti & Christina Fong, 2020. "An Experiment in Hiring Discrimination via Online Social Networks," Management Science, INFORMS, vol. 66(3), pages 1005-1024, March.
    8. Anindya Ghose & Sha Yang, 2009. "An Empirical Analysis of Search Engine Advertising: Sponsored Search in Electronic Markets," Management Science, INFORMS, vol. 55(10), pages 1605-1622, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bleier, Alexander & Fossen, Beth L. & Shapira, Michal, 2024. "On the role of social media platforms in the creator economy," International Journal of Research in Marketing, Elsevier, vol. 41(3), pages 411-426.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Abou Nabout, Nadia & Skiera, Bernd, 2012. "Return on Quality Improvements in Search Engine Marketing," Journal of Interactive Marketing, Elsevier, vol. 26(3), pages 141-154.
    2. Avi Goldfarb, 2014. "What is Different About Online Advertising?," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 44(2), pages 115-129, March.
    3. Darius Schlangenotto & Martin Poniatowski & Dennis Kundisch, 2018. "What Drives Paid Search Success: A Systematic Literature Review," Working Papers Dissertations 31, Paderborn University, Faculty of Business Administration and Economics.
    4. Yulia Evsyukova & Felix Rusche & Wladislaw Mill, 2023. "LinkedOut? A Field Experiment on Discrimination in Job Network Formation," CRC TR 224 Discussion Paper Series crctr224_2023_482v2, University of Bonn and University of Mannheim, Germany, revised Oct 2024.
    5. Kinshuk Jerath & Liye Ma & Young-Hoon Park & Kannan Srinivasan, 2011. "A "Position Paradox" in Sponsored Search Auctions," Marketing Science, INFORMS, vol. 30(4), pages 612-627, July.
    6. Mladen Adamovic & Andreas Leibbrandt, 2023. "A large‐scale field experiment on occupational gender segregation and hiring discrimination," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 62(1), pages 34-59, January.
    7. Peitz, Martin & Reisinger, Markus, 2014. "The Economics of Internet Media," Working Papers 14-23, University of Mannheim, Department of Economics.
    8. Joseph Golden & John Joseph Horton, 2021. "The Effects of Search Advertising on Competitors: An Experiment Before a Merger," Management Science, INFORMS, vol. 67(1), pages 342-362, January.
    9. Song Yao & Carl F. Mela, 2011. "A Dynamic Model of Sponsored Search Advertising," Marketing Science, INFORMS, vol. 30(3), pages 447-468, 05-06.
    10. Xiaoquan (Michael) Zhang & Juan Feng, 2011. "Cyclical Bid Adjustments in Search-Engine Advertising," Management Science, INFORMS, vol. 57(9), pages 1703-1719, February.
    11. Kudashvili, Nikoloz & Lergetporer, Philipp, 2022. "Minorities’ strategic response to discrimination: Experimental evidence," Journal of Public Economics, Elsevier, vol. 208(C).
    12. Chowdhury, Shyamal & Ooi, Evarn & Slonim, Robert, 2017. "Racial discrimination and white first name adoption: a field experiment in the Australian labour market," Working Papers 2017-15, University of Sydney, School of Economics.
    13. Mujcic, Redzo & Frijters, Paul, 2013. "Still Not Allowed on the Bus: It Matters If You're Black or White!," IZA Discussion Papers 7300, Institute of Labor Economics (IZA).
    14. Navdeep Sahni, 2015. "Effect of temporal spacing between advertising exposures: Evidence from online field experiments," Quantitative Marketing and Economics (QME), Springer, vol. 13(3), pages 203-247, September.
    15. Keith Head & Thierry Mayer, 2008. "Detection Of Local Interactions From The Spatial Pattern Of Names In France," Journal of Regional Science, Wiley Blackwell, vol. 48(1), pages 67-95, February.
    16. Jan Hanousek & Štěpán Jurajda, 2018. "Názvy společností a jejich vliv na výkonnost firem [Corporate Names and Performance]," Politická ekonomie, Prague University of Economics and Business, vol. 2018(6), pages 671-688.
    17. Button, Patrick & Walker, Brigham, 2020. "Employment discrimination against Indigenous Peoples in the United States: Evidence from a field experiment," Labour Economics, Elsevier, vol. 65(C).
    18. Lisa Cook, 2014. "Violence and economic activity: evidence from African American patents, 1870–1940," Journal of Economic Growth, Springer, vol. 19(2), pages 221-257, June.
    19. Aksoy, Billur & Chadd, Ian & Koh, Boon Han, 2023. "Sexual identity, gender, and anticipated discrimination in prosocial behavior," European Economic Review, Elsevier, vol. 154(C).
    20. Olivetti, Claudia & Paserman, M. Daniele & Salisbury, Laura, 2018. "Three-generation mobility in the United States, 1850–1940: The role of maternal and paternal grandparents," Explorations in Economic History, Elsevier, vol. 70(C), pages 73-90.

    More about this item

    Keywords

    Algorithmic fairness; Algorithmic discrimination; Advertising;
    All these keywords.

    JEL classification:

    • M2 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Economics
    • M3 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Marketing and Advertising

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:qmktec:v:22:y:2024:i:4:d:10.1007_s11129-024-09286-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.