IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_11644.html
   My bibliography  Save this paper

Toxic Content and User Engagement on Social Media: Evidence from a Field Experiment

Author

Listed:
  • George Beknazar-Yuzbashev
  • Rafael Jiménez-Durán
  • Jesse McCrosky
  • Mateusz Stalinski

Abstract

Most social media users have encountered harassment online, but there is scarce evidence of how this type of toxic content impacts engagement. In a pre-registered browser extension field experiment, we randomly hid toxic content for six weeks on Facebook, Twitter, and YouTube. Lowering exposure to toxicity reduced advertising impressions, time spent, and other measures of engagement, and reduced the toxicity of user-generated content. A survey experiment provides evidence that toxicity triggers curiosity and that engagement and welfare are not necessarily aligned. Taken together, our results suggest that platforms face a trade-off between curbing toxicity and increasing engagement.

Suggested Citation

  • George Beknazar-Yuzbashev & Rafael Jiménez-Durán & Jesse McCrosky & Mateusz Stalinski, 2025. "Toxic Content and User Engagement on Social Media: Evidence from a Field Experiment," CESifo Working Paper Series 11644, CESifo.
    • Handle: RePEc:ces:ceswps:_11644
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp11644.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Leonardo Bursztyn & Georgy Egorov & Ruben Enikolopov & Maria Petrova, 2019. "Social Media and Xenophobia: Evidence from Russia," NBER Working Papers 26567, National Bureau of Economic Research, Inc.
    2. Ronald E. Robertson & Jon Green & Damian J. Ruck & Katherine Ognyanova & Christo Wilson & David Lazer, 2023. "Users choose to engage with more partisan news than they are exposed to on Google Search," Nature, Nature, vol. 618(7964), pages 342-348, June.
    3. Luca Braghieri & Ro'ee Levy & Alexey Makarin, 2022. "Social Media and Mental Health," American Economic Review, American Economic Association, vol. 112(11), pages 3660-3693, November.
    4. Emeric Henry & Ekaterina Zhuravskaya & Sergei Guriev, 2022. "Checking and Sharing Alt-Facts," American Economic Journal: Economic Policy, American Economic Association, vol. 14(3), pages 55-86, August.
    5. Hunt Allcott & Matthew Gentzkow, 2017. "Social Media and Fake News in the 2016 Election," NBER Working Papers 23089, National Bureau of Economic Research, Inc.
    6. John C. Driscoll & Aart C. Kraay, 1998. "Consistent Covariance Matrix Estimation With Spatially Dependent Panel Data," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 549-560, November.
    7. Emeric Henry & Ekaterina Zhuravskaya & Sergei Guriev, 2022. "Checking and Sharing Alt-Facts," PSE-Ecole d'économie de Paris (Postprint) halshs-03342759, HAL.
    8. Sergei Guriev & Nikita Melnikov & Ekaterina Zhuravskaya, 2021. "3G Internet and Confidence in Government," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 136(4), pages 2533-2613.
    9. Emeric Henry & Ekaterina Zhuravskaya & Sergei Guriev, 2022. "Checking and Sharing Alt-Facts," Post-Print halshs-03342759, HAL.
    10. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    11. Fernando Alvarez & David Argente, 2022. "On the Effects of the Availability of Means of Payments: The Case of Uber," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 137(3), pages 1737-1789.
    12. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2024. "The Effect of Social Media on Elections: Evidence from The United States," Journal of the European Economic Association, European Economic Association, vol. 22(3), pages 1495-1539.
    13. Levi Boxell & Matthew Gentzkow & Jesse M. Shapiro, 2024. "Cross-Country Trends in Affective Polarization," The Review of Economics and Statistics, MIT Press, vol. 106(2), pages 557-565, March.
    14. Yi Liu & Pinar Yildirim & Z. John Zhang, 2021. "Social Media, Content Moderation, and Technology," Papers 2101.04618, arXiv.org, revised Jan 2021.
    15. Leonardo Bursztyn & Benjamin R. Handel & Rafael Jimenez & Christopher Roth, 2023. "When Product Markets Become Collective Traps: The Case of Social Media," NBER Working Papers 31771, National Bureau of Economic Research, Inc.
    16. Ruben Enikolopov & Alexey Makarin & Maria Petrova, 2020. "Social Media and Protest Participation: Evidence From Russia," Econometrica, Econometric Society, vol. 88(4), pages 1479-1514, July.
    17. McKenzie, David, 2012. "Beyond baseline and follow-up: The case for more T in experiments," Journal of Development Economics, Elsevier, vol. 99(2), pages 210-221.
    18. Wajeeha Ahmad & Ananya Sen & Charles Eesley & Erik Brynjolfsson, 2024. "Companies inadvertently fund online misinformation despite consumer backlash," Nature, Nature, vol. 630(8015), pages 123-131, June.
    19. Maria Petrova & Ananya Sen & Pinar Yildirim, 2021. "Social Media and Political Contributions: The Impact of New Technology on Political Competition," Management Science, INFORMS, vol. 67(5), pages 2997-3021, May.
    20. Andres, Raphaela & Slivko, Olga, 2021. "Combating online hate speech: The impact of legislation on Twitter," ZEW Discussion Papers 21-103, ZEW - Leibniz Centre for European Economic Research.
    21. Guy Aridor & Rafael Jiménez-Durán & Ro'ee Levy & Lena Song, 2024. "The Economics of Social Media," Journal of Economic Literature, American Economic Association, vol. 62(4), pages 1422-1474, December.
    22. Hunt Allcott & Luca Braghieri & Sarah Eichmeyer & Matthew Gentzkow, 2020. "The Welfare Effects of Social Media," American Economic Review, American Economic Association, vol. 110(3), pages 629-676, March.
    23. Doruk Cengiz & Arindrajit Dube & Attila Lindner & Ben Zipperer, 2019. "The Effect of Minimum Wages on Low-Wage Jobs," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1405-1454.
    24. Leonardo Bursztyn, 2023. "When Product Markets Become Collective Traps: The Case of Social Media," ECONtribute Discussion Papers Series 260, University of Bonn and University of Cologne, Germany.
    25. Leonardo Madio & Martin Quinn, 2024. "Content Moderation and Advertising in Social Media Platforms," CESifo Working Paper Series 11169, CESifo.
    26. Fabrizio Germano & Vicenç Gómez & Francesco Sobbrio, 2022. "Ranking for Engagement: How Social Media Algorithms Fuel Misinformation and Polarization," CESifo Working Paper Series 10011, CESifo.
    27. Scott Duke Kominers & Jesse M. Shapiro, 2024. "Content Moderation with Opaque Policies," NBER Working Papers 32156, National Bureau of Economic Research, Inc.
    28. Kevin Aslett & Zeve Sanderson & William Godel & Nathaniel Persily & Jonathan Nagler & Joshua A. Tucker, 2024. "Online searches to evaluate misinformation can increase its perceived veracity," Nature, Nature, vol. 625(7995), pages 548-556, January.
    29. Baker, Andrew C. & Larcker, David F. & Wang, Charles C.Y., 2022. "How much should we trust staggered difference-in-differences estimates?," Journal of Financial Economics, Elsevier, vol. 144(2), pages 370-395.
    30. Ro'ee Levy, 2021. "Social Media, News Consumption, and Polarization: Evidence from a Field Experiment," American Economic Review, American Economic Association, vol. 111(3), pages 831-870, March.
    31. Hunt Allcott & Matthew Gentzkow, 2017. "Social Media and Fake News in the 2016 Election," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 211-236, Spring.
    32. Chiara Farronato & Andrey Fradkin & Chris Karr, 2024. "Webmunk: A New Tool for Studying Online Behavior and Digital Platforms," NBER Working Papers 32694, National Bureau of Economic Research, Inc.
    33. Jacques Simon Song & Georges Ngnouwal Eloundou & Fabrice Bitoto Ewolo & Blaise Ondoua Beyene, 2024. "Does Social Media Contribute to Economic Growth?," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(2), pages 8349-8389, June.
    34. Brendan Nyhan & Jaime Settle & Emily Thorson & Magdalena Wojcieszak & Pablo Barberá & Annie Y. Chen & Hunt Allcott & Taylor Brown & Adriana Crespo-Tenorio & Drew Dimmery & Deen Freelon & Matthew Gentz, 2023. "Like-minded sources on Facebook are prevalent but not polarizing," Nature, Nature, vol. 620(7972), pages 137-144, August.
    35. Beknazar-Yuzbashev, George & Stalinski, Mateusz, 2022. "Do social media ads matter for political behavior? A field experiment," Journal of Public Economics, Elsevier, vol. 214(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Beknazar-Yuzbashev, George & Jiménez-Durán, Rafael & McCrosky, Jesse & Stalinski, Mateusz, 2025. "Toxic Content and User Engagement on Social Media: Evidence from a Field Experiment," CAGE Online Working Paper Series 741, Competitive Advantage in the Global Economy (CAGE).
    2. Beknazar-Yuzbashev, George & Jiménez-Durán, Rafael & McCrosky, Jesse & Stalinski, Mateusz, 2025. "Toxic Content and User Engagement on Social Media : Evidence from a Field Experiment," The Warwick Economics Research Paper Series (TWERPS) 1543, University of Warwick, Department of Economics.
    3. Jiménez Durán, Rafael & Muller, Karsten & Schwarz, Carlo, 2024. "The Effect of Content Moderation on Online and Offline Hate: Evidence from Germany’s NetzDG," CAGE Online Working Paper Series 701, Competitive Advantage in the Global Economy (CAGE).
    4. Guy Aridor & Rafael Jiménez-Durán & Ro'ee Levy & Lena Song, 2024. "The Economics of Social Media," Journal of Economic Literature, American Economic Association, vol. 62(4), pages 1422-1474, December.
    5. Guy Aridor & Rafael Jiménez-Durán & Ro'ee Levy & Lena Song, 2024. "Experiments on Social Media," CESifo Working Paper Series 11275, CESifo.
    6. Jiménez-Durán, Rafael, 2022. "The economics of content moderation: Theory and experimental evidence from hate speech on Twitter," Working Papers 324, The University of Chicago Booth School of Business, George J. Stigler Center for the Study of the Economy and the State.
    7. Maurizio Pugno, 2024. "Social media effects on well‐being: The hypothesis of addiction of a new variety," Kyklos, Wiley Blackwell, vol. 77(3), pages 690-704, August.
    8. Cariolle, Joël & Elkhateeb, Yasmine & Maurel, Mathilde, 2024. "Misinformation technology: Internet use and political misperceptions in Africa," Journal of Comparative Economics, Elsevier, vol. 52(2), pages 400-433.
    9. Andranik Tumasjan, 2024. "The many faces of social media in business and economics research: Taking stock of the literature and looking into the future," Journal of Economic Surveys, Wiley Blackwell, vol. 38(2), pages 389-426, April.
    10. Ruben Enikolopov & Maria Petrova & Gianluca Russo & David Yanagizawa-Drott, 2024. "Socializing Alone: How Online Homophily Has Underminded Social Cohesion in the US," CESifo Working Paper Series 11375, CESifo.
    11. Ali, Ayesha & Qazi, Ihsan Ayyub, 2023. "Countering misinformation on social media through educational interventions: Evidence from a randomized experiment in Pakistan," Journal of Development Economics, Elsevier, vol. 163(C).
    12. Geraci, Andrea & Nardotto, Mattia & Reggiani, Tommaso & Sabatini, Fabio, 2022. "Broadband Internet and social capital," Journal of Public Economics, Elsevier, vol. 206(C).
    13. Marco Grotteria & Max Miller & S.Lakshmi Naaraayanan, 2024. "Foreign influence in US politics," Discussion Papers 2024-12, Nottingham Interdisciplinary Centre for Economic and Political Research (NICEP).
    14. Nicolás Ajzenman & Bruno Ferman & Pedro C. Sant’Anna, 2023. "Rooting for the Same Team: On the Interplay between Political and Social Identities in the Formation of Social Ties," Working Papers 231, Red Nacional de Investigadores en Economía (RedNIE).
    15. Luca Braghieri & Ro'ee Levy & Alexey Makarin, 2022. "Social Media and Mental Health," American Economic Review, American Economic Association, vol. 112(11), pages 3660-3693, November.
    16. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2021. "The Effect of Social Media on Elections: Evidence from the United States," NBER Working Papers 28849, National Bureau of Economic Research, Inc.
    17. Martin Beraja & Noam Yuchtman, 2025. "Generalized Disruption: Society, Work, and Property Rights in the Age of AI," NBER Chapters, in: The Economics of Artificial Intelligence: Political Economy, National Bureau of Economic Research, Inc.
    18. Ek, Claes & Samahita, Margaret, 2023. "Too much commitment? An online experiment with tempting YouTube content," Journal of Economic Behavior & Organization, Elsevier, vol. 208(C), pages 21-38.
    19. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2024. "The Effect of Social Media on Elections: Evidence from The United States," Journal of the European Economic Association, European Economic Association, vol. 22(3), pages 1495-1539.
    20. Ekaterina Zhuravskaya & Maria Petrova & Ruben Enikolopov, 2020. "Political Effects of the Internet and Social Media," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 415-438, August.

    More about this item

    Keywords

    toxic content; moderation; social media; user engagement; browser experiment;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • D12 - Microeconomics - - Household Behavior - - - Consumer Economics: Empirical Analysis
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • D90 - Microeconomics - - Micro-Based Behavioral Economics - - - General
    • I31 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - General Welfare, Well-Being
    • L82 - Industrial Organization - - Industry Studies: Services - - - Entertainment; Media
    • L86 - Industrial Organization - - Industry Studies: Services - - - Information and Internet Services; Computer Software
    • M37 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Marketing and Advertising - - - Advertising
    • Z13 - Other Special Topics - - Cultural Economics - - - Economic Sociology; Economic Anthropology; Language; Social and Economic Stratification

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_11644. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.