IDEAS home Printed from https://ideas.repec.org/a/jas/jasssj/2023-60-2.html
   My bibliography  Save this article

Can a Single Line of Code Change Society? The Systemic Risks of Optimizing Engagement in Recommender Systems on Global Information Flow, Opinion Dynamics and Social Structures

Author

Abstract

As the last few years have seen an increase in both online hostility and polarization, we need to move beyond the fact-checking reflex or the praise for better moderation on social networking sites (SNS) and investigate their impact on social structures and social cohesion. In particular, the role of recommender systems deployed by Very Large Online Platforms (VLOPs) such as Facebook or Twitter has been overlooked. This paper draws on the literature on cognitive science, digital media, and opinion dynamics to propose a faithful replica of the entanglement between recommender systems, opinion dynamics and users' cognitive bias on SNSs like Twitter that is calibrated over a large scale longitudinal database of tweets from political activists. This model makes it possible to compare the consequences of various recommendation algorithms on the social fabric, to quantify their interaction with some major cognitive bias. In particular, we demonstrate that the recommender systems that seek to solely maximize users' engagement necessarily lead to a polarization of the opinion landscape, to a concentration of social power in the hands of the most toxic users and to an overexposure of users to negative content (up to 300% for some of them), a phenomenon called algorithmic negativity bias. Toxic users are more than twice as numerous in the top 1% of the most influential users than in the overall population. Overall, our results highlight the systemic risks generated by certain implementations of recommender systems and the urgent need to comprehensively identify implementations of recommender systems harmful to individuals and society. This is a necessary step in setting up future regulations for systemic SNSs, such as the European Digital Market Act.

Suggested Citation

  • David Chavalarias & Paul Bouchaud & Maziyar Panahi, 2024. "Can a Single Line of Code Change Society? The Systemic Risks of Optimizing Engagement in Recommender Systems on Global Information Flow, Opinion Dynamics and Social Structures," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 27(1), pages 1-9.
  • Handle: RePEc:jas:jasssj:2023-60-2
    as

    Download full text from publisher

    File URL: https://www.jasss.org/27/1/9/9.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hunt Allcott & Luca Braghieri & Sarah Eichmeyer & Matthew Gentzkow, 2020. "The Welfare Effects of Social Media," American Economic Review, American Economic Association, vol. 110(3), pages 629-676, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wu, Haitao & Ba, Ning & Ren, Siyu & Xu, Lu & Chai, Jingxia & Irfan, Muhammad & Hao, Yu & Lu, Zhi-Nan, 2022. "The impact of internet development on the health of Chinese residents: Transmission mechanisms and empirical tests," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    2. Nicolás Ajzenman & Bruno Ferman & Pedro C. Sant’Anna, 2023. "Rooting for the Same Team: On the Interplay between Political and Social Identities in the Formation of Social Ties," Working Papers 231, Red Nacional de Investigadores en Economía (RedNIE).
    3. McNamara, Trent & Mosquera, Roberto, 2024. "The political divide: The case of expectations and preferences," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 110(C).
    4. Larsen, Vegard H. & Thorsrud, Leif Anders & Zhulanova, Julia, 2021. "News-driven inflation expectations and information rigidities," Journal of Monetary Economics, Elsevier, vol. 117(C), pages 507-520.
    5. Cook, Joseph & Kabubo-Mariara, Jane & Kimuyu, Peter, 2021. "The Short-Run Impacts of Reducing Water Collection Times on Time Use, Well-Being and Education in Rural Kenya," EfD Discussion Paper 21-9, Environment for Development, University of Gothenburg.
    6. Assenza, Tiziana, 2021. "The Ability to 'Distill the Truth'," TSE Working Papers 21-1280, Toulouse School of Economics (TSE), revised Mar 2022.
    7. Meng, Delong & Wang, Siyu, 2024. "Impact of open-mindedness on information avoidance: Tailored vs. generic communication," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 108(C).
    8. Arora, Swapan Deep & Singh, Guninder Pal & Chakraborty, Anirban & Maity, Moutusy, 2022. "Polarization and social media: A systematic review and research agenda," Technological Forecasting and Social Change, Elsevier, vol. 183(C).
    9. Cowan, Benjamin & Jones, Todd R. & Swigert, Jeffrey, 2024. "Parental and Student Time Use Around the Academic Year," Journal of Economic Behavior & Organization, Elsevier, vol. 224(C), pages 66-110.
    10. Brynjolfsson, Erik & Collis, Avinash & Diewert, W. Erwin & Eggers, Felix & Fox, Kevin J., 2019. "GDP-B: Accounting for the Value of New and Free Goods in the Digital Economy," OSF Preprints sptfu, Center for Open Science.
    11. Daniel J Benjamin & Jakina Debnam Guzman & Marc Fleurbaey & Ori Heffetz & Miles Kimball, 2023. "What do Happiness Data Mean? Theory and Survey Evidence," Journal of the European Economic Association, European Economic Association, vol. 21(6), pages 2377-2412.
    12. Luca Braghieri & Ro'ee Levy & Alexey Makarin, 2022. "Social Media and Mental Health," American Economic Review, American Economic Association, vol. 112(11), pages 3660-3693, November.
    13. Mohadzlishah bin Mazli & Mohd Fikri bin Ishak & Ariff Azly bin Muhamed, 2023. "The Role of Status Consumption and Materialism in Influencing Attitude towards Counterfeit Fashion Product," Information Management and Business Review, AMH International, vol. 15(3), pages 344-350.
    14. Fazio, Andrea & Reggiani, Tommaso & Scervini, Francesco, 2023. "Social media charity campaigns and pro-social behaviour. Evidence from the Ice Bucket Challenge," Journal of Economic Psychology, Elsevier, vol. 96(C).
    15. Briglauer, Wolfgang & Krämer, Jan & Palan, Nicole, 2024. "Socioeconomic benefits of high-speed broadband availability and service adoption: A survey," Telecommunications Policy, Elsevier, vol. 48(7).
    16. Rakshit, Sonali & Sahoo, Soham, 2023. "Biased teachers and gender gap in learning outcomes: Evidence from India," Journal of Development Economics, Elsevier, vol. 161(C).
    17. Andrea Tesei & Filipe Campante & Ruben Durante, 2022. "Media and Social Capital," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 69-91, August.
    18. Eugen Dimant, 2020. "Hate Trumps Love: The Impact of Political Polarization on Social Preferences," ECONtribute Discussion Papers Series 029, University of Bonn and University of Cologne, Germany.
    19. Rezaee, Arman & Hirshleifer, Sarojini & Naseem, Mustafa & Raza, Agha Ali, 2023. "The Spread of (Mis)information: A Social Media Experiment in Pakistan," Institute on Global Conflict and Cooperation, Working Paper Series qt53n4q35z, Institute on Global Conflict and Cooperation, University of California.
    20. Matija Kovacic & Cristina Elisa Orso, 2024. "Adverse childhood experiences and social media use in adulthood. Evidence from a novel EU survey," Working Papers 2024: 17, Department of Economics, University of Venice "Ca' Foscari".

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jas:jasssj:2023-60-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesco Renzini (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.