IDEAS home Printed from https://ideas.repec.org/a/spr/jcsosc/v5y2022i1d10.1007_s42001-021-00130-y.html
   My bibliography  Save this article

Using word embeddings to probe sentiment associations of politically loaded terms in news and opinion articles from news media outlets

Author

Listed:
  • David Rozado

    (Otago Polytechnic)

  • Musa al-Gharbi

    (Columbia University)

Abstract

This work describes an analysis of political associations in 27 million diachronic (1975–2019) news and opinion articles from 47 news media outlets popular in the United States. We use embedding models trained on individual outlets content to quantify outlet-specific latent associations between positive/negative sentiment words and terms loaded with political connotations such as those describing political orientation, party affiliation, names of influential politicians, and ideologically aligned public figures. We observe that both left- and right-leaning news media tend to associate positive sentiment words with terms used to refer to members of their own political in-group and negative sentiment words with terms used to denote members of their ideological outgroup. Outlets rated as centrist by humans display political associations that are often milder but similar in orientation to those of left-leaning news organizations. A weighted average of political associations by outlets’ readership volume hints that political associations embedded in left of center news outlets might have larger societal reach. A chronological analysis of political associations through time suggests that political sentiment polarization is increasing in both left- and right-leaning news media contents. Our approach for measuring sentiment associations of words denoting political orientation in outlet-specific embedding models correlates substantially with external human ratings of outlet ideological bias (r > 0.7). Yet, specific sentiment associations are sometimes multifaceted and challenging to interpret. Overall, our work signals the potential of machine learning models derived from news media language usage to quantify the ideological bias embedded in news outlet content.

Suggested Citation

  • David Rozado & Musa al-Gharbi, 2022. "Using word embeddings to probe sentiment associations of politically loaded terms in news and opinion articles from news media outlets," Journal of Computational Social Science, Springer, vol. 5(1), pages 427-448, May.
    • Handle: RePEc:spr:jcsosc:v:5:y:2022:i:1:d:10.1007_s42001-021-00130-y
    DOI: 10.1007/s42001-021-00130-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s42001-021-00130-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s42001-021-00130-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gregory J. Martin & Ali Yurukoglu, 2017. "Bias in Cable News: Persuasion and Polarization," American Economic Review, American Economic Association, vol. 107(9), pages 2565-2599, September.
    2. Kahn, Kim Fridkin & Kenney, Patrick J., 2002. "The Slant of the News: How Editorial Endorsements Influence Campaign Coverage and Citizens' Views of Candidates," American Political Science Review, Cambridge University Press, vol. 96(2), pages 381-394, June.
    3. Larcinese, Valentino & Puglisi, Riccardo & Snyder, James M., 2011. "Partisan bias in economic news: Evidence on the agenda-setting behavior of U.S. newspapers," Journal of Public Economics, Elsevier, vol. 95(9), pages 1178-1189.
    4. Gasper, John T., 2011. "Shifting Ideologies? Re-examining Media Bias," Quarterly Journal of Political Science, now publishers, vol. 6(1), pages 85-102, August.
    5. Tim Groseclose & Jeffrey Milyo, 2005. "A Measure of Media Bias," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 120(4), pages 1191-1237.
    6. Baum, Matthew A. & Gussin, Phil, 2008. "In the Eye of the Beholder: How Information Shortcuts Shape Individual Perceptions of Bias in the Media," Quarterly Journal of Political Science, now publishers, vol. 3(1), pages 1-31, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Redlicki, B., 2017. "Spreading Lies," Cambridge Working Papers in Economics 1747, Faculty of Economics, University of Cambridge.
    2. Rafael Di Tella & Ignacio Franceschelli, 2011. "Government Advertising and Media Coverage of Corruption Scandals," American Economic Journal: Applied Economics, American Economic Association, vol. 3(4), pages 119-151, October.
    3. Riccardo Puglisi & James M. Snyder Jr., 2015. "The Balanced Us Press," Journal of the European Economic Association, European Economic Association, vol. 13(2), pages 240-264, April.
    4. Chun-Fang Chiang & Brian Knight, 2011. "Media Bias and Influence: Evidence from Newspaper Endorsements," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(3), pages 795-820.
    5. Knill, April & Liu, Baixiao & McConnell, John J. & McKenzie, Glades, 2024. "The influence of media slant on short sellers," Journal of Corporate Finance, Elsevier, vol. 84(C).
    6. Junze Sun & Arthur Schram & Randolph Sloof, 2019. "A Theory on Media Bias and Elections," Tinbergen Institute Discussion Papers 19-048/I, Tinbergen Institute.
    7. Dewan, Yasir, 2019. "Corporate crime and punishment : The role of status and ideology," Other publications TiSEM 08d87b94-7449-4a1f-a3ae-0, Tilburg University, School of Economics and Management.
    8. Bruce Sacerdote & Ranjan Sehgal & Molly Cook, 2020. "Why Is All COVID-19 News Bad News?," NBER Working Papers 28110, National Bureau of Economic Research, Inc.
    9. Bernhardt, Lea & Dewenter, Ralf & Thomas, Tobias, 2023. "Measuring partisan media bias in US newscasts from 2001 to 2012," European Journal of Political Economy, Elsevier, vol. 78(C).
    10. Giovanni Facchini & Anna Maria Mayda & Riccardo Puglisi, 2017. "Illegal immigration and media exposure: evidence on individual attitudes," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 7(1), pages 1-36, December.
    11. Pal Sudeshna, 2011. "Media Freedom and Socio-Political Instability," Peace Economics, Peace Science, and Public Policy, De Gruyter, vol. 17(1), pages 1-23, March.
    12. Larcinese, Valentino & Puglisi, Riccardo & Snyder, James M., 2011. "Partisan bias in economic news: Evidence on the agenda-setting behavior of U.S. newspapers," Journal of Public Economics, Elsevier, vol. 95(9), pages 1178-1189.
    13. Jetter, Michael & Molina, Teresa, 2022. "Persuasive agenda-setting: Rodrigo Duterte’s inauguration speech and drugs in the Philippines," Journal of Development Economics, Elsevier, vol. 156(C).
    14. Michael Jetter, 2017. "Mediated Terrorism: US News and Al-Qaeda Attacks," CESifo Working Paper Series 6804, CESifo.
    15. Jetter, Michael, 2019. "The inadvertent consequences of al-Qaeda news coverage," European Economic Review, Elsevier, vol. 119(C), pages 391-410.
    16. Piolatto, Amedeo & Schuett, Florian, 2015. "Media competition and electoral politics," Journal of Public Economics, Elsevier, vol. 130(C), pages 80-93.
    17. Puglisi Riccardo, 2011. "Being The New York Times: the Political Behaviour of a Newspaper," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 11(1), pages 1-34, April.
    18. John Duggan & César Martinelli, 2008. "The Role of Media Slant in Elections and Economics," Wallis Working Papers WP54, University of Rochester - Wallis Institute of Political Economy.
    19. Julia Cagé & Moritz Hengel & Nicolas Hervé & Camille Urvoy, 2022. "Hosting Media Bias: Evidence from the Universe of French Broadcasts, 2002-2020," SciencePo Working papers Main hal-03878119, HAL.
    20. Stefano Dellavigna & Johannes Hermle, 2017. "Does Conflict of Interest Lead to Biased Coverage? Evidence from Movie Reviews," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 84(4), pages 1510-1550.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jcsosc:v:5:y:2022:i:1:d:10.1007_s42001-021-00130-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.