IDEAS home Printed from https://ideas.repec.org/a/gam/jftint/v14y2022i10p284-d929512.html
   My bibliography  Save this article

Modeling and Validating a News Recommender Algorithm in a Mainstream Medium-Sized News Organization: An Experimental Approach

Author

Listed:
  • Paschalia (Lia) Spyridou

    (Department of Communication and Internet Studies, Cyprus University of Technology, Saripolou 33, 3036 Limassol, Cyprus)

  • Constantinos Djouvas

    (Department of Communication and Internet Studies, Cyprus University of Technology, Saripolou 33, 3036 Limassol, Cyprus)

  • Dimitra Milioni

    (Department of Communication and Internet Studies, Cyprus University of Technology, Saripolou 33, 3036 Limassol, Cyprus)

Abstract

News recommending systems (NRSs) are algorithmic tools that filter incoming streams of information according to the users’ preferences or point them to additional items of interest. In today’s high-choice media environment, attention shifts easily between platforms and news sites and is greatly affected by algorithmic technologies; news personalization is increasingly used by news media to woo and retain users’ attention and loyalty. The present study examines the implementation of a news recommender algorithm in a leading news media organization on the basis of observation of the recommender system’s outputs. Drawing on an experimental design employing the ‘algorithmic audit’ method, and more specifically the ‘collaborative audit’ which entails utilizing users as testers of algorithmic systems, we analyze the composition of the personalized MyNews area in terms of accuracy and user engagement. Premised on the idea of algorithms being black boxes, the study has a two-fold aim: first, to identify the implicated design parameters enlightening the underlying functionality of the algorithm, and second, to evaluate in practice the NRS through the deployed experimentation. Results suggest that although the recommender algorithm manages to discriminate between different users on the basis of their past behavior, overall, it underperforms. We find that this is related to flawed design decisions rather than technical deficiencies. The study offers insights to guide the improvement of NRSs’ design that both considers the production capabilities of the news organization and supports business goals, user demands and journalism’s civic values.

Suggested Citation

  • Paschalia (Lia) Spyridou & Constantinos Djouvas & Dimitra Milioni, 2022. "Modeling and Validating a News Recommender Algorithm in a Mainstream Medium-Sized News Organization: An Experimental Approach," Future Internet, MDPI, vol. 14(10), pages 1-21, September.
    • Handle: RePEc:gam:jftint:v:14:y:2022:i:10:p:284-:d:929512
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1999-5903/14/10/284/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1999-5903/14/10/284/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lazaros Vrysis & Nikolaos Vryzas & Rigas Kotsakis & Theodora Saridou & Maria Matsiola & Andreas Veglis & Carlos Arcila-Calderón & Charalampos Dimoulas, 2021. "A Web Interface for Analyzing Hate Speech," Future Internet, MDPI, vol. 13(3), pages 1-18, March.
    2. Bastian, Mariella & Makhortykh, Mykola & Harambam, Jaron & van Drunen, Max, 2020. "Explanations of news personalisation across countries and media types," Internet Policy Review: Journal on Internet Regulation, Alexander von Humboldt Institute for Internet and Society (HIIG), Berlin, vol. 9(4), pages 1-34.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Charalampos A. Dimoulas & Andreas Veglis, 2023. "Theory and Applications of Web 3.0 in the Media Sector," Future Internet, MDPI, vol. 15(5), pages 1-10, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carlos Arcila-Calderón & Javier J. Amores & Patricia Sánchez-Holgado & Lazaros Vrysis & Nikolaos Vryzas & Martín Oller Alonso, 2022. "How to Detect Online Hate towards Migrants and Refugees? Developing and Evaluating a Classifier of Racist and Xenophobic Hate Speech Using Shallow and Deep Learning," Sustainability, MDPI, vol. 14(20), pages 1-16, October.
    2. Andreas Giannakoulopoulos & Minas Pergantis & Laida Limniati & Alexandros Kouretsis, 2022. "Investigating the Country of Origin and the Role of the .eu TLD in External Trade of European Union Member States," Future Internet, MDPI, vol. 14(6), pages 1-27, June.
    3. Charalampos A. Dimoulas & Andreas Veglis, 2023. "Theory and Applications of Web 3.0 in the Media Sector," Future Internet, MDPI, vol. 15(5), pages 1-10, April.
    4. Urman, Aleksandra & Makhortykh, Mykola, 2023. "How transparent are transparency reports? Comparative analysis of transparency reporting across online platforms," Telecommunications Policy, Elsevier, vol. 47(3).
    5. Nikolaos Vryzas & Anastasia Katsaounidou & Lazaros Vrysis & Rigas Kotsakis & Charalampos Dimoulas, 2022. "A Prototype Web Application to Support Human-Centered Audiovisual Content Authentication and Crowdsourcing," Future Internet, MDPI, vol. 14(3), pages 1-17, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jftint:v:14:y:2022:i:10:p:284-:d:929512. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.