IDEAS home Printed from https://ideas.repec.org/a/gam/jsoctx/v15y2025i3p54-d1597256.html
   My bibliography  Save this article

Gamified Engagement for Data Crowdsourcing and AI Literacy: An Investigation in Affective Communication Through Speech Emotion Recognition

Author

Listed:
  • Eleni Siamtanidou

    (Multidisciplinary Media and Mediated Communication (M3C) Research Group, School of Journalism and Mass Communications, Aristotle University, 54124 Thessaloniki, Greece)

  • Lazaros Vrysis

    (Multidisciplinary Media and Mediated Communication (M3C) Research Group, School of Journalism and Mass Communications, Aristotle University, 54124 Thessaloniki, Greece)

  • Nikolaos Vryzas

    (Multidisciplinary Media and Mediated Communication (M3C) Research Group, School of Journalism and Mass Communications, Aristotle University, 54124 Thessaloniki, Greece)

  • Charalampos A. Dimoulas

    (Multidisciplinary Media and Mediated Communication (M3C) Research Group, School of Journalism and Mass Communications, Aristotle University, 54124 Thessaloniki, Greece)

Abstract

This research investigates the utilization of entertainment approaches, such as serious games and gamification technologies, to address various challenges and implement targeted tasks. Specifically, it details the design and development of an innovative gamified application named “J-Plus”, aimed at both professionals and non-professionals in journalism. This application facilitates the enjoyable, efficient, and high-quality collection of emotionally tagged speech samples, enhancing the performance and robustness of speech emotion recognition (SER) systems. Additionally, these approaches offer significant educational benefits, providing users with knowledge about emotional speech and artificial intelligence (AI) mechanisms while promoting digital skills. This project was evaluated by 48 participants, with 44 engaging in quantitative assessments and 4 forming an expert group for qualitative methodologies. This evaluation validated the research questions and hypotheses, demonstrating the application’s diverse benefits. Key findings indicate that gamified features can effectively support learning and attract users, with approximately 70% of participants agreeing that serious games and gamification could enhance their motivation to practice and improve their emotional speech. Additionally, 50% of participants identified social interaction features, such as collaboration, as most beneficial for fostering motivation and commitment. The integration of these elements supports reliable and extensive data collection and the advancement of AI algorithms while concurrently developing various skills, such as emotional speech articulation and digital literacy. This paper advocates for the creation of collaborative environments and digital communities through crowdsourcing, balancing technological innovation in the SER sector.

Suggested Citation

  • Eleni Siamtanidou & Lazaros Vrysis & Nikolaos Vryzas & Charalampos A. Dimoulas, 2025. "Gamified Engagement for Data Crowdsourcing and AI Literacy: An Investigation in Affective Communication Through Speech Emotion Recognition," Societies, MDPI, vol. 15(3), pages 1-29, February.
    • Handle: RePEc:gam:jsoctx:v:15:y:2025:i:3:p:54-:d:1597256
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2075-4698/15/3/54/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2075-4698/15/3/54/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Aspen Lillywhite & Gregor Wolbring, 2020. "Coverage of Artificial Intelligence and Machine Learning within Academic Literature, Canadian Newspapers, and Twitter Tweets: The Case of Disabled People," Societies, MDPI, vol. 10(1), pages 1-27, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gregor Wolbring, 2022. "Auditing the ‘Social’ of Quantum Technologies: A Scoping Review," Societies, MDPI, vol. 12(2), pages 1-38, March.
    2. Gregor Wolbring & Laiba Nasir, 2024. "Intersectionality of Disabled People through a Disability Studies, Ability-Based Studies, and Intersectional Pedagogy Lens: A Survey and a Scoping Review," Societies, MDPI, vol. 14(9), pages 1-77, September.
    3. Gregor Wolbring & Aspen Lillywhite, 2023. "Coverage of Allies, Allyship and Disabled People: A Scoping Review," Societies, MDPI, vol. 13(11), pages 1-38, November.
    4. Braganza, Ashley & Chen, Weifeng & Canhoto, Ana & Sap, Serap, 2021. "Productive employment and decent work: The impact of AI adoption on psychological contracts, job engagement and employee trust," Journal of Business Research, Elsevier, vol. 131(C), pages 485-494.
    5. Simerta Gill & Gregor Wolbring, 2022. "Auditing the ‘Social’ Using Conventions, Declarations, and Goal Setting Documents: A Scoping Review," Societies, MDPI, vol. 12(6), pages 1-100, October.
    6. Éidín Ní Shé & Deirdre O’Donnell & Marie O’Shea & Diarmuid Stokes, 2020. "New Ways of Working? A Rapid Exploration of Emerging Evidence Regarding the Care of Older People during COVID19," IJERPH, MDPI, vol. 17(18), pages 1-15, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsoctx:v:15:y:2025:i:3:p:54-:d:1597256. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.