IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0161752.html
   My bibliography  Save this article

Strength Is in Numbers: Can Concordant Artificial Listeners Improve Prediction of Emotion from Speech?

Author

Listed:
  • Eugenio Martinelli
  • Arianna Mencattini
  • Elena Daprati
  • Corrado Di Natale

Abstract

Humans can communicate their emotions by modulating facial expressions or the tone of their voice. Albeit numerous applications exist that enable machines to read facial emotions and recognize the content of verbal messages, methods for speech emotion recognition are still in their infancy. Yet, fast and reliable applications for emotion recognition are the obvious advancement of present ‘intelligent personal assistants’, and may have countless applications in diagnostics, rehabilitation and research. Taking inspiration from the dynamics of human group decision-making, we devised a novel speech emotion recognition system that applies, for the first time, a semi-supervised prediction model based on consensus. Three tests were carried out to compare this algorithm with traditional approaches. Labeling performances relative to a public database of spontaneous speeches are reported. The novel system appears to be fast, robust and less computationally demanding than traditional methods, allowing for easier implementation in portable voice-analyzers (as used in rehabilitation, research, industry, etc.) and for applications in the research domain (such as real-time pairing of stimuli to participants’ emotional state, selective/differential data collection based on emotional content, etc.).

Suggested Citation

  • Eugenio Martinelli & Arianna Mencattini & Elena Daprati & Corrado Di Natale, 2016. "Strength Is in Numbers: Can Concordant Artificial Listeners Improve Prediction of Emotion from Speech?," PLOS ONE, Public Library of Science, vol. 11(8), pages 1-16, August.
    • Handle: RePEc:plo:pone00:0161752
    DOI: 10.1371/journal.pone.0161752
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0161752
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0161752&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0161752?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Editors The, 2008. "From the Editors," Basic Income Studies, De Gruyter, vol. 3(1), pages 1-1, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rosalie L Tung & Günter K Stahl, 2018. "The tortuous evolution of the role of culture in IB research: What we know, what we don’t know, and where we are headed," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 49(9), pages 1167-1189, December.
    2. repec:dau:papers:123456789/7346 is not listed on IDEAS
    3. Laurent, Catherine E. & Berriet-Solliec, Marielle & Kirsch, Marc & Labarthe, Pierre & Trouve, Aurelie, 2010. "Multifunctionality Of Agriculture, Public Policies And Scientific Evidences: Some Critical Issues Of Contemporary Controversies," APSTRACT: Applied Studies in Agribusiness and Commerce, AGRIMBA, vol. 4(1-2), pages 1-6.
    4. Arruda Gustavo & Lima Daniela & Teles Vladimir Kühl, 2020. "Household borrowing constraints and monetary policy in emerging economies," The B.E. Journal of Macroeconomics, De Gruyter, vol. 20(1), pages 1-21, January.
    5. Elaine E Potter & Carol S Thornber & John-David Swanson & Malcolm McFarland, 2016. "Ploidy Distribution of the Harmful Bloom Forming Macroalgae Ulva spp. in Narragansett Bay, Rhode Island, USA, Using Flow Cytometry Methods," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-15, February.
    6. Hsu, Dan K. & Burmeister-Lamp, Katrin & Simmons, Sharon A. & Foo, Maw-Der & Hong, Michelle C. & Pipes, Jesse D., 2019. "“I know I can, but I don't fit”: Perceived fit, self-efficacy, and entrepreneurial intention," Journal of Business Venturing, Elsevier, vol. 34(2), pages 311-326.
    7. Steve Holden & Austin Kelly & Douglas McManus & Therese Scharlemann & Ryan Singer & John D. Worth, 2012. "The HAMP NPV Model: Development and Early Performance," Real Estate Economics, American Real Estate and Urban Economics Association, vol. 40, pages 32-64, December.
    8. Markusen, James R., 2013. "Expansion of trade at the extensive margin: A general gains-from-trade result and illustrative examples," Journal of International Economics, Elsevier, vol. 89(1), pages 262-270.
    9. Francesconi, Marco & Slonimczyk, Fabian & Yurko, Anna, 2017. "Moving On Up for High School Graduates in Russia: The Consequences of the Uni ed State Exam Reform," CEPR Discussion Papers 11996, C.E.P.R. Discussion Papers.
    10. Lude, Maximilian & Prügl, Reinhard, 2021. "Experimental studies in family business research," Journal of Family Business Strategy, Elsevier, vol. 12(1).
    11. Batistič, Saša & Černe, Matej & Kaše, Robert & Zupic, Ivan, 2016. "The role of organizational context in fostering employee proactive behavior: The interplay between HR system configurations and relational climates," European Management Journal, Elsevier, vol. 34(5), pages 579-588.
    12. Patrick Messerlin, 2010. "Climate change and trade policy: From mutual destruction to mutual support," Working Papers hal-00972994, HAL.
    13. Dan K. Hsu & Johan Wiklund & Richard D. Cotton, 2017. "Success, Failure, and Entrepreneurial Reentry: An Experimental Assessment of the Veracity of Self–Efficacy and Prospect Theory," Entrepreneurship Theory and Practice, , vol. 41(1), pages 19-47, January.
    14. Krueger, Norris & Bogers, Marcel L.A.M. & Labaki, Rania & Basco, Rodrigo, 2021. "Advancing family business science through context theorizing: The case of the Arab world," Journal of Family Business Strategy, Elsevier, vol. 12(1).
    15. Maureen Were, 2011. "Is There a Link Between Casual Employment and Export-Orientation of Firms? The Case of Kenya’s Manufacturing Sector," The Review of Black Political Economy, Springer;National Economic Association, vol. 38(3), pages 227-242, September.
    16. Patrick Sakdapolrak & Thomas Seyler & Christina Ergler, 2013. "Burden of direct and indirect costs of illness: Empirical findings from slum settlements in Chennai, South India," Progress in Development Studies, , vol. 13(2), pages 135-151, April.
    17. Jana Schmutzler & Edward Lorenz, 2018. "Tolerance, agglomeration, and enterprise innovation performance: a multilevel analysis of Latin American regions," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 27(2), pages 243-268.
    18. Choi, James J. & Haisley, Emily & Kurkoski, Jennifer & Massey, Cade, 2017. "Small cues change savings choices," Journal of Economic Behavior & Organization, Elsevier, vol. 142(C), pages 378-395.
    19. Carlos Scartascini & Mariano Tommasi & Ernesto Stein, 2010. "Veto Players and Policy Trade-Offs- An Intertemporal Approach to Study the Effects of Political Institutions on Policy," Research Department Publications 4660, Inter-American Development Bank, Research Department.
    20. John Beshears & James J. Choi & David Laibson & Brigitte C. Madrian, 2010. "The Impact of Employer Matching on Savings Plan Participation under Automatic Enrollment," NBER Chapters, in: Research Findings in the Economics of Aging, pages 311-327, National Bureau of Economic Research, Inc.
    21. repec:spo:wpmain:info:hdl:2441/5l6uh8ogmqildh09h2q83h42k is not listed on IDEAS
    22. Catherine Welch & Eriikka Paavilainen-Mäntymäki & Rebecca Piekkari & Emmanuella Plakoyiannaki, 2022. "Reconciling theory and context: How the case study can set a new agenda for international business research," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 53(1), pages 4-26, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0161752. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.