IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0210302.html
   My bibliography  Save this article

Computer simulations of coupled idiosyncrasies in speech perception and speech production with COSMO, a perceptuo-motor Bayesian model of speech communication

Author

Listed:
  • Marie-Lou Barnaud
  • Jean-Luc Schwartz
  • Pierre Bessière
  • Julien Diard

Abstract

The existence of a functional relationship between speech perception and production systems is now widely accepted, but the exact nature and role of this relationship remains quite unclear. The existence of idiosyncrasies in production and in perception sheds interesting light on the nature of the link. Indeed, a number of studies explore inter-individual variability in auditory and motor prototypes within a given language, and provide evidence for a link between both sets. In this paper, we attempt to simulate one study on coupled idiosyncrasies in the perception and production of French oral vowels, within COSMO, a Bayesian computational model of speech communication. First, we show that if the learning process in COSMO includes a communicative mechanism between a Learning Agent and a Master Agent, vowel production does display idiosyncrasies. Second, we implement within COSMO three models for speech perception that are, respectively, auditory, motor and perceptuo-motor. We show that no idiosyncrasy in perception can be obtained in the auditory model, since it is optimally tuned to the learning environment, which does not include the motor variability of the Learning Agent. On the contrary, motor and perceptuo-motor models provide perception idiosyncrasies correlated with idiosyncrasies in production. We draw conclusions about the role and importance of motor processes in speech perception, and propose a perceptuo-motor model in which auditory processing would enable optimal processing of learned sounds and motor processing would be helpful in unlearned adverse conditions.

Suggested Citation

  • Marie-Lou Barnaud & Jean-Luc Schwartz & Pierre Bessière & Julien Diard, 2019. "Computer simulations of coupled idiosyncrasies in speech perception and speech production with COSMO, a perceptuo-motor Bayesian model of speech communication," PLOS ONE, Public Library of Science, vol. 14(1), pages 1-34, January.
  • Handle: RePEc:plo:pone00:0210302
    DOI: 10.1371/journal.pone.0210302
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0210302
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0210302&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0210302?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Estelle Gilet & Julien Diard & Pierre Bessière, 2011. "Bayesian Action–Perception Computational Model: Interaction of Production and Recognition of Cursive Letters," PLOS ONE, Public Library of Science, vol. 6(6), pages 1-23, June.
    2. Bryan Gick & Donald Derrick, 2009. "Aero-tactile integration in speech perception," Nature, Nature, vol. 462(7272), pages 502-504, November.
    3. Pascal Belin & Robert J. Zatorre & Philippe Lafaille & Pierre Ahad & Bruce Pike, 2000. "Voice-selective areas in human auditory cortex," Nature, Nature, vol. 403(6767), pages 309-312, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sukhbinder Kumar & Klaas E Stephan & Jason D Warren & Karl J Friston & Timothy D Griffiths, 2007. "Hierarchical Processing of Auditory Objects in Humans," PLOS Computational Biology, Public Library of Science, vol. 3(6), pages 1-9, June.
    2. Sam V Norman-Haignere & Josh H McDermott, 2018. "Neural responses to natural and model-matched stimuli reveal distinct computations in primary and nonprimary auditory cortex," PLOS Biology, Public Library of Science, vol. 16(12), pages 1-46, December.
    3. Jean-François Patri & Pascal Perrier & Jean-Luc Schwartz & Julien Diard, 2018. "What drives the perceptual change resulting from speech motor adaptation? Evaluation of hypotheses in a Bayesian modeling framework," PLOS Computational Biology, Public Library of Science, vol. 14(1), pages 1-38, January.
    4. Patrícia Vanzella & E Glenn Schellenberg, 2010. "Absolute Pitch: Effects of Timbre on Note-Naming Ability," PLOS ONE, Public Library of Science, vol. 5(11), pages 1-7, November.
    5. Emmanuel Bigand & Charles Delbé & Yannick Gérard & Barbara Tillmann, 2011. "Categorization of Extremely Brief Auditory Stimuli: Domain-Specific or Domain-General Processes?," PLOS ONE, Public Library of Science, vol. 6(10), pages 1-6, October.
    6. Daniel E Re & Jillian J M O'Connor & Patrick J Bennett & David R Feinberg, 2012. "Preferences for Very Low and Very High Voice Pitch in Humans," PLOS ONE, Public Library of Science, vol. 7(3), pages 1-8, March.
    7. Clara Suied & Isabelle Viaud-Delmon, 2009. "Auditory-Visual Object Recognition Time Suggests Specific Processing for Animal Sounds," PLOS ONE, Public Library of Science, vol. 4(4), pages 1-9, April.
    8. Kazuo Imaizumi & Nicholas J Priebe & Tatyana O Sharpee & Steven W Cheung & Christoph E Schreiner, 2010. "Encoding of Temporal Information by Timing, Rate, and Place in Cat Auditory Cortex," PLOS ONE, Public Library of Science, vol. 5(7), pages 1-15, July.
    9. Carolin Brück & Christina Gößling-Arnold & Jürgen Wertheimer & Dirk Wildgruber, 2016. "“The Inner Theaterâ€," SAGE Open, , vol. 6(1), pages 21582440166, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0210302. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.