IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1000464.html
   My bibliography  Save this article

Recognizing Sequences of Sequences

Author

Listed:
  • Stefan J Kiebel
  • Katharina von Kriegstein
  • Jean Daunizeau
  • Karl J Friston

Abstract

The brain's decoding of fast sensory streams is currently impossible to emulate, even approximately, with artificial agents. For example, robust speech recognition is relatively easy for humans but exceptionally difficult for artificial speech recognition systems. In this paper, we propose that recognition can be simplified with an internal model of how sensory input is generated, when formulated in a Bayesian framework. We show that a plausible candidate for an internal or generative model is a hierarchy of ‘stable heteroclinic channels’. This model describes continuous dynamics in the environment as a hierarchy of sequences, where slower sequences cause faster sequences. Under this model, online recognition corresponds to the dynamic decoding of causal sequences, giving a representation of the environment with predictive power on several timescales. We illustrate the ensuing decoding or recognition scheme using synthetic sequences of syllables, where syllables are sequences of phonemes and phonemes are sequences of sound-wave modulations. By presenting anomalous stimuli, we find that the resulting recognition dynamics disclose inference at multiple time scales and are reminiscent of neuronal dynamics seen in the real brain.Author Summary: Despite tremendous advances in neuroscience, we cannot yet build machines that recognize the world as effortlessly as we do. One reason might be that there are computational approaches to recognition that have not yet been exploited. Here, we demonstrate that the ability to recognize temporal sequences might play an important part. We show that an artificial decoding device can extract natural speech sounds from sound waves if speech is generated as dynamic and transient sequences of sequences. In principle, this means that artificial recognition can be implemented robustly and online using dynamic systems theory and Bayesian inference.

Suggested Citation

  • Stefan J Kiebel & Katharina von Kriegstein & Jean Daunizeau & Karl J Friston, 2009. "Recognizing Sequences of Sequences," PLOS Computational Biology, Public Library of Science, vol. 5(8), pages 1-13, August.
  • Handle: RePEc:plo:pcbi00:1000464
    DOI: 10.1371/journal.pcbi.1000464
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1000464
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1000464&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1000464?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Mikhail I Rabinovich & Ramón Huerta & Pablo Varona & Valentin S Afraimovich, 2008. "Transient Cognitive Dynamics, Metastability, and Decision Making," PLOS Computational Biology, Public Library of Science, vol. 4(5), pages 1-9, May.
    2. Karl Friston, 2008. "Hierarchical Models in the Brain," PLOS Computational Biology, Public Library of Science, vol. 4(11), pages 1-24, November.
    3. Stefan J Kiebel & Jean Daunizeau & Karl J Friston, 2008. "A Hierarchy of Time-Scales and the Brain," PLOS Computational Biology, Public Library of Science, vol. 4(11), pages 1-12, November.
    4. Michael A. Long & Michale S. Fee, 2008. "Using temperature to analyse temporal dynamics in the songbird motor pathway," Nature, Nature, vol. 456(7219), pages 189-194, November.
    5. Sukhbinder Kumar & Klaas E Stephan & Jason D Warren & Karl J Friston & Timothy D Griffiths, 2007. "Hierarchical Processing of Auditory Objects in Humans," PLOS Computational Biology, Public Library of Science, vol. 3(6), pages 1-9, June.
    6. Konrad P. Körding & Daniel M. Wolpert, 2004. "Bayesian integration in sensorimotor learning," Nature, Nature, vol. 427(6971), pages 244-247, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dionysios Perdikis & Raoul Huys & Viktor K Jirsa, 2011. "Time Scale Hierarchies in the Functional Organization of Complex Behaviors," PLOS Computational Biology, Public Library of Science, vol. 7(9), pages 1-18, September.
    2. Mikhail I Rabinovich & Mehmet K Muezzinoglu & Irina Strigo & Alexander Bystritsky, 2010. "Dynamical Principles of Emotion-Cognition Interaction: Mathematical Images of Mental Disorders," PLOS ONE, Public Library of Science, vol. 5(9), pages 1-10, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dionysios Perdikis & Raoul Huys & Viktor Jirsa, 2011. "Complex Processes from Dynamical Architectures with Time-Scale Hierarchy," PLOS ONE, Public Library of Science, vol. 6(2), pages 1-12, February.
    2. Izzet B Yildiz & Stefan J Kiebel, 2011. "A Hierarchical Neuronal Model for Generation and Online Recognition of Birdsongs," PLOS Computational Biology, Public Library of Science, vol. 7(12), pages 1-18, December.
    3. Dionysios Perdikis & Raoul Huys & Viktor K Jirsa, 2011. "Time Scale Hierarchies in the Functional Organization of Complex Behaviors," PLOS Computational Biology, Public Library of Science, vol. 7(9), pages 1-18, September.
    4. Shih-Wei Wu & Maria F Dal Martello & Laurence T Maloney, 2009. "Sub-Optimal Allocation of Time in Sequential Movements," PLOS ONE, Public Library of Science, vol. 4(12), pages 1-13, December.
    5. Dezhe Z Jin & Alexay A Kozhevnikov, 2011. "A Compact Statistical Model of the Song Syntax in Bengalese Finch," PLOS Computational Biology, Public Library of Science, vol. 7(3), pages 1-19, March.
    6. Micha Heilbron & Florent Meyniel, 2019. "Confidence resets reveal hierarchical adaptive learning in humans," PLOS Computational Biology, Public Library of Science, vol. 15(4), pages 1-24, April.
    7. Leopold Zizlsperger & Thomas Sauvigny & Thomas Haarmeier, 2012. "Selective Attention Increases Choice Certainty in Human Decision Making," PLOS ONE, Public Library of Science, vol. 7(7), pages 1-9, July.
    8. Geonhui Lee & Woong Choi & Hanjin Jo & Wookhyun Park & Jaehyo Kim, 2020. "Analysis of motor control strategy for frontal and sagittal planes of circular tracking movements using visual feedback noise from velocity change and depth information," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-22, November.
    9. Wen-Hao Zhang & Si Wu & Krešimir Josić & Brent Doiron, 2023. "Sampling-based Bayesian inference in recurrent circuits of stochastic spiking neurons," Nature Communications, Nature, vol. 14(1), pages 1-19, December.
    10. John C. Boik, 2020. "Science-Driven Societal Transformation, Part I: Worldview," Sustainability, MDPI, vol. 12(17), pages 1-28, August.
    11. Alejandro Tabas & Anita Siebert & Selma Supek & Daniel Pressnitzer & Emili Balaguer-Ballester & André Rupp, 2016. "Insights on the Neuromagnetic Representation of Temporal Asymmetry in Human Auditory Cortex," PLOS ONE, Public Library of Science, vol. 11(4), pages 1-21, April.
    12. Lilian Fautrelle & Denis Mareschal & Robert French & Caspar Addyman & Elizabeth Thomas, 2015. "Motor Activity Improves Temporal Expectancy," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-14, March.
    13. Adam N Sanborn & Ulrik R Beierholm, 2016. "Fast and Accurate Learning When Making Discrete Numerical Estimates," PLOS Computational Biology, Public Library of Science, vol. 12(4), pages 1-28, April.
    14. Seth W. Egger & Stephen G. Lisberger, 2022. "Neural structure of a sensory decoder for motor control," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    15. Mateus Joffily & Giorgio Coricelli, 2013. "Emotional Valence and the Free-Energy Principle," Post-Print halshs-00834063, HAL.
    16. Tim Genewein & Eduard Hez & Zeynab Razzaghpanah & Daniel A Braun, 2015. "Structure Learning in Bayesian Sensorimotor Integration," PLOS Computational Biology, Public Library of Science, vol. 11(8), pages 1-27, August.
    17. Ofri Raviv & Merav Ahissar & Yonatan Loewenstein, 2012. "How Recent History Affects Perception: The Normative Approach and Its Heuristic Approximation," PLOS Computational Biology, Public Library of Science, vol. 8(10), pages 1-10, October.
    18. Falk Lieder & Klaas E Stephan & Jean Daunizeau & Marta I Garrido & Karl J Friston, 2013. "A Neurocomputational Model of the Mismatch Negativity," PLOS Computational Biology, Public Library of Science, vol. 9(11), pages 1-14, November.
    19. Brocas, Isabelle & Carrillo, Juan D., 2012. "From perception to action: An economic model of brain processes," Games and Economic Behavior, Elsevier, vol. 75(1), pages 81-103.
    20. Jennifer Laura Lee & Wei Ji Ma, 2021. "Point-estimating observer models for latent cause detection," PLOS Computational Biology, Public Library of Science, vol. 17(10), pages 1-29, October.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1000464. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.