IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-44801-6.html
   My bibliography  Save this article

Emergence of syntax and word prediction in an artificial neural circuit of the cerebellum

Author

Listed:
  • Keiko Ohmae

    (Baylor College of Medicine
    Chinese Institute for Brain Research (CIBR))

  • Shogo Ohmae

    (Baylor College of Medicine
    Chinese Institute for Brain Research (CIBR))

Abstract

The cerebellum, interconnected with the cerebral neocortex, plays a vital role in human-characteristic cognition such as language processing, however, knowledge about the underlying circuit computation of the cerebellum remains very limited. To gain a better understanding of the computation underlying cerebellar language processing, we developed a biologically constrained cerebellar artificial neural network (cANN) model, which implements the recently identified cerebello-cerebellar recurrent pathway. We found that while cANN acquires prediction of future words, another function of syntactic recognition emerges in the middle layer of the prediction circuit. The recurrent pathway of the cANN was essential for the two language functions, whereas cANN variants with further biological constraints preserved these functions. Considering the uniform structure of cerebellar circuitry across all functional domains, the single-circuit computation, which is the common basis of the two language functions, can be generalized to fundamental cerebellar functions of prediction and grammar-like rule extraction from sequences, that underpin a wide range of cerebellar motor and cognitive functions. This is a pioneering study to understand the circuit computation of human-characteristic cognition using biologically-constrained ANNs.

Suggested Citation

  • Keiko Ohmae & Shogo Ohmae, 2024. "Emergence of syntax and word prediction in an artificial neural circuit of the cerebellum," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-44801-6
    DOI: 10.1038/s41467-024-44801-6
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-44801-6
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-44801-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Shigeru Kitazawa & Tatsuya Kimura & Ping-Bo Yin, 1998. "Cerebellar complex spikes encode both destinations and errors in arm movements," Nature, Nature, vol. 392(6675), pages 494-497, April.
    2. Valerio Mante & David Sussillo & Krishna V. Shenoy & William T. Newsome, 2013. "Context-dependent computation by recurrent dynamics in prefrontal cortex," Nature, Nature, vol. 503(7474), pages 78-84, November.
    3. Alexander G. Huth & Wendy A. de Heer & Thomas L. Griffiths & Frédéric E. Theunissen & Jack L. Gallant, 2016. "Natural speech reveals the semantic maps that tile human cerebral cortex," Nature, Nature, vol. 532(7600), pages 453-458, April.
    4. Charlotte Caucheteux & Alexandre Gramfort & Jean-Rémi King, 2023. "Evidence of a predictive coding hierarchy in the human brain listening to speech," Nature Human Behaviour, Nature, vol. 7(3), pages 430-441, March.
    5. Devika Narain & Evan D. Remington & Chris I. De Zeeuw & Mehrdad Jazayeri, 2018. "A cerebellar mechanism for learning prior distributions of time intervals," Nature Communications, Nature, vol. 9(1), pages 1-12, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sreejan Kumar & Theodore R. Sumers & Takateru Yamakoshi & Ariel Goldstein & Uri Hasson & Kenneth A. Norman & Thomas L. Griffiths & Robert D. Hawkins & Samuel A. Nastase, 2024. "Shared functional specialization in transformer-based language models and the human brain," Nature Communications, Nature, vol. 15(1), pages 1-19, December.
    2. Chris. I. De Zeeuw & Julius Koppen & George. G. Bregman & Marit Runge & Devika Narain, 2023. "Heterogeneous encoding of temporal stimuli in the cerebellar cortex," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    3. Georgia Koppe & Hazem Toutounji & Peter Kirsch & Stefanie Lis & Daniel Durstewitz, 2019. "Identifying nonlinear dynamical systems via generative recurrent neural networks with applications to fMRI," PLOS Computational Biology, Public Library of Science, vol. 15(8), pages 1-35, August.
    4. Chandan Singh & Armin Askari & Rich Caruana & Jianfeng Gao, 2023. "Augmenting interpretable models with large language models during training," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    5. Katherine Farrow & Gilles Grolleau & Naoufel Mzoughi, 2018. "What in the Word! The Scope for the Effect of Word Choice on Economic Behavior," Kyklos, Wiley Blackwell, vol. 71(4), pages 557-580, November.
    6. Jan Weber & Anne-Kristin Solbakk & Alejandro O. Blenkmann & Anais Llorens & Ingrid Funderud & Sabine Leske & Pål Gunnar Larsson & Jugoslav Ivanovic & Robert T. Knight & Tor Endestad & Randolph F. Helf, 2024. "Ramping dynamics and theta oscillations reflect dissociable signatures during rule-guided human behavior," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    7. Pierre O. Boucher & Tian Wang & Laura Carceroni & Gary Kane & Krishna V. Shenoy & Chandramouli Chandrasekaran, 2023. "Initial conditions combine with sensory evidence to induce decision-related dynamics in premotor cortex," Nature Communications, Nature, vol. 14(1), pages 1-28, December.
    8. Rishi Rajalingham & Aída Piccato & Mehrdad Jazayeri, 2022. "Recurrent neural networks with explicit representation of dynamic latent variables can mimic behavioral patterns in a physical inference task," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    9. Sam V Norman-Haignere & Josh H McDermott, 2018. "Neural responses to natural and model-matched stimuli reveal distinct computations in primary and nonprimary auditory cortex," PLOS Biology, Public Library of Science, vol. 16(12), pages 1-46, December.
    10. Wan-Yu Shih & Hsiang-Yu Yu & Cheng-Chia Lee & Chien-Chen Chou & Chien Chen & Paul W. Glimcher & Shih-Wei Wu, 2023. "Electrophysiological population dynamics reveal context dependencies during decision making in human frontal cortex," Nature Communications, Nature, vol. 14(1), pages 1-24, December.
    11. Wenyi Zhang & Yang Xie & Tianming Yang, 2022. "Reward salience but not spatial attention dominates the value representation in the orbitofrontal cortex," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    12. Nir Even-Chen & Blue Sheffer & Saurabh Vyas & Stephen I Ryu & Krishna V Shenoy, 2019. "Structure and variability of delay activity in premotor cortex," PLOS Computational Biology, Public Library of Science, vol. 15(2), pages 1-17, February.
    13. Javier G. Orlandi & Mohammad Abdolrahmani & Ryo Aoki & Dmitry R. Lyamzin & Andrea Benucci, 2023. "Distributed context-dependent choice information in mouse posterior cortex," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    14. Beau Sievers & Christopher Welker & Uri Hasson & Adam M. Kleinbaum & Thalia Wheatley, 2024. "Consensus-building conversation leads to neural alignment," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    15. Joao Barbosa & Rémi Proville & Chris C. Rodgers & Michael R. DeWeese & Srdjan Ostojic & Yves Boubenec, 2023. "Early selection of task-relevant features through population gating," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    16. Nir Moneta & Mona M. Garvert & Hauke R. Heekeren & Nicolas W. Schuck, 2023. "Task state representations in vmPFC mediate relevant and irrelevant value signals and their behavioral influence," Nature Communications, Nature, vol. 14(1), pages 1-21, December.
    17. Huanyuan Zhou & KongFatt Wong-Lin & Da-Hui Wang, 2018. "Parallel Excitatory and Inhibitory Neural Circuit Pathways Underlie Reward-Based Phasic Neural Responses," Complexity, Hindawi, vol. 2018, pages 1-20, April.
    18. Lorenza Lucchi Basili & Pier Luigi Sacco, 2017. "Tie-Up Cycles in Long-Term Mating. Part II: Fictional Narratives and the Social Cognition of Mating," Challenges, MDPI, vol. 8(1), pages 1-60, February.
    19. Benjamin R Cowley & Matthew A Smith & Adam Kohn & Byron M Yu, 2016. "Stimulus-Driven Population Activity Patterns in Macaque Primary Visual Cortex," PLOS Computational Biology, Public Library of Science, vol. 12(12), pages 1-31, December.
    20. Kiyohito Iigaya & Sanghyun Yi & Iman A. Wahle & Sandy Tanwisuth & Logan Cross & John P. O’Doherty, 2023. "Neural mechanisms underlying the hierarchical construction of perceived aesthetic value," Nature Communications, Nature, vol. 14(1), pages 1-19, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-44801-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.