IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-44801-6.html
   My bibliography  Save this article

Emergence of syntax and word prediction in an artificial neural circuit of the cerebellum

Author

Listed:
  • Keiko Ohmae

    (Baylor College of Medicine
    Chinese Institute for Brain Research (CIBR))

  • Shogo Ohmae

    (Baylor College of Medicine
    Chinese Institute for Brain Research (CIBR))

Abstract

The cerebellum, interconnected with the cerebral neocortex, plays a vital role in human-characteristic cognition such as language processing, however, knowledge about the underlying circuit computation of the cerebellum remains very limited. To gain a better understanding of the computation underlying cerebellar language processing, we developed a biologically constrained cerebellar artificial neural network (cANN) model, which implements the recently identified cerebello-cerebellar recurrent pathway. We found that while cANN acquires prediction of future words, another function of syntactic recognition emerges in the middle layer of the prediction circuit. The recurrent pathway of the cANN was essential for the two language functions, whereas cANN variants with further biological constraints preserved these functions. Considering the uniform structure of cerebellar circuitry across all functional domains, the single-circuit computation, which is the common basis of the two language functions, can be generalized to fundamental cerebellar functions of prediction and grammar-like rule extraction from sequences, that underpin a wide range of cerebellar motor and cognitive functions. This is a pioneering study to understand the circuit computation of human-characteristic cognition using biologically-constrained ANNs.

Suggested Citation

  • Keiko Ohmae & Shogo Ohmae, 2024. "Emergence of syntax and word prediction in an artificial neural circuit of the cerebellum," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-44801-6
    DOI: 10.1038/s41467-024-44801-6
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-44801-6
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-44801-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Valerio Mante & David Sussillo & Krishna V. Shenoy & William T. Newsome, 2013. "Context-dependent computation by recurrent dynamics in prefrontal cortex," Nature, Nature, vol. 503(7474), pages 78-84, November.
    2. Alexander G. Huth & Wendy A. de Heer & Thomas L. Griffiths & Frédéric E. Theunissen & Jack L. Gallant, 2016. "Natural speech reveals the semantic maps that tile human cerebral cortex," Nature, Nature, vol. 532(7600), pages 453-458, April.
    3. Shigeru Kitazawa & Tatsuya Kimura & Ping-Bo Yin, 1998. "Cerebellar complex spikes encode both destinations and errors in arm movements," Nature, Nature, vol. 392(6675), pages 494-497, April.
    4. Charlotte Caucheteux & Alexandre Gramfort & Jean-Rémi King, 2023. "Evidence of a predictive coding hierarchy in the human brain listening to speech," Nature Human Behaviour, Nature, vol. 7(3), pages 430-441, March.
    5. Devika Narain & Evan D. Remington & Chris I. De Zeeuw & Mehrdad Jazayeri, 2018. "A cerebellar mechanism for learning prior distributions of time intervals," Nature Communications, Nature, vol. 9(1), pages 1-12, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sreejan Kumar & Theodore R. Sumers & Takateru Yamakoshi & Ariel Goldstein & Uri Hasson & Kenneth A. Norman & Thomas L. Griffiths & Robert D. Hawkins & Samuel A. Nastase, 2024. "Shared functional specialization in transformer-based language models and the human brain," Nature Communications, Nature, vol. 15(1), pages 1-19, December.
    2. Chris. I. De Zeeuw & Julius Koppen & George. G. Bregman & Marit Runge & Devika Narain, 2023. "Heterogeneous encoding of temporal stimuli in the cerebellar cortex," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    3. Chandan Singh & Armin Askari & Rich Caruana & Jianfeng Gao, 2023. "Augmenting interpretable models with large language models during training," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    4. Jan Weber & Anne-Kristin Solbakk & Alejandro O. Blenkmann & Anais Llorens & Ingrid Funderud & Sabine Leske & Pål Gunnar Larsson & Jugoslav Ivanovic & Robert T. Knight & Tor Endestad & Randolph F. Helf, 2024. "Ramping dynamics and theta oscillations reflect dissociable signatures during rule-guided human behavior," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    5. Pierre O. Boucher & Tian Wang & Laura Carceroni & Gary Kane & Krishna V. Shenoy & Chandramouli Chandrasekaran, 2023. "Initial conditions combine with sensory evidence to induce decision-related dynamics in premotor cortex," Nature Communications, Nature, vol. 14(1), pages 1-28, December.
    6. Rishi Rajalingham & Aída Piccato & Mehrdad Jazayeri, 2022. "Recurrent neural networks with explicit representation of dynamic latent variables can mimic behavioral patterns in a physical inference task," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    7. Wan-Yu Shih & Hsiang-Yu Yu & Cheng-Chia Lee & Chien-Chen Chou & Chien Chen & Paul W. Glimcher & Shih-Wei Wu, 2023. "Electrophysiological population dynamics reveal context dependencies during decision making in human frontal cortex," Nature Communications, Nature, vol. 14(1), pages 1-24, December.
    8. Wenyi Zhang & Yang Xie & Tianming Yang, 2022. "Reward salience but not spatial attention dominates the value representation in the orbitofrontal cortex," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    9. Beau Sievers & Christopher Welker & Uri Hasson & Adam M. Kleinbaum & Thalia Wheatley, 2024. "Consensus-building conversation leads to neural alignment," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    10. Lorenza Lucchi Basili & Pier Luigi Sacco, 2017. "Tie-Up Cycles in Long-Term Mating. Part II: Fictional Narratives and the Social Cognition of Mating," Challenges, MDPI, vol. 8(1), pages 1-60, February.
    11. Benjamin R Cowley & Matthew A Smith & Adam Kohn & Byron M Yu, 2016. "Stimulus-Driven Population Activity Patterns in Macaque Primary Visual Cortex," PLOS Computational Biology, Public Library of Science, vol. 12(12), pages 1-31, December.
    12. Katarzyna Jurewicz & Brianna J. Sleezer & Priyanka S. Mehta & Benjamin Y. Hayden & R. Becket Ebitz, 2024. "Irrational choices via a curvilinear representational geometry for value," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    13. Nagaraj R. Mahajan & Shreesh P. Mysore, 2022. "Donut-like organization of inhibition underlies categorical neural responses in the midbrain," Nature Communications, Nature, vol. 13(1), pages 1-17, December.
    14. Barbara Feulner & Matthew G. Perich & Raeed H. Chowdhury & Lee E. Miller & Juan A. Gallego & Claudia Clopath, 2022. "Small, correlated changes in synaptic connectivity may facilitate rapid motor learning," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    15. Noel Federman & Sebastián A. Romano & Macarena Amigo-Duran & Lucca Salomon & Antonia Marin-Burgin, 2024. "Acquisition of non-olfactory encoding improves odour discrimination in olfactory cortex," Nature Communications, Nature, vol. 15(1), pages 1-19, December.
    16. Daniel Durstewitz, 2017. "A state space approach for piecewise-linear recurrent neural networks for identifying computational dynamics from neural measurements," PLOS Computational Biology, Public Library of Science, vol. 13(6), pages 1-33, June.
    17. João D. Semedo & Anna I. Jasper & Amin Zandvakili & Aravind Krishna & Amir Aschner & Christian K. Machens & Adam Kohn & Byron M. Yu, 2022. "Feedforward and feedback interactions between visual cortical areas use different population activity patterns," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    18. Desjardins, Christoph, 2021. "Don't be too SMART, but SAVE your goals: Proposal for a renewed goal-setting formula for Generation Y," Journal of Applied Leadership and Management, Hochschule Kempten - University of Applied Sciences, Professional School of Business & Technology, vol. 9, pages 73-87.
    19. Laura E. Suárez & Agoston Mihalik & Filip Milisav & Kenji Marshall & Mingze Li & Petra E. Vértes & Guillaume Lajoie & Bratislav Misic, 2024. "Connectome-based reservoir computing with the conn2res toolbox," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    20. Maryam Honari-Jahromi & Brea Chouinard & Esti Blanco-Elorrieta & Liina Pylkkänen & Alona Fyshe, 2021. "Neural representation of words within phrases: Temporal evolution of color-adjectives and object-nouns during simple composition," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-17, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-44801-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.