IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v13y2022i1d10.1038_s41467-022-30978-1.html
   My bibliography  Save this article

Striatal hub of dynamic and stabilized prediction coding in forebrain networks for olfactory reinforcement learning

Author

Listed:
  • Laurens Winkelmeier

    (Heidelberg University)

  • Carla Filosa

    (University Medical Center, Johannes Gutenberg University)

  • Renée Hartig

    (University Medical Center, Johannes Gutenberg University)

  • Max Scheller

    (University Medical Center, Johannes Gutenberg University)

  • Markus Sack

    (Heidelberg University)

  • Jonathan R. Reinwald

    (Heidelberg University)

  • Robert Becker

    (Heidelberg University)

  • David Wolf

    (Heidelberg University)

  • Martin Fungisai Gerchen

    (Heidelberg University)

  • Alexander Sartorius

    (Heidelberg University)

  • Andreas Meyer-Lindenberg

    (Heidelberg University)

  • Wolfgang Weber-Fahr

    (Heidelberg University)

  • Christian Clemm von Hohenberg

    (Heidelberg University)

  • Eleonora Russo

    (Heidelberg University
    University Medical Center, Johannes Gutenberg University)

  • Wolfgang Kelsch

    (Heidelberg University
    University Medical Center, Johannes Gutenberg University)

Abstract

Identifying the circuits responsible for cognition and understanding their embedded computations is a challenge for neuroscience. We establish here a hierarchical cross-scale approach, from behavioral modeling and fMRI in task-performing mice to cellular recordings, in order to disentangle local network contributions to olfactory reinforcement learning. At mesoscale, fMRI identifies a functional olfactory-striatal network interacting dynamically with higher-order cortices. While primary olfactory cortices respectively contribute only some value components, the downstream olfactory tubercle of the ventral striatum expresses comprehensively reward prediction, its dynamic updating, and prediction error components. In the tubercle, recordings reveal two underlying neuronal populations with non-redundant reward prediction coding schemes. One population collectively produces stabilized predictions as distributed activity across neurons; in the other, neurons encode value individually and dynamically integrate the recent history of uncertain outcomes. These findings validate a cross-scale approach to mechanistic investigations of higher cognitive functions in rodents.

Suggested Citation

  • Laurens Winkelmeier & Carla Filosa & Renée Hartig & Max Scheller & Markus Sack & Jonathan R. Reinwald & Robert Becker & David Wolf & Martin Fungisai Gerchen & Alexander Sartorius & Andreas Meyer-Linde, 2022. "Striatal hub of dynamic and stabilized prediction coding in forebrain networks for olfactory reinforcement learning," Nature Communications, Nature, vol. 13(1), pages 1-21, December.
  • Handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-30978-1
    DOI: 10.1038/s41467-022-30978-1
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-022-30978-1
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-022-30978-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ali Mohebi & Jeffrey R. Pettibone & Arif A. Hamid & Jenny-Marie T. Wong & Leah T. Vinson & Tommaso Patriarchi & Lin Tian & Robert T. Kennedy & Joshua D. Berke, 2019. "Dissociable dopamine dynamics for learning and motivation," Nature, Nature, vol. 570(7759), pages 65-70, June.
    2. Jeanette A Mumford & Jean-Baptiste Poline & Russell A Poldrack, 2015. "Orthogonalization of Regressors in fMRI Models," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-11, April.
    3. Ben Seymour & John P. O'Doherty & Peter Dayan & Martin Koltzenburg & Anthony K. Jones & Raymond J. Dolan & Karl J. Friston & Richard S. Frackowiak, 2004. "Temporal difference models describe higher-order learning in humans," Nature, Nature, vol. 429(6992), pages 664-667, June.
    4. Lars-Lennart Oettl & Max Scheller & Carla Filosa & Sebastian Wieland & Franziska Haag & Cathrin Loeb & Daniel Durstewitz & Roman Shusterman & Eleonora Russo & Wolfgang Kelsch, 2020. "Phasic dopamine reinforces distinct striatal stimulus encoding in the olfactory tubercle driving dopaminergic reward prediction," Nature Communications, Nature, vol. 11(1), pages 1-14, December.
    5. Nikos K. Logothetis & Jon Pauls & Mark Augath & Torsten Trinath & Axel Oeltermann, 2001. "Neurophysiological investigation of the basis of the fMRI signal," Nature, Nature, vol. 412(6843), pages 150-157, July.
    6. Shelly B. Flagel & Jeremy J. Clark & Terry E. Robinson & Leah Mayo & Alayna Czuj & Ingo Willuhn & Christina A. Akers & Sarah M. Clinton & Paul E. M. Phillips & Huda Akil, 2011. "A selective role for dopamine in stimulus–reward learning," Nature, Nature, vol. 469(7328), pages 53-57, January.
    7. Ali Mohebi & Jeffrey R. Pettibone & Arif A. Hamid & Jenny-Marie T. Wong & Leah T. Vinson & Tommaso Patriarchi & Lin Tian & Robert T. Kennedy & Joshua D. Berke, 2019. "Publisher Correction: Dissociable dopamine dynamics for learning and motivation," Nature, Nature, vol. 571(7763), pages 3-3, July.
    8. Jeremiah Y. Cohen & Sebastian Haesler & Linh Vong & Bradford B. Lowell & Naoshige Uchida, 2012. "Neuron-type-specific signals for reward and punishment in the ventral tegmental area," Nature, Nature, vol. 482(7383), pages 85-88, February.
    9. James D. Howard & Thorsten Kahnt & Jay A. Gottfried, 2016. "Converging prefrontal pathways support associative and perceptual features of conditioned stimuli," Nature Communications, Nature, vol. 7(1), pages 1-11, September.
    10. Mark W. Howe & Patrick L. Tierney & Stefan G. Sandberg & Paul E. M. Phillips & Ann M. Graybiel, 2013. "Prolonged dopamine signalling in striatum signals proximity and value of distant rewards," Nature, Nature, vol. 500(7464), pages 575-579, August.
    11. Emili Balaguer-Ballester & Christopher C Lapish & Jeremy K Seamans & Daniel Durstewitz, 2011. "Attracting Dynamics of Frontal Cortex Ensembles during Memory-Guided Decision-Making," PLOS Computational Biology, Public Library of Science, vol. 7(5), pages 1-19, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. David Wolf & Renée Hartig & Yi Zhuo & Max F. Scheller & Mirko Articus & Marcel Moor & Valery Grinevich & Christiane Linster & Eleonora Russo & Wolfgang Weber-Fahr & Jonathan R. Reinwald & Wolfgang Kel, 2024. "Oxytocin induces the formation of distinctive cortical representations and cognitions biased toward familiar mice," Nature Communications, Nature, vol. 15(1), pages 1-19, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Allen P. F. Chen & Jeffrey M. Malgady & Lu Chen & Kaiyo W. Shi & Eileen Cheng & Joshua L. Plotkin & Shaoyu Ge & Qiaojie Xiong, 2022. "Nigrostriatal dopamine pathway regulates auditory discrimination behavior," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    2. Seetha Krishnan & Chad Heer & Chery Cherian & Mark E. J. Sheffield, 2022. "Reward expectation extinction restructures and degrades CA1 spatial maps through loss of a dopaminergic reward proximity signal," Nature Communications, Nature, vol. 13(1), pages 1-19, December.
    3. Miguel Skirzewski & Oren Princz-Lebel & Liliana German-Castelan & Alycia M. Crooks & Gerard Kyungwook Kim & Sophie Henke Tarnow & Amy Reichelt & Sara Memar & Daniel Palmer & Yulong Li & R. Jane Rylett, 2022. "Continuous cholinergic-dopaminergic updating in the nucleus accumbens underlies approaches to reward-predicting cues," Nature Communications, Nature, vol. 13(1), pages 1-21, December.
    4. Armando G. Salinas & Jeong Oen Lee & Shana M. Augustin & Shiliang Zhang & Tommaso Patriarchi & Lin Tian & Marisela Morales & Yolanda Mateo & David M. Lovinger, 2023. "Distinct sub-second dopamine signaling in dorsolateral striatum measured by a genetically-encoded fluorescent sensor," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    5. Abigail Kalmbach & Vanessa Winiger & Nuri Jeong & Arun Asok & Charles R. Gallistel & Peter D. Balsam & Eleanor H. Simpson, 2022. "Dopamine encodes real-time reward availability and transitions between reward availability states on different timescales," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    6. Lior Matityahu & Naomi Gilin & Gideon A. Sarpong & Yara Atamna & Lior Tiroshi & Nicolas X. Tritsch & Jeffery R. Wickens & Joshua A. Goldberg, 2023. "Acetylcholine waves and dopamine release in the striatum," Nature Communications, Nature, vol. 14(1), pages 1-23, December.
    7. Min Jung Kim & Daniel J. Gibson & Dan Hu & Tomoko Yoshida & Emily Hueske & Ayano Matsushima & Ara Mahar & Cynthia J. Schofield & Patlapa Sompolpong & Kathy T. Tran & Lin Tian & Ann M. Graybiel, 2024. "Dopamine release plateau and outcome signals in dorsal striatum contrast with classic reinforcement learning formulations," Nature Communications, Nature, vol. 15(1), pages 1-20, December.
    8. Johannes Algermissen & Jennifer C. Swart & René Scheeringa & Roshan Cools & Hanneke E. M. den Ouden, 2024. "Prefrontal signals precede striatal signals for biased credit assignment in motivational learning biases," Nature Communications, Nature, vol. 15(1), pages 1-19, December.
    9. Marie A. Labouesse & Maria Wilhelm & Zacharoula Kagiampaki & Andrew G. Yee & Raphaelle Denis & Masaya Harada & Andrea Gresch & Alina-Măriuca Marinescu & Kanako Otomo & Sebastiano Curreli & Laia Serrat, 2024. "A chemogenetic approach for dopamine imaging with tunable sensitivity," Nature Communications, Nature, vol. 15(1), pages 1-22, December.
    10. Han Guo & Jian-Bo Jiang & Wei Xu & Mu-Tian Zhang & Hui Chen & Huan-Ying Shi & Lu Wang & Miao He & Michael Lazarus & Shan-Qun Li & Zhi-Li Huang & Wei-Min Qu, 2023. "Parasubthalamic calretinin neurons modulate wakefulness associated with exploration in male mice," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    11. Lauren Faget & Lucie Oriol & Wen-Chun Lee & Vivien Zell & Cody Sargent & Andrew Flores & Nick G. Hollon & Dhakshin Ramanathan & Thomas S. Hnasko, 2024. "Ventral pallidum GABA and glutamate neurons drive approach and avoidance through distinct modulation of VTA cell types," Nature Communications, Nature, vol. 15(1), pages 1-18, December.
    12. Ali Ghazizadeh & Okihide Hikosaka, 2022. "Salience memories formed by value, novelty and aversiveness jointly shape object responses in the prefrontal cortex and basal ganglia," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    13. Zengpeng Han & Nengsong Luo & Wenyu Ma & Xiaodong Liu & Yuxiang Cai & Jiaxin Kou & Jie Wang & Lei Li & Siqi Peng & Zihong Xu & Wen Zhang & Yuxiang Qiu & Yang Wu & Chaohui Ye & Kunzhang Lin & Fuqiang X, 2023. "AAV11 enables efficient retrograde targeting of projection neurons and enhances astrocyte-directed transduction," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    14. Angela M. Ianni & Daniel P. Eisenberg & Erie D. Boorman & Sara M. Constantino & Catherine E. Hegarty & Michael D. Gregory & Joseph C. Masdeu & Philip D. Kohn & Timothy E. Behrens & Karen F. Berman, 2023. "PET-measured human dopamine synthesis capacity and receptor availability predict trading rewards and time-costs during foraging," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    15. Carole Morel & Sarah E. Montgomery & Long Li & Romain Durand-de Cuttoli & Emily M. Teichman & Barbara Juarez & Nikos Tzavaras & Stacy M. Ku & Meghan E. Flanigan & Min Cai & Jessica J. Walsh & Scott J., 2022. "Midbrain projection to the basolateral amygdala encodes anxiety-like but not depression-like behaviors," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    16. Allen P. F. Chen & Lu Chen & Kaiyo W. Shi & Eileen Cheng & Shaoyu Ge & Qiaojie Xiong, 2023. "Nigrostriatal dopamine modulates the striatal-amygdala pathway in auditory fear conditioning," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    17. Susanne Prokop & Péter Ábrányi-Balogh & Benjámin Barti & Márton Vámosi & Miklós Zöldi & László Barna & Gabriella M. Urbán & András Dávid Tóth & Barna Dudok & Attila Egyed & Hui Deng & Gian Marco Leggi, 2021. "PharmacoSTORM nanoscale pharmacology reveals cariprazine binding on Islands of Calleja granule cells," Nature Communications, Nature, vol. 12(1), pages 1-19, December.
    18. Xin-Yue Wang & Wen-Bin Jia & Xiang Xu & Rui Chen & Liang-Biao Wang & Xiao-Jing Su & Peng-Fei Xu & Xiao-Qing Liu & Jie Wen & Xiao-Yuan Song & Yuan-Yuan Liu & Zhi Zhang & Xin-Feng Liu & Yan Zhang, 2023. "A glutamatergic DRN–VTA pathway modulates neuropathic pain and comorbid anhedonia-like behavior in mice," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    19. Panna Hegedüs & Bálint Király & Dániel Schlingloff & Victoria Lyakhova & Anna Velencei & Írisz Szabó & Márton I. Mayer & Zsofia Zelenak & Gábor Nyiri & Balázs Hangya, 2024. "Parvalbumin-expressing basal forebrain neurons mediate learning from negative experience," Nature Communications, Nature, vol. 15(1), pages 1-20, December.
    20. Georgia Koppe & Hazem Toutounji & Peter Kirsch & Stefanie Lis & Daniel Durstewitz, 2019. "Identifying nonlinear dynamical systems via generative recurrent neural networks with applications to fMRI," PLOS Computational Biology, Public Library of Science, vol. 15(8), pages 1-35, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-30978-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.