IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1003311.html
   My bibliography  Save this article

Stochastic Computations in Cortical Microcircuit Models

Author

Listed:
  • Stefan Habenschuss
  • Zeno Jonke
  • Wolfgang Maass

Abstract

Experimental data from neuroscience suggest that a substantial amount of knowledge is stored in the brain in the form of probability distributions over network states and trajectories of network states. We provide a theoretical foundation for this hypothesis by showing that even very detailed models for cortical microcircuits, with data-based diverse nonlinear neurons and synapses, have a stationary distribution of network states and trajectories of network states to which they converge exponentially fast from any initial state. We demonstrate that this convergence holds in spite of the non-reversibility of the stochastic dynamics of cortical microcircuits. We further show that, in the presence of background network oscillations, separate stationary distributions emerge for different phases of the oscillation, in accordance with experimentally reported phase-specific codes. We complement these theoretical results by computer simulations that investigate resulting computation times for typical probabilistic inference tasks on these internally stored distributions, such as marginalization or marginal maximum-a-posteriori estimation. Furthermore, we show that the inherent stochastic dynamics of generic cortical microcircuits enables them to quickly generate approximate solutions to difficult constraint satisfaction problems, where stored knowledge and current inputs jointly constrain possible solutions. This provides a powerful new computing paradigm for networks of spiking neurons, that also throws new light on how networks of neurons in the brain could carry out complex computational tasks such as prediction, imagination, memory recall and problem solving.Author Summary: The brain has not only the capability to process sensory input, but it can also produce predictions, imaginations, and solve problems that combine learned knowledge with information about a new scenario. But although these more complex information processing capabilities lie at the heart of human intelligence, we still do not know how they are organized and implemented in the brain. Numerous studies in cognitive science and neuroscience conclude that many of these processes involve probabilistic inference. This suggests that neuronal circuits in the brain process information in the form of probability distributions, but we are missing insight into how complex distributions could be represented and stored in large and diverse networks of neurons in the brain. We prove in this article that realistic cortical microcircuit models can store complex probabilistic knowledge by embodying probability distributions in their inherent stochastic dynamics – yielding a knowledge representation in which typical probabilistic inference problems such as marginalization become straightforward readout tasks. We show that in cortical microcircuit models such computations can be performed satisfactorily within a few . Furthermore, we demonstrate how internally stored distributions can be programmed in a simple manner to endow a neural circuit with powerful problem solving capabilities.

Suggested Citation

  • Stefan Habenschuss & Zeno Jonke & Wolfgang Maass, 2013. "Stochastic Computations in Cortical Microcircuit Models," PLOS Computational Biology, Public Library of Science, vol. 9(11), pages 1-28, November.
  • Handle: RePEc:plo:pcbi00:1003311
    DOI: 10.1371/journal.pcbi.1003311
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1003311
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1003311&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1003311?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Karel Jezek & Espen J. Henriksen & Alessandro Treves & Edvard I. Moser & May-Britt Moser, 2011. "Theta-paced flickering between place-cell maps in the hippocampus," Nature, Nature, vol. 478(7368), pages 246-249, October.
    2. Kenneth D. Harris & Jozsef Csicsvari & Hajime Hirase & George Dragoi & György Buzsáki, 2003. "Organization of cell assemblies in the hippocampus," Nature, Nature, vol. 424(6948), pages 552-556, July.
    3. John Geweke, 1991. "Evaluating the accuracy of sampling-based approaches to the calculation of posterior moments," Staff Report 148, Federal Reserve Bank of Minneapolis.
    4. Dejan Pecevski & Lars Buesing & Wolfgang Maass, 2011. "Probabilistic Inference in General Graphical Models through Sampling in Stochastic Networks of Spiking Neurons," PLOS Computational Biology, Public Library of Science, vol. 7(12), pages 1-25, December.
    5. Lars Buesing & Johannes Bill & Bernhard Nessler & Wolfgang Maass, 2011. "Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons," PLOS Computational Biology, Public Library of Science, vol. 7(11), pages 1-22, November.
    6. El Adlouni, Salaheddine & Favre, Anne-Catherine & Bobee, Bernard, 2006. "Comparison of methodologies to assess the convergence of Markov chain Monte Carlo methods," Computational Statistics & Data Analysis, Elsevier, vol. 50(10), pages 2685-2701, June.
    7. Tal Kenet & Dmitri Bibitchkov & Misha Tsodyks & Amiram Grinvald & Amos Arieli, 2003. "Spontaneously emerging cortical representations of visual attributes," Nature, Nature, vol. 425(6961), pages 954-956, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert Legenstein & Wolfgang Maass, 2014. "Ensembles of Spiking Neurons with Noise Support Optimal Probabilistic Inference in a Dynamically Changing Environment," PLOS Computational Biology, Public Library of Science, vol. 10(10), pages 1-27, October.
    2. Dejan Pecevski & Lars Buesing & Wolfgang Maass, 2011. "Probabilistic Inference in General Graphical Models through Sampling in Stochastic Networks of Spiking Neurons," PLOS Computational Biology, Public Library of Science, vol. 7(12), pages 1-25, December.
    3. Bernhard Nessler & Michael Pfeiffer & Lars Buesing & Wolfgang Maass, 2013. "Bayesian Computation Emerges in Generic Cortical Microcircuits through Spike-Timing-Dependent Plasticity," PLOS Computational Biology, Public Library of Science, vol. 9(4), pages 1-30, April.
    4. Mamiko Arai & Vicky Brandt & Yuri Dabaghian, 2014. "The Effects of Theta Precession on Spatial Learning and Simplicial Complex Dynamics in a Topological Model of the Hippocampal Spatial Map," PLOS Computational Biology, Public Library of Science, vol. 10(6), pages 1-14, June.
    5. Buddhavarapu, Prasad & Bansal, Prateek & Prozzi, Jorge A., 2021. "A new spatial count data model with time-varying parameters," Transportation Research Part B: Methodological, Elsevier, vol. 150(C), pages 566-586.
    6. Jesús Fernández-Villaverde & Juan F. Rubio-Ramirez, 2001. "Comparing dynamic equilibrium economies to data," FRB Atlanta Working Paper 2001-23, Federal Reserve Bank of Atlanta.
    7. Atahan Afsar; José Elías Gallegos; Richard Jaimes; Edgar Silgado Gómez & José Elías Gallegos & Richard Jaimes & Edgar Silgado Gómez, 2020. "Reconciling Empirics and Theory: The Behavioral Hybrid New Keynesian Model," Vniversitas Económica 18560, Universidad Javeriana - Bogotá.
    8. Bai, Yizhou & Xue, Cheng, 2021. "An empirical study on the regulated Chinese agricultural commodity futures market based on skew Ornstein-Uhlenbeck model," Research in International Business and Finance, Elsevier, vol. 57(C).
    9. Aßmann, Christian & Boysen-Hogrefe, Jens & Pape, Markus, 2012. "The directional identification problem in Bayesian factor analysis: An ex-post approach," Kiel Working Papers 1799, Kiel Institute for the World Economy (IfW Kiel).
    10. Michael T. Owyang, 2002. "Modeling Volcker as a non-absorbing state: agnostic identification of a Markov-switching VAR," Working Papers 2002-018, Federal Reserve Bank of St. Louis.
    11. Wen-Hao Zhang & Si Wu & Krešimir Josić & Brent Doiron, 2023. "Sampling-based Bayesian inference in recurrent circuits of stochastic spiking neurons," Nature Communications, Nature, vol. 14(1), pages 1-19, December.
    12. Feng Dai & Baumgartner Richard & Svetnik Vladimir, 2018. "A Bayesian Framework for Estimating the Concordance Correlation Coefficient Using Skew-elliptical Distributions," The International Journal of Biostatistics, De Gruyter, vol. 14(1), pages 1-8, May.
    13. Keane, Michael & Stavrunova, Olena, 2016. "Adverse selection, moral hazard and the demand for Medigap insurance," Journal of Econometrics, Elsevier, vol. 190(1), pages 62-78.
    14. He, Yongda & Lin, Boqiang, 2018. "Time-varying effects of cyclical fluctuations in China's energy industry on the macro economy and carbon emissions," Energy, Elsevier, vol. 155(C), pages 1102-1112.
    15. Yang Qi & Pulin Gong, 2022. "Fractional neural sampling as a theory of spatiotemporal probabilistic computations in neural circuits," Nature Communications, Nature, vol. 13(1), pages 1-19, December.
    16. Brand, Claus & Goy, Gavin W & Lemke, Wolfgang, 2020. "Natural rate chimera and bond pricing reality," VfS Annual Conference 2020 (Virtual Conference): Gender Economics 224546, Verein für Socialpolitik / German Economic Association.
    17. González-Astudillo, Manuel, 2019. "An output gap measure for the euro area: Exploiting country-level and cross-sectional data heterogeneity," European Economic Review, Elsevier, vol. 120(C).
    18. Boeck, Maximilian & Feldkircher, Martin, 2021. "The Impact of Monetary Policy on Yield Curve Expectations," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 887-901.
    19. Xiong, Yingge & Tobias, Justin L. & Mannering, Fred L., 2014. "The analysis of vehicle crash injury-severity data: A Markov switching approach with road-segment heterogeneity," Transportation Research Part B: Methodological, Elsevier, vol. 67(C), pages 109-128.
    20. Tsionas, Efthymios G., 1998. "Monte Carlo inference in econometric models with symmetric stable disturbances," Journal of Econometrics, Elsevier, vol. 88(2), pages 365-401, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1003311. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.