IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1004640.html
   My bibliography  Save this article

Where’s the Noise? Key Features of Spontaneous Activity and Neural Variability Arise through Learning in a Deterministic Network

Author

Listed:
  • Christoph Hartmann
  • Andreea Lazar
  • Bernhard Nessler
  • Jochen Triesch

Abstract

Even in the absence of sensory stimulation the brain is spontaneously active. This background “noise” seems to be the dominant cause of the notoriously high trial-to-trial variability of neural recordings. Recent experimental observations have extended our knowledge of trial-to-trial variability and spontaneous activity in several directions: 1. Trial-to-trial variability systematically decreases following the onset of a sensory stimulus or the start of a motor act. 2. Spontaneous activity states in sensory cortex outline the region of evoked sensory responses. 3. Across development, spontaneous activity aligns itself with typical evoked activity patterns. 4. The spontaneous brain activity prior to the presentation of an ambiguous stimulus predicts how the stimulus will be interpreted. At present it is unclear how these observations relate to each other and how they arise in cortical circuits. Here we demonstrate that all of these phenomena can be accounted for by a deterministic self-organizing recurrent neural network model (SORN), which learns a predictive model of its sensory environment. The SORN comprises recurrently coupled populations of excitatory and inhibitory threshold units and learns via a combination of spike-timing dependent plasticity (STDP) and homeostatic plasticity mechanisms. Similar to balanced network architectures, units in the network show irregular activity and variable responses to inputs. Additionally, however, the SORN exhibits sequence learning abilities matching recent findings from visual cortex and the network’s spontaneous activity reproduces the experimental findings mentioned above. Intriguingly, the network’s behaviour is reminiscent of sampling-based probabilistic inference, suggesting that correlates of sampling-based inference can develop from the interaction of STDP and homeostasis in deterministic networks. We conclude that key observations on spontaneous brain activity and the variability of neural responses can be accounted for by a simple deterministic recurrent neural network which learns a predictive model of its sensory environment via a combination of generic neural plasticity mechanisms.Author Summary: Neural recordings seem very noisy. If the exact same stimulus is shown to an animal multiple times, the neural response will vary substantially. In fact, the activity of a single neuron shows many features of a random process. Furthermore, the spontaneous activity occurring in the absence of any sensory stimulus, which is usually considered a kind of background noise, often has a magnitude comparable to the activity evoked by stimulus presentation and interacts with sensory inputs in interesting ways. Here we show that the key features of neural variability and spontaneous activity can all be accounted for by a simple and completely deterministic neural network learning a predictive model of its sensory inputs. The network’s deterministic dynamics give rise to structured but variable responses matching key experimental findings obtained in different mammalian species with different recording techniques. Our results suggest that the notorious variability of neural recordings and the complex features of spontaneous brain activity could reflect the dynamics of a largely deterministic but highly adaptive network learning a predictive model of its sensory environment.

Suggested Citation

  • Christoph Hartmann & Andreea Lazar & Bernhard Nessler & Jochen Triesch, 2015. "Where’s the Noise? Key Features of Spontaneous Activity and Neural Variability Arise through Learning in a Deterministic Network," PLOS Computational Biology, Public Library of Science, vol. 11(12), pages 1-35, December.
  • Handle: RePEc:plo:pcbi00:1004640
    DOI: 10.1371/journal.pcbi.1004640
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1004640
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1004640&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1004640?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gina G. Turrigiano & Kenneth R. Leslie & Niraj S. Desai & Lana C. Rutherford & Sacha B. Nelson, 1998. "Activity-dependent scaling of quantal amplitude in neocortical neurons," Nature, Nature, vol. 391(6670), pages 892-896, February.
    2. Sen Song & Per Jesper Sjöström & Markus Reigl & Sacha Nelson & Dmitri B Chklovskii, 2005. "Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits," PLOS Biology, Public Library of Science, vol. 3(3), pages 1-1, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jimok Kim & Richard W Tsien & Bradley E Alger, 2012. "An Improved Test for Detecting Multiplicative Homeostatic Synaptic Scaling," PLOS ONE, Public Library of Science, vol. 7(5), pages 1-9, May.
    2. Baktash Babadi & L F Abbott, 2016. "Stability and Competition in Multi-spike Models of Spike-Timing Dependent Plasticity," PLOS Computational Biology, Public Library of Science, vol. 12(3), pages 1-26, March.
    3. Matteo Saponati & Martin Vinck, 2023. "Sequence anticipation and spike-timing-dependent plasticity emerge from a predictive learning rule," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    4. Niranjan Chakravarthy & Shivkumar Sabesan & Kostas Tsakalis & Leon Iasemidis, 2009. "Controlling epileptic seizures in a neural mass model," Journal of Combinatorial Optimization, Springer, vol. 17(1), pages 98-116, January.
    5. Damien M O’Halloran, 2020. "Simulation model of CA1 pyramidal neurons reveal opposing roles for the Na+/Ca2+ exchange current and Ca2+-activated K+ current during spike-timing dependent synaptic plasticity," PLOS ONE, Public Library of Science, vol. 15(3), pages 1-12, March.
    6. Sacha Jennifer van Albada & Moritz Helias & Markus Diesmann, 2015. "Scalability of Asynchronous Networks Is Limited by One-to-One Mapping between Effective Connectivity and Correlations," PLOS Computational Biology, Public Library of Science, vol. 11(9), pages 1-37, September.
    7. Dean J. Kareemo & Christina S. Winborn & Samantha S. Olah & Carley N. Miller & JungMin Kim & Chelsie A. Kadgien & Hannah S. Actor-Engel & Harrison J. Ramsay & Austin M. Ramsey & Jason Aoto & Matthew J, 2024. "Genetically encoded intrabody probes for labeling and manipulating AMPA-type glutamate receptors," Nature Communications, Nature, vol. 15(1), pages 1-18, December.
    8. Christian Keck & Cristina Savin & Jörg Lücke, 2012. "Feedforward Inhibition and Synaptic Scaling – Two Sides of the Same Coin?," PLOS Computational Biology, Public Library of Science, vol. 8(3), pages 1-15, March.
    9. Iris Reuveni & Sourav Ghosh & Edi Barkai, 2017. "Real Time Multiplicative Memory Amplification Mediated by Whole-Cell Scaling of Synaptic Response in Key Neurons," PLOS Computational Biology, Public Library of Science, vol. 13(1), pages 1-31, January.
    10. Julijana Gjorgjieva & Taro Toyoizumi & Stephen J Eglen, 2009. "Burst-Time-Dependent Plasticity Robustly Guides ON/OFF Segregation in the Lateral Geniculate Nucleus," PLOS Computational Biology, Public Library of Science, vol. 5(12), pages 1-19, December.
    11. Mizusaki, Beatriz E.P. & Agnes, Everton J. & Erichsen, Rubem & Brunnet, Leonardo G., 2017. "Learning and retrieval behavior in recurrent neural networks with pre-synaptic dependent homeostatic plasticity," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 479(C), pages 279-286.
    12. Giorgia Dellaferrera & Stanisław Woźniak & Giacomo Indiveri & Angeliki Pantazi & Evangelos Eleftheriou, 2022. "Introducing principles of synaptic integration in the optimization of deep neural networks," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    13. Vladimir V Klinshov & Jun-nosuke Teramae & Vladimir I Nekorkin & Tomoki Fukai, 2014. "Dense Neuron Clustering Explains Connectivity Statistics in Cortical Microcircuits," PLOS ONE, Public Library of Science, vol. 9(4), pages 1-12, April.
    14. Aseel Shomar & Lukas Geyrhofer & Noam E Ziv & Naama Brenner, 2017. "Cooperative stochastic binding and unbinding explain synaptic size dynamics and statistics," PLOS Computational Biology, Public Library of Science, vol. 13(7), pages 1-24, July.
    15. Jian K Liu & Zhen-Su She, 2009. "A Spike-Timing Pattern Based Neural Network Model for the Study of Memory Dynamics," PLOS ONE, Public Library of Science, vol. 4(7), pages 1-8, July.
    16. John Palmer & Adam Keane & Pulin Gong, 2017. "Learning and executing goal-directed choices by internally generated sequences in spiking neural circuits," PLOS Computational Biology, Public Library of Science, vol. 13(7), pages 1-23, July.
    17. Naoki Hiratani & Tomoki Fukai, 2015. "Mixed Signal Learning by Spike Correlation Propagation in Feedback Inhibitory Circuits," PLOS Computational Biology, Public Library of Science, vol. 11(4), pages 1-36, April.
    18. Angulo-Garcia, David & Torcini, Alessandro, 2014. "Stable chaos in fluctuation driven neural circuits," Chaos, Solitons & Fractals, Elsevier, vol. 69(C), pages 233-245.
    19. Georg Martius & Ralf Der & Nihat Ay, 2013. "Information Driven Self-Organization of Complex Robotic Behaviors," PLOS ONE, Public Library of Science, vol. 8(5), pages 1-14, May.
    20. Tiziano D’Albis & Richard Kempter, 2017. "A single-cell spiking model for the origin of grid-cell patterns," PLOS Computational Biology, Public Library of Science, vol. 13(10), pages 1-41, October.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1004640. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.