IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1004490.html
   My bibliography  Save this article

Scalability of Asynchronous Networks Is Limited by One-to-One Mapping between Effective Connectivity and Correlations

Author

Listed:
  • Sacha Jennifer van Albada
  • Moritz Helias
  • Markus Diesmann

Abstract

Network models are routinely downscaled compared to nature in terms of numbers of nodes or edges because of a lack of computational resources, often without explicit mention of the limitations this entails. While reliable methods have long existed to adjust parameters such that the first-order statistics of network dynamics are conserved, here we show that limitations already arise if also second-order statistics are to be maintained. The temporal structure of pairwise averaged correlations in the activity of recurrent networks is determined by the effective population-level connectivity. We first show that in general the converse is also true and explicitly mention degenerate cases when this one-to-one relationship does not hold. The one-to-one correspondence between effective connectivity and the temporal structure of pairwise averaged correlations implies that network scalings should preserve the effective connectivity if pairwise averaged correlations are to be held constant. Changes in effective connectivity can even push a network from a linearly stable to an unstable, oscillatory regime and vice versa. On this basis, we derive conditions for the preservation of both mean population-averaged activities and pairwise averaged correlations under a change in numbers of neurons or synapses in the asynchronous regime typical of cortical networks. We find that mean activities and correlation structure can be maintained by an appropriate scaling of the synaptic weights, but only over a range of numbers of synapses that is limited by the variance of external inputs to the network. Our results therefore show that the reducibility of asynchronous networks is fundamentally limited.Author Summary: Neural networks have two basic components: their structural elements (neurons and synapses), and the dynamics of these constituents. The so-called effective connectivity combines both components to yield a measure of the actual influence of physical connections. Previous work showed effective connectivity to determine correlations, which quantify the co-activation of different neurons. Conversely, methods for estimating network structure from correlations have been developed. We here extend the range of networks for which the mapping between effective connectivity and correlations can be shown to be one-to-one, and clarify the conditions under which this equivalence holds. These findings apply to a class of networks that is often used, with some variations, to model the activity of cerebral cortex. Since the numbers of neurons and synapses in real mammalian brains are vast, such models tend to be reduced in size for simulation purposes. However, our findings imply that if we wish to retain the original dynamics including correlations, effective connectivity needs to be unchanged, from which we derive scaling laws for synaptic strengths and external inputs, and fundamental limits on the reducibility of network size. The work points to the importance of considering networks with realistic numbers of neurons and synapses.

Suggested Citation

  • Sacha Jennifer van Albada & Moritz Helias & Markus Diesmann, 2015. "Scalability of Asynchronous Networks Is Limited by One-to-One Mapping between Effective Connectivity and Correlations," PLOS Computational Biology, Public Library of Science, vol. 11(9), pages 1-37, September.
  • Handle: RePEc:plo:pcbi00:1004490
    DOI: 10.1371/journal.pcbi.1004490
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1004490
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1004490&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1004490?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Volker Pernice & Benjamin Staude & Stefano Cardanobile & Stefan Rotter, 2011. "How Structure Determines Correlations in Neuronal Networks," PLOS Computational Biology, Public Library of Science, vol. 7(5), pages 1-14, May.
    2. Moritz Helias & Tom Tetzlaff & Markus Diesmann, 2014. "The Correlation Structure of Local Neuronal Networks Intrinsically Results from Recurrent Dynamics," PLOS Computational Biology, Public Library of Science, vol. 10(1), pages 1-21, January.
    3. Gina G. Turrigiano & Kenneth R. Leslie & Niraj S. Desai & Lana C. Rutherford & Sacha B. Nelson, 1998. "Activity-dependent scaling of quantal amplitude in neocortical neurons," Nature, Nature, vol. 391(6670), pages 892-896, February.
    4. Ehud Ahissar & Ronen Sosnik & Sebastian Haidarliu, 2000. "Transformation from temporal to rate coding in a somatosensory thalamocortical pathway," Nature, Nature, vol. 406(6793), pages 302-306, July.
    5. Elad Schneidman & Michael J. Berry & Ronen Segev & William Bialek, 2006. "Weak pairwise correlations imply strongly correlated network states in a neural population," Nature, Nature, vol. 440(7087), pages 1007-1012, April.
    6. Tom Tetzlaff & Moritz Helias & Gaute T Einevoll & Markus Diesmann, 2012. "Decorrelation of Neural-Network Activity by Inhibitory Feedback," PLOS Computational Biology, Public Library of Science, vol. 8(8), pages 1-29, August.
    7. Ranulfo Romo & Carlos D. Brody & Adrián Hernández & Luis Lemus, 1999. "Neuronal correlates of parametric working memory in the prefrontal cortex," Nature, Nature, vol. 399(6735), pages 470-473, June.
    8. James Trousdale & Yu Hu & Eric Shea-Brown & Krešimir Josić, 2012. "Impact of Network Structure and Cellular Response on Spike Time Correlations," PLOS Computational Biology, Public Library of Science, vol. 8(3), pages 1-15, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gabriel Koch Ocker & Ashok Litwin-Kumar & Brent Doiron, 2015. "Self-Organization of Microcircuits in Networks of Spiking Neurons with Plastic Synapses," PLOS Computational Biology, Public Library of Science, vol. 11(8), pages 1-40, August.
    2. Moritz Helias & Tom Tetzlaff & Markus Diesmann, 2014. "The Correlation Structure of Local Neuronal Networks Intrinsically Results from Recurrent Dynamics," PLOS Computational Biology, Public Library of Science, vol. 10(1), pages 1-21, January.
    3. Stefano Recanatesi & Gabriel Koch Ocker & Michael A Buice & Eric Shea-Brown, 2019. "Dimensionality in recurrent spiking networks: Global trends in activity and local origins in connectivity," PLOS Computational Biology, Public Library of Science, vol. 15(7), pages 1-29, July.
    4. Volker Pernice & Rava Azeredo da Silveira, 2018. "Interpretation of correlated neural variability from models of feed-forward and recurrent circuits," PLOS Computational Biology, Public Library of Science, vol. 14(2), pages 1-26, February.
    5. Stojan Jovanović & Stefan Rotter, 2016. "Interplay between Graph Topology and Correlations of Third Order in Spiking Neuronal Networks," PLOS Computational Biology, Public Library of Science, vol. 12(6), pages 1-28, June.
    6. Vicente Reyes-Puerta & Suam Kim & Jyh-Jang Sun & Barbara Imbrosci & Werner Kilb & Heiko J Luhmann, 2015. "High Stimulus-Related Information in Barrel Cortex Inhibitory Interneurons," PLOS Computational Biology, Public Library of Science, vol. 11(6), pages 1-32, June.
    7. Gabriel Koch Ocker & Krešimir Josić & Eric Shea-Brown & Michael A Buice, 2017. "Linking structure and activity in nonlinear spiking networks," PLOS Computational Biology, Public Library of Science, vol. 13(6), pages 1-47, June.
    8. Tom Tetzlaff & Moritz Helias & Gaute T Einevoll & Markus Diesmann, 2012. "Decorrelation of Neural-Network Activity by Inhibitory Feedback," PLOS Computational Biology, Public Library of Science, vol. 8(8), pages 1-29, August.
    9. Andrea K Barreiro & Cheng Ly, 2017. "When do correlations increase with firing rates in recurrent networks?," PLOS Computational Biology, Public Library of Science, vol. 13(4), pages 1-30, April.
    10. Sadra Sadeh & Stefan Rotter, 2015. "Orientation Selectivity in Inhibition-Dominated Networks of Spiking Neurons: Effect of Single Neuron Properties and Network Dynamics," PLOS Computational Biology, Public Library of Science, vol. 11(1), pages 1-17, January.
    11. Andrea K Barreiro & Shree Hari Gautam & Woodrow L Shew & Cheng Ly, 2017. "A theoretical framework for analyzing coupled neuronal networks: Application to the olfactory system," PLOS Computational Biology, Public Library of Science, vol. 13(10), pages 1-37, October.
    12. Lipovetsky, Stan, 2018. "Quantum paradigm of probability amplitude and complex utility in entangled discrete choice modeling," Journal of choice modelling, Elsevier, vol. 27(C), pages 62-73.
    13. Mark L Ioffe & Michael J Berry II, 2017. "The structured ‘low temperature’ phase of the retinal population code," PLOS Computational Biology, Public Library of Science, vol. 13(10), pages 1-31, October.
    14. Katarína Bod’ová & Enikő Szép & Nicholas H Barton, 2021. "Dynamic maximum entropy provides accurate approximation of structured population dynamics," PLOS Computational Biology, Public Library of Science, vol. 17(12), pages 1-22, December.
    15. MohammadReza Zahedian & Mahsa Bagherikalhor & Andrey Trufanov & G. Reza Jafari, 2022. "Financial Crisis in the Framework of Non-zero Temperature Balance Theory," Papers 2202.03198, arXiv.org.
    16. Wen-Hao Zhang & Si Wu & Krešimir Josić & Brent Doiron, 2023. "Sampling-based Bayesian inference in recurrent circuits of stochastic spiking neurons," Nature Communications, Nature, vol. 14(1), pages 1-19, December.
    17. Gaëlle Desbordes & Jianzhong Jin & Chong Weng & Nicholas A Lesica & Garrett B Stanley & Jose-Manuel Alonso, 2008. "Timing Precision in Population Coding of Natural Scenes in the Early Visual System," PLOS Biology, Public Library of Science, vol. 6(12), pages 1-11, December.
    18. Matteo Saponati & Martin Vinck, 2023. "Sequence anticipation and spike-timing-dependent plasticity emerge from a predictive learning rule," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    19. Yasser Roudi & Sheila Nirenberg & Peter E Latham, 2009. "Pairwise Maximum Entropy Models for Studying Large Biological Systems: When They Can Work and When They Can't," PLOS Computational Biology, Public Library of Science, vol. 5(5), pages 1-18, May.
    20. Elaida D. Dimwamwa & Aurélie Pala & Vivek Chundru & Nathaniel C. Wright & Garrett B. Stanley, 2024. "Dynamic corticothalamic modulation of the somatosensory thalamocortical circuit during wakefulness," Nature Communications, Nature, vol. 15(1), pages 1-16, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1004490. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.