IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1005258.html
   My bibliography  Save this article

Encoding in Balanced Networks: Revisiting Spike Patterns and Chaos in Stimulus-Driven Systems

Author

Listed:
  • Guillaume Lajoie
  • Kevin K Lin
  • Jean-Philippe Thivierge
  • Eric Shea-Brown

Abstract

Highly connected recurrent neural networks often produce chaotic dynamics, meaning their precise activity is sensitive to small perturbations. What are the consequences of chaos for how such networks encode streams of temporal stimuli? On the one hand, chaos is a strong source of randomness, suggesting that small changes in stimuli will be obscured by intrinsically generated variability. On the other hand, recent work shows that the type of chaos that occurs in spiking networks can have a surprisingly low-dimensional structure, suggesting that there may be room for fine stimulus features to be precisely resolved. Here we show that strongly chaotic networks produce patterned spikes that reliably encode time-dependent stimuli: using a decoder sensitive to spike times on timescales of 10’s of ms, one can easily distinguish responses to very similar inputs. Moreover, recurrence serves to distribute signals throughout chaotic networks so that small groups of cells can encode substantial information about signals arriving elsewhere. A conclusion is that the presence of strong chaos in recurrent networks need not exclude precise encoding of temporal stimuli via spike patterns.Author Summary: Recurrently connected populations of excitatory and inhibitory neurons found in cortex are known to produce rich and irregular spiking activity, with complex trial-to-trial variability in response to input stimuli. Many theoretical studies found this firing regime to be associated with chaos, where tiny perturbations explode to impact subsequent neural activity. As a result, the precise spiking patterns produced by such networks would be expected to be too fragile to carry any valuable information about stimuli, since inevitable sources of noise such as synaptic failure or ion channel fluctuations would be amplified by chaotic dynamics on repeated trials. In this article we revisit the implications of chaos in input-driven networks and directly measure its impact on evoked population spike patterns. We find that chaotic network dynamics can, in fact, produce highly patterned spiking activity which can be used by a simple decoder to perform input-classification tasks. This can be explained by the presence of low-dimensional, input-specific chaotic attractors, leading to a form of trial-to-trial variability that is intermittent, rather than uniformly random. We propose that chaos is a manageable by-product of recurrent connectivity, which serves to efficiently distribute information about stimuli throughout a network.

Suggested Citation

  • Guillaume Lajoie & Kevin K Lin & Jean-Philippe Thivierge & Eric Shea-Brown, 2016. "Encoding in Balanced Networks: Revisiting Spike Patterns and Chaos in Stimulus-Driven Systems," PLOS Computational Biology, Public Library of Science, vol. 12(12), pages 1-30, December.
  • Handle: RePEc:plo:pcbi00:1005258
    DOI: 10.1371/journal.pcbi.1005258
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1005258
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1005258&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1005258?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Brock, W. A., 1986. "Distinguishing random and deterministic systems: Abridged version," Journal of Economic Theory, Elsevier, vol. 40(1), pages 168-195, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Park, Joon Y. & Whang, Yoon-Jae, 2012. "Random walk or chaos: A formal test on the Lyapunov exponent," Journal of Econometrics, Elsevier, vol. 169(1), pages 61-74.
    2. Whang, Yoon-Jae & Linton, Oliver, 1999. "The asymptotic distribution of nonparametric estimates of the Lyapunov exponent for stochastic time series," Journal of Econometrics, Elsevier, vol. 91(1), pages 1-42, July.
    3. Takala, Kari & Virén, Matti, 1995. "Testing nonlinear dynamics, long memory and chaotic behaviour with macroeconomic data," Research Discussion Papers 9/1995, Bank of Finland.
    4. Takala, Kari & Virén, Matti, 1993. "Testing nonlinearities with Finnish historical time series," Bank of Finland Research Discussion Papers 15/1993, Bank of Finland.
    5. Bonache, Adrien, 2008. "Les ventes de produits innovants à la mode sont-elles chaotiques? Le cas des ventes de Game Boy au Japon [Are innovative and fashion goods sales chaotic? The case of Game Boy sales in Japan]," MPRA Paper 12964, University Library of Munich, Germany.
    6. repec:zbw:bofrdp:1995_009 is not listed on IDEAS
    7. Marisa Faggini, 2011. "Chaotic Time Series Analysis in Economics: Balance and Perspectives," Working papers 25, Former Department of Economics and Public Finance "G. Prato", University of Torino.
    8. Panas, E., 2001. "Long memory and chaotic models of prices on the London Metal Exchange," Resources Policy, Elsevier, vol. 27(4), pages 235-246, December.
    9. Akhmet, Marat & Akhmetova, Zhanar & Fen, Mehmet Onur, 2014. "Chaos in economic models with exogenous shocks," Journal of Economic Behavior & Organization, Elsevier, vol. 106(C), pages 95-108.
    10. Brock, W.A. & Hommes, C.H., 1997. "Models of Compelxity in Economics and Finance," Working papers 9706, Wisconsin Madison - Social Systems.
    11. Czamanski, Daniel & Dormaar, Paul & Hinich, Melvin J. & Serletis, Apostolos, 2007. "Episodic nonlinearity and nonstationarity in Alberta's power and natural gas markets," Energy Economics, Elsevier, vol. 29(1), pages 94-104, January.
    12. Ayan Bhattacharya & Rudra Sensarma, 2013. "Non-linearities in Emerging Financial Markets: Evidence from India," IIM Kozhikode Society & Management Review, , vol. 2(2), pages 165-175, July.
    13. Michele Boldrin, 1988. "Paths of Optimal Accumulation in Two-Sector Models," UCLA Economics Working Papers 464, UCLA Department of Economics.
    14. Kevin J. Dooley & Andrew H. Van de Ven, 1999. "Explaining Complex Organizational Dynamics," Organization Science, INFORMS, vol. 10(3), pages 358-372, June.
    15. Bunyamin Demir & Nesrin Alptekin & Yilmaz Kilicaslan & Mehmet Ergen & Nilgun Caglairmak Uslu, 2015. "Forecasting Agricultural Production: A Chaotic Dynamic Approach," World Journal of Applied Economics, WERI-World Economic Research Institute, vol. 1(1), pages 65-80, June.
    16. Stavros Degiannakis & Evdokia Xekalaki, 2007. "Assessing the performance of a prediction error criterion model selection algorithm in the context of ARCH models," Applied Financial Economics, Taylor & Francis Journals, vol. 17(2), pages 149-171.
    17. Christian Haxholdt & Erik R. Larsen & Ann van Ackere, 2003. "Mode Locking and Chaos in a Deterministic Queueing Model with Feedback," Management Science, INFORMS, vol. 49(6), pages 816-830, June.
    18. Matilla-Garcia, Mariano, 2007. "A non-parametric test for independence based on symbolic dynamics," Journal of Economic Dynamics and Control, Elsevier, vol. 31(12), pages 3889-3903, December.
    19. Luis A. Aguirre & Antonio Aguirre, 1997. "A tutorial introduction to nonlinear dynamics in economics," Nova Economia, Economics Department, Universidade Federal de Minas Gerais (Brazil), vol. 7(2), pages 9-47.
    20. Kampouridis, Michael & Chen, Shu-Heng & Tsang, Edward, 2012. "Market fraction hypothesis: A proposed test," International Review of Financial Analysis, Elsevier, vol. 23(C), pages 41-54.
    21. Mayer-Foulkes, David, 1995. "A statistical correlation dimension," Journal of Empirical Finance, Elsevier, vol. 2(3), pages 277-293, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1005258. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.