IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v633y2024ics0378437123008890.html
   My bibliography  Save this article

Characterization of the neuronal and network dynamics of liquid state machines

Author

Listed:
  • Woo, Junhyuk
  • Kim, Soon Ho
  • Kim, Hyeongmo
  • Han, Kyungreem

Abstract

Reservoir computing (RC) is a relatively new machine-learning framework that uses an abstract neural network model, called reservoir. The reservoir forms a complex system with high dimensionality, nonlinearity, and intrinsic memory effect due to recurrent connections among individual neurons. RC manifests a best-in-class performance in processing information generated by complex dynamical systems, yet little is known about its microscopic/macroscopic dynamics underlying the computational capability. Here, we characterize the neuronal and network dynamics of liquid state machines (LSMs) using numerical simulations and Modified National Institute of Standards and Technology (MNIST) database classification tasks. The computational performance of LSMs largely depends on a dynamic range of neuronal avalanches whereby the avalanche patterns are determined by the neuron and network models. A larger dynamic range leads to higher performance—the MNIST classification accuracy is highest when the avalanche sizes follow a slowly decaying power-law distribution with an exponent of ∼1.5, followed by the power-law statistics with a larger exponent and the mixture of power-law/log-normal distributions. Network-theoretic analysis suggests that the formation of large functional clusters and the promotion of dynamic transitions between large and small clusters may contribute to the scale-invariant nature. This study provides new insight into our understanding of the computational principles of RC concerning the actions of the individual neurons and the system-level collective behavior.

Suggested Citation

  • Woo, Junhyuk & Kim, Soon Ho & Kim, Hyeongmo & Han, Kyungreem, 2024. "Characterization of the neuronal and network dynamics of liquid state machines," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 633(C).
  • Handle: RePEc:eee:phsmap:v:633:y:2024:i:c:s0378437123008890
    DOI: 10.1016/j.physa.2023.129334
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437123008890
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2023.129334?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Joel Hochstetter & Ruomin Zhu & Alon Loeffler & Adrian Diaz-Alvarez & Tomonobu Nakayama & Zdenka Kuncic, 2021. "Avalanches and edge-of-chaos learning in neuromorphic nanowire networks," Nature Communications, Nature, vol. 12(1), pages 1-13, December.
    2. Manfred G Kitzbichler & Marie L Smith & Søren R Christensen & Ed Bullmore, 2009. "Broadband Criticality of Human Brain Network Synchronization," PLOS Computational Biology, Public Library of Science, vol. 5(3), pages 1-13, March.
    3. Benjamin Cramer & David Stöckel & Markus Kreft & Michael Wibral & Johannes Schemmel & Karlheinz Meier & Viola Priesemann, 2020. "Control of criticality and computation in spiking neuromorphic networks with plasticity," Nature Communications, Nature, vol. 11(1), pages 1-11, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zueva Marina V, 2018. "A New Look at Stimulation Therapy with Complex-Structured Stimuli in Traumatic Brain Injuries," Global Journal of Addiction & Rehabilitation Medicine, Juniper Publishers Inc., vol. 5(1), pages 12-16, January.
    2. Werner, Gerhard, 2013. "Consciousness viewed in the framework of brain phase space dynamics, criticality, and the Renormalization Group," Chaos, Solitons & Fractals, Elsevier, vol. 55(C), pages 3-12.
    3. Yuan-Hang Zhang & Chesson Sipling & Erbin Qiu & Ivan K. Schuller & Massimiliano Di Ventra, 2024. "Collective dynamics and long-range order in thermal neuristor networks," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    4. Robert G. Sacco, 2019. "The Predictability of Synchronicity Experience: Results from a Survey of Jungian Analysts," International Journal of Psychological Studies, Canadian Center of Science and Education, vol. 11(3), pages 1-46, September.
    5. Zhiwei Chen & Wenjie Li & Zhen Fan & Shuai Dong & Yihong Chen & Minghui Qin & Min Zeng & Xubing Lu & Guofu Zhou & Xingsen Gao & Jun-Ming Liu, 2023. "All-ferroelectric implementation of reservoir computing," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    6. Christian Meisel & Alexander Storch & Susanne Hallmeyer-Elgner & Ed Bullmore & Thilo Gross, 2012. "Failure of Adaptive Self-Organized Criticality during Epileptic Seizure Attacks," PLOS Computational Biology, Public Library of Science, vol. 8(1), pages 1-8, January.
    7. Todd Zorick & Mark A Mandelkern, 2013. "Multifractal Detrended Fluctuation Analysis of Human EEG: Preliminary Investigation and Comparison with the Wavelet Transform Modulus Maxima Technique," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-7, July.
    8. Angela Slavova & Ventsislav Ignatov, 2022. "Edge of Chaos in Memristor Cellular Nonlinear Networks," Mathematics, MDPI, vol. 10(8), pages 1-11, April.
    9. Fingelkurts, Andrew A. & Fingelkurts, Alexander A. & Neves, Carlos F.H., 2013. "Consciousness as a phenomenon in the operational architectonics of brain organization: Criticality and self-organization considerations," Chaos, Solitons & Fractals, Elsevier, vol. 55(C), pages 13-31.
    10. Martinez-Saito, Mario, 2022. "Discrete scaling and criticality in a chain of adaptive excitable integrators," Chaos, Solitons & Fractals, Elsevier, vol. 163(C).
    11. Ruomin Zhu & Sam Lilak & Alon Loeffler & Joseph Lizier & Adam Stieg & James Gimzewski & Zdenka Kuncic, 2023. "Online dynamical learning and sequence memory with neuromorphic nanowire networks," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    12. Wei, Jinling & Zhou, Haiyan & Meng, Jun & Zhang, Fan & Chen, Yunmo & Zhou, Su, 2016. "The SOC in cells’ living expectations of Conway’s Game of Life and its extended version," Chaos, Solitons & Fractals, Elsevier, vol. 89(C), pages 348-352.
    13. Mikail Rubinov & Olaf Sporns & Jean-Philippe Thivierge & Michael Breakspear, 2011. "Neurobiologically Realistic Determinants of Self-Organized Criticality in Networks of Spiking Neurons," PLOS Computational Biology, Public Library of Science, vol. 7(6), pages 1-14, June.
    14. Gianluca Milano & Alessandro Cultrera & Luca Boarino & Luca Callegaro & Carlo Ricciardi, 2023. "Tomography of memory engrams in self-organizing nanowire connectomes," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    15. Marcelo G Mattar & Michael W Cole & Sharon L Thompson-Schill & Danielle S Bassett, 2015. "A Functional Cartography of Cognitive Systems," PLOS Computational Biology, Public Library of Science, vol. 11(12), pages 1-26, December.
    16. Aguilar-Velázquez, D. & Guzmán-Vargas, L., 2017. "Synchronization and 1/f signals in interacting small-world networks," Chaos, Solitons & Fractals, Elsevier, vol. 104(C), pages 418-425.
    17. Allegrini, Paolo & Paradisi, Paolo & Menicucci, Danilo & Laurino, Marco & Bedini, Remo & Piarulli, Andrea & Gemignani, Angelo, 2013. "Sleep unconsciousness and breakdown of serial critical intermittency: New vistas on the global workspace," Chaos, Solitons & Fractals, Elsevier, vol. 55(C), pages 32-43.
    18. Laura E. Suárez & Agoston Mihalik & Filip Milisav & Kenji Marshall & Mingze Li & Petra E. Vértes & Guillaume Lajoie & Bratislav Misic, 2024. "Connectome-based reservoir computing with the conn2res toolbox," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    19. Adrián Ponce-Alvarez & Gustavo Deco & Patric Hagmann & Gian Luca Romani & Dante Mantini & Maurizio Corbetta, 2015. "Resting-State Temporal Synchronization Networks Emerge from Connectivity Topology and Heterogeneity," PLOS Computational Biology, Public Library of Science, vol. 11(2), pages 1-23, February.
    20. Stoop, Ruedi & Kanders, Karlis & Lorimer, Tom & Held, Jenny & Albert, Carlo, 2016. "Big data naturally rescaled," Chaos, Solitons & Fractals, Elsevier, vol. 90(C), pages 81-90.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:633:y:2024:i:c:s0378437123008890. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.