IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1004895.html
   My bibliography  Save this article

Learning Universal Computations with Spikes

Author

Listed:
  • Dominik Thalmeier
  • Marvin Uhlmann
  • Hilbert J Kappen
  • Raoul-Martin Memmesheimer

Abstract

Providing the neurobiological basis of information processing in higher animals, spiking neural networks must be able to learn a variety of complicated computations, including the generation of appropriate, possibly delayed reactions to inputs and the self-sustained generation of complex activity patterns, e.g. for locomotion. Many such computations require previous building of intrinsic world models. Here we show how spiking neural networks may solve these different tasks. Firstly, we derive constraints under which classes of spiking neural networks lend themselves to substrates of powerful general purpose computing. The networks contain dendritic or synaptic nonlinearities and have a constrained connectivity. We then combine such networks with learning rules for outputs or recurrent connections. We show that this allows to learn even difficult benchmark tasks such as the self-sustained generation of desired low-dimensional chaotic dynamics or memory-dependent computations. Furthermore, we show how spiking networks can build models of external world systems and use the acquired knowledge to control them.Author Summary: Animals and humans can learn versatile computations such as the generation of complicated activity patterns to steer movements or the generation of appropriate outputs in response to inputs. Such learning must be accomplished by networks of nerve cells in the brain, which communicate with short electrical impulses, so-called spikes. Here we show how such networks may perform the learning. We track their ability back to experimentally found nonlinearities in the couplings between nerve cells and to a network connectivity that complies with constraints. We show that the spiking networks are able to learn difficult tasks such as the generation of desired chaotic activity and the prediction of the impact of actions on the environment. The latter allows to compute optimal actions by mental exploration.

Suggested Citation

  • Dominik Thalmeier & Marvin Uhlmann & Hilbert J Kappen & Raoul-Martin Memmesheimer, 2016. "Learning Universal Computations with Spikes," PLOS Computational Biology, Public Library of Science, vol. 12(6), pages 1-29, June.
  • Handle: RePEc:plo:pcbi00:1004895
    DOI: 10.1371/journal.pcbi.1004895
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1004895
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1004895&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1004895?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Omri Harish & David Hansel, 2015. "Asynchronous Rate Chaos in Spiking Neuronal Circuits," PLOS Computational Biology, Public Library of Science, vol. 11(7), pages 1-38, July.
    2. Friedemann Zenke & Everton J. Agnes & Wulfram Gerstner, 2015. "Diverse synaptic plasticity mechanisms orchestrated to form and retrieve memories in spiking neural networks," Nature Communications, Nature, vol. 6(1), pages 1-13, November.
    3. Ashok Litwin-Kumar & Brent Doiron, 2014. "Formation and maintenance of neuronal assemblies through synaptic plasticity," Nature Communications, Nature, vol. 5(1), pages 1-12, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gabriel Koch Ocker & Ashok Litwin-Kumar & Brent Doiron, 2015. "Self-Organization of Microcircuits in Networks of Spiking Neurons with Plastic Synapses," PLOS Computational Biology, Public Library of Science, vol. 11(8), pages 1-40, August.
    2. Mizusaki, Beatriz E.P. & Agnes, Everton J. & Erichsen, Rubem & Brunnet, Leonardo G., 2017. "Learning and retrieval behavior in recurrent neural networks with pre-synaptic dependent homeostatic plasticity," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 479(C), pages 279-286.
    3. Michele N. Insanally & Badr F. Albanna & Jade Toth & Brian DePasquale & Saba Shokat Fadaei & Trisha Gupta & Olivia Lombardi & Kishore Kuchibhotla & Kanaka Rajan & Robert C. Froemke, 2024. "Contributions of cortical neuron firing patterns, synaptic connectivity, and plasticity to task performance," Nature Communications, Nature, vol. 15(1), pages 1-21, December.
    4. Douglas Feitosa Tomé & Sadra Sadeh & Claudia Clopath, 2022. "Coordinated hippocampal-thalamic-cortical communication crucial for engram dynamics underneath systems consolidation," Nature Communications, Nature, vol. 13(1), pages 1-18, December.
    5. Matteo Saponati & Martin Vinck, 2023. "Sequence anticipation and spike-timing-dependent plasticity emerge from a predictive learning rule," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    6. Klinshov, Vladimir V. & Kovalchuk, Andrey V. & Franović, Igor & Perc, Matjaž & Svetec, Milan, 2022. "Rate chaos and memory lifetime in spiking neural networks," Chaos, Solitons & Fractals, Elsevier, vol. 158(C).
    7. Gabriel Koch Ocker & Krešimir Josić & Eric Shea-Brown & Michael A Buice, 2017. "Linking structure and activity in nonlinear spiking networks," PLOS Computational Biology, Public Library of Science, vol. 13(6), pages 1-47, June.
    8. Vahid Rostami & Thomas Rost & Felix Johannes Schmitt & Sacha Jennifer Albada & Alexa Riehle & Martin Paul Nawrot, 2024. "Spiking attractor model of motor cortex explains modulation of neural and behavioral variability by prior target information," Nature Communications, Nature, vol. 15(1), pages 1-17, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1004895. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.