IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0191527.html
   My bibliography  Save this article

full-FORCE: A target-based method for training recurrent networks

Author

Listed:
  • Brian DePasquale
  • Christopher J Cueva
  • Kanaka Rajan
  • G Sean Escola
  • L F Abbott

Abstract

Trained recurrent networks are powerful tools for modeling dynamic neural computations. We present a target-based method for modifying the full connectivity matrix of a recurrent network to train it to perform tasks involving temporally complex input/output transformations. The method introduces a second network during training to provide suitable “target” dynamics useful for performing the task. Because it exploits the full recurrent connectivity, the method produces networks that perform tasks with fewer neurons and greater noise robustness than traditional least-squares (FORCE) approaches. In addition, we show how introducing additional input signals into the target-generating network, which act as task hints, greatly extends the range of tasks that can be learned and provides control over the complexity and nature of the dynamics of the trained, task-performing network.

Suggested Citation

  • Brian DePasquale & Christopher J Cueva & Kanaka Rajan & G Sean Escola & L F Abbott, 2018. "full-FORCE: A target-based method for training recurrent networks," PLOS ONE, Public Library of Science, vol. 13(2), pages 1-18, February.
    • Handle: RePEc:plo:pone00:0191527
    DOI: 10.1371/journal.pone.0191527
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0191527
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0191527&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0191527?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ranulfo Romo & Carlos D. Brody & Adrián Hernández & Luis Lemus, 1999. "Neuronal correlates of parametric working memory in the prefrontal cortex," Nature, Nature, vol. 399(6735), pages 470-473, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Filippo Costa & Eline V. Schaft & Geertjan Huiskamp & Erik J. Aarnoutse & Maryse A. van’t Klooster & Niklaus Krayenbühl & Georgia Ramantani & Maeike Zijlmans & Giacomo Indiveri & Johannes Sarnthein, 2024. "Robust compression and detection of epileptiform patterns in ECoG using a real-time spiking neural network hardware framework," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    2. Barbara Feulner & Matthew G. Perich & Raeed H. Chowdhury & Lee E. Miller & Juan A. Gallego & Claudia Clopath, 2022. "Small, correlated changes in synaptic connectivity may facilitate rapid motor learning," Nature Communications, Nature, vol. 13(1), pages 1-14, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sacha Jennifer van Albada & Moritz Helias & Markus Diesmann, 2015. "Scalability of Asynchronous Networks Is Limited by One-to-One Mapping between Effective Connectivity and Correlations," PLOS Computational Biology, Public Library of Science, vol. 11(9), pages 1-37, September.
    2. Gabriel D Puccini & Maria V Sanchez-Vives & Albert Compte, 2007. "Integrated Mechanisms of Anticipation and Rate-of-Change Computations in Cortical Circuits," PLOS Computational Biology, Public Library of Science, vol. 3(5), pages 1-13, May.
    3. Kaushik J. Lakshminarasimhan & Eric Avila & Xaq Pitkow & Dora E. Angelaki, 2023. "Dynamical latent state computation in the male macaque posterior parietal cortex," Nature Communications, Nature, vol. 14(1), pages 1-20, December.
    4. Francesco Ceccarelli & Lorenzo Ferrucci & Fabrizio Londei & Surabhi Ramawat & Emiliano Brunamonti & Aldo Genovesio, 2023. "Static and dynamic coding in distinct cell types during associative learning in the prefrontal cortex," Nature Communications, Nature, vol. 14(1), pages 1-17, December.
    5. Juan Linde-Domingo & Bernhard Spitzer, 2024. "Geometry of visuospatial working memory information in miniature gaze patterns," Nature Human Behaviour, Nature, vol. 8(2), pages 336-348, February.
    6. Yue Liu & Xiao-Jing Wang, 2024. "Flexible gating between subspaces in a neural network model of internally guided task switching," Nature Communications, Nature, vol. 15(1), pages 1-20, December.
    7. Xin Wei Chia & Jian Kwang Tan & Lee Fang Ang & Tsukasa Kamigaki & Hiroshi Makino, 2023. "Emergence of cortical network motifs for short-term memory during learning," Nature Communications, Nature, vol. 14(1), pages 1-17, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0191527. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.