IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1000007.html
   My bibliography  Save this article

Robustness of Learning That Is Based on Covariance-Driven Synaptic Plasticity

Author

Listed:
  • Yonatan Loewenstein

Abstract

It is widely believed that learning is due, at least in part, to long-lasting modifications of the strengths of synapses in the brain. Theoretical studies have shown that a family of synaptic plasticity rules, in which synaptic changes are driven by covariance, is particularly useful for many forms of learning, including associative memory, gradient estimation, and operant conditioning. Covariance-based plasticity is inherently sensitive. Even a slight mistuning of the parameters of a covariance-based plasticity rule is likely to result in substantial changes in synaptic efficacies. Therefore, the biological relevance of covariance-based plasticity models is questionable. Here, we study the effects of mistuning parameters of the plasticity rule in a decision making model in which synaptic plasticity is driven by the covariance of reward and neural activity. An exact covariance plasticity rule yields Herrnstein's matching law. We show that although the effect of slight mistuning of the plasticity rule on the synaptic efficacies is large, the behavioral effect is small. Thus, matching behavior is robust to mistuning of the parameters of the covariance-based plasticity rule. Furthermore, the mistuned covariance rule results in undermatching, which is consistent with experimentally observed behavior. These results substantiate the hypothesis that approximate covariance-based synaptic plasticity underlies operant conditioning. However, we show that the mistuning of the mean subtraction makes behavior sensitive to the mistuning of the properties of the decision making network. Thus, there is a tradeoff between the robustness of matching behavior to changes in the plasticity rule and its robustness to changes in the properties of the decision making network.Author Summary: It is widely believed that learning is due, at least in part, to modifications of synapses in the brain. The ability of a synapse to change its strength is called “synaptic plasticity,” and the rules governing these changes are a subject of intense research. Theoretical studies have shown that a particular family of synaptic plasticity rules, known as covariance rules, could underlie many forms of learning. While it is possible that a biological synapse would be able to approximately implement such abstract rules, it seems unlikely that this implementation would be exact. Covariance rules are inherently sensitive, and even a slight inaccuracy in their implementation is likely to result in substantial changes in synaptic strengths. Thus, the biological relevance of these rules remains questionable. Here we study the consequences of the mistuning of a covariance plasticity rule in the context of operant conditioning. In a previous study, we showed that an approximate phenomenological law of behavior called “the matching law” naturally emerges if synapses change according to the covariance rule. Here we show that although the effect of slight mistuning of the covariance rule on synaptic strengths is substantial, it leads to only small deviations from the matching law. Furthermore, these deviations are observed experimentally. Thus, our results support the hypothesis that covariance synaptic plasticity underlies operant conditioning.

Suggested Citation

  • Yonatan Loewenstein, 2008. "Robustness of Learning That Is Based on Covariance-Driven Synaptic Plasticity," PLOS Computational Biology, Public Library of Science, vol. 4(3), pages 1-10, March.
  • Handle: RePEc:plo:pcbi00:1000007
    DOI: 10.1371/journal.pcbi.1000007
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1000007
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1000007&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1000007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. U. Alon & M. G. Surette & N. Barkai & S. Leibler, 1999. "Robustness in bacterial chemotaxis," Nature, Nature, vol. 397(6715), pages 168-171, January.
    2. Nace L. Golding & Nathan P. Staff & Nelson Spruston, 2002. "Dendritic spikes as a mechanism for cooperative long-term potentiation," Nature, Nature, vol. 418(6895), pages 326-331, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lotem Elber-Dorozko & Yonatan Loewenstein, 2018. "Striatial Action-Value Neurons Reconsidered," Discussion Paper Series dp720, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jae Kyoung Kim & Trachette L Jackson, 2013. "Mechanisms That Enhance Sustainability of p53 Pulses," PLOS ONE, Public Library of Science, vol. 8(6), pages 1-11, June.
    2. Junjie Luo & Jun Wang & Ting Martin Ma & Zhirong Sun, 2010. "Reverse Engineering of Bacterial Chemotaxis Pathway via Frequency Domain Analysis," PLOS ONE, Public Library of Science, vol. 5(3), pages 1-8, March.
    3. Oliver Pohl & Marius Hintsche & Zahra Alirezaeizanjani & Maximilian Seyrich & Carsten Beta & Holger Stark, 2017. "Inferring the Chemotactic Strategy of P. putida and E. coli Using Modified Kramers-Moyal Coefficients," PLOS Computational Biology, Public Library of Science, vol. 13(1), pages 1-24, January.
    4. Jinlong Yuan & Lei Wang & Xu Zhang & Enmin Feng & Hongchao Yin & Zhilong Xiu, 2015. "Parameter identification for a nonlinear enzyme-catalytic dynamic system with time-delays," Journal of Global Optimization, Springer, vol. 62(4), pages 791-810, August.
    5. Adel Dayarian & Madalena Chaves & Eduardo D Sontag & Anirvan M Sengupta, 2009. "Shape, Size, and Robustness: Feasible Regions in the Parameter Space of Biochemical Networks," PLOS Computational Biology, Public Library of Science, vol. 5(1), pages 1-12, January.
    6. Matteo Saponati & Martin Vinck, 2023. "Sequence anticipation and spike-timing-dependent plasticity emerge from a predictive learning rule," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    7. Balázs Ujfalussy & Tamás Kiss & Péter Érdi, 2009. "Parallel Computational Subunits in Dentate Granule Cells Generate Multiple Place Fields," PLOS Computational Biology, Public Library of Science, vol. 5(9), pages 1-16, September.
    8. Miri Adler & Avi Mayo & Uri Alon, 2014. "Logarithmic and Power Law Input-Output Relations in Sensory Systems with Fold-Change Detection," PLOS Computational Biology, Public Library of Science, vol. 10(8), pages 1-14, August.
    9. Yann S Dufour & Sébastien Gillet & Nicholas W Frankel & Douglas B Weibel & Thierry Emonet, 2016. "Direct Correlation between Motile Behavior and Protein Abundance in Single Cells," PLOS Computational Biology, Public Library of Science, vol. 12(9), pages 1-25, September.
    10. Payne, Joshua L., 2016. "No tradeoff between versatility and robustness in gene circuit motifs," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 449(C), pages 192-199.
    11. Imke Spöring & Vincent A Martinez & Christian Hotz & Jana Schwarz-Linek & Keara L Grady & Josué M Nava-Sedeño & Teun Vissers & Hanna M Singer & Manfred Rohde & Carole Bourquin & Haralampos Hatzikirou , 2018. "Hook length of the bacterial flagellum is optimized for maximal stability of the flagellar bundle," PLOS Biology, Public Library of Science, vol. 16(9), pages 1-19, September.
    12. Gregor Moenke & Martin Falcke & Keven Thurley, 2012. "Hierarchic Stochastic Modelling Applied to Intracellular Ca2+ Signals," PLOS ONE, Public Library of Science, vol. 7(12), pages 1-12, December.
    13. Jung Ho Hyun & Kenichiro Nagahama & Ho Namkung & Neymi Mignocchi & Seung-Eon Roh & Patrick Hannan & Sarah Krüssel & Chuljung Kwak & Abigail McElroy & Bian Liu & Mingguang Cui & Seunghwan Lee & Dongmin, 2022. "Tagging active neurons by soma-targeted Cal-Light," Nature Communications, Nature, vol. 13(1), pages 1-16, December.
    14. Kirstin Meyer & Nicholas C. Lammers & Lukasz J. Bugaj & Hernan G. Garcia & Orion D. Weiner, 2023. "Optogenetic control of YAP reveals a dynamic communication code for stem cell fate and proliferation," Nature Communications, Nature, vol. 14(1), pages 1-18, December.
    15. Ross D. Jones & Yili Qian & Katherine Ilia & Benjamin Wang & Michael T. Laub & Domitilla Del Vecchio & Ron Weiss, 2022. "Robust and tunable signal processing in mammalian cells via engineered covalent modification cycles," Nature Communications, Nature, vol. 13(1), pages 1-17, December.
    16. Gabriele Micali & Gerardo Aquino & David M Richards & Robert G Endres, 2015. "Accurate Encoding and Decoding by Single Cells: Amplitude Versus Frequency Modulation," PLOS Computational Biology, Public Library of Science, vol. 11(6), pages 1-21, June.
    17. Zeina Shreif & Vipul Periwal, 2014. "A Network Characteristic That Correlates Environmental and Genetic Robustness," PLOS Computational Biology, Public Library of Science, vol. 10(2), pages 1-23, February.
    18. Diana Clausznitzer & Olga Oleksiuk & Linda Løvdok & Victor Sourjik & Robert G Endres, 2010. "Chemotactic Response and Adaptation Dynamics in Escherichia coli," PLOS Computational Biology, Public Library of Science, vol. 6(5), pages 1-11, May.
    19. Li, Wenyuan & Lin, Yongjing & Liu, Ying, 2007. "The structure of weighted small-world networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 376(C), pages 708-718.
    20. Robert G Endres & Joseph J Falke & Ned S Wingreen, 2007. "Chemotaxis Receptor Complexes: From Signaling to Assembly," PLOS Computational Biology, Public Library of Science, vol. 3(7), pages 1-9, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1000007. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.