IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0063400.html
   My bibliography  Save this article

Information Driven Self-Organization of Complex Robotic Behaviors

Author

Listed:
  • Georg Martius
  • Ralf Der
  • Nihat Ay

Abstract

Information theory is a powerful tool to express principles to drive autonomous systems because it is domain invariant and allows for an intuitive interpretation. This paper studies the use of the predictive information (PI), also called excess entropy or effective measure complexity, of the sensorimotor process as a driving force to generate behavior. We study nonlinear and nonstationary systems and introduce the time-local predicting information (TiPI) which allows us to derive exact results together with explicit update rules for the parameters of the controller in the dynamical systems framework. In this way the information principle, formulated at the level of behavior, is translated to the dynamics of the synapses. We underpin our results with a number of case studies with high-dimensional robotic systems. We show the spontaneous cooperativity in a complex physical system with decentralized control. Moreover, a jointly controlled humanoid robot develops a high behavioral variety depending on its physics and the environment it is dynamically embedded into. The behavior can be decomposed into a succession of low-dimensional modes that increasingly explore the behavior space. This is a promising way to avoid the curse of dimensionality which hinders learning systems to scale well.

Suggested Citation

  • Georg Martius & Ralf Der & Nihat Ay, 2013. "Information Driven Self-Organization of Complex Robotic Behaviors," PLOS ONE, Public Library of Science, vol. 8(5), pages 1-14, May.
  • Handle: RePEc:plo:pone00:0063400
    DOI: 10.1371/journal.pone.0063400
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0063400
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0063400&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0063400?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gina G. Turrigiano & Kenneth R. Leslie & Niraj S. Desai & Lana C. Rutherford & Sacha B. Nelson, 1998. "Activity-dependent scaling of quantal amplitude in neocortical neurons," Nature, Nature, vol. 391(6670), pages 892-896, February.
    2. N. Ay & N. Bertschinger & R. Der & F. Güttler & E. Olbrich, 2008. "Predictive information and explorative behavior of autonomous robots," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 63(3), pages 329-339, June.
    3. Alexander Maye & Chih-hao Hsieh & George Sugihara & Björn Brembs, 2007. "Order in Spontaneous Behavior," PLOS ONE, Public Library of Science, vol. 2(5), pages 1-14, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matteo Saponati & Martin Vinck, 2023. "Sequence anticipation and spike-timing-dependent plasticity emerge from a predictive learning rule," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    2. Kin Fai Ellick Wong & Cecilia Cheng, 2013. "Predictable or Not? Individuals’ Risk Decisions Do Not Necessarily Predict Their Next Ones," PLOS ONE, Public Library of Science, vol. 8(2), pages 1-5, February.
    3. Niranjan Chakravarthy & Shivkumar Sabesan & Kostas Tsakalis & Leon Iasemidis, 2009. "Controlling epileptic seizures in a neural mass model," Journal of Combinatorial Optimization, Springer, vol. 17(1), pages 98-116, January.
    4. Damien M O’Halloran, 2020. "Simulation model of CA1 pyramidal neurons reveal opposing roles for the Na+/Ca2+ exchange current and Ca2+-activated K+ current during spike-timing dependent synaptic plasticity," PLOS ONE, Public Library of Science, vol. 15(3), pages 1-12, March.
    5. Taro Ueno & Naoki Masuda & Shoen Kume & Kazuhiko Kume, 2012. "Dopamine Modulates the Rest Period Length without Perturbation of Its Power Law Distribution in Drosophila melanogaster," PLOS ONE, Public Library of Science, vol. 7(2), pages 1-12, February.
    6. Christoph Salge & Daniel Polani, 2011. "Digested Information as an Information Theoretic Motivation for Social Interaction," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 14(1), pages 1-5.
    7. Sacha Jennifer van Albada & Moritz Helias & Markus Diesmann, 2015. "Scalability of Asynchronous Networks Is Limited by One-to-One Mapping between Effective Connectivity and Correlations," PLOS Computational Biology, Public Library of Science, vol. 11(9), pages 1-37, September.
    8. Dean J. Kareemo & Christina S. Winborn & Samantha S. Olah & Carley N. Miller & JungMin Kim & Chelsie A. Kadgien & Hannah S. Actor-Engel & Harrison J. Ramsay & Austin M. Ramsey & Jason Aoto & Matthew J, 2024. "Genetically encoded intrabody probes for labeling and manipulating AMPA-type glutamate receptors," Nature Communications, Nature, vol. 15(1), pages 1-18, December.
    9. Christian Keck & Cristina Savin & Jörg Lücke, 2012. "Feedforward Inhibition and Synaptic Scaling – Two Sides of the Same Coin?," PLOS Computational Biology, Public Library of Science, vol. 8(3), pages 1-15, March.
    10. Iris Reuveni & Sourav Ghosh & Edi Barkai, 2017. "Real Time Multiplicative Memory Amplification Mediated by Whole-Cell Scaling of Synaptic Response in Key Neurons," PLOS Computational Biology, Public Library of Science, vol. 13(1), pages 1-31, January.
    11. Jimok Kim & Richard W Tsien & Bradley E Alger, 2012. "An Improved Test for Detecting Multiplicative Homeostatic Synaptic Scaling," PLOS ONE, Public Library of Science, vol. 7(5), pages 1-9, May.
    12. Andrea Censi & Andrew D Straw & Rosalyn W Sayaman & Richard M Murray & Michael H Dickinson, 2013. "Discriminating External and Internal Causes for Heading Changes in Freely Flying Drosophila," PLOS Computational Biology, Public Library of Science, vol. 9(2), pages 1-14, February.
    13. Christoph Hartmann & Andreea Lazar & Bernhard Nessler & Jochen Triesch, 2015. "Where’s the Noise? Key Features of Spontaneous Activity and Neural Variability Arise through Learning in a Deterministic Network," PLOS Computational Biology, Public Library of Science, vol. 11(12), pages 1-35, December.
    14. Julijana Gjorgjieva & Taro Toyoizumi & Stephen J Eglen, 2009. "Burst-Time-Dependent Plasticity Robustly Guides ON/OFF Segregation in the Lateral Geniculate Nucleus," PLOS Computational Biology, Public Library of Science, vol. 5(12), pages 1-19, December.
    15. Mizusaki, Beatriz E.P. & Agnes, Everton J. & Erichsen, Rubem & Brunnet, Leonardo G., 2017. "Learning and retrieval behavior in recurrent neural networks with pre-synaptic dependent homeostatic plasticity," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 479(C), pages 279-286.
    16. Giorgia Dellaferrera & Stanisław Woźniak & Giacomo Indiveri & Angeliki Pantazi & Evangelos Eleftheriou, 2022. "Introducing principles of synaptic integration in the optimization of deep neural networks," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    17. Aseel Shomar & Lukas Geyrhofer & Noam E Ziv & Naama Brenner, 2017. "Cooperative stochastic binding and unbinding explain synaptic size dynamics and statistics," PLOS Computational Biology, Public Library of Science, vol. 13(7), pages 1-24, July.
    18. John Palmer & Adam Keane & Pulin Gong, 2017. "Learning and executing goal-directed choices by internally generated sequences in spiking neural circuits," PLOS Computational Biology, Public Library of Science, vol. 13(7), pages 1-23, July.
    19. Sepideh Bazazi & Frederic Bartumeus & Joseph J Hale & Iain D Couzin, 2012. "Intermittent Motion in Desert Locusts: Behavioural Complexity in Simple Environments," PLOS Computational Biology, Public Library of Science, vol. 8(5), pages 1-10, May.
    20. Masato S Abe & Masakazu Shimada, 2015. "Lévy Walks Suboptimal under Predation Risk," PLOS Computational Biology, Public Library of Science, vol. 11(11), pages 1-16, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0063400. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.