IDEAS home Printed from https://ideas.repec.org/a/hin/complx/7948684.html
   My bibliography  Save this article

Skill Learning for Intelligent Robot by Perception-Action Integration: A View from Hierarchical Temporal Memory

Author

Listed:
  • Xinzheng Zhang
  • Jianfen Zhang
  • Junpei Zhong

Abstract

Skill learning autonomously through interactions with the environment is a crucial ability for intelligent robot. A perception-action integration or sensorimotor cycle, as an important issue in imitation learning, is a natural mechanism without the complex program process. Recently, neurocomputing model and developmental intelligence method are considered as a new trend for implementing the robot skill learning. In this paper, based on research of the human brain neocortex model, we present a skill learning method by perception-action integration strategy from the perspective of hierarchical temporal memory (HTM) theory. The sequential sensor data representing a certain skill from a RGB-D camera are received and then encoded as a sequence of Sparse Distributed Representation (SDR) vectors. The sequential SDR vectors are treated as the inputs of the perception-action HTM. The HTM learns sequences of SDRs and makes predictions of what the next input SDR will be. It stores the transitions of the current perceived sensor data and next predicted actions. We evaluated the performance of this proposed framework for learning the shaking hands skill on a humanoid NAO robot. The experimental results manifest that the skill learning method designed in this paper is promising.

Suggested Citation

  • Xinzheng Zhang & Jianfen Zhang & Junpei Zhong, 2017. "Skill Learning for Intelligent Robot by Perception-Action Integration: A View from Hierarchical Temporal Memory," Complexity, Hindawi, vol. 2017, pages 1-16, November.
  • Handle: RePEc:hin:complx:7948684
    DOI: 10.1155/2017/7948684
    as

    Download full text from publisher

    File URL: http://downloads.hindawi.com/journals/8503/2017/7948684.pdf
    Download Restriction: no

    File URL: http://downloads.hindawi.com/journals/8503/2017/7948684.xml
    Download Restriction: no

    File URL: https://libkey.io/10.1155/2017/7948684?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. D. Huber & D. A. Gutnisky & S. Peron & D. H. O’Connor & J. S. Wiegert & L. Tian & T. G. Oertner & L. L. Looger & K. Svoboda, 2012. "Multiple dynamic representations in the motor cortex during sensorimotor learning," Nature, Nature, vol. 484(7395), pages 473-478, April.
    2. Konrad P. Körding & Daniel M. Wolpert, 2004. "Bayesian integration in sensorimotor learning," Nature, Nature, vol. 427(6971), pages 244-247, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bettina Voelcker & Ravi Pancholi & Simon Peron, 2022. "Transformation of primary sensory cortical representations from layer 4 to layer 2," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    2. Shih-Wei Wu & Maria F Dal Martello & Laurence T Maloney, 2009. "Sub-Optimal Allocation of Time in Sequential Movements," PLOS ONE, Public Library of Science, vol. 4(12), pages 1-13, December.
    3. Wen-Hao Zhang & Si Wu & Krešimir Josić & Brent Doiron, 2023. "Sampling-based Bayesian inference in recurrent circuits of stochastic spiking neurons," Nature Communications, Nature, vol. 14(1), pages 1-19, December.
    4. Adam N Sanborn & Ulrik R Beierholm, 2016. "Fast and Accurate Learning When Making Discrete Numerical Estimates," PLOS Computational Biology, Public Library of Science, vol. 12(4), pages 1-28, April.
    5. Seth W. Egger & Stephen G. Lisberger, 2022. "Neural structure of a sensory decoder for motor control," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    6. Brocas, Isabelle & Carrillo, Juan D., 2012. "From perception to action: An economic model of brain processes," Games and Economic Behavior, Elsevier, vol. 75(1), pages 81-103.
    7. Vassilios N Christopoulos & Paul R Schrater, 2009. "Grasping Objects with Environmentally Induced Position Uncertainty," PLOS Computational Biology, Public Library of Science, vol. 5(10), pages 1-11, October.
    8. Guido Marco Cicchini & Giovanni D’Errico & David Charles Burr, 2022. "Crowding results from optimal integration of visual targets with contextual information," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    9. Fan Li & Jazlyn Gallego & Natasha N. Tirko & Jenna Greaser & Derek Bashe & Rudra Patel & Eric Shaker & Grace E. Valkenburg & Alanoud S. Alsubhi & Steven Wellman & Vanshika Singh & Camila Garcia Padill, 2024. "Low-intensity pulsed ultrasound stimulation (LIPUS) modulates microglial activation following intracortical microelectrode implantation," Nature Communications, Nature, vol. 15(1), pages 1-21, December.
    10. Alice Soldà & Changxia Ke & Lionel Page & William von Hippel, 2020. "Strategically delusional," Experimental Economics, Springer;Economic Science Association, vol. 23(3), pages 604-631, September.
    11. Daniel Bjasch & Christopher J Bockisch & Dominik Straumann & Alexander A Tarnutzer, 2012. "Differential Effects of Visual Feedback on Subjective Visual Vertical Accuracy and Precision," PLOS ONE, Public Library of Science, vol. 7(11), pages 1-11, November.
    12. Philipp Schustek & Rubén Moreno-Bote, 2018. "Instance-based generalization for human judgments about uncertainty," PLOS Computational Biology, Public Library of Science, vol. 14(6), pages 1-27, June.
    13. Daniel Durstewitz, 2017. "A state space approach for piecewise-linear recurrent neural networks for identifying computational dynamics from neural measurements," PLOS Computational Biology, Public Library of Science, vol. 13(6), pages 1-33, June.
    14. Joshua G A Cashaback & Christopher K Lao & Dimitrios J Palidis & Susan K Coltman & Heather R McGregor & Paul L Gribble, 2019. "The gradient of the reinforcement landscape influences sensorimotor learning," PLOS Computational Biology, Public Library of Science, vol. 15(3), pages 1-27, March.
    15. Michael Bergin & Kylie Tucker & Bill Vicenzino & Paul W Hodges, 2021. "“Taking action” to reduce pain—Has interpretation of the motor adaptation to pain been too simplistic?," PLOS ONE, Public Library of Science, vol. 16(12), pages 1-19, December.
    16. Nils Neupärtl & Fabian Tatai & Constantin A Rothkopf, 2020. "Intuitive physical reasoning about objects’ masses transfers to a visuomotor decision task consistent with Newtonian physics," PLOS Computational Biology, Public Library of Science, vol. 16(10), pages 1-26, October.
    17. Salvador Dura-Bernal & Thomas Wennekers & Susan L Denham, 2012. "Top-Down Feedback in an HMAX-Like Cortical Model of Object Perception Based on Hierarchical Bayesian Networks and Belief Propagation," PLOS ONE, Public Library of Science, vol. 7(11), pages 1-25, November.
    18. Jonathan B Dingwell & Joby John & Joseph P Cusumano, 2010. "Do Humans Optimally Exploit Redundancy to Control Step Variability in Walking?," PLOS Computational Biology, Public Library of Science, vol. 6(7), pages 1-15, July.
    19. Jingwei Sun & Jian Li & Hang Zhang, 2019. "Human representation of multimodal distributions as clusters of samples," PLOS Computational Biology, Public Library of Science, vol. 15(5), pages 1-29, May.
    20. Siqueira, Jose Ribamar & ter Horst, Enrique & Molina, German & Losada, Mauricio & Mateus, Marelby Amado, 2020. "A Bayesian examination of the relationship of internal and external touchpoints in the customer experience process across various service environments," Journal of Retailing and Consumer Services, Elsevier, vol. 53(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hin:complx:7948684. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Mohamed Abdelhakeem (email available below). General contact details of provider: https://www.hindawi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.