IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-54327-6.html
   My bibliography  Save this article

Sensing expectation enables simultaneous proprioception and contact detection in an intelligent soft continuum robot

Author

Listed:
  • Peiyi Wang

    (Beijing Jiaotong University
    National University of Singapore
    National University of Singapore)

  • Zhexin Xie

    (National University of Singapore
    National University of Singapore)

  • Wenci Xin

    (National University of Singapore
    National University of Singapore)

  • Zhiqiang Tang

    (National University of Singapore
    National University of Singapore)

  • Xinhua Yang

    (Beijing Jiaotong University)

  • Muralidharan Mohanakrishnan

    (National University of Singapore
    National University of Singapore)

  • Sheng Guo

    (Beijing Jiaotong University)

  • Cecilia Laschi

    (National University of Singapore
    National University of Singapore)

Abstract

A high-level perceptual model found in the human brain is essential to guide robotic control when facing perception-intensive interactive tasks. Soft robots with inherent softness may benefit from such mechanisms when interacting with their surroundings. Here, we propose an expected-actual perception-action loop and demonstrate the model on a sensorized soft continuum robot. By sensing and matching expected and actual shape (1.4% estimation error on average), at each perception loop, our robot system rapidly (detection within 0.4 s) and robustly detects contact and distinguishes deformation sources, whether external and internal actions are applied separately or simultaneously. We also show that our soft arm can accurately perceive contact direction in both static and dynamic configurations (error below 10°), even in interactive environments without vision. The potential of our method are demonstrated in two experimental scenarios: learning to autonomously navigate by touching the walls, and teaching and repeating desired configurations of position and force through interaction with human operators.

Suggested Citation

  • Peiyi Wang & Zhexin Xie & Wenci Xin & Zhiqiang Tang & Xinhua Yang & Muralidharan Mohanakrishnan & Sheng Guo & Cecilia Laschi, 2024. "Sensing expectation enables simultaneous proprioception and contact detection in an intelligent soft continuum robot," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-54327-6
    DOI: 10.1038/s41467-024-54327-6
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-54327-6
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-54327-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Wenbo Liu & Youning Duo & Jiaqi Liu & Feiyang Yuan & Lei Li & Luchen Li & Gang Wang & Bohan Chen & Siqi Wang & Hui Yang & Yuchen Liu & Yanru Mo & Yun Wang & Bin Fang & Fuchun Sun & Xilun Ding & Chi Zh, 2022. "Touchless interactive teaching of soft robots through flexible bimodal sensory interfaces," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    2. Daniela Rus & Michael T. Tolley, 2015. "Design, fabrication and control of soft robots," Nature, Nature, vol. 521(7553), pages 467-475, May.
    3. Tao Jin & Zhongda Sun & Long Li & Quan Zhang & Minglu Zhu & Zixuan Zhang & Guangjie Yuan & Tao Chen & Yingzhong Tian & Xuyan Hou & Chengkuo Lee, 2020. "Triboelectric nanogenerator sensors for soft robotics aiming at digital twin applications," Nature Communications, Nature, vol. 11(1), pages 1-12, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haitao Yang & Shuo Ding & Jiahao Wang & Shuo Sun & Ruphan Swaminathan & Serene Wen Ling Ng & Xinglong Pan & Ghim Wei Ho, 2024. "Computational design of ultra-robust strain sensors for soft robot perception and autonomy," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    2. Wenbo Liu & Youning Duo & Jiaqi Liu & Feiyang Yuan & Lei Li & Luchen Li & Gang Wang & Bohan Chen & Siqi Wang & Hui Yang & Yuchen Liu & Yanru Mo & Yun Wang & Bin Fang & Fuchun Sun & Xilun Ding & Chi Zh, 2022. "Touchless interactive teaching of soft robots through flexible bimodal sensory interfaces," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    3. Zhao, Kun & Song, Zhenhua & Sun, Wanru & Gao, Wei & Guo, Junhong & Zhang, Kewei, 2024. "Flexible neodymium iron boron/polyvinyl chloride (Nd2Fe14B/PVC) composite film based hybrid nanogenerator for efficient mechanical energy harvesting," Energy, Elsevier, vol. 300(C).
    4. Shijing Zhang & Yingxiang Liu & Jie Deng & Xiang Gao & Jing Li & Weiyi Wang & Mingxin Xun & Xuefeng Ma & Qingbing Chang & Junkao Liu & Weishan Chen & Jie Zhao, 2023. "Piezo robotic hand for motion manipulation from micro to macro," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    5. Amir Souhail & Passakorn vassakosol, 2018. "Low Cost Soft Robotic Grippers For Reliable Grasping," Journal of Mechanical Engineering Research & Developments (JMERD), Zibeline International Publishing, vol. 41(4), pages 88-95, November.
    6. Jiang, Dongyue & Xu, Minyi & Dong, Ming & Guo, Fei & Liu, Xiaohua & Chen, Guijun & Wang, Zhong Lin, 2019. "Water-solid triboelectric nanogenerators: An alternative means for harvesting hydropower," Renewable and Sustainable Energy Reviews, Elsevier, vol. 115(C).
    7. Federico Pratissoli & Andreagiovanni Reina & Yuri Kaszubowski Lopes & Carlo Pinciroli & Genki Miyauchi & Lorenzo Sabattini & Roderich Groß, 2023. "Coherent movement of error-prone individuals through mechanical coupling," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    8. Yunjiang Wang & Xinben Hu & Luhang Cui & Xuan Xiao & Keji Yang & Yongjian Zhu & Haoran Jin, 2024. "Bioinspired handheld time-share driven robot with expandable DoFs," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    9. Hanqi Zhao & Jian Wang & Yang Liu & Zhifan Chen & Jingqi Wang & Lin Chen, 2024. "Quality and Testing of Red Pepper Soft Picking Manipulator Based on RD-DEM Coupling," Agriculture, MDPI, vol. 14(8), pages 1-18, August.
    10. Haoqing Yang & Tengxiao Liu & Lihua Jin & Yu Huang & Xiangfeng Duan & Hongtao Sun, 2024. "Tailoring smart hydrogels through manipulation of heterogeneous subdomains," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    11. Hayato Saigo & Makoto Naruse & Kazuya Okamura & Hirokazu Hori & Izumi Ojima, 2019. "Analysis of Soft Robotics Based on the Concept of Category of Mobility," Complexity, Hindawi, vol. 2019, pages 1-12, March.
    12. Jean Chenevier & David González & J Vicente Aguado & Francisco Chinesta & Elías Cueto, 2018. "Reduced-order modeling of soft robots," PLOS ONE, Public Library of Science, vol. 13(2), pages 1-15, February.
    13. Van Hiep Nguyen & Saewoong Oh & Manmatha Mahato & Rassoul Tabassian & Hyunjoon Yoo & Seong-Gyu Lee & Mousumi Garai & Kwang Jin Kim & Il-Kwon Oh, 2024. "Functionally antagonistic polyelectrolyte for electro-ionic soft actuator," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    14. Gyeongji Kang & Young-Joo Kim & Sung-Jin Lee & Se Kwon Kim & Dae-Young Lee & Kahye Song, 2023. "Grasping through dynamic weaving with entangled closed loops," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    15. Toru Ube & Shota Sasaki & Kenji Katayama & Hikaru Sotome & Hiroshi Miyasaka & Ryota Mizutani & Kenji Kamada & Tomiki Ikeda, 2024. "Spatially selective actuation of liquid-crystalline polymer films through two-photon absorption processes," Nature Communications, Nature, vol. 15(1), pages 1-7, December.
    16. Shibo Zou & Sergio Picella & Jelle Vries & Vera G. Kortman & Aimée Sakes & Johannes T. B. Overvelde, 2024. "A retrofit sensing strategy for soft fluidic robots," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    17. Ningning Bai & Yiheng Xue & Shuiqing Chen & Lin Shi & Junli Shi & Yuan Zhang & Xingyu Hou & Yu Cheng & Kaixi Huang & Weidong Wang & Jin Zhang & Yuan Liu & Chuan Fei Guo, 2023. "A robotic sensory system with high spatiotemporal resolution for texture recognition," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    18. Chin Leong Lim, 2020. "Fundamental Concepts of Human Thermoregulation and Adaptation to Heat: A Review in the Context of Global Warming," IJERPH, MDPI, vol. 17(21), pages 1-34, October.
    19. Guorui Li & Tuck-Whye Wong & Benjamin Shih & Chunyu Guo & Luwen Wang & Jiaqi Liu & Tao Wang & Xiaobo Liu & Jiayao Yan & Baosheng Wu & Fajun Yu & Yunsai Chen & Yiming Liang & Yaoting Xue & Chengjun Wan, 2023. "Bioinspired soft robots for deep-sea exploration," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    20. Rasool Nasseri & Negin Bouzari & Junting Huang & Hossein Golzar & Sarah Jankhani & Xiaowu (Shirley) Tang & Tizazu H. Mekonnen & Amirreza Aghakhani & Hamed Shahsavan, 2023. "Programmable nanocomposites of cellulose nanocrystals and zwitterionic hydrogels for soft robotics," Nature Communications, Nature, vol. 14(1), pages 1-15, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-54327-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.