IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-51674-2.html
   My bibliography  Save this article

A bioinspired tactile scanner for computer haptics

Author

Listed:
  • Huimin Li

    (Sun Yat-sen University)

  • Jianle Lin

    (Sun Yat-sen University)

  • Shuxin Lin

    (Sun Yat-sen University)

  • Haojie Zhong

    (Sun Yat-sen University)

  • Bowei Jiang

    (Sun Yat-sen University)

  • Xinghui Liu

    (Shenzhen Chipwey Innovation Technologies Co. Ltd.)

  • Weisheng Wu

    (Sun Yat-sen University)

  • Weiwei Li

    (Chinese Academy of Sciences)

  • Emad Iranmanesh

    (Sun Yat-sen University)

  • Zhongyi Zhou

    (Shenzhen Chipwey Innovation Technologies Co. Ltd.)

  • Wenjun Li

    (Sun Yat-sen University)

  • Kai Wang

    (Sun Yat-sen University)

Abstract

Computer haptics (CH) is about integration of tactile sensation and rendering in Metaverse. However, unlike computer vision (CV) where both hardware infrastructure and software programs are well developed, a generic tactile data capturing device that serves the same role as what a camera does for CV, is missing. Bioinspired by electrophysiological processes in human tactile somatosensory nervous system, here we propose a tactile scanner along with a neuromorphically-engineered system, in which a closed-loop tactile acquisition and rendering (re-creation) are preliminarily achieved. Based on the architecture of afferent nerves and intelligent functions of mechano-gating and leaky integrate-and-fire models, such a tactile scanner is designed and developed by using piezoelectric transducers as axon neurons and thin film transistor (TFT)-based neuromorphic circuits to mimic synaptic behaviours and neural functions. As an example, the neuron-like tactile information of surface textures is captured and further used to render the texture friction of a virtual surface for “recreating” a “true” feeling of touch.

Suggested Citation

  • Huimin Li & Jianle Lin & Shuxin Lin & Haojie Zhong & Bowei Jiang & Xinghui Liu & Weisheng Wu & Weiwei Li & Emad Iranmanesh & Zhongyi Zhou & Wenjun Li & Kai Wang, 2024. "A bioinspired tactile scanner for computer haptics," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-51674-2
    DOI: 10.1038/s41467-024-51674-2
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-51674-2
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-51674-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Xinge Yu & Zhaoqian Xie & Yang Yu & Jungyup Lee & Abraham Vazquez-Guardado & Haiwen Luan & Jasper Ruban & Xin Ning & Aadeel Akhtar & Dengfeng Li & Bowen Ji & Yiming Liu & Rujie Sun & Jingyue Cao & Qin, 2019. "Skin-integrated wireless haptic interfaces for virtual and augmented reality," Nature, Nature, vol. 575(7783), pages 473-479, November.
    2. Yifat Prut & Eberhard E. Fetz, 1999. "Primate spinal interneurons show pre-movement instructed delay activity," Nature, Nature, vol. 401(6753), pages 590-594, October.
    3. Seung-Hyun Woo & Sanjeev Ranade & Andy D. Weyer & Adrienne E. Dubin & Yoshichika Baba & Zhaozhu Qiu & Matt Petrus & Takashi Miyamoto & Kritika Reddy & Ellen A. Lumpkin & Cheryl L. Stucky & Ardem Patap, 2014. "Piezo2 is required for Merkel-cell mechanotransduction," Nature, Nature, vol. 509(7502), pages 622-626, May.
    4. Hongwei Tan & Quanzheng Tao & Ishan Pande & Sayani Majumdar & Fu Liu & Yifan Zhou & Per O. Å. Persson & Johanna Rosen & Sebastiaan van Dijken, 2020. "Tactile sensory coding and learning with bio-inspired optoelectronic spiking afferent nerves," Nature Communications, Nature, vol. 11(1), pages 1-9, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pavlo Makushko & Jin Ge & Gilbert Santiago Cañón Bermúdez & Oleksii Volkov & Yevhen Zabila & Stanislav Avdoshenko & Rico Illing & Leonid Ionov & Martin Kaltenbrunner & Jürgen Fassbender & Rui Xu & Den, 2025. "Scalable magnetoreceptive e-skin for energy-efficient high-resolution interaction towards undisturbed extended reality," Nature Communications, Nature, vol. 16(1), pages 1-11, December.
    2. Haisheng Xia & Yuchong Zhang & Nona Rajabi & Farzaneh Taleb & Qunting Yang & Danica Kragic & Zhijun Li, 2024. "Shaping high-performance wearable robots for human motor and sensory reconstruction and enhancement," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    3. Won Bae Han & Gwan-Jin Ko & Kang-Gon Lee & Donghak Kim & Joong Hoon Lee & Seung Min Yang & Dong-Je Kim & Jeong-Woong Shin & Tae-Min Jang & Sungkeun Han & Honglei Zhou & Heeseok Kang & Jun Hyeon Lim & , 2023. "Ultra-stretchable and biodegradable elastomers for soft, transient electronics," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    4. Giovanni Maria Matrone & Eveline R. W. Doremaele & Abhijith Surendran & Zachary Laswick & Sophie Griggs & Gang Ye & Iain McCulloch & Francesca Santoro & Jonathan Rivnay & Yoeri Burgt, 2024. "A modular organic neuromorphic spiking circuit for retina-inspired sensory coding and neurotransmitter-mediated neural pathways," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    5. Zhiyuan Li & Zhongshao Li & Wei Tang & Jiaping Yao & Zhipeng Dou & Junjie Gong & Yongfei Li & Beining Zhang & Yunxiao Dong & Jian Xia & Lin Sun & Peng Jiang & Xun Cao & Rui Yang & Xiangshui Miao & Ron, 2024. "Crossmodal sensory neurons based on high-performance flexible memristors for human-machine in-sensor computing system," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    6. Pengwei Wang & Xiaohao Ma & Zhiqiang Lin & Fan Chen & Zijian Chen & Hong Hu & Hailong Xu & Xinyi Zhang & Yuqing Shi & Qiyao Huang & Yuanjing Lin & Zijian Zheng, 2024. "Well-defined in-textile photolithography towards permeable textile electronics," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    7. Zhongfang Zhang & Xiaolong Zhao & Xumeng Zhang & Xiaohu Hou & Xiaolan Ma & Shuangzhu Tang & Ying Zhang & Guangwei Xu & Qi Liu & Shibing Long, 2022. "In-sensor reservoir computing system for latent fingerprint recognition with deep ultraviolet photo-synapses and memristor array," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    8. Chen, Mo & Zhang, Yuchen & Zhang, Yunzhen & Xu, Quan & Wu, Huagan, 2024. "Transition and bifurcation mechanism of firing activities in memristor synapse-coupled Hindmarsh–Rose bi-neuron model," Chaos, Solitons & Fractals, Elsevier, vol. 188(C).
    9. Saeka Tomatsu & GeeHee Kim & Shinji Kubota & Kazuhiko Seki, 2023. "Presynaptic gating of monkey proprioceptive signals for proper motor action," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    10. Jonathan Madar & Namrata Tiwari & Cristina Smith & Divya Sharma & Shanwei Shen & Alsiddig Elmahdi & Liya Y. Qiao, 2023. "Piezo2 regulates colonic mechanical sensitivity in a sex specific manner in mice," Nature Communications, Nature, vol. 14(1), pages 1-18, December.
    11. Luis O. Romero & Rebeca Caires & A. Kaitlyn Victor & Juanma Ramirez & Francisco J. Sierra-Valdez & Patrick Walsh & Vincent Truong & Jungsoo Lee & Ugo Mayor & Lawrence T. Reiter & Valeria Vásquez & Jul, 2023. "Linoleic acid improves PIEZO2 dysfunction in a mouse model of Angelman Syndrome," Nature Communications, Nature, vol. 14(1), pages 1-20, December.
    12. Guorui Li & Tuck-Whye Wong & Benjamin Shih & Chunyu Guo & Luwen Wang & Jiaqi Liu & Tao Wang & Xiaobo Liu & Jiayao Yan & Baosheng Wu & Fajun Yu & Yunsai Chen & Yiming Liang & Yaoting Xue & Chengjun Wan, 2023. "Bioinspired soft robots for deep-sea exploration," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    13. Chuanqian Shi & Jing Jiang & Chenglong Li & Chenhong Chen & Wei Jian & Jizhou Song, 2024. "Precision-induced localized molten liquid metal stamps for damage-free transfer printing of ultrathin membranes and 3D objects," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    14. Tanner C Dixon & Christina M Merrick & Joni D Wallis & Richard B Ivry & Jose M Carmena, 2021. "Hybrid dedicated and distributed coding in PMd/M1 provides separation and interaction of bilateral arm signals," PLOS Computational Biology, Public Library of Science, vol. 17(11), pages 1-35, November.
    15. Shun An & Hanrui Zhu & Chunzhi Guo & Benwei Fu & Chengyi Song & Peng Tao & Wen Shang & Tao Deng, 2022. "Noncontact human-machine interaction based on hand-responsive infrared structural color," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    16. Dongjin Kim & Baekgyeom Kim & Bongsu Shin & Dongwook Shin & Chang-Kun Lee & Jae-Seung Chung & Juwon Seo & Yun-Tae Kim & Geeyoung Sung & Wontaek Seo & Sunil Kim & Sunghoon Hong & Sungwoo Hwang & Seungy, 2022. "Actuating compact wearable augmented reality devices by multifunctional artificial muscle," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    17. Aobo Cheng & Xin Li & Ding Li & Zhikang Chen & Tianrui Cui & Lu-Qi Tao & Jinming Jian & HuiJun Xiao & Wancheng Shao & Zeyi Tang & Xinyue Li & Zirui Dong & Houfang Liu & Yi Yang & Tian-Ling Ren, 2025. "An intelligent hybrid-fabric wristband system enabled by thermal encapsulation for ergonomic human-machine interaction," Nature Communications, Nature, vol. 16(1), pages 1-9, December.
    18. Shuzhi Liu & Jianmin Zeng & Zhixin Wu & Han Hu & Ao Xu & Xiaohe Huang & Weilin Chen & Qilai Chen & Zhe Yu & Yinyu Zhao & Rong Wang & Tingting Han & Chao Li & Pingqi Gao & Hyunwoo Kim & Seung Jae Baik , 2023. "An ultrasmall organic synapse for neuromorphic computing," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    19. Yiming Liu & Shengxin Jia & Chun Ki Yiu & Wooyoung Park & Zhenlin Chen & Jin Nan & Xingcan Huang & Hongting Chen & Wenyang Li & Yuyu Gao & Weike Song & Tomoyuki Yokota & Takao Someya & Zhao Zhao & Yuh, 2024. "Intelligent wearable olfactory interface for latency-free mixed reality and fast olfactory enhancement," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    20. Hengtian Zhu & Huan Yang & Siqi Xu & Yuanyuan Ma & Shugeng Zhu & Zhengyi Mao & Weiwei Chen & Zizhong Hu & Rongrong Pan & Yurui Xu & Yifeng Xiong & Ye Chen & Yanqing Lu & Xinghai Ning & Dechen Jiang & , 2024. "Frequency-encoded eye tracking smart contact lens for human–machine interaction," Nature Communications, Nature, vol. 15(1), pages 1-13, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-51674-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.