IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-51674-2.html
   My bibliography  Save this article

A bioinspired tactile scanner for computer haptics

Author

Listed:
  • Huimin Li

    (Sun Yat-sen University)

  • Jianle Lin

    (Sun Yat-sen University)

  • Shuxin Lin

    (Sun Yat-sen University)

  • Haojie Zhong

    (Sun Yat-sen University)

  • Bowei Jiang

    (Sun Yat-sen University)

  • Xinghui Liu

    (Shenzhen Chipwey Innovation Technologies Co. Ltd.)

  • Weisheng Wu

    (Sun Yat-sen University)

  • Weiwei Li

    (Chinese Academy of Sciences)

  • Emad Iranmanesh

    (Sun Yat-sen University)

  • Zhongyi Zhou

    (Shenzhen Chipwey Innovation Technologies Co. Ltd.)

  • Wenjun Li

    (Sun Yat-sen University)

  • Kai Wang

    (Sun Yat-sen University)

Abstract

Computer haptics (CH) is about integration of tactile sensation and rendering in Metaverse. However, unlike computer vision (CV) where both hardware infrastructure and software programs are well developed, a generic tactile data capturing device that serves the same role as what a camera does for CV, is missing. Bioinspired by electrophysiological processes in human tactile somatosensory nervous system, here we propose a tactile scanner along with a neuromorphically-engineered system, in which a closed-loop tactile acquisition and rendering (re-creation) are preliminarily achieved. Based on the architecture of afferent nerves and intelligent functions of mechano-gating and leaky integrate-and-fire models, such a tactile scanner is designed and developed by using piezoelectric transducers as axon neurons and thin film transistor (TFT)-based neuromorphic circuits to mimic synaptic behaviours and neural functions. As an example, the neuron-like tactile information of surface textures is captured and further used to render the texture friction of a virtual surface for “recreating” a “true” feeling of touch.

Suggested Citation

  • Huimin Li & Jianle Lin & Shuxin Lin & Haojie Zhong & Bowei Jiang & Xinghui Liu & Weisheng Wu & Weiwei Li & Emad Iranmanesh & Zhongyi Zhou & Wenjun Li & Kai Wang, 2024. "A bioinspired tactile scanner for computer haptics," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-51674-2
    DOI: 10.1038/s41467-024-51674-2
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-51674-2
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-51674-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Xinge Yu & Zhaoqian Xie & Yang Yu & Jungyup Lee & Abraham Vazquez-Guardado & Haiwen Luan & Jasper Ruban & Xin Ning & Aadeel Akhtar & Dengfeng Li & Bowen Ji & Yiming Liu & Rujie Sun & Jingyue Cao & Qin, 2019. "Skin-integrated wireless haptic interfaces for virtual and augmented reality," Nature, Nature, vol. 575(7783), pages 473-479, November.
    2. Seung-Hyun Woo & Sanjeev Ranade & Andy D. Weyer & Adrienne E. Dubin & Yoshichika Baba & Zhaozhu Qiu & Matt Petrus & Takashi Miyamoto & Kritika Reddy & Ellen A. Lumpkin & Cheryl L. Stucky & Ardem Patap, 2014. "Piezo2 is required for Merkel-cell mechanotransduction," Nature, Nature, vol. 509(7502), pages 622-626, May.
    3. Hongwei Tan & Quanzheng Tao & Ishan Pande & Sayani Majumdar & Fu Liu & Yifan Zhou & Per O. Å. Persson & Johanna Rosen & Sebastiaan van Dijken, 2020. "Tactile sensory coding and learning with bio-inspired optoelectronic spiking afferent nerves," Nature Communications, Nature, vol. 11(1), pages 1-9, December.
    4. Yifat Prut & Eberhard E. Fetz, 1999. "Primate spinal interneurons show pre-movement instructed delay activity," Nature, Nature, vol. 401(6753), pages 590-594, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hengtian Zhu & Huan Yang & Siqi Xu & Yuanyuan Ma & Shugeng Zhu & Zhengyi Mao & Weiwei Chen & Zizhong Hu & Rongrong Pan & Yurui Xu & Yifeng Xiong & Ye Chen & Yanqing Lu & Xinghai Ning & Dechen Jiang & , 2024. "Frequency-encoded eye tracking smart contact lens for human–machine interaction," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    2. Shuo Li & Yong Zhang & Xiaoping Liang & Haomin Wang & Haojie Lu & Mengjia Zhu & Huimin Wang & Mingchao Zhang & Xinping Qiu & Yafeng Song & Yingying Zhang, 2022. "Humidity-sensitive chemoelectric flexible sensors based on metal-air redox reaction for health management," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    3. Julia Ojeda-Alonso & Laura Calvo-Enrique & Ricardo Paricio-Montesinos & Rakesh Kumar & Ming-Dong Zhang & James F. A. Poulet & Patrik Ernfors & Gary R. Lewin, 2024. "Sensory Schwann cells set perceptual thresholds for touch and selectively regulate mechanical nociception," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    4. Hongwei Tan & Sebastiaan van Dijken, 2023. "Dynamic machine vision with retinomorphic photomemristor-reservoir computing," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    5. Haisheng Xia & Yuchong Zhang & Nona Rajabi & Farzaneh Taleb & Qunting Yang & Danica Kragic & Zhijun Li, 2024. "Shaping high-performance wearable robots for human motor and sensory reconstruction and enhancement," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    6. Jinhong Park & Duhwan Seong & Yong Jun Park & Sang Hyeok Park & Hyunjin Jung & Yewon Kim & Hyoung Won Baac & Mikyung Shin & Seunghyun Lee & Minbaek Lee & Donghee Son, 2022. "Reversible electrical percolation in a stretchable and self-healable silver-gradient nanocomposite bilayer," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    7. Won Bae Han & Gwan-Jin Ko & Kang-Gon Lee & Donghak Kim & Joong Hoon Lee & Seung Min Yang & Dong-Je Kim & Jeong-Woong Shin & Tae-Min Jang & Sungkeun Han & Honglei Zhou & Heeseok Kang & Jun Hyeon Lim & , 2023. "Ultra-stretchable and biodegradable elastomers for soft, transient electronics," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    8. Giovanni Maria Matrone & Eveline R. W. Doremaele & Abhijith Surendran & Zachary Laswick & Sophie Griggs & Gang Ye & Iain McCulloch & Francesca Santoro & Jonathan Rivnay & Yoeri Burgt, 2024. "A modular organic neuromorphic spiking circuit for retina-inspired sensory coding and neurotransmitter-mediated neural pathways," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    9. Zhiyuan Li & Zhongshao Li & Wei Tang & Jiaping Yao & Zhipeng Dou & Junjie Gong & Yongfei Li & Beining Zhang & Yunxiao Dong & Jian Xia & Lin Sun & Peng Jiang & Xun Cao & Rui Yang & Xiangshui Miao & Ron, 2024. "Crossmodal sensory neurons based on high-performance flexible memristors for human-machine in-sensor computing system," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    10. Jian Li & Huiling Jia & Jingkun Zhou & Xingcan Huang & Long Xu & Shengxin Jia & Zhan Gao & Kuanming Yao & Dengfeng Li & Binbin Zhang & Yiming Liu & Ya Huang & Yue Hu & Guangyao Zhao & Zitong Xu & Jiyu, 2023. "Thin, soft, wearable system for continuous wireless monitoring of artery blood pressure," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    11. Pengwei Wang & Xiaohao Ma & Zhiqiang Lin & Fan Chen & Zijian Chen & Hong Hu & Hailong Xu & Xinyi Zhang & Yuqing Shi & Qiyao Huang & Yuanjing Lin & Zijian Zheng, 2024. "Well-defined in-textile photolithography towards permeable textile electronics," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    12. Martina Nicoletti & Letizia Chiodo & Alessandro Loppini, 2021. "Biophysics and Modeling of Mechanotransduction in Neurons: A Review," Mathematics, MDPI, vol. 9(4), pages 1-32, February.
    13. Zhongfang Zhang & Xiaolong Zhao & Xumeng Zhang & Xiaohu Hou & Xiaolan Ma & Shuangzhu Tang & Ying Zhang & Guangwei Xu & Qi Liu & Shibing Long, 2022. "In-sensor reservoir computing system for latent fingerprint recognition with deep ultraviolet photo-synapses and memristor array," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    14. Ke Yang & Yanghao Wang & Pek Jun Tiw & Chaoming Wang & Xiaolong Zou & Rui Yuan & Chang Liu & Ge Li & Chen Ge & Si Wu & Teng Zhang & Ru Huang & Yuchao Yang, 2024. "High-order sensory processing nanocircuit based on coupled VO2 oscillators," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    15. Min Chen & Jingyu Ouyang & Aijia Jian & Jia Liu & Pan Li & Yixue Hao & Yuchen Gong & Jiayu Hu & Jing Zhou & Rui Wang & Jiaxi Wang & Long Hu & Yuwei Wang & Ju Ouyang & Jing Zhang & Chong Hou & Lei Wei , 2022. "Imperceptible, designable, and scalable braided electronic cord," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    16. Saeka Tomatsu & GeeHee Kim & Shinji Kubota & Kazuhiko Seki, 2023. "Presynaptic gating of monkey proprioceptive signals for proper motor action," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    17. Zhongda Sun & Minglu Zhu & Xuechuan Shan & Chengkuo Lee, 2022. "Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    18. Jonathan Madar & Namrata Tiwari & Cristina Smith & Divya Sharma & Shanwei Shen & Alsiddig Elmahdi & Liya Y. Qiao, 2023. "Piezo2 regulates colonic mechanical sensitivity in a sex specific manner in mice," Nature Communications, Nature, vol. 14(1), pages 1-18, December.
    19. Kewang Nan & Kiwan Wong & Dengfeng Li & Binbin Ying & James C. McRae & Vivian R. Feig & Shubing Wang & Ningjie Du & Yuelong Liang & Qijiang Mao & Enjie Zhou & Yonglin Chen & Lei Sang & Kuanming Yao & , 2024. "An ingestible, battery-free, tissue-adhering robotic interface for non-invasive and chronic electrostimulation of the gut," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    20. Luis O. Romero & Rebeca Caires & A. Kaitlyn Victor & Juanma Ramirez & Francisco J. Sierra-Valdez & Patrick Walsh & Vincent Truong & Jungsoo Lee & Ugo Mayor & Lawrence T. Reiter & Valeria Vásquez & Jul, 2023. "Linoleic acid improves PIEZO2 dysfunction in a mouse model of Angelman Syndrome," Nature Communications, Nature, vol. 14(1), pages 1-20, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-51674-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.