IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-52331-4.html
   My bibliography  Save this article

Behavioral biometric optical tactile sensor for instantaneous decoupling of dynamic touch signals in real time

Author

Listed:
  • Changil Son

    (Ulsan National Institute of Science and Technology (UNIST))

  • Jinyoung Kim

    (Ulsan National Institute of Science and Technology (UNIST))

  • Dongwon Kang

    (Sogang University)

  • Seojoung Park

    (Ulsan National Institute of Science and Technology (UNIST))

  • Chaeyeong Ryu

    (Ulsan National Institute of Science and Technology (UNIST))

  • Dahye Baek

    (Ulsan National Institute of Science and Technology (UNIST))

  • Geonyoung Jeong

    (Ulsan National Institute of Science and Technology (UNIST))

  • Sanggyun Jeong

    (Ulsan National Institute of Science and Technology (UNIST))

  • Seonghyeon Ahn

    (Ulsan National Institute of Science and Technology (UNIST))

  • Chanoong Lim

    (Ulsan National Institute of Science and Technology (UNIST))

  • Yundon Jeong

    (Ulsan National Institute of Science and Technology (UNIST))

  • Jeongin Eom

    (Sogang University)

  • Jung-Hoon Park

    (Ulsan National Institute of Science and Technology (UNIST))

  • Dong Woog Lee

    (Ulsan National Institute of Science and Technology (UNIST))

  • Donghyuk Kim

    (Ulsan National Institute of Science and Technology (UNIST))

  • Jungwook Kim

    (Gwanak-gu)

  • Hyunhyub Ko

    (Ulsan National Institute of Science and Technology (UNIST))

  • Jiseok Lee

    (Ulsan National Institute of Science and Technology (UNIST))

Abstract

Decoupling dynamic touch signals in the optical tactile sensors is highly desired for behavioral tactile applications yet challenging because typical optical sensors mostly measure only static normal force and use imprecise multi-image averaging for dynamic force sensing. Here, we report a highly sensitive upconversion nanocrystals-based behavioral biometric optical tactile sensor that instantaneously and quantitatively decomposes dynamic touch signals into individual components of vertical normal and lateral shear force from a single image in real-time. By mimicking the sensory architecture of human skin, the unique luminescence signal obtained is axisymmetric for static normal forces and non-axisymmetric for dynamic shear forces. Our sensor demonstrates high spatio-temporal screening of small objects and recognizes fingerprints for authentication with high spatial-temporal resolution. Using a dynamic force discrimination machine learning framework, we realized a Braille-to-Speech translation system and a next-generation dynamic biometric recognition system for handwriting.

Suggested Citation

  • Changil Son & Jinyoung Kim & Dongwon Kang & Seojoung Park & Chaeyeong Ryu & Dahye Baek & Geonyoung Jeong & Sanggyun Jeong & Seonghyeon Ahn & Chanoong Lim & Yundon Jeong & Jeongin Eom & Jung-Hoon Park , 2024. "Behavioral biometric optical tactile sensor for instantaneous decoupling of dynamic touch signals in real time," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-52331-4
    DOI: 10.1038/s41467-024-52331-4
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-52331-4
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-024-52331-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ho-Hsiu Chou & Amanda Nguyen & Alex Chortos & John W.F. To & Chien Lu & Jianguo Mei & Tadanori Kurosawa & Won-Gyu Bae & Jeffrey B.-H. Tok & Zhenan Bao, 2015. "A chameleon-inspired stretchable electronic skin with interactive colour changing controlled by tactile sensing," Nature Communications, Nature, vol. 6(1), pages 1-10, November.
    2. Feng Wang & Yu Han & Chin Seong Lim & Yunhao Lu & Juan Wang & Jun Xu & Hongyu Chen & Chun Zhang & Minghui Hong & Xiaogang Liu, 2010. "Simultaneous phase and size control of upconversion nanocrystals through lanthanide doping," Nature, Nature, vol. 463(7284), pages 1061-1065, February.
    3. Weijun Zhao & Zikai He & Qian Peng & Jacky W. Y. Lam & Huili Ma & Zijie Qiu & Yuncong Chen & Zheng Zhao & Zhigang Shuai & Yongqiang Dong & Ben Zhong Tang, 2018. "Highly sensitive switching of solid-state luminescence by controlling intersystem crossing," Nature Communications, Nature, vol. 9(1), pages 1-8, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xiao-Jing Liu & Yu-Hang Zhang & Rong-Yao Gao & Hua-Bing Jia & Qian-Qian Shao & Ya-Wen Hu & Li-Min Fu & Jian-Ping Zhang, 2024. "The Effects of Food on the Uptake and Excretion of Nano-Plastics by Daphnia magna," Sustainability, MDPI, vol. 16(10), pages 1-14, May.
    2. Yuhang Liang & Feng Li & Xiangyuan Cui & Taoyuze Lv & Catherine Stampfl & Simon P. Ringer & Xudong Yang & Jun Huang & Rongkun Zheng, 2024. "Toward stabilization of formamidinium lead iodide perovskites by defect control and composition engineering," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    3. Dongdong Sun & Yong Wu & Xie Han & Simin Liu, 2023. "The host–guest inclusion driven by host-stabilized charge transfer for construction of sequentially red-shifted mechanochromic system," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    4. Diogo A. Gálico & Emille M. Rodrigues & Ilias Halimi & Juho Toivola & He Zhao & Jiahui Xu & Jani O. Moilanen & Xiaogang Liu & Eva Hemmer & Muralee Murugesu, 2024. "Confining single Er3+ ions in sub-3 nm NaYF4 nanoparticles to induce slow relaxation of the magnetisation," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    5. Jinhui Zhang & Haimin Yao & Jiaying Mo & Songyue Chen & Yu Xie & Shenglin Ma & Rui Chen & Tao Luo & Weisong Ling & Lifeng Qin & Zuankai Wang & Wei Zhou, 2022. "Finger-inspired rigid-soft hybrid tactile sensor with superior sensitivity at high frequency," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    6. Dongjin Kim & Baekgyeom Kim & Bongsu Shin & Dongwook Shin & Chang-Kun Lee & Jae-Seung Chung & Juwon Seo & Yun-Tae Kim & Geeyoung Sung & Wontaek Seo & Sunil Kim & Sunghoon Hong & Sungwoo Hwang & Seungy, 2022. "Actuating compact wearable augmented reality devices by multifunctional artificial muscle," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    7. Kyowon Kang & Seongryeol Ye & Chanho Jeong & Jinmo Jeong & Yeong-sinn Ye & Jin-Young Jeong & Yu-Jin Kim & Selin Lim & Tae Hee Kim & Kyung Yeun Kim & Jong Uk Kim & Gwan In Kim & Do Hoon Chun & Kiho Kim, 2024. "Bionic artificial skin with a fully implantable wireless tactile sensory system for wound healing and restoring skin tactile function," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    8. Guowei Li & Shihui Jiang & Aijun Liu & Lixiang Ye & Jianxi Ke & Caiping Liu & Lian Chen & Yongsheng Liu & Maochun Hong, 2023. "Proof of crystal-field-perturbation-enhanced luminescence of lanthanide-doped nanocrystals through interstitial H+ doping," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    9. Ansari, Anees A. & Sillanpää, Mika, 2021. "Advancement in upconversion nanoparticles based NIR-driven photocatalysts," Renewable and Sustainable Energy Reviews, Elsevier, vol. 151(C).
    10. Dinghui Chen & Zizheng Tong & Qiushi Rao & Xingchen Liu & Hong Meng & Wei Huang, 2024. "High-Performance Black Copolymers Enabling Full Spectrum Control in Electrochromic Devices," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    11. Lei Lei & Yubin Wang & Weixin Xu & Renguang Ye & Youjie Hua & Degang Deng & Liang Chen & Paras N. Prasad & Shiqing Xu, 2022. "Manipulation of time-dependent multicolour evolution of X-ray excited afterglow in lanthanide-doped fluoride nanoparticles," Nature Communications, Nature, vol. 13(1), pages 1-11, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-52331-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.