IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v13y2022i1d10.1038_s41467-022-29197-5.html
   My bibliography  Save this article

Noncontact human-machine interaction based on hand-responsive infrared structural color

Author

Listed:
  • Shun An

    (Shanghai Jiao Tong University)

  • Hanrui Zhu

    (Shanghai Jiao Tong University)

  • Chunzhi Guo

    (Shanghai Jiao Tong University)

  • Benwei Fu

    (Shanghai Jiao Tong University)

  • Chengyi Song

    (Shanghai Jiao Tong University)

  • Peng Tao

    (Shanghai Jiao Tong University)

  • Wen Shang

    (Shanghai Jiao Tong University)

  • Tao Deng

    (Shanghai Jiao Tong University)

Abstract

Noncontact human-machine interaction provides a hygienic and intelligent approach for the communication between human and robots. Current noncontact human-machine interactions are generally limited by the interaction distance or conditions, such as in the dark. Here we explore the utilization of hand as an infrared light source for noncontact human-machine interaction. Metallic gratings are used as the human-machine interface to respond to infrared radiation from hand and the generated signals are visualized as different infrared structural colors. We demonstrate the applications of the infrared structural color-based human-machine interaction for user-interactive touchless display and real-time control of a robot vehicle. The interaction is flexible to the hand-interface distance ranging from a few centimeters to tens of centimeters and can be used in low lighting condition or in the dark. The findings in this work provide an alternative and complementary approach to traditional noncontact human-machine interactions, which may further broaden the potential applications of human-machine interaction.

Suggested Citation

  • Shun An & Hanrui Zhu & Chunzhi Guo & Benwei Fu & Chengyi Song & Peng Tao & Wen Shang & Tao Deng, 2022. "Noncontact human-machine interaction based on hand-responsive infrared structural color," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
  • Handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-29197-5
    DOI: 10.1038/s41467-022-29197-5
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-022-29197-5
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-022-29197-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Xinge Yu & Zhaoqian Xie & Yang Yu & Jungyup Lee & Abraham Vazquez-Guardado & Haiwen Luan & Jasper Ruban & Xin Ning & Aadeel Akhtar & Dengfeng Li & Bowen Ji & Yiming Liu & Rujie Sun & Jingyue Cao & Qin, 2019. "Skin-integrated wireless haptic interfaces for virtual and augmented reality," Nature, Nature, vol. 575(7783), pages 473-479, November.
    2. Oluwaseun A. Araromi & Moritz A. Graule & Kristen L. Dorsey & Sam Castellanos & Jonathan R. Foster & Wen-Hao Hsu & Arthur E. Passy & Joost J. Vlassak & James C. Weaver & Conor J. Walsh & Robert J. Woo, 2020. "Ultra-sensitive and resilient compliant strain gauges for soft machines," Nature, Nature, vol. 587(7833), pages 219-224, November.
    3. Jin Ge & Xu Wang & Michael Drack & Oleksii Volkov & Mo Liang & Gilbert Santiago Cañón Bermúdez & Rico Illing & Changan Wang & Shengqiang Zhou & Jürgen Fassbender & Martin Kaltenbrunner & Denys Makarov, 2019. "A bimodal soft electronic skin for tactile and touchless interaction in real time," Nature Communications, Nature, vol. 10(1), pages 1-10, December.
    4. Pingqiang Cai & Changjin Wan & Liang Pan & Naoji Matsuhisa & Ke He & Zequn Cui & Wei Zhang & Chengcheng Li & Jianwu Wang & Jing Yu & Ming Wang & Ying Jiang & Geng Chen & Xiaodong Chen, 2020. "Locally coupled electromechanical interfaces based on cytoadhesion-inspired hybrids to identify muscular excitation-contraction signatures," Nature Communications, Nature, vol. 11(1), pages 1-12, December.
    5. Wei Gao & Sam Emaminejad & Hnin Yin Yin Nyein & Samyuktha Challa & Kevin Chen & Austin Peck & Hossain M. Fahad & Hiroki Ota & Hiroshi Shiraki & Daisuke Kiriya & Der-Hsien Lien & George A. Brooks & Ron, 2016. "Fully integrated wearable sensor arrays for multiplexed in situ perspiration analysis," Nature, Nature, vol. 529(7587), pages 509-514, January.
    6. Minglu Zhu & Zhongda Sun & Tao Chen & Chengkuo Lee, 2021. "Low cost exoskeleton manipulator using bidirectional triboelectric sensors enhanced multiple degree of freedom sensory system," Nature Communications, Nature, vol. 12(1), pages 1-16, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jinrong Wang & Weibin Lin & Zhuo Chen & Valeriia O. Nikolaeva & Lukman O. Alimi & Niveen M. Khashab, 2024. "Smart touchless human–machine interaction based on crystalline porous cages," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    2. Yingyue Zhang & Hanrui Zhu & Shun An & Wenkui Xing & Benwei Fu & Peng Tao & Wen Shang & Jianbo Wu & Michael D. Dickey & Chengyi Song & Tao Deng, 2024. "Chameleon-inspired tunable multi-layered infrared-modulating system via stretchable liquid metal microdroplets in elastomer film," Nature Communications, Nature, vol. 15(1), pages 1-13, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shuo Li & Yong Zhang & Xiaoping Liang & Haomin Wang & Haojie Lu & Mengjia Zhu & Huimin Wang & Mingchao Zhang & Xinping Qiu & Yafeng Song & Yingying Zhang, 2022. "Humidity-sensitive chemoelectric flexible sensors based on metal-air redox reaction for health management," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    2. Zhongda Sun & Minglu Zhu & Xuechuan Shan & Chengkuo Lee, 2022. "Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    3. Dongjin Kim & Baekgyeom Kim & Bongsu Shin & Dongwook Shin & Chang-Kun Lee & Jae-Seung Chung & Juwon Seo & Yun-Tae Kim & Geeyoung Sung & Wontaek Seo & Sunil Kim & Sunghoon Hong & Sungwoo Hwang & Seungy, 2022. "Actuating compact wearable augmented reality devices by multifunctional artificial muscle," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    4. Hengtian Zhu & Huan Yang & Siqi Xu & Yuanyuan Ma & Shugeng Zhu & Zhengyi Mao & Weiwei Chen & Zizhong Hu & Rongrong Pan & Yurui Xu & Yifeng Xiong & Ye Chen & Yanqing Lu & Xinghai Ning & Dechen Jiang & , 2024. "Frequency-encoded eye tracking smart contact lens for human–machine interaction," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    5. Matthew S. Brown & Louis Somma & Melissa Mendoza & Yeonsik Noh & Gretchen J. Mahler & Ahyeon Koh, 2022. "Upcycling Compact Discs for Flexible and Stretchable Bioelectronic Applications," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    6. Shuxing Mei & Haokun Yi & Jun Zhao & Yanting Xu & Lan Shi & Yajie Qin & Yizhou Jiang & Jiajie Guo & Zhuo Li & Limin Wu, 2024. "High-density, highly sensitive sensor array of spiky carbon nanospheres for strain field mapping," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    7. Shaomei Lin & Weifeng Yang & Xubin Zhu & Yubin Lan & Kerui Li & Qinghong Zhang & Yaogang Li & Chengyi Hou & Hongzhi Wang, 2024. "Triboelectric micro-flexure-sensitive fiber electronics," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    8. Xiaoxiang Gao & Xiangjun Chen & Hongjie Hu & Xinyu Wang & Wentong Yue & Jing Mu & Zhiyuan Lou & Ruiqi Zhang & Keren Shi & Xue Chen & Muyang Lin & Baiyan Qi & Sai Zhou & Chengchangfeng Lu & Yue Gu & Xi, 2022. "A photoacoustic patch for three-dimensional imaging of hemoglobin and core temperature," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    9. Haisheng Xia & Yuchong Zhang & Nona Rajabi & Farzaneh Taleb & Qunting Yang & Danica Kragic & Zhijun Li, 2024. "Shaping high-performance wearable robots for human motor and sensory reconstruction and enhancement," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    10. Bekir Aksoy & Yufei Hao & Giulio Grasso & Krishna Manaswi Digumarti & Vito Cacucciolo & Herbert Shea, 2022. "Shielded soft force sensors," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    11. Jinhong Park & Duhwan Seong & Yong Jun Park & Sang Hyeok Park & Hyunjin Jung & Yewon Kim & Hyoung Won Baac & Mikyung Shin & Seunghyun Lee & Minbaek Lee & Donghee Son, 2022. "Reversible electrical percolation in a stretchable and self-healable silver-gradient nanocomposite bilayer," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    12. Won Bae Han & Gwan-Jin Ko & Kang-Gon Lee & Donghak Kim & Joong Hoon Lee & Seung Min Yang & Dong-Je Kim & Jeong-Woong Shin & Tae-Min Jang & Sungkeun Han & Honglei Zhou & Heeseok Kang & Jun Hyeon Lim & , 2023. "Ultra-stretchable and biodegradable elastomers for soft, transient electronics," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    13. Sangha Kim & Seongjin Park & Jina Choi & Wonseop Hwang & Sunho Kim & In-Suk Choi & Hyunjung Yi & Rhokyun Kwak, 2022. "An epifluidic electronic patch with spiking sweat clearance for event-driven perspiration monitoring," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    14. Xia Zhu & Ke Wu & Xiaohang Xie & Stephan W. Anderson & Xin Zhang, 2024. "A robust near-field body area network based on coaxially-shielded textile metamaterial," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    15. Yijia Lu & Han Tian & Jia Cheng & Fei Zhu & Bin Liu & Shanshan Wei & Linhong Ji & Zhong Lin Wang, 2022. "Decoding lip language using triboelectric sensors with deep learning," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    16. Jian Li & Huiling Jia & Jingkun Zhou & Xingcan Huang & Long Xu & Shengxin Jia & Zhan Gao & Kuanming Yao & Dengfeng Li & Binbin Zhang & Yiming Liu & Ya Huang & Yue Hu & Guangyao Zhao & Zitong Xu & Jiyu, 2023. "Thin, soft, wearable system for continuous wireless monitoring of artery blood pressure," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    17. Pengwei Wang & Xiaohao Ma & Zhiqiang Lin & Fan Chen & Zijian Chen & Hong Hu & Hailong Xu & Xinyi Zhang & Yuqing Shi & Qiyao Huang & Yuanjing Lin & Zijian Zheng, 2024. "Well-defined in-textile photolithography towards permeable textile electronics," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    18. Xi Tian & Qihang Zeng & Selman A. Kurt & Renee R. Li & Dat T. Nguyen & Ze Xiong & Zhipeng Li & Xin Yang & Xiao Xiao & Changsheng Wu & Benjamin C. K. Tee & Denys Nikolayev & Christopher J. Charles & Jo, 2023. "Implant-to-implant wireless networking with metamaterial textiles," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    19. Itsuki Kageyama & Karin Kurata & Shuto Miyashita & Yeongjoo Lim & Shintaro Sengoku & Kota Kodama, 2022. "A Bibliometric Analysis of Wearable Device Research Trends 2001–2022—A Study on the Reversal of Number of Publications and Research Trends in China and the USA," IJERPH, MDPI, vol. 19(24), pages 1-19, December.
    20. Min Chen & Jingyu Ouyang & Aijia Jian & Jia Liu & Pan Li & Yixue Hao & Yuchen Gong & Jiayu Hu & Jing Zhou & Rui Wang & Jiaxi Wang & Long Hu & Yuwei Wang & Ju Ouyang & Jing Zhang & Chong Hou & Lei Wei , 2022. "Imperceptible, designable, and scalable braided electronic cord," Nature Communications, Nature, vol. 13(1), pages 1-10, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-29197-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.