IDEAS home Printed from https://ideas.repec.org/a/nat/nature/v575y2019i7783d10.1038_s41586-019-1687-0.html
   My bibliography  Save this article

Skin-integrated wireless haptic interfaces for virtual and augmented reality

Author

Listed:
  • Xinge Yu

    (City University of Hong Kong)

  • Zhaoqian Xie

    (City University of Hong Kong
    Dalian University of Technology
    Northwestern University
    Northwestern University)

  • Yang Yu

    (University of Illinois at Urbana-Champaign
    University of Illinois at Urbana-Champaign
    Tsinghua University)

  • Jungyup Lee

    (NeuroLux Corporation)

  • Abraham Vazquez-Guardado

    (Northwestern University)

  • Haiwen Luan

    (Northwestern University)

  • Jasper Ruban

    (NeuroLux Corporation)

  • Xin Ning

    (Pennsylvania State University)

  • Aadeel Akhtar

    (PSYONIC, Inc.)

  • Dengfeng Li

    (City University of Hong Kong)

  • Bowen Ji

    (Northwestern University
    Northwestern University
    Northwestern University
    Shanghai Jiao Tong University)

  • Yiming Liu

    (City University of Hong Kong)

  • Rujie Sun

    (University of Bristol)

  • Jingyue Cao

    (Wearifi, Inc.)

  • Qingze Huo

    (Northwestern University
    Northwestern University
    Northwestern University)

  • Yishan Zhong

    (University of Illinois at Urbana-Champaign
    University of Illinois at Urbana-Champaign)

  • ChanMi Lee

    (University of Illinois at Urbana-Champaign
    University of Illinois at Urbana-Champaign)

  • SeungYeop Kim

    (University of Illinois at Urbana-Champaign
    University of Illinois at Urbana-Champaign)

  • Philipp Gutruf

    (University of Arizona)

  • Changxing Zhang

    (Tsinghua University)

  • Yeguang Xue

    (Northwestern University
    Northwestern University
    Northwestern University)

  • Qinglei Guo

    (Shandong University)

  • Aditya Chempakasseril

    (University of Illinois at Urbana-Champaign
    University of Illinois at Urbana-Champaign)

  • Peilin Tian

    (University of Illinois at Urbana-Champaign
    University of Illinois at Urbana-Champaign)

  • Wei Lu

    (Northwestern University)

  • JiYoon Jeong

    (NeuroLux Corporation)

  • YongJoon Yu

    (NeuroLux Corporation)

  • Jesse Cornman

    (PSYONIC, Inc.)

  • CheeSim Tan

    (PSYONIC, Inc.)

  • BongHoon Kim

    (University of Illinois at Urbana-Champaign
    University of Illinois at Urbana-Champaign
    Northwestern University)

  • KunHyuk Lee

    (Northwestern University)

  • Xue Feng

    (Tsinghua University)

  • Yonggang Huang

    (Northwestern University
    Northwestern University
    Northwestern University
    Northwestern University)

  • John A. Rogers

    (Northwestern University
    Northwestern University
    University of Illinois at Urbana-Champaign
    University of Illinois at Urbana-Champaign)

Abstract

Traditional technologies for virtual reality (VR) and augmented reality (AR) create human experiences through visual and auditory stimuli that replicate sensations associated with the physical world. The most widespread VR and AR systems use head-mounted displays, accelerometers and loudspeakers as the basis for three-dimensional, computer-generated environments that can exist in isolation or as overlays on actual scenery. In comparison to the eyes and the ears, the skin is a relatively underexplored sensory interface for VR and AR technology that could, nevertheless, greatly enhance experiences at a qualitative level, with direct relevance in areas such as communications, entertainment and medicine1,2. Here we present a wireless, battery-free platform of electronic systems and haptic (that is, touch-based) interfaces capable of softly laminating onto the curved surfaces of the skin to communicate information via spatio-temporally programmable patterns of localized mechanical vibrations. We describe the materials, device structures, power delivery strategies and communication schemes that serve as the foundations for such platforms. The resulting technology creates many opportunities for use where the skin provides an electronically programmable communication and sensory input channel to the body, as demonstrated through applications in social media and personal engagement, prosthetic control and feedback, and gaming and entertainment.

Suggested Citation

  • Xinge Yu & Zhaoqian Xie & Yang Yu & Jungyup Lee & Abraham Vazquez-Guardado & Haiwen Luan & Jasper Ruban & Xin Ning & Aadeel Akhtar & Dengfeng Li & Bowen Ji & Yiming Liu & Rujie Sun & Jingyue Cao & Qin, 2019. "Skin-integrated wireless haptic interfaces for virtual and augmented reality," Nature, Nature, vol. 575(7783), pages 473-479, November.
  • Handle: RePEc:nat:nature:v:575:y:2019:i:7783:d:10.1038_s41586-019-1687-0
    DOI: 10.1038/s41586-019-1687-0
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41586-019-1687-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1038/s41586-019-1687-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Min Chen & Jingyu Ouyang & Aijia Jian & Jia Liu & Pan Li & Yixue Hao & Yuchen Gong & Jiayu Hu & Jing Zhou & Rui Wang & Jiaxi Wang & Long Hu & Yuwei Wang & Ju Ouyang & Jing Zhang & Chong Hou & Lei Wei , 2022. "Imperceptible, designable, and scalable braided electronic cord," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    2. Hengtian Zhu & Huan Yang & Siqi Xu & Yuanyuan Ma & Shugeng Zhu & Zhengyi Mao & Weiwei Chen & Zizhong Hu & Rongrong Pan & Yurui Xu & Yifeng Xiong & Ye Chen & Yanqing Lu & Xinghai Ning & Dechen Jiang & , 2024. "Frequency-encoded eye tracking smart contact lens for human–machine interaction," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    3. Won Bae Han & Gwan-Jin Ko & Kang-Gon Lee & Donghak Kim & Joong Hoon Lee & Seung Min Yang & Dong-Je Kim & Jeong-Woong Shin & Tae-Min Jang & Sungkeun Han & Honglei Zhou & Heeseok Kang & Jun Hyeon Lim & , 2023. "Ultra-stretchable and biodegradable elastomers for soft, transient electronics," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    4. Kewang Nan & Kiwan Wong & Dengfeng Li & Binbin Ying & James C. McRae & Vivian R. Feig & Shubing Wang & Ningjie Du & Yuelong Liang & Qijiang Mao & Enjie Zhou & Yonglin Chen & Lei Sang & Kuanming Yao & , 2024. "An ingestible, battery-free, tissue-adhering robotic interface for non-invasive and chronic electrostimulation of the gut," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    5. Shuzhi Liu & Jianmin Zeng & Zhixin Wu & Han Hu & Ao Xu & Xiaohe Huang & Weilin Chen & Qilai Chen & Zhe Yu & Yinyu Zhao & Rong Wang & Tingting Han & Chao Li & Pingqi Gao & Hyunwoo Kim & Seung Jae Baik , 2023. "An ultrasmall organic synapse for neuromorphic computing," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    6. Jian Li & Huiling Jia & Jingkun Zhou & Xingcan Huang & Long Xu & Shengxin Jia & Zhan Gao & Kuanming Yao & Dengfeng Li & Binbin Zhang & Yiming Liu & Ya Huang & Yue Hu & Guangyao Zhao & Zitong Xu & Jiyu, 2023. "Thin, soft, wearable system for continuous wireless monitoring of artery blood pressure," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    7. Shuo Li & Yong Zhang & Xiaoping Liang & Haomin Wang & Haojie Lu & Mengjia Zhu & Huimin Wang & Mingchao Zhang & Xinping Qiu & Yafeng Song & Yingying Zhang, 2022. "Humidity-sensitive chemoelectric flexible sensors based on metal-air redox reaction for health management," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    8. Guorui Li & Tuck-Whye Wong & Benjamin Shih & Chunyu Guo & Luwen Wang & Jiaqi Liu & Tao Wang & Xiaobo Liu & Jiayao Yan & Baosheng Wu & Fajun Yu & Yunsai Chen & Yiming Liang & Yaoting Xue & Chengjun Wan, 2023. "Bioinspired soft robots for deep-sea exploration," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    9. Yiming Liu & Shengxin Jia & Chun Ki Yiu & Wooyoung Park & Zhenlin Chen & Jin Nan & Xingcan Huang & Hongting Chen & Wenyang Li & Yuyu Gao & Weike Song & Tomoyuki Yokota & Takao Someya & Zhao Zhao & Yuh, 2024. "Intelligent wearable olfactory interface for latency-free mixed reality and fast olfactory enhancement," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    10. Jinyuan Zhang & Kyunghun Kim & Ho Joong Kim & Dawn Meyer & Woohyun Park & Seul Ah Lee & Yumin Dai & Bongjoong Kim & Haesoo Moon & Jay V. Shah & Keely E. Harris & Brett Collar & Kangying Liu & Pedro Ir, 2022. "Smart soft contact lenses for continuous 24-hour monitoring of intraocular pressure in glaucoma care," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    11. Chuanqian Shi & Jing Jiang & Chenglong Li & Chenhong Chen & Wei Jian & Jizhou Song, 2024. "Precision-induced localized molten liquid metal stamps for damage-free transfer printing of ultrathin membranes and 3D objects," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    12. Pengwei Wang & Xiaohao Ma & Zhiqiang Lin & Fan Chen & Zijian Chen & Hong Hu & Hailong Xu & Xinyi Zhang & Yuqing Shi & Qiyao Huang & Yuanjing Lin & Zijian Zheng, 2024. "Well-defined in-textile photolithography towards permeable textile electronics," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    13. Zhongda Sun & Minglu Zhu & Xuechuan Shan & Chengkuo Lee, 2022. "Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    14. Yiming Liu & Chun Ki Yiu & Zhao Zhao & Wooyoung Park & Rui Shi & Xingcan Huang & Yuyang Zeng & Kuan Wang & Tsz Hung Wong & Shengxin Jia & Jingkun Zhou & Zhan Gao & Ling Zhao & Kuanming Yao & Jian Li &, 2023. "Soft, miniaturized, wireless olfactory interface for virtual reality," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    15. Shun An & Hanrui Zhu & Chunzhi Guo & Benwei Fu & Chengyi Song & Peng Tao & Wen Shang & Tao Deng, 2022. "Noncontact human-machine interaction based on hand-responsive infrared structural color," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    16. Haisheng Xia & Yuchong Zhang & Nona Rajabi & Farzaneh Taleb & Qunting Yang & Danica Kragic & Zhijun Li, 2024. "Shaping high-performance wearable robots for human motor and sensory reconstruction and enhancement," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    17. Yiyue Luo & Chao Liu & Young Joong Lee & Joseph DelPreto & Kui Wu & Michael Foshey & Daniela Rus & Tomás Palacios & Yunzhu Li & Antonio Torralba & Wojciech Matusik, 2024. "Adaptive tactile interaction transfer via digitally embroidered smart gloves," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    18. Huimin Li & Jianle Lin & Shuxin Lin & Haojie Zhong & Bowei Jiang & Xinghui Liu & Weisheng Wu & Weiwei Li & Emad Iranmanesh & Zhongyi Zhou & Wenjun Li & Kai Wang, 2024. "A bioinspired tactile scanner for computer haptics," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    19. Dongjin Kim & Baekgyeom Kim & Bongsu Shin & Dongwook Shin & Chang-Kun Lee & Jae-Seung Chung & Juwon Seo & Yun-Tae Kim & Geeyoung Sung & Wontaek Seo & Sunil Kim & Sunghoon Hong & Sungwoo Hwang & Seungy, 2022. "Actuating compact wearable augmented reality devices by multifunctional artificial muscle," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    20. Jingkun Zhou & Jian Li & Huiling Jia & Kuanming Yao & Shengxin Jia & Jiyu Li & Guangyao Zhao & Chun Ki Yiu & Zhan Gao & Dengfeng Li & Binbin Zhang & Ya Huang & Qiuna Zhuang & Yawen Yang & Xingcan Huan, 2024. "Mormyroidea-inspired electronic skin for active non-contact three-dimensional tracking and sensing," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    21. Jinhong Park & Duhwan Seong & Yong Jun Park & Sang Hyeok Park & Hyunjin Jung & Yewon Kim & Hyoung Won Baac & Mikyung Shin & Seunghyun Lee & Minbaek Lee & Donghee Son, 2022. "Reversible electrical percolation in a stretchable and self-healable silver-gradient nanocomposite bilayer," Nature Communications, Nature, vol. 13(1), pages 1-13, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:nature:v:575:y:2019:i:7783:d:10.1038_s41586-019-1687-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.