IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-47851-y.html
   My bibliography  Save this article

Frequency-encoded eye tracking smart contact lens for human–machine interaction

Author

Listed:
  • Hengtian Zhu

    (Nanjing University)

  • Huan Yang

    (Nanjing University)

  • Siqi Xu

    (The First Affiliated Hospital with Nanjing Medical University)

  • Yuanyuan Ma

    (Nanjing University)

  • Shugeng Zhu

    (Nanjing University)

  • Zhengyi Mao

    (Nanjing University)

  • Weiwei Chen

    (Nanjing University
    Nanjing University
    Nanjing University)

  • Zizhong Hu

    (The First Affiliated Hospital with Nanjing Medical University)

  • Rongrong Pan

    (Nanjing University)

  • Yurui Xu

    (Nanjing University
    Nanjing University
    Nanjing University)

  • Yifeng Xiong

    (Nanjing University)

  • Ye Chen

    (Nanjing University
    Nanjing University of Aeronautics and Astronautics)

  • Yanqing Lu

    (Nanjing University)

  • Xinghai Ning

    (Nanjing University
    Nanjing University
    Nanjing University)

  • Dechen Jiang

    (Nanjing University
    Nanjing University)

  • Songtao Yuan

    (The First Affiliated Hospital with Nanjing Medical University)

  • Fei Xu

    (Nanjing University
    Nanjing University)

Abstract

Eye tracking techniques enable high-efficient, natural, and effortless human-machine interaction by detecting users’ eye movements and decoding their attention and intentions. Here, a miniature, imperceptible, and biocompatible smart contact lens is proposed for in situ eye tracking and wireless eye-machine interaction. Employing the frequency encoding strategy, the chip-free and battery-free lens successes in detecting eye movement and closure. Using a time-sequential eye tracking algorithm, the lens has a great angular accuracy of

Suggested Citation

  • Hengtian Zhu & Huan Yang & Siqi Xu & Yuanyuan Ma & Shugeng Zhu & Zhengyi Mao & Weiwei Chen & Zizhong Hu & Rongrong Pan & Yurui Xu & Yifeng Xiong & Ye Chen & Yanqing Lu & Xinghai Ning & Dechen Jiang & , 2024. "Frequency-encoded eye tracking smart contact lens for human–machine interaction," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-47851-y
    DOI: 10.1038/s41467-024-47851-y
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-47851-y
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-024-47851-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Xinge Yu & Zhaoqian Xie & Yang Yu & Jungyup Lee & Abraham Vazquez-Guardado & Haiwen Luan & Jasper Ruban & Xin Ning & Aadeel Akhtar & Dengfeng Li & Bowen Ji & Yiming Liu & Rujie Sun & Jingyue Cao & Qin, 2019. "Skin-integrated wireless haptic interfaces for virtual and augmented reality," Nature, Nature, vol. 575(7783), pages 473-479, November.
    2. Qilin Hua & Junlu Sun & Haitao Liu & Rongrong Bao & Ruomeng Yu & Junyi Zhai & Caofeng Pan & Zhong Lin Wang, 2018. "Skin-inspired highly stretchable and conformable matrix networks for multifunctional sensing," Nature Communications, Nature, vol. 9(1), pages 1-11, December.
    3. Cheng Yang & Qianni Wu & Junqing Liu & Jingshan Mo & Xiangling Li & Chengduan Yang & Ziqi Liu & Jingbo Yang & Lelun Jiang & Weirong Chen & Hui-jiuan Chen & Ji Wang & Xi Xie, 2022. "Intelligent wireless theranostic contact lens for electrical sensing and regulation of intraocular pressure," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    4. Joohee Kim & Minji Kim & Mi-Sun Lee & Kukjoo Kim & Sangyoon Ji & Yun-Tae Kim & Jihun Park & Kyungmin Na & Kwi-Hyun Bae & Hong Kyun Kim & Franklin Bien & Chang Young Lee & Jang-Ung Park, 2017. "Wearable smart sensor systems integrated on soft contact lenses for wireless ocular diagnostics," Nature Communications, Nature, vol. 8(1), pages 1-8, April.
    5. Kyunghun Kim & Ho Joong Kim & Haozhe Zhang & Woohyun Park & Dawn Meyer & Min Ku Kim & Bongjoong Kim & Heun Park & Baoxing Xu & Pete Kollbaum & Bryan W. Boudouris & Chi Hwan Lee, 2021. "All-printed stretchable corneal sensor on soft contact lenses for noninvasive and painless ocular electrodiagnosis," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    6. Jinyuan Zhang & Kyunghun Kim & Ho Joong Kim & Dawn Meyer & Woohyun Park & Seul Ah Lee & Yumin Dai & Bongjoong Kim & Haesoo Moon & Jay V. Shah & Keely E. Harris & Brett Collar & Kangying Liu & Pedro Ir, 2022. "Smart soft contact lenses for continuous 24-hour monitoring of intraocular pressure in glaucoma care," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Weijia Liu & Zhijian Du & Zhongyi Duan & La Li & Guozhen Shen, 2024. "Neuroprosthetic contact lens enabled sensorimotor system for point-of-care monitoring and feedback of intraocular pressure," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    2. Jinyuan Zhang & Kyunghun Kim & Ho Joong Kim & Dawn Meyer & Woohyun Park & Seul Ah Lee & Yumin Dai & Bongjoong Kim & Haesoo Moon & Jay V. Shah & Keely E. Harris & Brett Collar & Kangying Liu & Pedro Ir, 2022. "Smart soft contact lenses for continuous 24-hour monitoring of intraocular pressure in glaucoma care," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    3. Shuo Li & Yong Zhang & Xiaoping Liang & Haomin Wang & Haojie Lu & Mengjia Zhu & Huimin Wang & Mingchao Zhang & Xinping Qiu & Yafeng Song & Yingying Zhang, 2022. "Humidity-sensitive chemoelectric flexible sensors based on metal-air redox reaction for health management," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    4. Xueguang Lu & Feilong Zhang & Liguo Zhu & Shan Peng & Jiazhen Yan & Qiwu Shi & Kefan Chen & Xue Chang & Hongfu Zhu & Cheng Zhang & Wanxia Huang & Qiang Cheng, 2024. "A terahertz meta-sensor array for 2D strain mapping," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    5. Haisheng Xia & Yuchong Zhang & Nona Rajabi & Farzaneh Taleb & Qunting Yang & Danica Kragic & Zhijun Li, 2024. "Shaping high-performance wearable robots for human motor and sensory reconstruction and enhancement," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    6. Linlin Li & Shufang Zhao & Wenhao Ran & Zhexin Li & Yongxu Yan & Bowen Zhong & Zheng Lou & Lili Wang & Guozhen Shen, 2022. "Dual sensing signal decoupling based on tellurium anisotropy for VR interaction and neuro-reflex system application," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    7. Bekir Aksoy & Yufei Hao & Giulio Grasso & Krishna Manaswi Digumarti & Vito Cacucciolo & Herbert Shea, 2022. "Shielded soft force sensors," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    8. Jinhong Park & Duhwan Seong & Yong Jun Park & Sang Hyeok Park & Hyunjin Jung & Yewon Kim & Hyoung Won Baac & Mikyung Shin & Seunghyun Lee & Minbaek Lee & Donghee Son, 2022. "Reversible electrical percolation in a stretchable and self-healable silver-gradient nanocomposite bilayer," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    9. Won Bae Han & Gwan-Jin Ko & Kang-Gon Lee & Donghak Kim & Joong Hoon Lee & Seung Min Yang & Dong-Je Kim & Jeong-Woong Shin & Tae-Min Jang & Sungkeun Han & Honglei Zhou & Heeseok Kang & Jun Hyeon Lim & , 2023. "Ultra-stretchable and biodegradable elastomers for soft, transient electronics," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    10. Jin Pyo Lee & Hanhyeok Jang & Yeonwoo Jang & Hyeonseo Song & Suwoo Lee & Pooi See Lee & Jiyun Kim, 2024. "Encoding of multi-modal emotional information via personalized skin-integrated wireless facial interface," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    11. Shangda Qu & Lin Sun & Song Zhang & Jiaqi Liu & Yue Li & Junchi Liu & Wentao Xu, 2023. "An artificially-intelligent cornea with tactile sensation enables sensory expansion and interaction," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    12. Xia Zhu & Ke Wu & Xiaohang Xie & Stephan W. Anderson & Xin Zhang, 2024. "A robust near-field body area network based on coaxially-shielded textile metamaterial," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    13. Yijia Lu & Han Tian & Jia Cheng & Fei Zhu & Bin Liu & Shanshan Wei & Linhong Ji & Zhong Lin Wang, 2022. "Decoding lip language using triboelectric sensors with deep learning," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    14. Jian Li & Huiling Jia & Jingkun Zhou & Xingcan Huang & Long Xu & Shengxin Jia & Zhan Gao & Kuanming Yao & Dengfeng Li & Binbin Zhang & Yiming Liu & Ya Huang & Yue Hu & Guangyao Zhao & Zitong Xu & Jiyu, 2023. "Thin, soft, wearable system for continuous wireless monitoring of artery blood pressure," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    15. Pengwei Wang & Xiaohao Ma & Zhiqiang Lin & Fan Chen & Zijian Chen & Hong Hu & Hailong Xu & Xinyi Zhang & Yuqing Shi & Qiyao Huang & Yuanjing Lin & Zijian Zheng, 2024. "Well-defined in-textile photolithography towards permeable textile electronics," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    16. Min Chen & Jingyu Ouyang & Aijia Jian & Jia Liu & Pan Li & Yixue Hao & Yuchen Gong & Jiayu Hu & Jing Zhou & Rui Wang & Jiaxi Wang & Long Hu & Yuwei Wang & Ju Ouyang & Jing Zhang & Chong Hou & Lei Wei , 2022. "Imperceptible, designable, and scalable braided electronic cord," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    17. Zhongda Sun & Minglu Zhu & Xuechuan Shan & Chengkuo Lee, 2022. "Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    18. Cheng Yang & Qianni Wu & Junqing Liu & Jingshan Mo & Xiangling Li & Chengduan Yang & Ziqi Liu & Jingbo Yang & Lelun Jiang & Weirong Chen & Hui-jiuan Chen & Ji Wang & Xi Xie, 2022. "Intelligent wireless theranostic contact lens for electrical sensing and regulation of intraocular pressure," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    19. Vidal, João V. & Rolo, Pedro & Carneiro, Pedro M.R. & Peres, Inês & Kholkin, Andrei L. & Soares dos Santos, Marco P., 2022. "Automated electromagnetic generator with self-adaptive structure by coil switching," Applied Energy, Elsevier, vol. 325(C).
    20. Kewang Nan & Kiwan Wong & Dengfeng Li & Binbin Ying & James C. McRae & Vivian R. Feig & Shubing Wang & Ningjie Du & Yuelong Liang & Qijiang Mao & Enjie Zhou & Yonglin Chen & Lei Sang & Kuanming Yao & , 2024. "An ingestible, battery-free, tissue-adhering robotic interface for non-invasive and chronic electrostimulation of the gut," Nature Communications, Nature, vol. 15(1), pages 1-12, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-47851-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.