IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-47851-y.html
   My bibliography  Save this article

Frequency-encoded eye tracking smart contact lens for human–machine interaction

Author

Listed:
  • Hengtian Zhu

    (Nanjing University)

  • Huan Yang

    (Nanjing University)

  • Siqi Xu

    (The First Affiliated Hospital with Nanjing Medical University)

  • Yuanyuan Ma

    (Nanjing University)

  • Shugeng Zhu

    (Nanjing University)

  • Zhengyi Mao

    (Nanjing University)

  • Weiwei Chen

    (Nanjing University
    Nanjing University
    Nanjing University)

  • Zizhong Hu

    (The First Affiliated Hospital with Nanjing Medical University)

  • Rongrong Pan

    (Nanjing University)

  • Yurui Xu

    (Nanjing University
    Nanjing University
    Nanjing University)

  • Yifeng Xiong

    (Nanjing University)

  • Ye Chen

    (Nanjing University
    Nanjing University of Aeronautics and Astronautics)

  • Yanqing Lu

    (Nanjing University)

  • Xinghai Ning

    (Nanjing University
    Nanjing University
    Nanjing University)

  • Dechen Jiang

    (Nanjing University
    Nanjing University)

  • Songtao Yuan

    (The First Affiliated Hospital with Nanjing Medical University)

  • Fei Xu

    (Nanjing University
    Nanjing University)

Abstract

Eye tracking techniques enable high-efficient, natural, and effortless human-machine interaction by detecting users’ eye movements and decoding their attention and intentions. Here, a miniature, imperceptible, and biocompatible smart contact lens is proposed for in situ eye tracking and wireless eye-machine interaction. Employing the frequency encoding strategy, the chip-free and battery-free lens successes in detecting eye movement and closure. Using a time-sequential eye tracking algorithm, the lens has a great angular accuracy of

Suggested Citation

  • Hengtian Zhu & Huan Yang & Siqi Xu & Yuanyuan Ma & Shugeng Zhu & Zhengyi Mao & Weiwei Chen & Zizhong Hu & Rongrong Pan & Yurui Xu & Yifeng Xiong & Ye Chen & Yanqing Lu & Xinghai Ning & Dechen Jiang & , 2024. "Frequency-encoded eye tracking smart contact lens for human–machine interaction," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-47851-y
    DOI: 10.1038/s41467-024-47851-y
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-47851-y
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-024-47851-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kyunghun Kim & Ho Joong Kim & Haozhe Zhang & Woohyun Park & Dawn Meyer & Min Ku Kim & Bongjoong Kim & Heun Park & Baoxing Xu & Pete Kollbaum & Bryan W. Boudouris & Chi Hwan Lee, 2021. "All-printed stretchable corneal sensor on soft contact lenses for noninvasive and painless ocular electrodiagnosis," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    2. Xinge Yu & Zhaoqian Xie & Yang Yu & Jungyup Lee & Abraham Vazquez-Guardado & Haiwen Luan & Jasper Ruban & Xin Ning & Aadeel Akhtar & Dengfeng Li & Bowen Ji & Yiming Liu & Rujie Sun & Jingyue Cao & Qin, 2019. "Skin-integrated wireless haptic interfaces for virtual and augmented reality," Nature, Nature, vol. 575(7783), pages 473-479, November.
    3. Qilin Hua & Junlu Sun & Haitao Liu & Rongrong Bao & Ruomeng Yu & Junyi Zhai & Caofeng Pan & Zhong Lin Wang, 2018. "Skin-inspired highly stretchable and conformable matrix networks for multifunctional sensing," Nature Communications, Nature, vol. 9(1), pages 1-11, December.
    4. Cheng Yang & Qianni Wu & Junqing Liu & Jingshan Mo & Xiangling Li & Chengduan Yang & Ziqi Liu & Jingbo Yang & Lelun Jiang & Weirong Chen & Hui-jiuan Chen & Ji Wang & Xi Xie, 2022. "Intelligent wireless theranostic contact lens for electrical sensing and regulation of intraocular pressure," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    5. Joohee Kim & Minji Kim & Mi-Sun Lee & Kukjoo Kim & Sangyoon Ji & Yun-Tae Kim & Jihun Park & Kyungmin Na & Kwi-Hyun Bae & Hong Kyun Kim & Franklin Bien & Chang Young Lee & Jang-Ung Park, 2017. "Wearable smart sensor systems integrated on soft contact lenses for wireless ocular diagnostics," Nature Communications, Nature, vol. 8(1), pages 1-8, April.
    6. Jinyuan Zhang & Kyunghun Kim & Ho Joong Kim & Dawn Meyer & Woohyun Park & Seul Ah Lee & Yumin Dai & Bongjoong Kim & Haesoo Moon & Jay V. Shah & Keely E. Harris & Brett Collar & Kangying Liu & Pedro Ir, 2022. "Smart soft contact lenses for continuous 24-hour monitoring of intraocular pressure in glaucoma care," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jinyuan Zhang & Kyunghun Kim & Ho Joong Kim & Dawn Meyer & Woohyun Park & Seul Ah Lee & Yumin Dai & Bongjoong Kim & Haesoo Moon & Jay V. Shah & Keely E. Harris & Brett Collar & Kangying Liu & Pedro Ir, 2022. "Smart soft contact lenses for continuous 24-hour monitoring of intraocular pressure in glaucoma care," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    2. Shuo Li & Yong Zhang & Xiaoping Liang & Haomin Wang & Haojie Lu & Mengjia Zhu & Huimin Wang & Mingchao Zhang & Xinping Qiu & Yafeng Song & Yingying Zhang, 2022. "Humidity-sensitive chemoelectric flexible sensors based on metal-air redox reaction for health management," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    3. Haisheng Xia & Yuchong Zhang & Nona Rajabi & Farzaneh Taleb & Qunting Yang & Danica Kragic & Zhijun Li, 2024. "Shaping high-performance wearable robots for human motor and sensory reconstruction and enhancement," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    4. Linlin Li & Shufang Zhao & Wenhao Ran & Zhexin Li & Yongxu Yan & Bowen Zhong & Zheng Lou & Lili Wang & Guozhen Shen, 2022. "Dual sensing signal decoupling based on tellurium anisotropy for VR interaction and neuro-reflex system application," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    5. Bekir Aksoy & Yufei Hao & Giulio Grasso & Krishna Manaswi Digumarti & Vito Cacucciolo & Herbert Shea, 2022. "Shielded soft force sensors," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    6. Won Bae Han & Gwan-Jin Ko & Kang-Gon Lee & Donghak Kim & Joong Hoon Lee & Seung Min Yang & Dong-Je Kim & Jeong-Woong Shin & Tae-Min Jang & Sungkeun Han & Honglei Zhou & Heeseok Kang & Jun Hyeon Lim & , 2023. "Ultra-stretchable and biodegradable elastomers for soft, transient electronics," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    7. Jin Pyo Lee & Hanhyeok Jang & Yeonwoo Jang & Hyeonseo Song & Suwoo Lee & Pooi See Lee & Jiyun Kim, 2024. "Encoding of multi-modal emotional information via personalized skin-integrated wireless facial interface," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    8. Shangda Qu & Lin Sun & Song Zhang & Jiaqi Liu & Yue Li & Junchi Liu & Wentao Xu, 2023. "An artificially-intelligent cornea with tactile sensation enables sensory expansion and interaction," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    9. Pengwei Wang & Xiaohao Ma & Zhiqiang Lin & Fan Chen & Zijian Chen & Hong Hu & Hailong Xu & Xinyi Zhang & Yuqing Shi & Qiyao Huang & Yuanjing Lin & Zijian Zheng, 2024. "Well-defined in-textile photolithography towards permeable textile electronics," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    10. Vidal, João V. & Rolo, Pedro & Carneiro, Pedro M.R. & Peres, Inês & Kholkin, Andrei L. & Soares dos Santos, Marco P., 2022. "Automated electromagnetic generator with self-adaptive structure by coil switching," Applied Energy, Elsevier, vol. 325(C).
    11. Haoran Jin & Zesheng Zheng & Zequn Cui & Ying Jiang & Geng Chen & Wenlong Li & Zhimin Wang & Jilei Wang & Chuanshi Yang & Weitao Song & Xiaodong Chen & Yuanjin Zheng, 2023. "A flexible optoacoustic blood ‘stethoscope’ for noninvasive multiparametric cardiovascular monitoring," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    12. Guorui Li & Tuck-Whye Wong & Benjamin Shih & Chunyu Guo & Luwen Wang & Jiaqi Liu & Tao Wang & Xiaobo Liu & Jiayao Yan & Baosheng Wu & Fajun Yu & Yunsai Chen & Yiming Liang & Yaoting Xue & Chengjun Wan, 2023. "Bioinspired soft robots for deep-sea exploration," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    13. Roberto de Fazio & Donato Cafagna & Giorgio Marcuccio & Alessandro Minerba & Paolo Visconti, 2020. "A Multi-Source Harvesting System Applied to Sensor-Based Smart Garments for Monitoring Workers’ Bio-Physical Parameters in Harsh Environments," Energies, MDPI, vol. 13(9), pages 1-33, May.
    14. Shun An & Hanrui Zhu & Chunzhi Guo & Benwei Fu & Chengyi Song & Peng Tao & Wen Shang & Tao Deng, 2022. "Noncontact human-machine interaction based on hand-responsive infrared structural color," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    15. Dongjin Kim & Baekgyeom Kim & Bongsu Shin & Dongwook Shin & Chang-Kun Lee & Jae-Seung Chung & Juwon Seo & Yun-Tae Kim & Geeyoung Sung & Wontaek Seo & Sunil Kim & Sunghoon Hong & Sungwoo Hwang & Seungy, 2022. "Actuating compact wearable augmented reality devices by multifunctional artificial muscle," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    16. Tae Yeon Kim & Jee Won Mok & Sang Hoon Hong & Sang Hoon Jeong & Hyunsik Choi & Sangbaie Shin & Choun-Ki Joo & Sei Kwang Hahn, 2022. "Wireless theranostic smart contact lens for monitoring and control of intraocular pressure in glaucoma," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    17. Mahmoud Wagih & Junjie Shi & Menglong Li & Abiodun Komolafe & Thomas Whittaker & Johannes Schneider & Shanmugam Kumar & William Whittow & Steve Beeby, 2024. "Wide-range soft anisotropic thermistor with a direct wireless radio frequency interface," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    18. Shuzhi Liu & Jianmin Zeng & Zhixin Wu & Han Hu & Ao Xu & Xiaohe Huang & Weilin Chen & Qilai Chen & Zhe Yu & Yinyu Zhao & Rong Wang & Tingting Han & Chao Li & Pingqi Gao & Hyunwoo Kim & Seung Jae Baik , 2023. "An ultrasmall organic synapse for neuromorphic computing," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    19. Yufei Zhang & Qiuchun Lu & Jiang He & Zhihao Huo & Runhui Zhou & Xun Han & Mengmeng Jia & Caofeng Pan & Zhong Lin Wang & Junyi Zhai, 2023. "Localizing strain via micro-cage structure for stretchable pressure sensor arrays with ultralow spatial crosstalk," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    20. Xueguang Lu & Feilong Zhang & Liguo Zhu & Shan Peng & Jiazhen Yan & Qiwu Shi & Kefan Chen & Xue Chang & Hongfu Zhu & Cheng Zhang & Wanxia Huang & Qiang Cheng, 2024. "A terahertz meta-sensor array for 2D strain mapping," Nature Communications, Nature, vol. 15(1), pages 1-9, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-47851-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.