IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v14y2023i1d10.1038_s41467-023-39068-2.html
   My bibliography  Save this article

Eye tracking and eye expression decoding based on transparent, flexible and ultra-persistent electrostatic interface

Author

Listed:
  • Yuxiang Shi

    (Beijing Key Laboratory of Micro-nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences
    University of Chinese Academy of Sciences)

  • Peng Yang

    (Beijing Key Laboratory of Micro-nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences
    University of Chinese Academy of Sciences)

  • Rui Lei

    (Beijing Key Laboratory of Micro-nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences)

  • Zhaoqi Liu

    (Beijing Key Laboratory of Micro-nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences
    University of Chinese Academy of Sciences)

  • Xuanyi Dong

    (Beijing Key Laboratory of Micro-nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences
    University of Chinese Academy of Sciences)

  • Xinglin Tao

    (Beijing Key Laboratory of Micro-nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences
    University of Chinese Academy of Sciences)

  • Xiangcheng Chu

    (Tsinghua University)

  • Zhong Lin Wang

    (Beijing Key Laboratory of Micro-nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences
    Georgia Institute of Technology)

  • Xiangyu Chen

    (Beijing Key Laboratory of Micro-nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences
    University of Chinese Academy of Sciences)

Abstract

Eye tracking provides valuable insight for analyzing visual attention and underlying thinking progress through the observation of eye movements. Here, a transparent, flexible and ultra-persistent electrostatic sensing interface is proposed for realizing active eye tracking (AET) system based on the electrostatic induction effect. Through a triple-layer structure combined with a dielectric bilayer and a rough-surface Ag nanowire (Ag NW) electrode layer, the inherent capacitance and interfacial trapping density of the electrostatic interface has been strongly enhanced, contributing to an unprecedented charge storage capability. The electrostatic charge density of the interface reached 1671.10 μC·m−2 with a charge-keeping rate of 96.91% after 1000 non-contact operation cycles, which can finally realize oculogyric detection with an angular resolution of 5°. Thus, the AET system enables real-time decoding eye movements for customer preference recording and eye-controlled human-computer interaction, supporting its limitless potentiality in commercial purpose, virtual reality, human computer interactions and medical monitoring.

Suggested Citation

  • Yuxiang Shi & Peng Yang & Rui Lei & Zhaoqi Liu & Xuanyi Dong & Xinglin Tao & Xiangcheng Chu & Zhong Lin Wang & Xiangyu Chen, 2023. "Eye tracking and eye expression decoding based on transparent, flexible and ultra-persistent electrostatic interface," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    • Handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-39068-2
    DOI: 10.1038/s41467-023-39068-2
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-39068-2
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-023-39068-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Yijia Lu & Han Tian & Jia Cheng & Fei Zhu & Bin Liu & Shanshan Wei & Linhong Ji & Zhong Lin Wang, 2022. "Decoding lip language using triboelectric sensors with deep learning," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    2. Zhongda Sun & Minglu Zhu & Xuechuan Shan & Chengkuo Lee, 2022. "Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    3. Zhaoqi Liu & Yunzhi Huang & Yuxiang Shi & Xinglin Tao & Hezhi He & Feida Chen & Zhao-Xia Huang & Zhong Lin Wang & Xiangyu Chen & Jin-Ping Qu, 2022. "Fabrication of triboelectric polymer films via repeated rheological forging for ultrahigh surface charge density," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    4. Cheng Yang & Qianni Wu & Junqing Liu & Jingshan Mo & Xiangling Li & Chengduan Yang & Ziqi Liu & Jingbo Yang & Lelun Jiang & Weirong Chen & Hui-jiuan Chen & Ji Wang & Xi Xie, 2022. "Intelligent wireless theranostic contact lens for electrical sensing and regulation of intraocular pressure," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kyeonghee Lim & Jakyoung Lee & Sumin Kim & Myoungjae Oh & Chin Su Koh & Hunkyu Seo & Yeon-Mi Hong & Won Gi Chung & Jiuk Jang & Jung Ah Lim & Hyun Ho Jung & Jang-Ung Park, 2024. "Interference haptic stimulation and consistent quantitative tactility in transparent electrotactile screen with pressure-sensitive transistors," Nature Communications, Nature, vol. 15(1), pages 1-15, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiayue Zhang & Yikui Gao & Di Liu & Jing-Shan Zhao & Jie Wang, 2023. "Discharge domains regulation and dynamic processes of direct-current triboelectric nanogenerator," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    2. Xiao Lu & Haiqiu Tan & Haodong Zhang & Wuhong Wang & Shaorong Xie & Tao Yue & Facheng Chen, 2025. "Triboelectric sensor gloves for real-time behavior identification and takeover time adjustment in conditionally automated vehicles," Nature Communications, Nature, vol. 16(1), pages 1-13, December.
    3. Aobo Cheng & Xin Li & Ding Li & Zhikang Chen & Tianrui Cui & Lu-Qi Tao & Jinming Jian & HuiJun Xiao & Wancheng Shao & Zeyi Tang & Xinyue Li & Zirui Dong & Houfang Liu & Yi Yang & Tian-Ling Ren, 2025. "An intelligent hybrid-fabric wristband system enabled by thermal encapsulation for ergonomic human-machine interaction," Nature Communications, Nature, vol. 16(1), pages 1-9, December.
    4. Yi Li & Yi Luo & Song Xiao & Cheng Zhang & Cheng Pan & Fuping Zeng & Zhaolun Cui & Bangdou Huang & Ju Tang & Tao Shao & Xiaoxing Zhang & Jiaqing Xiong & Zhong Lin Wang, 2024. "Visualization and standardized quantification of surface charge density for triboelectric materials," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    5. Shaomei Lin & Weifeng Yang & Xubin Zhu & Yubin Lan & Kerui Li & Qinghong Zhang & Yaogang Li & Chengyi Hou & Hongzhi Wang, 2024. "Triboelectric micro-flexure-sensitive fiber electronics," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    6. Haisheng Xia & Yuchong Zhang & Nona Rajabi & Farzaneh Taleb & Qunting Yang & Danica Kragic & Zhijun Li, 2024. "Shaping high-performance wearable robots for human motor and sensory reconstruction and enhancement," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    7. Zhao, Lin-Chuan & Zhou, Teng & Chang, Si-Deng & Zou, Hong-Xiang & Gao, Qiu-Hua & Wu, Zhi-Yuan & Yan, Ge & Wei, Ke-Xiang & Yeatman, Eric M. & Meng, Guang & Zhang, Wen-Ming, 2024. "A disposable cup inspired smart floor for trajectory recognition and human-interactive sensing," Applied Energy, Elsevier, vol. 357(C).
    8. Jin Pyo Lee & Hanhyeok Jang & Yeonwoo Jang & Hyeonseo Song & Suwoo Lee & Pooi See Lee & Jiyun Kim, 2024. "Encoding of multi-modal emotional information via personalized skin-integrated wireless facial interface," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    9. Shangda Qu & Lin Sun & Song Zhang & Jiaqi Liu & Yue Li & Junchi Liu & Wentao Xu, 2023. "An artificially-intelligent cornea with tactile sensation enables sensory expansion and interaction," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    10. Yanhua Liu & Jinlong Wang & Tao Liu & Zhiting Wei & Bin Luo & Mingchao Chi & Song Zhang & Chenchen Cai & Cong Gao & Tong Zhao & Shuangfei Wang & Shuangxi Nie, 2025. "Triboelectric tactile sensor for pressure and temperature sensing in high-temperature applications," Nature Communications, Nature, vol. 16(1), pages 1-10, December.
    11. Weijia Liu & Zhijian Du & Zhongyi Duan & La Li & Guozhen Shen, 2024. "Neuroprosthetic contact lens enabled sensorimotor system for point-of-care monitoring and feedback of intraocular pressure," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    12. Ningning Bai & Yiheng Xue & Shuiqing Chen & Lin Shi & Junli Shi & Yuan Zhang & Xingyu Hou & Yu Cheng & Kaixi Huang & Weidong Wang & Jin Zhang & Yuan Liu & Chuan Fei Guo, 2023. "A robotic sensory system with high spatiotemporal resolution for texture recognition," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    13. Hang Zhang & Sankaran Sundaresan & Michael A. Webb, 2024. "Thermodynamic driving forces in contact electrification between polymeric materials," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    14. Taemin Kim & Yejee Shin & Kyowon Kang & Kiho Kim & Gwanho Kim & Yunsu Byeon & Hwayeon Kim & Yuyan Gao & Jeong Ryong Lee & Geonhui Son & Taeseong Kim & Yohan Jun & Jihyun Kim & Jinyoung Lee & Seyun Um , 2022. "Ultrathin crystalline-silicon-based strain gauges with deep learning algorithms for silent speech interfaces," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    15. Chunpeng Jiang & Wenqiang Xu & Yutong Li & Zhenjun Yu & Longchun Wang & Xiaotong Hu & Zhengyi Xie & Qingkun Liu & Bin Yang & Xiaolin Wang & Wenxin Du & Tutian Tang & Dongzhe Zheng & Siqiong Yao & Cewu, 2024. "Capturing forceful interaction with deformable objects using a deep learning-powered stretchable tactile array," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    16. Hira Hameed & Muhammad Usman & Ahsen Tahir & Amir Hussain & Hasan Abbas & Tie Jun Cui & Muhammad Ali Imran & Qammer H. Abbasi, 2022. "Pushing the limits of remote RF sensing by reading lips under the face mask," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    17. Liuting Shan & Qizhen Chen & Rengjian Yu & Changsong Gao & Lujian Liu & Tailiang Guo & Huipeng Chen, 2023. "A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    18. Jie Li & Fan Zhang & Xiaobin Xia & Kaihang Zhang & Jianhui Wu & Yulu Liu & Chi Zhang & Xinyu Cai & Jiaqi Lu & Liangquan Xu & Rui Wan & Dinku Hazarika & Weipeng Xuan & Jinkai Chen & Zhen Cao & Yubo Li , 2024. "An ultrasensitive multimodal intracranial pressure biotelemetric system enabled by exceptional point and iontronics," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    19. Yiming Liu & Shengxin Jia & Chun Ki Yiu & Wooyoung Park & Zhenlin Chen & Jin Nan & Xingcan Huang & Hongting Chen & Wenyang Li & Yuyu Gao & Weike Song & Tomoyuki Yokota & Takao Someya & Zhao Zhao & Yuh, 2024. "Intelligent wearable olfactory interface for latency-free mixed reality and fast olfactory enhancement," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    20. Zixuan Zhang & Xinge Guo & Chengkuo Lee, 2024. "Advances in olfactory augmented virtual reality towards future metaverse applications," Nature Communications, Nature, vol. 15(1), pages 1-4, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-39068-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.