IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v14y2023i1d10.1038_s41467-023-39068-2.html
   My bibliography  Save this article

Eye tracking and eye expression decoding based on transparent, flexible and ultra-persistent electrostatic interface

Author

Listed:
  • Yuxiang Shi

    (Beijing Key Laboratory of Micro-nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences
    University of Chinese Academy of Sciences)

  • Peng Yang

    (Beijing Key Laboratory of Micro-nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences
    University of Chinese Academy of Sciences)

  • Rui Lei

    (Beijing Key Laboratory of Micro-nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences)

  • Zhaoqi Liu

    (Beijing Key Laboratory of Micro-nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences
    University of Chinese Academy of Sciences)

  • Xuanyi Dong

    (Beijing Key Laboratory of Micro-nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences
    University of Chinese Academy of Sciences)

  • Xinglin Tao

    (Beijing Key Laboratory of Micro-nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences
    University of Chinese Academy of Sciences)

  • Xiangcheng Chu

    (Tsinghua University)

  • Zhong Lin Wang

    (Beijing Key Laboratory of Micro-nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences
    Georgia Institute of Technology)

  • Xiangyu Chen

    (Beijing Key Laboratory of Micro-nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences
    University of Chinese Academy of Sciences)

Abstract

Eye tracking provides valuable insight for analyzing visual attention and underlying thinking progress through the observation of eye movements. Here, a transparent, flexible and ultra-persistent electrostatic sensing interface is proposed for realizing active eye tracking (AET) system based on the electrostatic induction effect. Through a triple-layer structure combined with a dielectric bilayer and a rough-surface Ag nanowire (Ag NW) electrode layer, the inherent capacitance and interfacial trapping density of the electrostatic interface has been strongly enhanced, contributing to an unprecedented charge storage capability. The electrostatic charge density of the interface reached 1671.10 μC·m−2 with a charge-keeping rate of 96.91% after 1000 non-contact operation cycles, which can finally realize oculogyric detection with an angular resolution of 5°. Thus, the AET system enables real-time decoding eye movements for customer preference recording and eye-controlled human-computer interaction, supporting its limitless potentiality in commercial purpose, virtual reality, human computer interactions and medical monitoring.

Suggested Citation

  • Yuxiang Shi & Peng Yang & Rui Lei & Zhaoqi Liu & Xuanyi Dong & Xinglin Tao & Xiangcheng Chu & Zhong Lin Wang & Xiangyu Chen, 2023. "Eye tracking and eye expression decoding based on transparent, flexible and ultra-persistent electrostatic interface," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    • Handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-39068-2
    DOI: 10.1038/s41467-023-39068-2
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-39068-2
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-023-39068-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Zhaoqi Liu & Yunzhi Huang & Yuxiang Shi & Xinglin Tao & Hezhi He & Feida Chen & Zhao-Xia Huang & Zhong Lin Wang & Xiangyu Chen & Jin-Ping Qu, 2022. "Fabrication of triboelectric polymer films via repeated rheological forging for ultrahigh surface charge density," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    2. Zhongda Sun & Minglu Zhu & Xuechuan Shan & Chengkuo Lee, 2022. "Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    3. Yijia Lu & Han Tian & Jia Cheng & Fei Zhu & Bin Liu & Shanshan Wei & Linhong Ji & Zhong Lin Wang, 2022. "Decoding lip language using triboelectric sensors with deep learning," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    4. Cheng Yang & Qianni Wu & Junqing Liu & Jingshan Mo & Xiangling Li & Chengduan Yang & Ziqi Liu & Jingbo Yang & Lelun Jiang & Weirong Chen & Hui-jiuan Chen & Ji Wang & Xi Xie, 2022. "Intelligent wireless theranostic contact lens for electrical sensing and regulation of intraocular pressure," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kyeonghee Lim & Jakyoung Lee & Sumin Kim & Myoungjae Oh & Chin Su Koh & Hunkyu Seo & Yeon-Mi Hong & Won Gi Chung & Jiuk Jang & Jung Ah Lim & Hyun Ho Jung & Jang-Ung Park, 2024. "Interference haptic stimulation and consistent quantitative tactility in transparent electrotactile screen with pressure-sensitive transistors," Nature Communications, Nature, vol. 15(1), pages 1-15, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiayue Zhang & Yikui Gao & Di Liu & Jing-Shan Zhao & Jie Wang, 2023. "Discharge domains regulation and dynamic processes of direct-current triboelectric nanogenerator," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    2. Hengtian Zhu & Huan Yang & Siqi Xu & Yuanyuan Ma & Shugeng Zhu & Zhengyi Mao & Weiwei Chen & Zizhong Hu & Rongrong Pan & Yurui Xu & Yifeng Xiong & Ye Chen & Yanqing Lu & Xinghai Ning & Dechen Jiang & , 2024. "Frequency-encoded eye tracking smart contact lens for human–machine interaction," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    3. Yi Li & Yi Luo & Song Xiao & Cheng Zhang & Cheng Pan & Fuping Zeng & Zhaolun Cui & Bangdou Huang & Ju Tang & Tao Shao & Xiaoxing Zhang & Jiaqing Xiong & Zhong Lin Wang, 2024. "Visualization and standardized quantification of surface charge density for triboelectric materials," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    4. Shaomei Lin & Weifeng Yang & Xubin Zhu & Yubin Lan & Kerui Li & Qinghong Zhang & Yaogang Li & Chengyi Hou & Hongzhi Wang, 2024. "Triboelectric micro-flexure-sensitive fiber electronics," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    5. Haisheng Xia & Yuchong Zhang & Nona Rajabi & Farzaneh Taleb & Qunting Yang & Danica Kragic & Zhijun Li, 2024. "Shaping high-performance wearable robots for human motor and sensory reconstruction and enhancement," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    6. Zhao, Lin-Chuan & Zhou, Teng & Chang, Si-Deng & Zou, Hong-Xiang & Gao, Qiu-Hua & Wu, Zhi-Yuan & Yan, Ge & Wei, Ke-Xiang & Yeatman, Eric M. & Meng, Guang & Zhang, Wen-Ming, 2024. "A disposable cup inspired smart floor for trajectory recognition and human-interactive sensing," Applied Energy, Elsevier, vol. 357(C).
    7. Jin Pyo Lee & Hanhyeok Jang & Yeonwoo Jang & Hyeonseo Song & Suwoo Lee & Pooi See Lee & Jiyun Kim, 2024. "Encoding of multi-modal emotional information via personalized skin-integrated wireless facial interface," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    8. Shangda Qu & Lin Sun & Song Zhang & Jiaqi Liu & Yue Li & Junchi Liu & Wentao Xu, 2023. "An artificially-intelligent cornea with tactile sensation enables sensory expansion and interaction," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    9. Chungryeol Lee & Changhyeon Lee & Seungmin Lee & Junhwan Choi & Hocheon Yoo & Sung Gap Im, 2023. "A reconfigurable binary/ternary logic conversion-in-memory based on drain-aligned floating-gate heterojunction transistors," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    10. Yang, Ying & Zhang, Wei & Lin, Hongyi & Liu, Yang & Qu, Xiaobo, 2024. "Applying masked language model for transport mode choice behavior prediction," Transportation Research Part A: Policy and Practice, Elsevier, vol. 184(C).
    11. Weijia Liu & Zhijian Du & Zhongyi Duan & La Li & Guozhen Shen, 2024. "Neuroprosthetic contact lens enabled sensorimotor system for point-of-care monitoring and feedback of intraocular pressure," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    12. Yunlong Xu & Zhongda Sun & Zhiqing Bai & Hua Shen & Run Wen & Fumei Wang & Guangbiao Xu & Chengkuo Lee, 2024. "Bionic e-skin with precise multi-directional droplet sliding sensing for enhanced robotic perception," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    13. Ningning Bai & Yiheng Xue & Shuiqing Chen & Lin Shi & Junli Shi & Yuan Zhang & Xingyu Hou & Yu Cheng & Kaixi Huang & Weidong Wang & Jin Zhang & Yuan Liu & Chuan Fei Guo, 2023. "A robotic sensory system with high spatiotemporal resolution for texture recognition," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    14. Hang Zhang & Sankaran Sundaresan & Michael A. Webb, 2024. "Thermodynamic driving forces in contact electrification between polymeric materials," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    15. Yiming Liu & Chun Ki Yiu & Zhao Zhao & Wooyoung Park & Rui Shi & Xingcan Huang & Yuyang Zeng & Kuan Wang & Tsz Hung Wong & Shengxin Jia & Jingkun Zhou & Zhan Gao & Ling Zhao & Kuanming Yao & Jian Li &, 2023. "Soft, miniaturized, wireless olfactory interface for virtual reality," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    16. Pang, Yafeng & Zhu, Xingyi & Jin, Yiyang & Yang, Zichao & Liu, Shuainian & Shen, Lingjie & Li, Xinhong & Lee, Chengkuo, 2023. "Textile-inspired triboelectric nanogenerator as intelligent pavement energy harvester and self-powered skid resistance sensor," Applied Energy, Elsevier, vol. 348(C).
    17. Taemin Kim & Yejee Shin & Kyowon Kang & Kiho Kim & Gwanho Kim & Yunsu Byeon & Hwayeon Kim & Yuyan Gao & Jeong Ryong Lee & Geonhui Son & Taeseong Kim & Yohan Jun & Jihyun Kim & Jinyoung Lee & Seyun Um , 2022. "Ultrathin crystalline-silicon-based strain gauges with deep learning algorithms for silent speech interfaces," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    18. Chunpeng Jiang & Wenqiang Xu & Yutong Li & Zhenjun Yu & Longchun Wang & Xiaotong Hu & Zhengyi Xie & Qingkun Liu & Bin Yang & Xiaolin Wang & Wenxin Du & Tutian Tang & Dongzhe Zheng & Siqiong Yao & Cewu, 2024. "Capturing forceful interaction with deformable objects using a deep learning-powered stretchable tactile array," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    19. Hira Hameed & Muhammad Usman & Ahsen Tahir & Amir Hussain & Hasan Abbas & Tie Jun Cui & Muhammad Ali Imran & Qammer H. Abbasi, 2022. "Pushing the limits of remote RF sensing by reading lips under the face mask," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    20. Yiyue Luo & Chao Liu & Young Joong Lee & Joseph DelPreto & Kui Wu & Michael Foshey & Daniela Rus & Tomás Palacios & Yunzhu Li & Antonio Torralba & Wojciech Matusik, 2024. "Adaptive tactile interaction transfer via digitally embroidered smart gloves," Nature Communications, Nature, vol. 15(1), pages 1-13, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-39068-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.