IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-45296-x.html
   My bibliography  Save this article

Vision-driven metasurfaces for perception enhancement

Author

Listed:
  • Tianshuo Qiu

    (Fourth Military Medical University
    Air Force Engineering University
    Southeast University)

  • Qiang An

    (Fourth Military Medical University)

  • Jianqi Wang

    (Fourth Military Medical University)

  • Jiafu Wang

    (Aerospace metamaterials laboratory of SuZhou National Laboratory)

  • Cheng-Wei Qiu

    (National University of Singapore)

  • Shiyong Li

    (Beijing Institute of Technology)

  • Hao Lv

    (Fourth Military Medical University)

  • Ming Cai

    (Air Force Engineering University)

  • Jianyi Wang

    (the First Affiliated Hospital of Xi’an Jiaotong University)

  • Lin Cong

    (Fourth Military Medical University)

  • Shaobo Qu

    (Aerospace metamaterials laboratory of SuZhou National Laboratory)

Abstract

Metasurfaces have exhibited unprecedented degree of freedom in manipulating electromagnetic (EM) waves and thus provide fantastic front-end interfaces for smart systems. Here we show a framework for perception enhancement based on vision-driven metasurface. Human’s eye movements are matched with microwave radiations to extend the humans’ perception spectrum. By this means, our eyes can “sense” visual information and invisible microwave information. Several experimental demonstrations are given for specific implementations, including a physiological-signal-monitoring system, an “X-ray-glasses” system, a “glimpse-and-forget” tracking system and a speech reception system for deaf people. Both the simulation and experiment results verify evident advantages in perception enhancement effects and improving information acquisition efficiency. This framework can be readily integrated into healthcare systems to monitor physiological signals and to offer assistance for people with disabilities. This work provides an alternative framework for perception enhancement and may find wide applications in healthcare, wearable devices, search-and-rescue and others.

Suggested Citation

  • Tianshuo Qiu & Qiang An & Jianqi Wang & Jiafu Wang & Cheng-Wei Qiu & Shiyong Li & Hao Lv & Ming Cai & Jianyi Wang & Lin Cong & Shaobo Qu, 2024. "Vision-driven metasurfaces for perception enhancement," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-45296-x
    DOI: 10.1038/s41467-024-45296-x
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-45296-x
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-024-45296-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Si Ran Wang & Jun Yan Dai & Qun Yan Zhou & Jun Chen Ke & Qiang Cheng & Tie Jun Cui, 2023. "Manipulations of multi-frequency waves and signals via multi-partition asynchronous space-time-coding digital metasurface," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    2. Davi D. Bock & Wei-Chung Allen Lee & Aaron M. Kerlin & Mark L. Andermann & Greg Hood & Arthur W. Wetzel & Sergey Yurgenson & Edward R. Soucy & Hyon Suk Kim & R. Clay Reid, 2011. "Network anatomy and in vivo physiology of visual cortical neurons," Nature, Nature, vol. 471(7337), pages 177-182, March.
    3. Weihan Li & Qian Ma & Che Liu & Yunfeng Zhang & Xianning Wu & Jiawei Wang & Shizhao Gao & Tianshuo Qiu & Tonghao Liu & Qiang Xiao & Jiaxuan Wei & Ting Ting Gu & Zhize Zhou & Fashuai Li & Qiang Cheng &, 2023. "Intelligent metasurface system for automatic tracking of moving targets and wireless communications based on computer vision," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    4. Leonard C. Kogos & Yunzhe Li & Jianing Liu & Yuyu Li & Lei Tian & Roberto Paiella, 2020. "Plasmonic ommatidia for lensless compound-eye vision," Nature Communications, Nature, vol. 11(1), pages 1-9, December.
    5. Lianlin Li & Tie Jun Cui & Wei Ji & Shuo Liu & Jun Ding & Xiang Wan & Yun Bo Li & Menghua Jiang & Cheng-Wei Qiu & Shuang Zhang, 2017. "Electromagnetic reprogrammable coding-metasurface holograms," Nature Communications, Nature, vol. 8(1), pages 1-7, December.
    6. Jérôme Sol & David R. Smith & Philipp Hougne, 2022. "Meta-programmable analog differentiator," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    7. Huan Lu & Jiwei Zhao & Bin Zheng & Chao Qian & Tong Cai & Erping Li & Hongsheng Chen, 2023. "Eye accommodation-inspired neuro-metasurface focusing," Nature Communications, Nature, vol. 14(1), pages 1-7, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wenzhi Li & Qiyue Yu & Jing Hui Qiu & Jiaran Qi, 2024. "Intelligent wireless power transfer via a 2-bit compact reconfigurable transmissive-metasurface-based router," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    2. Xin Wang & Jia Qi Han & Guan Xuan Li & De Xiao Xia & Ming Yang Chang & Xiang Jin Ma & Hao Xue & Peng Xu & Rui Jie Li & Kun Yi Zhang & Hai Xia Liu & Long Li & Tie Jun Cui, 2023. "High-performance cost efficient simultaneous wireless information and power transfers deploying jointly modulated amplifying programmable metasurface," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    3. Hiroki Takeshita & Ashif Aminulloh Fathnan & Daisuke Nita & Atsuko Nagata & Shinya Sugiura & Hiroki Wakatsuchi, 2024. "Frequency-hopping wave engineering with metasurfaces," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    4. Xiaopeng Feng & Yuhong He & Wei Qu & Jinmei Song & Wanting Pan & Mingrui Tan & Bai Yang & Haotong Wei, 2022. "Spray-coated perovskite hemispherical photodetector featuring narrow-band and wide-angle imaging," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    5. Shang, Ke-ke & Small, Michael & Yan, Wei-sheng, 2017. "Link direction for link prediction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 469(C), pages 767-776.
    6. Volker Pernice & Benjamin Staude & Stefano Cardanobile & Stefan Rotter, 2011. "How Structure Determines Correlations in Neuronal Networks," PLOS Computational Biology, Public Library of Science, vol. 7(5), pages 1-14, May.
    7. Jérôme Sol & David R. Smith & Philipp Hougne, 2022. "Meta-programmable analog differentiator," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    8. Jing Cheng Liang & Lei Zhang & Zhangjie Luo & Rui Zhe Jiang & Zhang Wen Cheng & Si Ran Wang & Meng Ke Sun & Shi Jin & Qiang Cheng & Tie Jun Cui, 2024. "A filtering reconfigurable intelligent surface for interference-free wireless communications," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    9. Qingbin Fan & Weizhu Xu & Xuemei Hu & Wenqi Zhu & Tao Yue & Cheng Zhang & Feng Yan & Lu Chen & Henri J. Lezec & Yanqing Lu & Amit Agrawal & Ting Xu, 2022. "Trilobite-inspired neural nanophotonic light-field camera with extreme depth-of-field," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    10. Jérôme Sol & Hugo Prod’homme & Luc Le Magoarou & Philipp del Hougne, 2024. "Experimentally realized physical-model-based frugal wave control in metasurface-programmable complex media," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    11. Anton Kocheturov & Panos M. Pardalos & Athanasia Karakitsiou, 2019. "Massive datasets and machine learning for computational biomedicine: trends and challenges," Annals of Operations Research, Springer, vol. 276(1), pages 5-34, May.
    12. Sergiy Popovych & Thomas Macrina & Nico Kemnitz & Manuel Castro & Barak Nehoran & Zhen Jia & J. Alexander Bae & Eric Mitchell & Shang Mu & Eric T. Trautman & Stephan Saalfeld & Kai Li & H. Sebastian S, 2024. "Petascale pipeline for precise alignment of images from serial section electron microscopy," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    13. Anna Kreshuk & Ullrich Koethe & Elizabeth Pax & Davi D Bock & Fred A Hamprecht, 2014. "Automated Detection of Synapses in Serial Section Transmission Electron Microscopy Image Stacks," PLOS ONE, Public Library of Science, vol. 9(2), pages 1-11, February.
    14. Huan Lu & Jiwei Zhao & Bin Zheng & Chao Qian & Tong Cai & Erping Li & Hongsheng Chen, 2023. "Eye accommodation-inspired neuro-metasurface focusing," Nature Communications, Nature, vol. 14(1), pages 1-7, December.
    15. Umberto Esposito & Michele Giugliano & Mark van Rossum & Eleni Vasilaki, 2014. "Measuring Symmetry, Asymmetry and Randomness in Neural Network Connectivity," PLOS ONE, Public Library of Science, vol. 9(7), pages 1-16, July.
    16. Ryan C Williamson & Benjamin R Cowley & Ashok Litwin-Kumar & Brent Doiron & Adam Kohn & Matthew A Smith & Byron M Yu, 2016. "Scaling Properties of Dimensionality Reduction for Neural Populations and Network Models," PLOS Computational Biology, Public Library of Science, vol. 12(12), pages 1-27, December.
    17. Stefano Recanatesi & Gabriel Koch Ocker & Michael A Buice & Eric Shea-Brown, 2019. "Dimensionality in recurrent spiking networks: Global trends in activity and local origins in connectivity," PLOS Computational Biology, Public Library of Science, vol. 15(7), pages 1-29, July.
    18. Weihan Li & Qian Ma & Che Liu & Yunfeng Zhang & Xianning Wu & Jiawei Wang & Shizhao Gao & Tianshuo Qiu & Tonghao Liu & Qiang Xiao & Jiaxuan Wei & Ting Ting Gu & Zhize Zhou & Fashuai Li & Qiang Cheng &, 2023. "Intelligent metasurface system for automatic tracking of moving targets and wireless communications based on computer vision," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    19. Zijian Shi & Zhensong Wan & Ziyu Zhan & Kaige Liu & Qiang Liu & Xing Fu, 2023. "Super-resolution orbital angular momentum holography," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    20. Erda Wen & Xiaozhen Yang & Daniel F. Sievenpiper, 2023. "Real-data-driven real-time reconfigurable microwave reflective surface," Nature Communications, Nature, vol. 14(1), pages 1-8, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-45296-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.