IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v14y2023i1d10.1038_s41467-023-36645-3.html
   My bibliography  Save this article

Intelligent metasurface system for automatic tracking of moving targets and wireless communications based on computer vision

Author

Listed:
  • Weihan Li

    (Southeast University)

  • Qian Ma

    (Southeast University)

  • Che Liu

    (Southeast University)

  • Yunfeng Zhang

    (Southeast University)

  • Xianning Wu

    (Air Force Engineering University)

  • Jiawei Wang

    (Southeast University)

  • Shizhao Gao

    (Southeast University)

  • Tianshuo Qiu

    (Air Force Engineering University)

  • Tonghao Liu

    (Air Force Engineering University)

  • Qiang Xiao

    (Southeast University)

  • Jiaxuan Wei

    (Southeast University)

  • Ting Ting Gu

    (Zhejiang University)

  • Zhize Zhou

    (Zhejiang University)

  • Fashuai Li

    (Zhejiang University)

  • Qiang Cheng

    (Southeast University)

  • Lianlin Li

    (Peking University)

  • Wenxuan Tang

    (Southeast University)

  • Tie Jun Cui

    (Southeast University)

Abstract

The fifth-generation (5G) wireless communication has an urgent need for target tracking. Digital programmable metasurface (DPM) may offer an intelligent and efficient solution owing to its powerful and flexible controls of electromagnetic waves and advantages of lower cost, less complexity and smaller size than the traditional antenna array. Here, we report an intelligent metasurface system to perform target tracking and wireless communications, in which computer vision integrated with a convolutional neural network (CNN) is used to automatically detect the locations of moving targets, and the dual-polarized DPM integrated with a pre-trained artificial neural network (ANN) serves to realize the smart beam tracking and wireless communications. Three groups of experiments are conducted for demonstrating the intelligent system: detection and identification of moving targets, detection of radio-frequency signals, and real-time wireless communications. The proposed method sets the stage for an integrated implementation of target identification, radio environment tracking, and wireless communications. This strategy opens up an avenue for intelligent wireless networks and self-adaptive systems.

Suggested Citation

  • Weihan Li & Qian Ma & Che Liu & Yunfeng Zhang & Xianning Wu & Jiawei Wang & Shizhao Gao & Tianshuo Qiu & Tonghao Liu & Qiang Xiao & Jiaxuan Wei & Ting Ting Gu & Zhize Zhou & Fashuai Li & Qiang Cheng &, 2023. "Intelligent metasurface system for automatic tracking of moving targets and wireless communications based on computer vision," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
  • Handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-36645-3
    DOI: 10.1038/s41467-023-36645-3
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-36645-3
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-023-36645-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Yueyi Yuan & Kuang Zhang & Badreddine Ratni & Qinghua Song & Xumin Ding & Qun Wu & Shah Nawaz Burokur & Patrice Genevet, 2020. "Independent phase modulation for quadruplex polarization channels enabled by chirality-assisted geometric-phase metasurfaces," Nature Communications, Nature, vol. 11(1), pages 1-9, December.
    2. Xingjie Ni & Alexander V. Kildishev & Vladimir M. Shalaev, 2013. "Metasurface holograms for visible light," Nature Communications, Nature, vol. 4(1), pages 1-6, December.
    3. Lianlin Li & Tie Jun Cui & Wei Ji & Shuo Liu & Jun Ding & Xiang Wan & Yun Bo Li & Menghua Jiang & Cheng-Wei Qiu & Shuang Zhang, 2017. "Electromagnetic reprogrammable coding-metasurface holograms," Nature Communications, Nature, vol. 8(1), pages 1-7, December.
    4. Hou-Tong Chen & Willie J. Padilla & Joshua M. O. Zide & Arthur C. Gossard & Antoinette J. Taylor & Richard D. Averitt, 2006. "Active terahertz metamaterial devices," Nature, Nature, vol. 444(7119), pages 597-600, November.
    5. Lianlin Li & Hengxin Ruan & Che Liu & Ying Li & Ya Shuang & Andrea Alù & Cheng-Wei Qiu & Tie Jun Cui, 2019. "Machine-learning reprogrammable metasurface imager," Nature Communications, Nature, vol. 10(1), pages 1-8, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xin Wang & Jia Qi Han & Guan Xuan Li & De Xiao Xia & Ming Yang Chang & Xiang Jin Ma & Hao Xue & Peng Xu & Rui Jie Li & Kun Yi Zhang & Hai Xia Liu & Long Li & Tie Jun Cui, 2023. "High-performance cost efficient simultaneous wireless information and power transfers deploying jointly modulated amplifying programmable metasurface," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    2. Tianshuo Qiu & Qiang An & Jianqi Wang & Jiafu Wang & Cheng-Wei Qiu & Shiyong Li & Hao Lv & Ming Cai & Jianyi Wang & Lin Cong & Shaobo Qu, 2024. "Vision-driven metasurfaces for perception enhancement," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    3. Erda Wen & Xiaozhen Yang & Daniel F. Sievenpiper, 2023. "Real-data-driven real-time reconfigurable microwave reflective surface," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    4. Wenzhi Li & Qiyue Yu & Jing Hui Qiu & Jiaran Qi, 2024. "Intelligent wireless power transfer via a 2-bit compact reconfigurable transmissive-metasurface-based router," Nature Communications, Nature, vol. 15(1), pages 1-10, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liheng Bian & Daoyu Li & Shuoguang Wang & Chunyang Teng & Jinxuan Wu & Huteng Liu & Hanwen Xu & Xuyang Chang & Guoqiang Zhao & Shiyong Li & Jun Zhang, 2024. "Towards large-scale single-shot millimeter-wave imaging for low-cost security inspection," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    2. Hiroki Takeshita & Ashif Aminulloh Fathnan & Daisuke Nita & Atsuko Nagata & Shinya Sugiura & Hiroki Wakatsuchi, 2024. "Frequency-hopping wave engineering with metasurfaces," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    3. Zi Wang & Lorry Chang & Feifan Wang & Tiantian Li & Tingyi Gu, 2022. "Integrated photonic metasystem for image classifications at telecommunication wavelength," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    4. Wenzhi Li & Qiyue Yu & Jing Hui Qiu & Jiaran Qi, 2024. "Intelligent wireless power transfer via a 2-bit compact reconfigurable transmissive-metasurface-based router," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    5. Zhiyao Ma & Tian Tian & Yuxuan Liao & Xue Feng & Yongzhuo Li & Kaiyu Cui & Fang Liu & Hao Sun & Wei Zhang & Yidong Huang, 2024. "Electrically switchable 2N-channel wave-front control for certain functionalities with N cascaded polarization-dependent metasurfaces," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    6. Huan Lu & Jiwei Zhao & Bin Zheng & Chao Qian & Tong Cai & Erping Li & Hongsheng Chen, 2023. "Eye accommodation-inspired neuro-metasurface focusing," Nature Communications, Nature, vol. 14(1), pages 1-7, December.
    7. Xin Wang & Jia Qi Han & Guan Xuan Li & De Xiao Xia & Ming Yang Chang & Xiang Jin Ma & Hao Xue & Peng Xu & Rui Jie Li & Kun Yi Zhang & Hai Xia Liu & Long Li & Tie Jun Cui, 2023. "High-performance cost efficient simultaneous wireless information and power transfers deploying jointly modulated amplifying programmable metasurface," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    8. Hongrui Zhang & Yanjin Chen & Zhuo Wang & Tie Jun Cui & Philipp Hougne & Lianlin Li, 2024. "Semantic regularization of electromagnetic inverse problems," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    9. Yueqiang Hu & Yuting Jiang & Yi Zhang & Xing Yang & Xiangnian Ou & Ling Li & Xianghong Kong & Xingsi Liu & Cheng-Wei Qiu & Huigao Duan, 2023. "Asymptotic dispersion engineering for ultra-broadband meta-optics," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    10. Cristiano Bortolotti & Federico Grandi & Matteo Butti & Lorenzo Gatto & Francesco Modena & Christina Kousseff & Iain McCulloch & Caterina Vozzi & Mario Caironi & Eugenio Cinquanta & Giorgio Ernesto Bo, 2024. "Tuning direct-written terahertz metadevices with organic mixed ion-electron conductors," Nature Communications, Nature, vol. 15(1), pages 1-7, December.
    11. Claudio U. Hail & Morgan Foley & Ruzan Sokhoyan & Lior Michaeli & Harry A. Atwater, 2023. "High quality factor metasurfaces for two-dimensional wavefront manipulation," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    12. Jérôme Sol & David R. Smith & Philipp Hougne, 2022. "Meta-programmable analog differentiator," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    13. S. W. Jun & Y. H. Ahn, 2022. "Terahertz thermal curve analysis for label-free identification of pathogens," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    14. Leal Filho, Walter & Wall, Tony & Rui Mucova, Serafino Afonso & Nagy, Gustavo J. & Balogun, Abdul-Lateef & Luetz, Johannes M. & Ng, Artie W. & Kovaleva, Marina & Safiul Azam, Fardous Mohammad & Alves,, 2022. "Deploying artificial intelligence for climate change adaptation," Technological Forecasting and Social Change, Elsevier, vol. 180(C).
    15. Qingbin Fan & Weizhu Xu & Xuemei Hu & Wenqi Zhu & Tao Yue & Cheng Zhang & Feng Yan & Lu Chen & Henri J. Lezec & Yanqing Lu & Amit Agrawal & Ting Xu, 2022. "Trilobite-inspired neural nanophotonic light-field camera with extreme depth-of-field," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    16. Zong-Lin Li & Kun Chen & Fei Li & Zhi-Jun Shi & Qi-Li Sun & Peng-Qi Li & Yu-Gui Peng & Lai-Xin Huang & Guang Yang & Hairong Zheng & Xue-Feng Zhu, 2023. "Decorated bacteria-cellulose ultrasonic metasurface," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    17. Yue Wu & Ji Chen & Yin Wang & Zhongyi Yuan & Chunyu Huang & Jiacheng Sun & Chengyi Feng & Muyang Li & Kai Qiu & Shining Zhu & Zaichen Zhang & Tao Li, 2024. "Tbps wide-field parallel optical wireless communications based on a metasurface beam splitter," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    18. Xiujuan Zou & Youming Zhang & Ruoyu Lin & Guangxing Gong & Shuming Wang & Shining Zhu & Zhenlin Wang, 2022. "Pixel-level Bayer-type colour router based on metasurfaces," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    19. Yinan Zhang & Shengting Zhu & Jinming Hu & Min Gu, 2024. "Femtosecond laser direct nanolithography of perovskite hydration for temporally programmable holograms," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    20. Georgy Ermolaev & Kirill Voronin & Denis G. Baranov & Vasyl Kravets & Gleb Tselikov & Yury Stebunov & Dmitry Yakubovsky & Sergey Novikov & Andrey Vyshnevyy & Arslan Mazitov & Ivan Kruglov & Sergey Zhu, 2022. "Topological phase singularities in atomically thin high-refractive-index materials," Nature Communications, Nature, vol. 13(1), pages 1-9, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-36645-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.