IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v13y2022i1d10.1038_s41467-022-30377-6.html
   My bibliography  Save this article

Dynamic recognition and mirage using neuro-metamaterials

Author

Listed:
  • Chao Qian

    (Zhejiang University
    Zhejiang University
    Zhejiang University)

  • Zhedong Wang

    (Zhejiang University
    Zhejiang University
    Zhejiang University)

  • Haoliang Qian

    (Zhejiang University
    Zhejiang University
    Zhejiang University)

  • Tong Cai

    (Zhejiang University
    Zhejiang University
    Zhejiang University)

  • Bin Zheng

    (Zhejiang University
    Zhejiang University
    Zhejiang University)

  • Xiao Lin

    (Zhejiang University
    Zhejiang University
    Zhejiang University)

  • Yichen Shen

    (Lightelligence Inc.)

  • Ido Kaminer

    (Technion–Israel Institute of Technology)

  • Erping Li

    (Zhejiang University
    Zhejiang University
    Zhejiang University)

  • Hongsheng Chen

    (Zhejiang University
    Zhejiang University
    Zhejiang University)

Abstract

Breakthroughs in the field of object recognition facilitate ubiquitous applications in the modern world, ranging from security and surveillance equipment to accessibility devices for the visually impaired. Recently-emerged optical computing provides a fundamentally new computing modality to accelerate its solution with photons; however, it still necessitates digital processing for in situ application, inextricably tied to Moore’s law. Here, from an entirely optical perspective, we introduce the concept of neuro-metamaterials that can be applied to realize a dynamic object- recognition system. The neuro-metamaterials are fabricated from inhomogeneous metamaterials or transmission metasurfaces, and optimized using, such as topology optimization and deep learning. We demonstrate the concept in experiments where living rabbits play freely in front of the neuro-metamaterials, which enable to perceive in light speed the rabbits’ representative postures. Furthermore, we show how this capability enables a new physical mechanism for creating dynamic optical mirages, through which a sequence of rabbit movements is converted into a holographic video of a different animal. Our work provides deep insight into how metamaterials could facilitate a myriad of in situ applications, such as illusive cloaking and speed-of-light information display, processing, and encryption, possibly ushering in an “Optical Internet of Things” era.

Suggested Citation

  • Chao Qian & Zhedong Wang & Haoliang Qian & Tong Cai & Bin Zheng & Xiao Lin & Yichen Shen & Ido Kaminer & Erping Li & Hongsheng Chen, 2022. "Dynamic recognition and mirage using neuro-metamaterials," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
  • Handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-30377-6
    DOI: 10.1038/s41467-022-30377-6
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-022-30377-6
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-022-30377-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Tengfeng Zhu & Yihan Zhou & Yijie Lou & Hui Ye & Min Qiu & Zhichao Ruan & Shanhui Fan, 2017. "Plasmonic computing of spatial differentiation," Nature Communications, Nature, vol. 8(1), pages 1-6, August.
    2. Jingkai Weng & Yujiang Ding & Chengbo Hu & Xue-Feng Zhu & Bin Liang & Jing Yang & Jianchun Cheng, 2020. "Meta-neural-network for real-time and passive deep-learning-based object recognition," Nature Communications, Nature, vol. 11(1), pages 1-8, December.
    3. Nicolas K. Fontaine & Roland Ryf & Haoshuo Chen & David T. Neilson & Kwangwoong Kim & Joel Carpenter, 2019. "Laguerre-Gaussian mode sorter," Nature Communications, Nature, vol. 10(1), pages 1-7, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chao Qian & Yi Yang & Yifei Hua & Chan Wang & Xiao Lin & Tong Cai & Dexin Ye & Erping Li & Ido Kaminer & Hongsheng Chen, 2022. "Breaking the fundamental scattering limit with gain metasurfaces," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    2. Zhixiang Fan & Chao Qian & Yuetian Jia & Yiming Feng & Haoliang Qian & Er-Ping Li & Romain Fleury & Hongsheng Chen, 2024. "Holographic multiplexing metasurface with twisted diffractive neural network," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    3. Xinxin Gao & Ze Gu & Qian Ma & Bao Jie Chen & Kam-Man Shum & Wen Yi Cui & Jian Wei You & Tie Jun Cui & Chi Hou Chan, 2024. "Terahertz spoof plasmonic neural network for diffractive information recognition and processing," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    4. Jieting Chen & Chao Qian & Jie Zhang & Yuetian Jia & Hongsheng Chen, 2023. "Correlating metasurface spectra with a generation-elimination framework," Nature Communications, Nature, vol. 14(1), pages 1-9, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rodrigo Gutiérrez-Cuevas & Dorian Bouchet & Julien Rosny & Sébastien M. Popoff, 2024. "Reaching the precision limit with tensor-based wavefront shaping," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    2. Michele Cotrufo & Shaban B. Sulejman & Lukas Wesemann & Md. Ataur Rahman & Madhu Bhaskaran & Ann Roberts & Andrea Alù, 2024. "Reconfigurable image processing metasurfaces with phase-change materials," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    3. Yurou Jia & Suying Zhang & Xuan Zhang & Houyou Long & Caibin Xu & Yechao Bai & Ying Cheng & Dajian Wu & Mingxi Deng & Cheng-Wei Qiu & Xiaojun Liu, 2024. "Compact meta-differentiator for achieving isotropically high-contrast ultrasonic imaging," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    4. Zi Wang & Lorry Chang & Feifan Wang & Tiantian Li & Tingyi Gu, 2022. "Integrated photonic metasystem for image classifications at telecommunication wavelength," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    5. Pengcheng Huo & Le Tan & Yaqi Jin & Yanzeng Zhang & Mingze Liu & Peicheng Lin & Song Zhang & Yilin Wang & Haiyang Ren & Yanqing Lu & Ting Xu, 2024. "Broadband and parallel multiple-order optical spatial differentiation enabled by Bessel vortex modulated metalens," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    6. Xin Liu & Qian Cao & Nianjia Zhang & Andy Chong & Yangjian Cai & Qiwen Zhan, 2024. "Spatiotemporal optical vortices with controllable radial and azimuthal quantum numbers," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    7. Martin Plöschner & Marcos Maestre Morote & Daniel Stephen Dahl & Mickael Mounaix & Greta Light & Aleksandar D. Rakić & Joel Carpenter, 2022. "Spatial tomography of light resolved in time, spectrum, and polarisation," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    8. Jérôme Sol & David R. Smith & Philipp Hougne, 2022. "Meta-programmable analog differentiator," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    9. Kaihang Lu & Zengqi Chen & Hao Chen & Wu Zhou & Zunyue Zhang & Hon Ki Tsang & Yeyu Tong, 2024. "Empowering high-dimensional optical fiber communications with integrated photonic processors," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    10. Ugo Zanforlin & Cosmo Lupo & Peter W. R. Connolly & Pieter Kok & Gerald S. Buller & Zixin Huang, 2022. "Optical quantum super-resolution imaging and hypothesis testing," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    11. Zhuochao Wang & Guangwei Hu & Xinwei Wang & Xumin Ding & Kuang Zhang & Haoyu Li & Shah Nawaz Burokur & Qun Wu & Jian Liu & Jiubin Tan & Cheng-Wei Qiu, 2022. "Single-layer spatial analog meta-processor for imaging processing," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    12. Raoul Trines & Holger Schmitz & Martin King & Paul McKenna & Robert Bingham, 2024. "Laser harmonic generation with independent control of frequency and orbital angular momentum," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    13. Ming Deng & Michele Cotrufo & Jian Wang & Jianji Dong & Zhichao Ruan & Andrea Alù & Lin Chen, 2024. "Broadband angular spectrum differentiation using dielectric metasurfaces," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    14. Kaiheng Zou & Kai Pang & Hao Song & Jintao Fan & Zhe Zhao & Haoqian Song & Runzhou Zhang & Huibin Zhou & Amir Minoofar & Cong Liu & Xinzhou Su & Nanzhe Hu & Andrew McClung & Mahsa Torfeh & Amir Arbabi, 2022. "High-capacity free-space optical communications using wavelength- and mode-division-multiplexing in the mid-infrared region," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    15. Xinwei Wang & Hao Wang & Jinlu Wang & Xingsi Liu & Huijie Hao & You Sin Tan & Yilei Zhang & He Zhang & Xiangyan Ding & Weisong Zhao & Yuhang Wang & Zhengang Lu & Jian Liu & Joel K. W. Yang & Jiubin Ta, 2023. "Single-shot isotropic differential interference contrast microscopy," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    16. Zi-Lan Deng & Meng-Xia Hu & Shanfeng Qiu & Xianfeng Wu & Adam Overvig & Xiangping Li & Andrea Alù, 2024. "Poincaré sphere trajectory encoding metasurfaces based on generalized Malus’ law," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    17. Yang Liu & Mingchuan Huang & Qiankun Chen & Douguo Zhang, 2022. "Single planar photonic chip with tailored angular transmission for multiple-order analog spatial differentiator," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    18. Pengyu Fu & Zimeng Xu & Tiankuang Zhou & Hao Li & Jiamin Wu & Qionghai Dai & Yue Li, 2024. "Reconfigurable metamaterial processing units that solve arbitrary linear calculus equations," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    19. Michele Cotrufo & Akshaj Arora & Sahitya Singh & Andrea Alù, 2023. "Dispersion engineered metasurfaces for broadband, high-NA, high-efficiency, dual-polarization analog image processing," Nature Communications, Nature, vol. 14(1), pages 1-9, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-30377-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.