IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v13y2022i1d10.1038_s41467-022-35483-z.html
   My bibliography  Save this article

Single-shot 3D imaging with point cloud projection based on metadevice

Author

Listed:
  • Xiaoli Jing

    (Beijing Institute of Technology)

  • Ruizhe Zhao

    (Beijing Institute of Technology)

  • Xin Li

    (Beijing Institute of Technology)

  • Qiang Jiang

    (Beijing Institute of Technology)

  • Chengzhi Li

    (Beijing Institute of Technology)

  • Guangzhou Geng

    (Chinese Academy of Sciences)

  • Junjie Li

    (Chinese Academy of Sciences)

  • Yongtian Wang

    (Beijing Institute of Technology)

  • Lingling Huang

    (Beijing Institute of Technology)

Abstract

Three-dimensional (3D) imaging is a crucial information acquisition technology for light detection, autonomous vehicles, gesture recognition, machine vision, and other applications. Metasurface, as a subwavelength scale two-dimensional array, offers flexible control of optical wavefront owing to abundant design freedom. Metasurfaces are promising for use as optical devices because they have large field of view and powerful functionality. In this study, we propose a flat optical device based on a single-layer metasurface to project a coded point cloud in the Fourier space and explore a sophisticated matching algorithm to achieve 3D reconstruction, offering a complete technical roadmap for single-shot detection. We experimentally demonstrate that the depth accuracy of our system is smaller than 0.24 mm at a measurement distance of 300 mm, indicating the feasibility of the submillimetre measurement platform. Our method can pave the way for practical applications such as surface shape detection, gesture recognition, and personal authentication.

Suggested Citation

  • Xiaoli Jing & Ruizhe Zhao & Xin Li & Qiang Jiang & Chengzhi Li & Guangzhou Geng & Junjie Li & Yongtian Wang & Lingling Huang, 2022. "Single-shot 3D imaging with point cloud projection based on metadevice," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    • Handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-35483-z
    DOI: 10.1038/s41467-022-35483-z
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-022-35483-z
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-022-35483-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Christopher Rogers & Alexander Y. Piggott & David J. Thomson & Robert F. Wiser & Ion E. Opris & Steven A. Fortune & Andrew J. Compston & Alexander Gondarenko & Fanfan Meng & Xia Chen & Graham T. Reed , 2021. "A universal 3D imaging sensor on a silicon photonics platform," Nature, Nature, vol. 590(7845), pages 256-261, February.
    2. Jongchan Park & KyeoReh Lee & YongKeun Park, 2019. "Ultrathin wide-angle large-area digital 3D holographic display using a non-periodic photon sieve," Nature Communications, Nature, vol. 10(1), pages 1-8, December.
    3. Kun Huang & Hong Liu & Francisco J. Garcia-Vidal & Minghui Hong & Boris Luk’yanchuk & Jinghua Teng & Cheng-Wei Qiu, 2015. "Ultrahigh-capacity non-periodic photon sieves operating in visible light," Nature Communications, Nature, vol. 6(1), pages 1-7, November.
    4. Qiyue Zhang & Wen Wen & Shixue Hu & Michael J. Benton & Changyong Zhou & Tao Xie & Tao Lü & Jinyuan Huang & Brian Choo & Zhong-Qiang Chen & Jun Liu & Qican Zhang, 2014. "Nothosaur foraging tracks from the Middle Triassic of southwestern China," Nature Communications, Nature, vol. 5(1), pages 1-12, September.
    5. Lingling Huang & Xianzhong Chen & Holger Mühlenbernd & Hao Zhang & Shumei Chen & Benfeng Bai & Qiaofeng Tan & Guofan Jin & Kok-Wai Cheah & Cheng-Wei Qiu & Jensen Li & Thomas Zentgraf & Shuang Zhang, 2013. "Three-dimensional optical holography using a plasmonic metasurface," Nature Communications, Nature, vol. 4(1), pages 1-8, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ethan Tseng & Grace Kuo & Seung-Hwan Baek & Nathan Matsuda & Andrew Maimone & Florian Schiffers & Praneeth Chakravarthula & Qiang Fu & Wolfgang Heidrich & Douglas Lanman & Felix Heide, 2024. "Neural étendue expander for ultra-wide-angle high-fidelity holographic display," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    2. Shiqiu Liu & Adam S Smith & Yuting Gu & Jie Tan & C Karen Liu & Greg Turk, 2015. "Computer Simulations Imply Forelimb-Dominated Underwater Flight in Plesiosaurs," PLOS Computational Biology, Public Library of Science, vol. 11(12), pages 1-18, December.
    3. Grigory Lihachev & Johann Riemensberger & Wenle Weng & Junqiu Liu & Hao Tian & Anat Siddharth & Viacheslav Snigirev & Vladimir Shadymov & Andrey Voloshin & Rui Ning Wang & Jijun He & Sunil A. Bhave & , 2022. "Low-noise frequency-agile photonic integrated lasers for coherent ranging," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    4. Pengcheng Chen & Xiaoyi Xu & Tianxin Wang & Chao Zhou & Dunzhao Wei & Jianan Ma & Junjie Guo & Xuejing Cui & Xiaoyan Cheng & Chenzhu Xie & Shuang Zhang & Shining Zhu & Min Xiao & Yong Zhang, 2023. "Laser nanoprinting of 3D nonlinear holograms beyond 25000 pixels-per-inch for inter-wavelength-band information processing," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    5. Changwon Jang & Kiseung Bang & Minseok Chae & Byoungho Lee & Douglas Lanman, 2024. "Waveguide holography for 3D augmented reality glasses," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    6. Phillip S. Blakey & Han Liu & Georgios Papangelakis & Yutian Zhang & Zacharie M. Léger & Meng Lon Iu & Amr S. Helmy, 2022. "Quantum and non-local effects offer over 40 dB noise resilience advantage towards quantum lidar," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    7. Xiaohua Feng & Yayao Ma & Liang Gao, 2022. "Compact light field photography towards versatile three-dimensional vision," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    8. Anton Lukashchuk & Halil Kerim Yildirim & Andrea Bancora & Grigory Lihachev & Yang Liu & Zheru Qiu & Xinru Ji & Andrey Voloshin & Sunil A. Bhave & Edoardo Charbon & Tobias J. Kippenberg, 2024. "Photonic-electronic integrated circuit-based coherent LiDAR engine," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    9. Anton Lukashchuk & Johann Riemensberger & Maxim Karpov & Junqiu Liu & Tobias J. Kippenberg, 2022. "Dual chirped microcomb based parallel ranging at megapixel-line rates," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    10. Dawoon Jeong & Hansol Jang & Min Uk Jung & Taeho Jeong & Hyunsoo Kim & Sanghyeok Yang & Janghyeon Lee & Chang-Seok Kim, 2024. "Spatio-spectral 4D coherent ranging using a flutter-wavelength-swept laser," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    11. Renato Juliano Martins & Emil Marinov & M. Aziz Ben Youssef & Christina Kyrou & Mathilde Joubert & Constance Colmagro & Valentin Gâté & Colette Turbil & Pierre-Marie Coulon & Daniel Turover & Samira K, 2022. "Metasurface-enhanced light detection and ranging technology," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    12. Qiuhong Cheng & Aiyou Hao & Pengyao Xing, 2021. "A chemosensor-based chiral coassembly with switchable circularly polarized luminescence," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    13. Zicheng Shen & Feng Zhao & Chunqi Jin & Shuai Wang & Liangcai Cao & Yuanmu Yang, 2023. "Monocular metasurface camera for passive single-shot 4D imaging," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    14. Jun He & Dong Zhao & Hong Liu & Jinghua Teng & Cheng-Wei Qiu & Kun Huang, 2023. "An entropy-controlled objective chip for reflective confocal microscopy with subdiffraction-limit resolution," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    15. Sudip Shekhar & Wim Bogaerts & Lukas Chrostowski & John E. Bowers & Michael Hochberg & Richard Soref & Bhavin J. Shastri, 2024. "Roadmapping the next generation of silicon photonics," Nature Communications, Nature, vol. 15(1), pages 1-15, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:13:y:2022:i:1:d:10.1038_s41467-022-35483-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.