IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-53747-8.html
   My bibliography  Save this article

SpectraTrack: megapixel, hundred-fps, and thousand-channel hyperspectral imaging

Author

Listed:
  • Daoyu Li

    (Beijing Institute of Technology)

  • Jinxuan Wu

    (Beijing Institute of Technology)

  • Jiajun Zhao

    (Beijing Institute of Technology)

  • Hanwen Xu

    (Beijing Institute of Technology)

  • Liheng Bian

    (Beijing Institute of Technology)

Abstract

Hyperspectral imaging (HSI) finds broad applications in various fields due to its substantial optical signatures for the intrinsic identification of physical and chemical characteristics. However, it faces the inherent challenge of balancing spatial, temporal, and spectral resolution due to limited bandwidth. Here we present SpectraTrack, a computational HSI scheme that simultaneously achieves high spatial, temporal, and spectral resolution in the visible-to-near-infrared (VIS-NIR) spectral range. We deeply investigated the spatio-temporal-spectral multiplexing principle inherent in HSI videos. Based on this theoretical foundation, the SpectraTrack system uses two cameras including a line-scan imaging spectrometer for temporal-multiplexed hyperspectral data and an auxiliary RGB camera to capture motion flow. The motion flow guides hyperspectral reconstruction by reintegrating the scanned spectra into a 4D video. The SpectraTrack system can achieve around megapixel HSI at 100 fps with 1200 spectral channels, demonstrating its great application potential from drone-based anti-vibration video-rate HSI to high-throughput non-cooperative anti-spoofing.

Suggested Citation

  • Daoyu Li & Jinxuan Wu & Jiajun Zhao & Hanwen Xu & Liheng Bian, 2024. "SpectraTrack: megapixel, hundred-fps, and thousand-channel hyperspectral imaging," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
  • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-53747-8
    DOI: 10.1038/s41467-024-53747-8
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-53747-8
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-024-53747-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jongchan Park & Xiaohua Feng & Rongguang Liang & Liang Gao, 2020. "Snapshot multidimensional photography through active optical mapping," Nature Communications, Nature, vol. 11(1), pages 1-13, December.
    2. Alex M. Valm & Sarah Cohen & Wesley R. Legant & Justin Melunis & Uri Hershberg & Eric Wait & Andrew R. Cohen & Michael W. Davidson & Eric Betzig & Jennifer Lippincott-Schwartz, 2017. "Applying systems-level spectral imaging and analysis to reveal the organelle interactome," Nature, Nature, vol. 546(7656), pages 162-167, June.
    3. V. Backman & M. B. Wallace & L. T. Perelman & J. T. Arendt & R. Gurjar & M. G. Müller & Q. Zhang & G. Zonios & E. Kline & T. McGillican & S. Shapshay & T. Valdez & K. Badizadegan & J. M. Crawford & M., 2000. "Detection of preinvasive cancer cells," Nature, Nature, vol. 406(6791), pages 35-36, July.
    4. Fanglin Bao & Xueji Wang & Shree Hari Sureshbabu & Gautam Sreekumar & Liping Yang & Vaneet Aggarwal & Vishnu N. Boddeti & Zubin Jacob, 2023. "Heat-assisted detection and ranging," Nature, Nature, vol. 619(7971), pages 743-748, July.
    5. Yibo Xu & Liyang Lu & Vishwanath Saragadam & Kevin F. Kelly, 2024. "A compressive hyperspectral video imaging system using a single-pixel detector," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Archibald Enninful & Alev Baysoy & Rong Fan, 2022. "Unmixing for ultra-high-plex fluorescence imaging," Nature Communications, Nature, vol. 13(1), pages 1-3, December.
    2. Katelyn C. Cook & Elene Tsopurashvili & Jason M. Needham & Sunnie R. Thompson & Ileana M. Cristea, 2022. "Restructured membrane contacts rewire organelles for human cytomegalovirus infection," Nature Communications, Nature, vol. 13(1), pages 1-20, December.
    3. Raja Chouket & Agnès Pellissier-Tanon & Aliénor Lahlou & Ruikang Zhang & Diana Kim & Marie-Aude Plamont & Mingshu Zhang & Xi Zhang & Pingyong Xu & Nicolas Desprat & Dominique Bourgeois & Agathe Espagn, 2022. "Extra kinetic dimensions for label discrimination," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    4. Güneş Parlakgül & Song Pang & Leonardo L. Artico & Nina Min & Erika Cagampan & Reyna Villa & Renata L. S. Goncalves & Grace Yankun Lee & C. Shan Xu & Gökhan S. Hotamışlıgil & Ana Paula Arruda, 2024. "Spatial mapping of hepatic ER and mitochondria architecture reveals zonated remodeling in fasting and obesity," Nature Communications, Nature, vol. 15(1), pages 1-18, December.
    5. Xiujuan Gao & Xinyuan Huang & Zhongyun Chen & Liu Yang & Yifu Zhou & Zhenxuan Hou & Jie Yang & Shuhong Qi & Zheng Liu & Zhihong Zhang & Qian Liu & Qingming Luo & Ling Fu, 2024. "Supercontinuum-tailoring multicolor imaging reveals spatiotemporal dynamics of heterogeneous tumor evolution," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    6. Alexandre Santinho & Maxime Carpentier & Julio Lopes Sampaio & Mohyeddine Omrane & Abdou Rachid Thiam, 2024. "Giant organelle vesicles to uncover intracellular membrane mechanics and plasticity," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    7. Junxiong Guo & Shuyi Gu & Lin Lin & Yu Liu & Ji Cai & Hongyi Cai & Yu Tian & Yuelin Zhang & Qinghua Zhang & Ze Liu & Yafei Zhang & Xiaosheng Zhang & Yuan Lin & Wen Huang & Lin Gu & Jinxing Zhang, 2024. "Type-printable photodetector arrays for multichannel meta-infrared imaging," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    8. Nell Saunders & Blandine Monel & Nadège Cayet & Lorenzo Archetti & Hugo Moreno & Alexandre Jeanne & Agathe Marguier & Julian Buchrieser & Timothy Wai & Olivier Schwartz & Mathieu Fréchin, 2024. "Dynamic label-free analysis of SARS-CoV-2 infection reveals virus-induced subcellular remodeling," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    9. Dingfang Hu & Lingya Peng & Wenjun Xu & Shenghui Zhang & Zhongshan Liu & Yu Fang, 2024. "Ultrathin near-infrared transmitting films enabled by deprotonation-induced intramolecular charge transfer of a dopant," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    10. Jan Kretschmer & Tomáš David & Martin Dračínský & Ondřej Socha & Daniel Jirak & Martin Vít & Radek Jurok & Martin Kuchař & Ivana Císařová & Miloslav Polasek, 2022. "Paramagnetic encoding of molecules," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    11. Cátia Silva Janota & Andreia Pinto & Anna Pezzarossa & Pedro Machado & Judite Costa & Pedro Campinho & Cláudio A. Franco & Edgar R. Gomes, 2022. "Shielding of actin by the endoplasmic reticulum impacts nuclear positioning," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    12. Nikolaos Mougios & Elena R. Cotroneo & Nils Imse & Jonas Setzke & Silvio O. Rizzoli & Nadja A. Simeth & Roman Tsukanov & Felipe Opazo, 2024. "NanoPlex: a universal strategy for fluorescence microscopy multiplexing using nanobodies with erasable signals," Nature Communications, Nature, vol. 15(1), pages 1-17, December.
    13. Noble Kumar Talari & Ushodaya Mattam & Niroj Kumar Meher & Arun Kumar Paripati & Kalyankar Mahadev & Thanuja Krishnamoorthy & Naresh Babu V. Sepuri, 2023. "Lipid-droplet associated mitochondria promote fatty-acid oxidation through a distinct bioenergetic pattern in male Wistar rats," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    14. Jiří Bezdíček & Andrea Nesvadbová & Jaromír Ducháček & Jana Sekaninová & Luděk Stádník & Martina Janků, 2024. "Changes in the oxidative - biochemical status in dairy cows during the transition period affecting reproductive and health parameters," Czech Journal of Animal Science, Czech Academy of Agricultural Sciences, vol. 69(9), pages 345-355.
    15. Dianne Lumaquin-Yin & Emily Montal & Eleanor Johns & Arianna Baggiolini & Ting-Hsiang Huang & Yilun Ma & Charlotte LaPlante & Shruthy Suresh & Lorenz Studer & Richard M. White, 2023. "Lipid droplets are a metabolic vulnerability in melanoma," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    16. Yong Mi Choi & Dalila Ajjaji & Kaelin D. Fleming & Peter P. Borbat & Meredith L. Jenkins & Brandon E. Moeller & Shaveen Fernando & Surita R. Bhatia & Jack H. Freed & John E. Burke & Abdou Rachid Thiam, 2023. "Structural insights into perilipin 3 membrane association in response to diacylglycerol accumulation," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    17. Junyoung Seo & Yeonbo Sim & Jeewon Kim & Hyunwoo Kim & In Cho & Hoyeon Nam & Young-Gyu Yoon & Jae-Byum Chang, 2022. "PICASSO allows ultra-multiplexed fluorescence imaging of spatially overlapping proteins without reference spectra measurements," Nature Communications, Nature, vol. 13(1), pages 1-17, December.
    18. James Burgess & Jeffrey J. Nirschl & Maria-Clara Zanellati & Alejandro Lozano & Sarah Cohen & Serena Yeung-Levy, 2024. "Orientation-invariant autoencoders learn robust representations for shape profiling of cells and organelles," Nature Communications, Nature, vol. 15(1), pages 1-14, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-53747-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.