IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v14y2023i1d10.1038_s41467-023-41165-1.html
   My bibliography  Save this article

A deep learning-based stripe self-correction method for stitched microscopic images

Author

Listed:
  • Shu Wang

    (Fuzhou University
    Fuzhou University
    Fujian Normal University)

  • Xiaoxiang Liu

    (Fuzhou University)

  • Yueying Li

    (Fuzhou University)

  • Xinquan Sun

    (Fuzhou University)

  • Qi Li

    (Fuzhou University)

  • Yinhua She

    (Fuzhou University)

  • Yixuan Xu

    (Fuzhou University)

  • Xingxin Huang

    (Fujian Normal University)

  • Ruolan Lin

    (Fujian Medical University Union Hospital)

  • Deyong Kang

    (Fujian Medical University Union Hospital)

  • Xingfu Wang

    (The First Affiliated Hospital of Fujian Medical University)

  • Haohua Tu

    (University of Illinois at Urbana-Champaign
    University of Illinois at Urbana-Champaign)

  • Wenxi Liu

    (Fuzhou University)

  • Feng Huang

    (Fuzhou University)

  • Jianxin Chen

    (Fujian Normal University)

Abstract

Stitched fluorescence microscope images inevitably exist in various types of stripes or artifacts caused by uncertain factors such as optical devices or specimens, which severely affects the image quality and downstream quantitative analysis. Here, we present a deep learning-based Stripe Self-Correction method, so-called SSCOR. Specifically, we propose a proximity sampling scheme and adversarial reciprocal self-training paradigm that enable SSCOR to utilize stripe-free patches sampled from the stitched microscope image itself to correct their adjacent stripe patches. Comparing to off-the-shelf approaches, SSCOR can not only adaptively correct non-uniform, oblique, and grid stripes, but also remove scanning, bubble, and out-of-focus artifacts, achieving the state-of-the-art performance across different imaging conditions and modalities. Moreover, SSCOR does not require any physical parameter estimation, patch-wise manual annotation, or raw stitched information in the correction process. This provides an intelligent prior-free image restoration solution for microscopists or even microscope companies, thus ensuring more precise biomedical applications for researchers.

Suggested Citation

  • Shu Wang & Xiaoxiang Liu & Yueying Li & Xinquan Sun & Qi Li & Yinhua She & Yixuan Xu & Xingxin Huang & Ruolan Lin & Deyong Kang & Xingfu Wang & Haohua Tu & Wenxi Liu & Feng Huang & Jianxin Chen, 2023. "A deep learning-based stripe self-correction method for stitched microscopic images," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
  • Handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-41165-1
    DOI: 10.1038/s41467-023-41165-1
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-41165-1
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-023-41165-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Tingying Peng & Kurt Thorn & Timm Schroeder & Lichao Wang & Fabian J. Theis & Carsten Marr & Nassir Navab, 2017. "A BaSiC tool for background and shading correction of optical microscopy images," Nature Communications, Nature, vol. 8(1), pages 1-7, August.
    2. Lamiae Abdeladim & Katherine S. Matho & Solène Clavreul & Pierre Mahou & Jean-Marc Sintes & Xavier Solinas & Ignacio Arganda-Carreras & Stephen G. Turney & Jeff W. Lichtman & Anatole Chessel & Alexis-, 2019. "Multicolor multiscale brain imaging with chromatic multiphoton serial microscopy," Nature Communications, Nature, vol. 10(1), pages 1-14, December.
    3. Lamiae Abdeladim & Katherine S. Matho & Solène Clavreul & Pierre Mahou & Jean-Marc Sintes & Xavier Solinas & Ignacio Arganda-Carreras & Stephen G. Turney & Jeff W. Lichtman & Anatole Chessel & Alexis-, 2019. "Publisher Correction: Multicolor multiscale brain imaging with chromatic multiphoton serial microscopy," Nature Communications, Nature, vol. 10(1), pages 1-1, December.
    4. Hui Gong & Dongli Xu & Jing Yuan & Xiangning Li & Congdi Guo & Jie Peng & Yuxin Li & Lindsay A. Schwarz & Anan Li & Bihe Hu & Benyi Xiong & Qingtao Sun & Yalun Zhang & Jiepeng Liu & Qiuyuan Zhong & To, 2016. "High-throughput dual-colour precision imaging for brain-wide connectome with cytoarchitectonic landmarks at the cellular level," Nature Communications, Nature, vol. 7(1), pages 1-12, November.
    5. Pengxiang Chen & Wei Wang & Rui Liu & Jiahui Lyu & Lei Zhang & Baizhou Li & Biying Qiu & Anhao Tian & Wenhong Jiang & Honggang Ying & Rui Jing & Qianqian Wang & Keqing Zhu & Ruiliang Bai & Linghui Zen, 2022. "Olfactory sensory experience regulates gliomagenesis via neuronal IGF1," Nature, Nature, vol. 606(7914), pages 550-556, June.
    6. Kevin Haan & Yijie Zhang & Jonathan E. Zuckerman & Tairan Liu & Anthony E. Sisk & Miguel F. P. Diaz & Kuang-Yu Jen & Alexander Nobori & Sofia Liou & Sarah Zhang & Rana Riahi & Yair Rivenson & W. Dean , 2021. "Deep learning-based transformation of H&E stained tissues into special stains," Nature Communications, Nature, vol. 12(1), pages 1-13, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wenli Li & Pei He & Dangyuan Lei & Yulong Fan & Yangtao Du & Bo Gao & Zhiqin Chu & Longqiu Li & Kaipeng Liu & Chengxu An & Weizheng Yuan & Yiting Yu, 2023. "Super-resolution multicolor fluorescence microscopy enabled by an apochromatic super-oscillatory lens with extended depth-of-focus," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    2. Min Lee & Hyungseok C. Moon & Hyeonjeong Jeong & Dong Wook Kim & Hye Yoon Park & Yongdae Shin, 2024. "Optogenetic control of mRNA condensation reveals an intimate link between condensate material properties and functions," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    3. David R. Ghasemi & Konstantin Okonechnikov & Anne Rademacher & Stephan Tirier & Kendra K. Maass & Hanna Schumacher & Piyush Joshi & Maxwell P. Gold & Julia Sundheimer & Britta Statz & Ahmet S. Rifaiog, 2024. "Compartments in medulloblastoma with extensive nodularity are connected through differentiation along the granular precursor lineage," Nature Communications, Nature, vol. 15(1), pages 1-20, December.
    4. Qingtao Sun & Jianping Zhang & Anan Li & Mei Yao & Guangcai Liu & Siqi Chen & Yue Luo & Zhi Wang & Hui Gong & Xiangning Li & Qingming Luo, 2022. "Acetylcholine deficiency disrupts extratelencephalic projection neurons in the prefrontal cortex in a mouse model of Alzheimer’s disease," Nature Communications, Nature, vol. 13(1), pages 1-22, December.
    5. Diek W. Wheeler & Shaina Banduri & Sruthi Sankararaman & Samhita Vinay & Giorgio A. Ascoli, 2024. "Unsupervised classification of brain-wide axons reveals the presubiculum neuronal projection blueprint," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    6. David Eriksson & Artur Schneider & Anupriya Thirumalai & Mansour Alyahyay & Brice Crompe & Kirti Sharma & Patrick Ruther & Ilka Diester, 2022. "Multichannel optogenetics combined with laminar recordings for ultra-controlled neuronal interrogation," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    7. Philip Dettinger & Tobias Kull & Geethika Arekatla & Nouraiz Ahmed & Yang Zhang & Florin Schneiter & Arne Wehling & Daniel Schirmacher & Shunsuke Kawamura & Dirk Loeffler & Timm Schroeder, 2022. "Open-source personal pipetting robots with live-cell incubation and microscopy compatibility," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    8. Meng Wang & Ke Liu & Junxia Pan & Jialin Li & Pei Sun & Yongsheng Zhang & Longhui Li & Wenyan Guo & Qianqian Xin & Zhikai Zhao & Yurong Liu & Zhenqiao Zhou & Jing Lyu & Ting Zheng & Yunyun Han & Chunq, 2022. "Brain-wide projection reconstruction of single functionally defined neurons," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    9. Seungmin Lee & Jeong Soo Park & Hyowon Woo & Yong Kyoung Yoo & Dongho Lee & Seok Chung & Dae Sung Yoon & Ki- Baek Lee & Jeong Hoon Lee, 2024. "Rapid deep learning-assisted predictive diagnostics for point-of-care testing," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    10. Yuzhu Li & Nir Pillar & Jingxi Li & Tairan Liu & Di Wu & Songyu Sun & Guangdong Ma & Kevin Haan & Luzhe Huang & Yijie Zhang & Sepehr Hamidi & Anatoly Urisman & Tal Keidar Haran & William Dean Wallace , 2024. "Virtual histological staining of unlabeled autopsy tissue," Nature Communications, Nature, vol. 15(1), pages 1-17, December.
    11. Melanie Schoof & Shweta Godbole & Thomas K. Albert & Matthias Dottermusch & Carolin Walter & Annika Ballast & Nan Qin & Marlena Baca Olivera & Carolin Göbel & Sina Neyazi & Dörthe Holdhof & Catena Kre, 2023. "Mouse models of pediatric high-grade gliomas with MYCN amplification reveal intratumoral heterogeneity and lineage signatures," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    12. Ceren Pajanoja & Jenny Hsin & Bradley Olinger & Andrew Schiffmacher & Rita Yazejian & Shaun Abrams & Arvydas Dapkunas & Zarin Zainul & Andrew D. Doyle & Daniel Martin & Laura Kerosuo, 2023. "Maintenance of pluripotency-like signature in the entire ectoderm leads to neural crest stem cell potential," Nature Communications, Nature, vol. 14(1), pages 1-17, December.
    13. Junyoung Seo & Yeonbo Sim & Jeewon Kim & Hyunwoo Kim & In Cho & Hoyeon Nam & Young-Gyu Yoon & Jae-Byum Chang, 2022. "PICASSO allows ultra-multiplexed fluorescence imaging of spatially overlapping proteins without reference spectra measurements," Nature Communications, Nature, vol. 13(1), pages 1-17, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-41165-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.