IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v14y2023i1d10.1038_s41467-023-37126-3.html
   My bibliography  Save this article

Benchmarking integration of single-cell differential expression

Author

Listed:
  • Hai C. T. Nguyen

    (Ulsan National Institute of Science and Technology)

  • Bukyung Baik

    (Ulsan National Institute of Science and Technology)

  • Sora Yoon

    (Ulsan National Institute of Science and Technology
    University of Pennsylvania Perelman School of Medicine)

  • Taesung Park

    (Seoul National University
    Seoul National University)

  • Dougu Nam

    (Ulsan National Institute of Science and Technology
    Ulsan National Institute of Science and Technology)

Abstract

Integration of single-cell RNA sequencing data between different samples has been a major challenge for analyzing cell populations. However, strategies to integrate differential expression analysis of single-cell data remain underinvestigated. Here, we benchmark 46 workflows for differential expression analysis of single-cell data with multiple batches. We show that batch effects, sequencing depth and data sparsity substantially impact their performances. Notably, we find that the use of batch-corrected data rarely improves the analysis for sparse data, whereas batch covariate modeling improves the analysis for substantial batch effects. We show that for low depth data, single-cell techniques based on zero-inflation model deteriorate the performance, whereas the analysis of uncorrected data using limmatrend, Wilcoxon test and fixed effects model performs well. We suggest several high-performance methods under different conditions based on various simulation and real data analyses. Additionally, we demonstrate that differential expression analysis for a specific cell type outperforms that of large-scale bulk sample data in prioritizing disease-related genes.

Suggested Citation

  • Hai C. T. Nguyen & Bukyung Baik & Sora Yoon & Taesung Park & Dougu Nam, 2023. "Benchmarking integration of single-cell differential expression," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
  • Handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-37126-3
    DOI: 10.1038/s41467-023-37126-3
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-37126-3
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-023-37126-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jordan W. Squair & Matthieu Gautier & Claudia Kathe & Mark A. Anderson & Nicholas D. James & Thomas H. Hutson & Rémi Hudelle & Taha Qaiser & Kaya J. E. Matson & Quentin Barraud & Ariel J. Levine & Gio, 2021. "Confronting false discoveries in single-cell differential expression," Nature Communications, Nature, vol. 12(1), pages 1-15, December.
    2. Nayoung Kim & Hong Kwan Kim & Kyungjong Lee & Yourae Hong & Jong Ho Cho & Jung Won Choi & Jung-Il Lee & Yeon-Lim Suh & Bo Mi Ku & Hye Hyeon Eum & Soyean Choi & Yoon-La Choi & Je-Gun Joung & Woong-Yang, 2020. "Single-cell RNA sequencing demonstrates the molecular and cellular reprogramming of metastatic lung adenocarcinoma," Nature Communications, Nature, vol. 11(1), pages 1-15, December.
    3. Martin Jinye Zhang & Vasilis Ntranos & David Tse, 2020. "Determining sequencing depth in a single-cell RNA-seq experiment," Nature Communications, Nature, vol. 11(1), pages 1-11, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guillermo Serrano & Nerea Berastegui & Aintzane Díaz-Mazkiaran & Paula García-Olloqui & Carmen Rodriguez-Res & Sofia Huerga-Dominguez & Marina Ainciburu & Amaia Vilas-Zornoza & Patxi San Martin-Uriz &, 2024. "Single-cell transcriptional profile of CD34+ hematopoietic progenitor cells from del(5q) myelodysplastic syndromes and impact of lenalidomide," Nature Communications, Nature, vol. 15(1), pages 1-17, December.
    2. Özkan İş & Xue Wang & Joseph S. Reddy & Yuhao Min & Elanur Yilmaz & Prabesh Bhattarai & Tulsi Patel & Jeremiah Bergman & Zachary Quicksall & Michael G. Heckman & Frederick Q. Tutor-New & Birsen Can De, 2024. "Gliovascular transcriptional perturbations in Alzheimer’s disease reveal molecular mechanisms of blood brain barrier dysfunction," Nature Communications, Nature, vol. 15(1), pages 1-23, December.
    3. Magnus Zethoven & Luciano Martelotto & Andrew Pattison & Blake Bowen & Shiva Balachander & Aidan Flynn & Fernando J. Rossello & Annette Hogg & Julie A. Miller & Zdenek Frysak & Sean Grimmond & Lauren , 2022. "Single-nuclei and bulk-tissue gene-expression analysis of pheochromocytoma and paraganglioma links disease subtypes with tumor microenvironment," Nature Communications, Nature, vol. 13(1), pages 1-18, December.
    4. Nelson Johansen & Hongru Hu & Gerald Quon, 2023. "Projecting RNA measurements onto single cell atlases to extract cell type-specific expression profiles using scProjection," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    5. Raymond Hall Yip Louie & Curtis Cai & Jerome Samir & Mandeep Singh & Ira W. Deveson & James M. Ferguson & Timothy G. Amos & Helen Marie McGuire & Kavitha Gowrishankar & Thiruni Adikari & Robert Balder, 2023. "CAR+ and CAR− T cells share a differentiation trajectory into an NK-like subset after CD19 CAR T cell infusion in patients with B cell malignancies," Nature Communications, Nature, vol. 14(1), pages 1-18, December.
    6. Ioana Olan & Masami Ando-Kuri & Aled J. Parry & Tetsuya Handa & Stefan Schoenfelder & Peter Fraser & Yasuyuki Ohkawa & Hiroshi Kimura & Masako Narita & Masashi Narita, 2024. "HMGA1 orchestrates chromatin compartmentalization and sequesters genes into 3D networks coordinating senescence heterogeneity," Nature Communications, Nature, vol. 15(1), pages 1-18, December.
    7. Han Luo & Xuyang Xia & Li-Bin Huang & Hyunsu An & Minyuan Cao & Gyeong Dae Kim & Hai-Ning Chen & Wei-Han Zhang & Yang Shu & Xiangyu Kong & Zhixiang Ren & Pei-Heng Li & Yang Liu & Huairong Tang & Rongh, 2022. "Pan-cancer single-cell analysis reveals the heterogeneity and plasticity of cancer-associated fibroblasts in the tumor microenvironment," Nature Communications, Nature, vol. 13(1), pages 1-17, December.
    8. Haven Tillmon & Breeanne M. Soteros & Liang Shen & Qifei Cong & Mackenna Wollet & Julianne General & Hanna Chin & John Beichen Lee & Flavia R. Carreno & David A. Morilak & Jun Hee Kim & Gek Ming Sia, 2024. "Complement and microglia activation mediate stress-induced synapse loss in layer 2/3 of the medial prefrontal cortex in male mice," Nature Communications, Nature, vol. 15(1), pages 1-17, December.
    9. Yuna Landais & Céline Vallot, 2023. "Multi-modal quantification of pathway activity with MAYA," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    10. Jia-Ru Wei & Zhao-Zhe Hao & Chuan Xu & Mengyao Huang & Lei Tang & Nana Xu & Ruifeng Liu & Yuhui Shen & Sarah A. Teichmann & Zhichao Miao & Sheng Liu, 2022. "Identification of visual cortex cell types and species differences using single-cell RNA sequencing," Nature Communications, Nature, vol. 13(1), pages 1-21, December.
    11. David G. Coffey & Francesco Maura & Edgar Gonzalez-Kozlova & J. Javier Diaz-Mejia & Ping Luo & Yong Zhang & Yuexin Xu & Edus H. Warren & Travis Dawson & Brian Lee & Hui Xie & Eric Smith & Amanda Ciard, 2023. "Immunophenotypic correlates of sustained MRD negativity in patients with multiple myeloma," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    12. Jonas Stewen & Kai Kruse & Anca T. Godoi-Filip & Zenia & Hyun-Woo Jeong & Susanne Adams & Frank Berkenfeld & Martin Stehling & Kristy Red-Horse & Ralf H. Adams & Mara E. Pitulescu, 2024. "Eph-ephrin signaling couples endothelial cell sorting and arterial specification," Nature Communications, Nature, vol. 15(1), pages 1-23, December.
    13. Yang Zhang & Gan Liu & Minzhen Tao & Hui Ning & Wei Guo & Gaofei Yin & Wen Gao & Lifei Feng & Jin Gu & Zhen Xie & Zhigang Huang, 2023. "Integrated transcriptome study of the tumor microenvironment for treatment response prediction in male predominant hypopharyngeal carcinoma," Nature Communications, Nature, vol. 14(1), pages 1-17, December.
    14. T. Hautz & S. Salcher & M. Fodor & G. Sturm & S. Ebner & A. Mair & M. Trebo & G. Untergasser & S. Sopper & B. Cardini & A. Martowicz & J. Hofmann & S. Daum & M. Kalb & T. Resch & F. Krendl & A. Weisse, 2023. "Immune cell dynamics deconvoluted by single-cell RNA sequencing in normothermic machine perfusion of the liver," Nature Communications, Nature, vol. 14(1), pages 1-18, December.
    15. Gregor Werba & Daniel Weissinger & Emily A. Kawaler & Ende Zhao & Despoina Kalfakakou & Surajit Dhara & Lidong Wang & Heather B. Lim & Grace Oh & Xiaohong Jing & Nina Beri & Lauren Khanna & Tamas Gond, 2023. "Single-cell RNA sequencing reveals the effects of chemotherapy on human pancreatic adenocarcinoma and its tumor microenvironment," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    16. Maxime Brunner & David Lopez-Rodriguez & Judith Estrada-Meza & Rafik Dali & Antoine Rohrbach & Tamara Deglise & Andrea Messina & Bernard Thorens & Federico Santoni & Fanny Langlet, 2024. "Fasting induces metabolic switches and spatial redistributions of lipid processing and neuronal interactions in tanycytes," Nature Communications, Nature, vol. 15(1), pages 1-19, December.
    17. BaDoi N. Phan & Madelyn H. Ray & Xiangning Xue & Chen Fu & Robert J. Fenster & Stephen J. Kohut & Jack Bergman & Suzanne N. Haber & Kenneth M. McCullough & Madeline K. Fish & Jill R. Glausier & Qiao S, 2024. "Single nuclei transcriptomics in human and non-human primate striatum in opioid use disorder," Nature Communications, Nature, vol. 15(1), pages 1-19, December.
    18. Manvendra Singh & Ying Zhao & Vinicius Daguano Gastaldi & Sonja M. Wojcik & Yasmina Curto & Riki Kawaguchi & Ricardo M. Merino & Laura Fernandez Garcia-Agudo & Holger Taschenberger & Nils Brose & Dani, 2023. "Erythropoietin re-wires cognition-associated transcriptional networks," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    19. Ariel Madrigal & Tianyuan Lu & Larisa M. Soto & Hamed S. Najafabadi, 2024. "A unified model for interpretable latent embedding of multi-sample, multi-condition single-cell data," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    20. Jae-Won Cho & Seyeon Park & Gamin Kim & Heonjong Han & Hyo Sup Shim & Sunhye Shin & Yong-Soo Bae & Seong Yong Park & Sang-Jun Ha & Insuk Lee & Hye Ryun Kim, 2021. "Dysregulation of TFH-B-TRM lymphocyte cooperation is associated with unfavorable anti-PD-1 responses in EGFR-mutant lung cancer," Nature Communications, Nature, vol. 12(1), pages 1-16, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-37126-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.