IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v14y2023i1d10.1038_s41467-023-37126-3.html
   My bibliography  Save this article

Benchmarking integration of single-cell differential expression

Author

Listed:
  • Hai C. T. Nguyen

    (Ulsan National Institute of Science and Technology)

  • Bukyung Baik

    (Ulsan National Institute of Science and Technology)

  • Sora Yoon

    (Ulsan National Institute of Science and Technology
    University of Pennsylvania Perelman School of Medicine)

  • Taesung Park

    (Seoul National University
    Seoul National University)

  • Dougu Nam

    (Ulsan National Institute of Science and Technology
    Ulsan National Institute of Science and Technology)

Abstract

Integration of single-cell RNA sequencing data between different samples has been a major challenge for analyzing cell populations. However, strategies to integrate differential expression analysis of single-cell data remain underinvestigated. Here, we benchmark 46 workflows for differential expression analysis of single-cell data with multiple batches. We show that batch effects, sequencing depth and data sparsity substantially impact their performances. Notably, we find that the use of batch-corrected data rarely improves the analysis for sparse data, whereas batch covariate modeling improves the analysis for substantial batch effects. We show that for low depth data, single-cell techniques based on zero-inflation model deteriorate the performance, whereas the analysis of uncorrected data using limmatrend, Wilcoxon test and fixed effects model performs well. We suggest several high-performance methods under different conditions based on various simulation and real data analyses. Additionally, we demonstrate that differential expression analysis for a specific cell type outperforms that of large-scale bulk sample data in prioritizing disease-related genes.

Suggested Citation

  • Hai C. T. Nguyen & Bukyung Baik & Sora Yoon & Taesung Park & Dougu Nam, 2023. "Benchmarking integration of single-cell differential expression," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
  • Handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-37126-3
    DOI: 10.1038/s41467-023-37126-3
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-37126-3
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-023-37126-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jordan W. Squair & Matthieu Gautier & Claudia Kathe & Mark A. Anderson & Nicholas D. James & Thomas H. Hutson & Rémi Hudelle & Taha Qaiser & Kaya J. E. Matson & Quentin Barraud & Ariel J. Levine & Gio, 2021. "Confronting false discoveries in single-cell differential expression," Nature Communications, Nature, vol. 12(1), pages 1-15, December.
    2. Martin Jinye Zhang & Vasilis Ntranos & David Tse, 2020. "Determining sequencing depth in a single-cell RNA-seq experiment," Nature Communications, Nature, vol. 11(1), pages 1-11, December.
    3. Nayoung Kim & Hong Kwan Kim & Kyungjong Lee & Yourae Hong & Jong Ho Cho & Jung Won Choi & Jung-Il Lee & Yeon-Lim Suh & Bo Mi Ku & Hye Hyeon Eum & Soyean Choi & Yoon-La Choi & Je-Gun Joung & Woong-Yang, 2020. "Single-cell RNA sequencing demonstrates the molecular and cellular reprogramming of metastatic lung adenocarcinoma," Nature Communications, Nature, vol. 11(1), pages 1-15, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Magnus Zethoven & Luciano Martelotto & Andrew Pattison & Blake Bowen & Shiva Balachander & Aidan Flynn & Fernando J. Rossello & Annette Hogg & Julie A. Miller & Zdenek Frysak & Sean Grimmond & Lauren , 2022. "Single-nuclei and bulk-tissue gene-expression analysis of pheochromocytoma and paraganglioma links disease subtypes with tumor microenvironment," Nature Communications, Nature, vol. 13(1), pages 1-18, December.
    2. Raymond Hall Yip Louie & Curtis Cai & Jerome Samir & Mandeep Singh & Ira W. Deveson & James M. Ferguson & Timothy G. Amos & Helen Marie McGuire & Kavitha Gowrishankar & Thiruni Adikari & Robert Balder, 2023. "CAR+ and CAR− T cells share a differentiation trajectory into an NK-like subset after CD19 CAR T cell infusion in patients with B cell malignancies," Nature Communications, Nature, vol. 14(1), pages 1-18, December.
    3. Han Luo & Xuyang Xia & Li-Bin Huang & Hyunsu An & Minyuan Cao & Gyeong Dae Kim & Hai-Ning Chen & Wei-Han Zhang & Yang Shu & Xiangyu Kong & Zhixiang Ren & Pei-Heng Li & Yang Liu & Huairong Tang & Rongh, 2022. "Pan-cancer single-cell analysis reveals the heterogeneity and plasticity of cancer-associated fibroblasts in the tumor microenvironment," Nature Communications, Nature, vol. 13(1), pages 1-17, December.
    4. Gregor Werba & Daniel Weissinger & Emily A. Kawaler & Ende Zhao & Despoina Kalfakakou & Surajit Dhara & Lidong Wang & Heather B. Lim & Grace Oh & Xiaohong Jing & Nina Beri & Lauren Khanna & Tamas Gond, 2023. "Single-cell RNA sequencing reveals the effects of chemotherapy on human pancreatic adenocarcinoma and its tumor microenvironment," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    5. Manvendra Singh & Ying Zhao & Vinicius Daguano Gastaldi & Sonja M. Wojcik & Yasmina Curto & Riki Kawaguchi & Ricardo M. Merino & Laura Fernandez Garcia-Agudo & Holger Taschenberger & Nils Brose & Dani, 2023. "Erythropoietin re-wires cognition-associated transcriptional networks," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    6. Zhoufeng Wang & Zhe Li & Kun Zhou & Chengdi Wang & Lili Jiang & Li Zhang & Ying Yang & Wenxin Luo & Wenliang Qiao & Gang Wang & Yinyun Ni & Shuiping Dai & Tingting Guo & Guiyi Ji & Minjie Xu & Yiying , 2021. "Deciphering cell lineage specification of human lung adenocarcinoma with single-cell RNA sequencing," Nature Communications, Nature, vol. 12(1), pages 1-15, December.
    7. Christopher J. Hanley & Sara Waise & Matthew J. Ellis & Maria A. Lopez & Wai Y. Pun & Julian Taylor & Rachel Parker & Lucy M. Kimbley & Serena J. Chee & Emily C. Shaw & Jonathan West & Aiman Alzetani , 2023. "Single-cell analysis reveals prognostic fibroblast subpopulations linked to molecular and immunological subtypes of lung cancer," Nature Communications, Nature, vol. 14(1), pages 1-18, December.
    8. Suhas V. Vasaikar & Adam K. Savage & Qiuyu Gong & Elliott Swanson & Aarthi Talla & Cara Lord & Alexander T. Heubeck & Julian Reading & Lucas T. Graybuck & Paul Meijer & Troy R. Torgerson & Peter J. Sk, 2023. "A comprehensive platform for analyzing longitudinal multi-omics data," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    9. Z. L. Liu & X. Y. Meng & R. J. Bao & M. Y. Shen & J. J. Sun & W. D. Chen & F. Liu & Y. He, 2024. "Single cell deciphering of progression trajectories of the tumor ecosystem in head and neck cancer," Nature Communications, Nature, vol. 15(1), pages 1-18, December.
    10. Roberta Piras & Emily Y. Ko & Connor Barrett & Marco Simone & Xianzhi Lin & Marina T. Broz & Fernando H. G. Tessaro & Mireia Castillo-Martin & Carlos Cordon-Cardo & Helen S. Goodridge & Dolores Vizio , 2022. "circCsnk1g3- and circAnkib1-regulated interferon responses in sarcoma promote tumorigenesis by shaping the immune microenvironment," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    11. Jiarui Ding & John J. Garber & Amiko Uchida & Ariel Lefkovith & Grace T. Carter & Praveen Vimalathas & Lauren Canha & Michael Dougan & Kyle Staller & Joseph Yarze & Toni M. Delorey & Orit Rozenblatt-R, 2024. "An esophagus cell atlas reveals dynamic rewiring during active eosinophilic esophagitis and remission," Nature Communications, Nature, vol. 15(1), pages 1-18, December.
    12. Alan E. Murphy & Nathan G. Skene, 2022. "A balanced measure shows superior performance of pseudobulk methods in single-cell RNA-sequencing analysis," Nature Communications, Nature, vol. 13(1), pages 1-4, December.
    13. Yin Li & Manling Jiang & Ling Aye & Li Luo & Yong Zhang & Fengkai Xu & Yongqi Wei & Dan Peng & Xiang He & Jie Gu & Xiaofang Yu & Guoping Li & Di Ge & Chunlai Lu, 2024. "UPP1 promotes lung adenocarcinoma progression through the induction of an immunosuppressive microenvironment," Nature Communications, Nature, vol. 15(1), pages 1-23, December.
    14. Ido Nofech-Mozes & David Soave & Philip Awadalla & Sagi Abelson, 2023. "Pan-cancer classification of single cells in the tumour microenvironment," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    15. A. S. Eisele & M. Tarbier & A. A. Dormann & V. Pelechano & D. M. Suter, 2024. "Gene-expression memory-based prediction of cell lineages from scRNA-seq datasets," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    16. Igor Dolgalev & Hua Zhou & Nina Murrell & Hortense Le & Theodore Sakellaropoulos & Nicolas Coudray & Kelsey Zhu & Varshini Vasudevaraja & Anna Yeaton & Chandra Goparaju & Yonghua Li & Imran Sulaiman &, 2023. "Inflammation in the tumor-adjacent lung as a predictor of clinical outcome in lung adenocarcinoma," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    17. Bing He & Yao Xiao & Haodong Liang & Qianhui Huang & Yuheng Du & Yijun Li & David Garmire & Duxin Sun & Lana X. Garmire, 2023. "ASGARD is A Single-cell Guided Pipeline to Aid Repurposing of Drugs," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    18. Nelson Johansen & Hongru Hu & Gerald Quon, 2023. "Projecting RNA measurements onto single cell atlases to extract cell type-specific expression profiles using scProjection," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    19. Yuna Landais & Céline Vallot, 2023. "Multi-modal quantification of pathway activity with MAYA," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    20. Jia-Ru Wei & Zhao-Zhe Hao & Chuan Xu & Mengyao Huang & Lei Tang & Nana Xu & Ruifeng Liu & Yuhui Shen & Sarah A. Teichmann & Zhichao Miao & Sheng Liu, 2022. "Identification of visual cortex cell types and species differences using single-cell RNA sequencing," Nature Communications, Nature, vol. 13(1), pages 1-21, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-37126-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.