IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v14y2023i1d10.1038_s41467-023-38625-z.html
   My bibliography  Save this article

A positive statistical benchmark to assess network agreement

Author

Listed:
  • Bingjie Hao

    (Northwestern University)

  • István A. Kovács

    (Northwestern University
    Northwestern Institute on Complex Systems, Northwestern University)

Abstract

Current computational methods for validating experimental network datasets compare overlap, i.e., shared links, with a reference network using a negative benchmark. However, this fails to quantify the level of agreement between the two networks. To address this, we propose a positive statistical benchmark to determine the maximum possible overlap between networks. Our approach can efficiently generate this benchmark in a maximum entropy framework and provides a way to assess whether the observed overlap is significantly different from the best-case scenario. We introduce a normalized overlap score, Normlap, to enhance comparisons between experimental networks. As an application, we compare molecular and functional networks, resulting in an agreement network of human as well as yeast network datasets. The Normlap score can improve the comparison between experimental networks by providing a computational alternative to network thresholding and validation.

Suggested Citation

  • Bingjie Hao & István A. Kovács, 2023. "A positive statistical benchmark to assess network agreement," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
  • Handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-38625-z
    DOI: 10.1038/s41467-023-38625-z
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-38625-z
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-023-38625-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Soon Gang Choi & Julien Olivet & Patricia Cassonnet & Pierre-Olivier Vidalain & Katja Luck & Luke Lambourne & Kerstin Spirohn & Irma Lemmens & Mélanie Dos Santos & Caroline Demeret & Louis Jones & Sud, 2019. "Maximizing binary interactome mapping with a minimal number of assays," Nature Communications, Nature, vol. 10(1), pages 1-13, December.
    2. Peter Uetz & Loic Giot & Gerard Cagney & Traci A. Mansfield & Richard S. Judson & James R. Knight & Daniel Lockshon & Vaibhav Narayan & Maithreyan Srinivasan & Pascale Pochart & Alia Qureshi-Emili & Y, 2000. "A comprehensive analysis of protein–protein interactions in Saccharomyces cerevisiae," Nature, Nature, vol. 403(6770), pages 623-627, February.
    3. Anne-Claude Gavin & Markus Bösche & Roland Krause & Paola Grandi & Martina Marzioch & Andreas Bauer & Jörg Schultz & Jens M. Rick & Anne-Marie Michon & Cristina-Maria Cruciat & Marita Remor & Christia, 2002. "Functional organization of the yeast proteome by systematic analysis of protein complexes," Nature, Nature, vol. 415(6868), pages 141-147, January.
    4. Nevan J. Krogan & Gerard Cagney & Haiyuan Yu & Gouqing Zhong & Xinghua Guo & Alexandr Ignatchenko & Joyce Li & Shuye Pu & Nira Datta & Aaron P. Tikuisis & Thanuja Punna & José M. Peregrín-Alvarez & Mi, 2006. "Global landscape of protein complexes in the yeast Saccharomyces cerevisiae," Nature, Nature, vol. 440(7084), pages 637-643, March.
    5. Anne-Claude Gavin & Patrick Aloy & Paola Grandi & Roland Krause & Markus Boesche & Martina Marzioch & Christina Rau & Lars Juhl Jensen & Sonja Bastuck & Birgit Dümpelfeld & Angela Edelmann & Marie-Ann, 2006. "Proteome survey reveals modularity of the yeast cell machinery," Nature, Nature, vol. 440(7084), pages 631-636, March.
    6. Katja Luck & Dae-Kyum Kim & Luke Lambourne & Kerstin Spirohn & Bridget E. Begg & Wenting Bian & Ruth Brignall & Tiziana Cafarelli & Francisco J. Campos-Laborie & Benoit Charloteaux & Dongsic Choi & At, 2020. "A reference map of the human binary protein interactome," Nature, Nature, vol. 580(7803), pages 402-408, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jie Zhao & Xiujuan Lei & Fang-Xiang Wu, 2017. "Predicting Protein Complexes in Weighted Dynamic PPI Networks Based on ICSC," Complexity, Hindawi, vol. 2017, pages 1-11, August.
    2. Hong-Wen Tang & Kerstin Spirohn & Yanhui Hu & Tong Hao & István A. Kovács & Yue Gao & Richard Binari & Donghui Yang-Zhou & Kenneth H. Wan & Joel S. Bader & Dawit Balcha & Wenting Bian & Benjamin W. Bo, 2023. "Next-generation large-scale binary protein interaction network for Drosophila melanogaster," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    3. Erica W. Carter & Orlene Guerra Peraza & Nian Wang, 2023. "The protein interactome of the citrus Huanglongbing pathogen Candidatus Liberibacter asiaticus," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    4. Yesheng Fu & Lei Li & Xin Zhang & Zhikang Deng & Ying Wu & Wenzhe Chen & Yuchen Liu & Shan He & Jian Wang & Yuping Xie & Zhiwei Tu & Yadi Lyu & Yange Wei & Shujie Wang & Chun-Ping Cui & Cui Hua Liu & , 2024. "Systematic HOIP interactome profiling reveals critical roles of linear ubiquitination in tissue homeostasis," Nature Communications, Nature, vol. 15(1), pages 1-19, December.
    5. Patrick Bryant & Gabriele Pozzati & Arne Elofsson, 2022. "Improved prediction of protein-protein interactions using AlphaFold2," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    6. Gergo Gogl & Boglarka Zambo & Camille Kostmann & Alexandra Cousido-Siah & Bastien Morlet & Fabien Durbesson & Luc Negroni & Pascal Eberling & Pau Jané & Yves Nominé & Andras Zeke & Søren Østergaard & , 2022. "Quantitative fragmentomics allow affinity mapping of interactomes," Nature Communications, Nature, vol. 13(1), pages 1-18, December.
    7. Patrick Bryant & Gabriele Pozzati & Wensi Zhu & Aditi Shenoy & Petras Kundrotas & Arne Elofsson, 2022. "Predicting the structure of large protein complexes using AlphaFold and Monte Carlo tree search," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    8. Shilin Sun & Hua Tian & Runze Wang & Zehua Zhang, 2023. "Biomedical Interaction Prediction with Adaptive Line Graph Contrastive Learning," Mathematics, MDPI, vol. 11(3), pages 1-14, February.
    9. Adrià Fernández-Torras & Miquel Duran-Frigola & Martino Bertoni & Martina Locatelli & Patrick Aloy, 2022. "Integrating and formatting biomedical data as pre-calculated knowledge graph embeddings in the Bioteque," Nature Communications, Nature, vol. 13(1), pages 1-18, December.
    10. Abdolhosseini-Qomi, Amir Mahdi & Yazdani, Naser & Asadpour, Masoud, 2020. "Overlapping communities and the prediction of missing links in multiplex networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 554(C).
    11. Florin Ratajczak & Mitchell Joblin & Marcel Hildebrandt & Martin Ringsquandl & Pascal Falter-Braun & Matthias Heinig, 2023. "Speos: an ensemble graph representation learning framework to predict core gene candidates for complex diseases," Nature Communications, Nature, vol. 14(1), pages 1-18, December.
    12. Michael A. Skinnider & Mopelola O. Akinlaja & Leonard J. Foster, 2023. "Mapping protein states and interactions across the tree of life with co-fractionation mass spectrometry," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    13. Yuan Liu & Jingwen Yang & Tianlu Wang & Mei Luo & Yamei Chen & Chengxuan Chen & Ze’ev Ronai & Yubin Zhou & Eytan Ruppin & Leng Han, 2023. "Expanding PROTACtable genome universe of E3 ligases," Nature Communications, Nature, vol. 14(1), pages 1-17, December.
    14. Ghulam Muhiuddin & Sovan Samanta & Abdulrahman F. Aljohani & Abeer M. Alkhaibari, 2023. "A Study on Graph Centrality Measures of Different Diseases Due to DNA Sequencing," Mathematics, MDPI, vol. 11(14), pages 1-18, July.
    15. Diego Esposito & Jane Dudley-Fraser & Acely Garza-Garcia & Katrin Rittinger, 2022. "Divergent self-association properties of paralogous proteins TRIM2 and TRIM3 regulate their E3 ligase activity," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    16. Jing Lei & Reiko U. Yoshimoto & Takeshi Matsui & Masayuki Amagai & Mizuho A. Kido & Makoto Tominaga, 2023. "Involvement of skin TRPV3 in temperature detection regulated by TMEM79 in mice," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    17. Johannes Venezian & Hagit Bar-Yosef & Hila Ben-Arie Zilberman & Noam Cohen & Oded Kleifeld & Juan Fernandez-Recio & Fabian Glaser & Ayala Shiber, 2024. "Diverging co-translational protein complex assembly pathways are governed by interface energy distribution," Nature Communications, Nature, vol. 15(1), pages 1-17, December.
    18. Mu Gao & Davi Nakajima An & Jerry M. Parks & Jeffrey Skolnick, 2022. "AF2Complex predicts direct physical interactions in multimeric proteins with deep learning," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    19. Maik Müller & Fabienne Gräbnitz & Niculò Barandun & Yang Shen & Fabian Wendt & Sebastian N. Steiner & Yannik Severin & Stefan U. Vetterli & Milon Mondal & James R. Prudent & Raphael Hofmann & Marc Oos, 2021. "Light-mediated discovery of surfaceome nanoscale organization and intercellular receptor interaction networks," Nature Communications, Nature, vol. 12(1), pages 1-17, December.
    20. Pisanu Buphamalai & Tomislav Kokotovic & Vanja Nagy & Jörg Menche, 2021. "Network analysis reveals rare disease signatures across multiple levels of biological organization," Nature Communications, Nature, vol. 12(1), pages 1-15, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-38625-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.