IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0091315.html
   My bibliography  Save this article

Parallel Clustering Algorithm for Large-Scale Biological Data Sets

Author

Listed:
  • Minchao Wang
  • Wu Zhang
  • Wang Ding
  • Dongbo Dai
  • Huiran Zhang
  • Hao Xie
  • Luonan Chen
  • Yike Guo
  • Jiang Xie

Abstract

Backgrounds: Recent explosion of biological data brings a great challenge for the traditional clustering algorithms. With increasing scale of data sets, much larger memory and longer runtime are required for the cluster identification problems. The affinity propagation algorithm outperforms many other classical clustering algorithms and is widely applied into the biological researches. However, the time and space complexity become a great bottleneck when handling the large-scale data sets. Moreover, the similarity matrix, whose constructing procedure takes long runtime, is required before running the affinity propagation algorithm, since the algorithm clusters data sets based on the similarities between data pairs. Methods: Two types of parallel architectures are proposed in this paper to accelerate the similarity matrix constructing procedure and the affinity propagation algorithm. The memory-shared architecture is used to construct the similarity matrix, and the distributed system is taken for the affinity propagation algorithm, because of its large memory size and great computing capacity. An appropriate way of data partition and reduction is designed in our method, in order to minimize the global communication cost among processes. Result: A speedup of 100 is gained with 128 cores. The runtime is reduced from serval hours to a few seconds, which indicates that parallel algorithm is capable of handling large-scale data sets effectively. The parallel affinity propagation also achieves a good performance when clustering large-scale gene data (microarray) and detecting families in large protein superfamilies.

Suggested Citation

  • Minchao Wang & Wu Zhang & Wang Ding & Dongbo Dai & Huiran Zhang & Hao Xie & Luonan Chen & Yike Guo & Jiang Xie, 2014. "Parallel Clustering Algorithm for Large-Scale Biological Data Sets," PLOS ONE, Public Library of Science, vol. 9(4), pages 1-9, April.
  • Handle: RePEc:plo:pone00:0091315
    DOI: 10.1371/journal.pone.0091315
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0091315
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0091315&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0091315?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Roger Guimerà & Luís A. Nunes Amaral, 2005. "Functional cartography of complex metabolic networks," Nature, Nature, vol. 433(7028), pages 895-900, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hayda Almeida & Marie-Jean Meurs & Leila Kosseim & Greg Butler & Adrian Tsang, 2014. "Machine Learning for Biomedical Literature Triage," PLOS ONE, Public Library of Science, vol. 9(12), pages 1-21, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chan, Ho-Yin & Ma, Hanxi & Zhou, Jiangping, 2024. "Resilience of socio-technical transportation systems: A demand-driven community detection in human mobility structures," Transportation Research Part A: Policy and Practice, Elsevier, vol. 190(C).
    2. Leto Peel & Tiago P. Peixoto & Manlio De Domenico, 2022. "Statistical inference links data and theory in network science," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    3. Attila Mester & Andrei Pop & Bogdan-Eduard-Mădălin Mursa & Horea Greblă & Laura Dioşan & Camelia Chira, 2021. "Network Analysis Based on Important Node Selection and Community Detection," Mathematics, MDPI, vol. 9(18), pages 1-16, September.
    4. Nicholas S. Vonortas & Koichiro Okamura, 2013. "Network structure and robustness: lessons for research programme design," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 22(4), pages 392-411, June.
    5. Feng, Xiao & He, Shiwei & Li, Guangye & Chi, Jushang, 2021. "Transfer network of high-speed rail and aviation: Structure and critical components," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 581(C).
    6. Yang, Yitao & Jia, Bin & Yan, Xiao-Yong & Zhi, Danyue & Song, Dongdong & Chen, Yan & de Bok, Michiel & Tavasszy, Lóránt A. & Gao, Ziyou, 2023. "Uncovering and modeling the hierarchical organization of urban heavy truck flows," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 179(C).
    7. Wu, Jiaxin & Lu, Jing & Zhang, Lingye & Fan, Hanwen, 2024. "Spatial heterogeneity among different-sized port communities in directed-weighted global liner shipping network," Journal of Transport Geography, Elsevier, vol. 114(C).
    8. Manikandan Narayanan & Adrian Vetta & Eric E Schadt & Jun Zhu, 2010. "Simultaneous Clustering of Multiple Gene Expression and Physical Interaction Datasets," PLOS Computational Biology, Public Library of Science, vol. 6(4), pages 1-13, April.
    9. Helena Osterholz & Stephanie Turner & Linda J. Alakangas & Eva-Lena Tullborg & Thorsten Dittmar & Birgitta E. Kalinowski & Mark Dopson, 2022. "Terrigenous dissolved organic matter persists in the energy-limited deep groundwaters of the Fennoscandian Shield," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    10. Ursula A. Tooley & Aidan Latham & Jeanette K. Kenley & Dimitrios Alexopoulos & Tara A. Smyser & Ashley N. Nielsen & Lisa Gorham & Barbara B. Warner & Joshua S. Shimony & Jeffrey J. Neil & Joan L. Luby, 2024. "Prenatal environment is associated with the pace of cortical network development over the first three years of life," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    11. Milena Oehlers & Benjamin Fabian, 2021. "Graph Metrics for Network Robustness—A Survey," Mathematics, MDPI, vol. 9(8), pages 1-48, April.
    12. Yau-Hua Yu & Hsu-Ko Kuo & Kuo-Wei Chang, 2008. "The Evolving Transcriptome of Head and Neck Squamous Cell Carcinoma: A Systematic Review," PLOS ONE, Public Library of Science, vol. 3(9), pages 1-11, September.
    13. Shen, Xin & Han, Yue & Li, Wenqian & Wong, Ka-Chun & Peng, Chengbin, 2021. "Finding core–periphery structures in large networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 581(C).
    14. Ayelet M. Rosenberg & Manish Saggar & Anna S. Monzel & Jack Devine & Peter Rogu & Aaron Limoges & Alex Junker & Carmen Sandi & Eugene V. Mosharov & Dani Dumitriu & Christoph Anacker & Martin Picard, 2023. "Brain mitochondrial diversity and network organization predict anxiety-like behavior in male mice," Nature Communications, Nature, vol. 14(1), pages 1-19, December.
    15. Shuqi Qin & Dianye Zhang & Bin Wei & Yuanhe Yang, 2024. "Dual roles of microbes in mediating soil carbon dynamics in response to warming," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    16. Jiansheng Cai & Wencong Li & Xiaodong Zhang & Jihui Wang, 2024. "New Random Walk Algorithm Based on Different Seed Nodes for Community Detection," Mathematics, MDPI, vol. 12(15), pages 1-21, July.
    17. Du, Yuxian & Lin, Xi & Pan, Ye & Chen, Zhaoxin & Xia, Huan & Luo, Qian, 2023. "Identifying influential airports in airline network based on failure risk factors with TOPSIS," Chaos, Solitons & Fractals, Elsevier, vol. 169(C).
    18. Serguei Saavedra & Jordi Duch & Brian Uzzi, 2011. "Tracking Traders' Understanding of the Market Using e-Communication Data," PLOS ONE, Public Library of Science, vol. 6(10), pages 1-7, October.
    19. Carlos Garcia, 2016. "BoCluSt: Bootstrap Clustering Stability Algorithm for Community Detection," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-15, June.
    20. Tinic, Murat & Sensoy, Ahmet & Demir, Muge & Nguyen, Duc Khuong, 2020. "Broker Network Connectivity and the Cross-Section of Expected Stock Returns," MPRA Paper 104719, University Library of Munich, Germany.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0091315. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.