IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v654y2024ics0378437124006344.html
   My bibliography  Save this article

Improving community detection in blockmodel by distance-based observation selection

Author

Listed:
  • Shao, Cunqi
  • Wu, Mincheng
  • He, Shibo

Abstract

Community detection is an important research topic in complex systems and has plenty of applications in real-world networks. Probabilistic methods, such as the Expectation–Maximization (EM), are developed to classify nodes that have similar connection patterns in a network based on blockmodels. However, the detection procedures in these models are typically started from randomly generated initial community distributions without prior knowledge. In biological and social networks, there are practical measures to obtain prior knowledge for a subset of nodes, such as local observations. These facts lead us to question how we can select a subset of nodes with known community labels to enhance the accuracy of the EM method. The current selection methods lack the relationship between detection accuracy and structural characteristics and most approaches consider the nodes as the center of communities, which is not suitable for block models. In this paper, we first study the relationships between the structural distance and detection accuracy without prior knowledge. Then we propose a distance-based indicator to describe the performance of the observation node set in the EM method. Finally, we introduce a scoring method based on the indicator to select a partial observation set, improving the accuracy of community detection using the EM method. Empirical results from synthetic and real-world networks corroborate that the proposed indicator could contribute to a better performance in kinds of scenarios.

Suggested Citation

  • Shao, Cunqi & Wu, Mincheng & He, Shibo, 2024. "Improving community detection in blockmodel by distance-based observation selection," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 654(C).
  • Handle: RePEc:eee:phsmap:v:654:y:2024:i:c:s0378437124006344
    DOI: 10.1016/j.physa.2024.130125
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437124006344
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2024.130125?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. L. Šubelj & M. Bajec, 2012. "Ubiquitousness of link-density and link-pattern communities in real-world networks," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 85(1), pages 1-11, January.
    2. Wang, Yan & Li, Haozhan & Zhang, Ling & Zhao, Linlin & Li, Wanlan, 2022. "Identifying influential nodes in social networks: Centripetal centrality and seed exclusion approach," Chaos, Solitons & Fractals, Elsevier, vol. 162(C).
    3. Yong-Yeol Ahn & James P. Bagrow & Sune Lehmann, 2010. "Link communities reveal multiscale complexity in networks," Nature, Nature, vol. 466(7307), pages 761-764, August.
    4. Wang, Zhi-Yong & Zhang, Cui-Ping & Othman Yahya, Rebaz, 2024. "High-quality community detection in complex networks based on node influence analysis," Chaos, Solitons & Fractals, Elsevier, vol. 182(C).
    5. Wang, Chunyu & Zhang, Fan & Deng, Yue & Gao, Chao & Li, Xianghua & Wang, Zhen, 2020. "An adaptive population control framework for ACO-based community detection," Chaos, Solitons & Fractals, Elsevier, vol. 138(C).
    6. Daniel Witvliet & Ben Mulcahy & James K. Mitchell & Yaron Meirovitch & Daniel R. Berger & Yuelong Wu & Yufang Liu & Wan Xian Koh & Rajeev Parvathala & Douglas Holmyard & Richard L. Schalek & Nir Shavi, 2021. "Connectomes across development reveal principles of brain maturation," Nature, Nature, vol. 596(7871), pages 257-261, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Amiri, Babak & Karimianghadim, Ramin, 2024. "A novel text clustering model based on topic modelling and social network analysis," Chaos, Solitons & Fractals, Elsevier, vol. 181(C).
    2. Xiaofeng Wang & Gongshen Liu & Jianhua Li & Jan P Nees, 2017. "Locating Structural Centers: A Density-Based Clustering Method for Community Detection," PLOS ONE, Public Library of Science, vol. 12(1), pages 1-23, January.
    3. Jo, Hang-Hyun & Moon, Eunyoung, 2016. "Dynamical complexity in the perception-based network formation model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 463(C), pages 282-292.
    4. Zhihao Zheng & Christopher S. Own & Adrian A. Wanner & Randal A. Koene & Eric W. Hammerschmith & William M. Silversmith & Nico Kemnitz & Ran Lu & David W. Tank & H. Sebastian Seung, 2024. "Fast imaging of millimeter-scale areas with beam deflection transmission electron microscopy," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    5. Tamás Nepusz & Tamás Vicsek, 2013. "Hierarchical Self-Organization of Non-Cooperating Individuals," PLOS ONE, Public Library of Science, vol. 8(12), pages 1-9, December.
    6. Wu, Zhihao & Lin, Youfang & Wan, Huaiyu & Tian, Shengfeng & Hu, Keyun, 2012. "Efficient overlapping community detection in huge real-world networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(7), pages 2475-2490.
    7. Yang, Xu-Hua & Lou, Shun-Li & Chen, Guang & Chen, Sheng-Yong & Huang, Wei, 2013. "Scale-free networks via attaching to random neighbors," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(17), pages 3531-3536.
    8. Badie, Reza & Aleahmad, Abolfazl & Asadpour, Masoud & Rahgozar, Maseud, 2013. "An efficient agent-based algorithm for overlapping community detection using nodes’ closeness," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(20), pages 5231-5247.
    9. Jean-Gabriel Young & Antoine Allard & Laurent Hébert-Dufresne & Louis J Dubé, 2015. "A Shadowing Problem in the Detection of Overlapping Communities: Lifting the Resolution Limit through a Cascading Procedure," PLOS ONE, Public Library of Science, vol. 10(10), pages 1-19, October.
    10. Wang, Yuyao & Bu, Zhan & Yang, Huan & Li, Hui-Jia & Cao, Jie, 2021. "An effective and scalable overlapping community detection approach: Integrating social identity model and game theory," Applied Mathematics and Computation, Elsevier, vol. 390(C).
    11. Le Ou-Yang & Dao-Qing Dai & Xiao-Fei Zhang, 2013. "Protein Complex Detection via Weighted Ensemble Clustering Based on Bayesian Nonnegative Matrix Factorization," PLOS ONE, Public Library of Science, vol. 8(5), pages 1-18, May.
    12. Noa Deshe & Yifat Eliezer & Lihi Hoch & Eyal Itskovits & Eduard Bokman & Shachaf Ben-Ezra & Alon Zaslaver, 2023. "Inheritance of associative memories and acquired cellular changes in C. elegans," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    13. Aykut SENGUL & Levent CINKO, 2024. "Examining Financial Development and Depth in the Context of Country Groups with the GMM Method," Journal of BRSA Banking and Financial Markets, Banking Regulation and Supervision Agency, vol. 18(2), pages 211-228.
    14. Jiang, Yasong & Li, Taisong & Zhang, Yan & Yan, Yonghong, 2017. "Collective prediction based on community structure," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 465(C), pages 587-598.
    15. Xu, Guiqiong & Meng, Lei, 2023. "A novel algorithm for identifying influential nodes in complex networks based on local propagation probability model," Chaos, Solitons & Fractals, Elsevier, vol. 168(C).
    16. Zhang, Hongli & Gao, Yang & Zhang, Yue, 2018. "Overlapping communities from dense disjoint and high total degree clusters," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 496(C), pages 286-298.
    17. Hyunsoo Yim & Daniel T. Choe & J. Alexander Bae & Myung-kyu Choi & Hae-Mook Kang & Ken C. Q. Nguyen & Soungyub Ahn & Sang-kyu Bahn & Heeseung Yang & David H. Hall & Jinseop S. Kim & Junho Lee, 2024. "Comparative connectomics of dauer reveals developmental plasticity," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    18. Li, Xianghua & Zhen, Xiyuan & Qi, Xin & Han, Huichun & Zhang, Long & Han, Zhen, 2023. "Dynamic community detection based on graph convolutional networks and contrastive learning," Chaos, Solitons & Fractals, Elsevier, vol. 176(C).
    19. Cui, Xue-Mei & Yoon, Chang No & Youn, Hyejin & Lee, Sang Hoon & Jung, Jean S. & Han, Seung Kee, 2017. "Dynamic burstiness of word-occurrence and network modularity in textbook systems," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 487(C), pages 103-110.
    20. Hanlin You & Mengjun Li & Jiang Jiang & Bingfeng Ge & Xueting Zhang, 2017. "Evolution monitoring for innovation sources using patent cluster analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(2), pages 693-715, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:654:y:2024:i:c:s0378437124006344. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.