IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v586y2022ics0378437121007408.html
   My bibliography  Save this article

Weighted interdependent network disintegration strategy based on Q-learning

Author

Listed:
  • Chen, Wenhao
  • Li, Jichao
  • Jiang, Jiang
  • Chen, Gang

Abstract

The problem of network disintegration is one of the core topics in the field of network science. Currently, most of the existing research is based on homogeneous and single-layer networks of nodes. However, the various components of complex systems in the real world are often interdependent, and the cost of attacking different units is diverse, causing the traditional network disintegration method to lack good applicability. This paper establishes a weighted interdependent network (WIN) model, and based on this, a WIN disintegration strategy based on Q-learning is proposed. First, the network nodes are divided into multiple node sets according to the dependencies between the nodes, and the state and action space of Q-learning are determined. Next, the disintegration cost constraints and Q-learning parameters are defined to perform iterative learning. Then, the optimal network disintegration strategy is calculated according to the iterative Q-table. The results show that when the cost sensitivity factor (p) is fixed, DSQ can maintain good results in disintegrating different types of networks under different cost constraints, while the baseline methods have difficulty guaranteeing the disintegration effect in the face of different types of networks. Furthermore, we perform a sensitivity analysis on the p value and find that the effect of most of the baseline methods worsens as the p value increases, while DSQ maintains a good effect.

Suggested Citation

  • Chen, Wenhao & Li, Jichao & Jiang, Jiang & Chen, Gang, 2022. "Weighted interdependent network disintegration strategy based on Q-learning," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 586(C).
  • Handle: RePEc:eee:phsmap:v:586:y:2022:i:c:s0378437121007408
    DOI: 10.1016/j.physa.2021.126467
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437121007408
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2021.126467?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Huang, Binchao & Yang, Jin-Xuan & Li, Xin, 2021. "Identifying influential links to control spreading of epidemics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 583(C).
    2. Yu, Yang & Deng, Ye & Tan, Suo-Yi & Wu, Jun, 2018. "Efficient disintegration strategy in directed networks based on tabu search," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 507(C), pages 435-442.
    3. Xuzhen Zhu & Jinming Ma & Xin Su & Hui Tian & Wei Wang & Shimin Cai, 2019. "Information Spreading on Weighted Multiplex Social Network," Complexity, Hindawi, vol. 2019, pages 1-15, November.
    4. Qingqing Zhai & Rui Peng & Jun Zhuang, 2020. "Defender–Attacker Games with Asymmetric Player Utilities," Risk Analysis, John Wiley & Sons, vol. 40(2), pages 408-420, February.
    5. Alessandro Vespignani, 2018. "Twenty years of network science," Nature, Nature, vol. 558(7711), pages 528-529, June.
    6. Gu, Yu & Fu, Xiao & Liu, Zhiyuan & Xu, Xiangdong & Chen, Anthony, 2020. "Performance of transportation network under perturbations: Reliability, vulnerability, and resilience," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 133(C).
    7. Mahmoud Saleh & Yusef Esa & Ahmed Mohamed, 2018. "Applications of Complex Network Analysis in Electric Power Systems," Energies, MDPI, vol. 11(6), pages 1-16, May.
    8. Faramondi, Luca & Setola, Roberto & Panzieri, Stefano & Pascucci, Federica & Oliva, Gabriele, 2018. "Finding critical nodes in infrastructure networks," International Journal of Critical Infrastructure Protection, Elsevier, vol. 20(C), pages 3-15.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Feng, Xiao & He, Shiwei & Li, Guangye & Chi, Jushang, 2021. "Transfer network of high-speed rail and aviation: Structure and critical components," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 581(C).
    2. Xu, Xiangdong & Qu, Kai & Chen, Anthony & Yang, Chao, 2021. "A new day-to-day dynamic network vulnerability analysis approach with Weibit-based route adjustment process," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 153(C).
    3. Kurmankhojayev, Daniyar & Li, Guoyuan & Chen, Anthony, 2024. "Link criticality index: Refinement, framework extension, and a case study," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    4. Tio, Adonis E. & Hill, David J. & Ma, Jin, 2020. "Can graph properties determine future grid adequacy for power injection diversity?," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 550(C).
    5. Lin, Chen & Xiao, Hui & Kou, Gang & Peng, Rui, 2020. "Defending a series system with individual protection, overarching protection, and disinformation," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    6. Xinyuan Chen & Ruyang Yin & Qinhe An & Yuan Zhang, 2021. "Modeling a Distance-Based Preferential Fare Scheme for Park-and-Ride Services in a Multimodal Transport Network," Sustainability, MDPI, vol. 13(5), pages 1-14, March.
    7. Ali Nouri Qarahasanlou & Ali Zamani & Abbas Barabadi & Mahdi Mokhberdoran, 2021. "Resilience Assessment: A Performance-Based Importance Measure," Energies, MDPI, vol. 14(22), pages 1-16, November.
    8. Mylonas, Chrysostomos & Mitsakis, Evangelos & Kepaptsoglou, Konstantinos, 2023. "Criticality analysis in road networks with graph-theoretic measures, traffic assignment, and simulation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 629(C).
    9. Zhang, Jing & Wang, Yan & Zhuang, Jun, 2021. "Modeling multi-target defender-attacker games with quantal response attack strategies," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    10. Cailian Gu & Yibo Wang & Weisheng Wang & Yang Gao, 2023. "Research on Load State Sensing and Early Warning Method of Distribution Network under High Penetration Distributed Generation Access," Energies, MDPI, vol. 16(7), pages 1-15, March.
    11. Hector Eduardo Roman & Fabrizio Croccolo, 2021. "Spreading of Infections on Network Models: Percolation Clusters and Random Trees," Mathematics, MDPI, vol. 9(23), pages 1-22, November.
    12. Wang, Xuhui & Wu, Jiao & Yang, Zheng & Xu, Kesheng & Wang, Zhengling & Zheng, Muhua, 2024. "The correlation between independent edge and triangle degrees promote the explosive information spreading," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 640(C).
    13. Sasai, Kotaro & Chouinard, Luc E. & Power, Gabriel J. & Conciatori, David & Zufferey, Nicolas, 2024. "Accounting for traffic disturbance in road infrastructure management: Optimal maintenance and rehabilitation planning for the society," Transportation Research Part A: Policy and Practice, Elsevier, vol. 183(C).
    14. Lawford, Steve & Mehmeti, Yll, 2020. "Cliques and a new measure of clustering: With application to U.S. domestic airlines," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 560(C).
    15. Wang, Shuliang & Chen, Chen & Zhang, Jianhua & Gu, Xifeng & Huang, Xiaodi, 2022. "Vulnerability assessment of urban road traffic systems based on traffic flow," International Journal of Critical Infrastructure Protection, Elsevier, vol. 38(C).
    16. Hunt, Kyle & Zhuang, Jun, 2024. "A review of attacker-defender games: Current state and paths forward," European Journal of Operational Research, Elsevier, vol. 313(2), pages 401-417.
    17. Tang, Junqing & Xu, Lei & Luo, Chunling & Ng, Tsan Sheng Adam, 2021. "Multi-disruption resilience assessment of rail transit systems with optimized commuter flows," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    18. Li, Yang & Sun, Hao & Xiong, Wanda & Xu, Genjiu, 2021. "Belief model of complex contagions on random networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 567(C).
    19. Yin, Kai & Wu, Jianjun & Wang, Weiping & Lee, Der-Horng & Wei, Yun, 2023. "An integrated resilience assessment model of urban transportation network: A case study of 40 cities in China," Transportation Research Part A: Policy and Practice, Elsevier, vol. 173(C).
    20. Fang, Yinhai & Xu, Haiyan & Perc, Matjaž & Tan, Qingmei, 2019. "Dynamic evolution of economic networks under the influence of mergers and divestitures," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 524(C), pages 89-99.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:586:y:2022:i:c:s0378437121007408. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.