IDEAS home Printed from https://ideas.repec.org/a/eee/matcom/v226y2024icp24-41.html
   My bibliography  Save this article

Optimal region-specific social distancing strategies in a complex multi-patch model through reinforcement learning

Author

Listed:
  • Lee, Hyosun
  • Abdulali, Arsen
  • Park, Haeyoung
  • Lee, Sunmi

Abstract

Although non-pharmaceutical interventions such as social distancing have proven effective in curbing outbreaks, they also carry economic consequences. This poses a dilemma for policymakers striving to find a balance between disease control and economic burden. This delicate balance varies regionally, influenced by non-epidemiological factors such as population movements, socio-demographic characteristics, and the intricacies of social distancing policies. These factors interact in intricate ways, shaping the transmission dynamics of COVID-19. To address this complexity, we propose an innovative approach utilizing deep reinforcement learning (RL). This method assists in tailoring intervention policies for diverse regions, taking into account their unique dynamics. We incorporate South Korea’s social distancing policies and their economic impact into a RL framework with a multi-region epidemic model, offering a comprehensive solution. We integrate official mobility data and GDP specific to each region, employing the proximity policy optimization algorithm to determine the most appropriate region-specific social distancing policy. The algorithm’s reward function considers both outbreak control and economic impacts, providing policymakers with the flexibility to fine-tune the balance between these two factors according to their preferences. This adjustment can be performed across three distinct cost scenarios: High, Base, and Low-cost scenarios. In scenarios with High-costs, social distancing measures are aimed at regions with extensive connectivity and higher transmission rates. When costs are moderate, policies center around the period of peak prevalence, illustrating adaptable strategies in areas characterized by high transmission rates, budget limitations, and population mobility. In situations with Low-costs, these measures encompass most regions, excluding those with low transmission rates. The study’s results support focused interventions in specific regions to balance outbreak control and economic impact mitigation.

Suggested Citation

  • Lee, Hyosun & Abdulali, Arsen & Park, Haeyoung & Lee, Sunmi, 2024. "Optimal region-specific social distancing strategies in a complex multi-patch model through reinforcement learning," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 226(C), pages 24-41.
  • Handle: RePEc:eee:matcom:v:226:y:2024:i:c:p:24-41
    DOI: 10.1016/j.matcom.2024.06.013
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378475424002386
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.matcom.2024.06.013?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gloria Hyunjung Kwak & Lowell Ling & Pan Hui, 2021. "Deep reinforcement learning approaches for global public health strategies for COVID-19 pandemic," PLOS ONE, Public Library of Science, vol. 16(5), pages 1-15, May.
    2. Junhwi Jeon & Changyong Han & Tobhin Kim & Sunmi Lee, 2022. "Evolution of Responses to COVID-19 and Epidemiological Characteristics in South Korea," IJERPH, MDPI, vol. 19(7), pages 1-20, March.
    3. Julien Arino & P. van den Driessche, 2003. "A multi-city epidemic model," Mathematical Population Studies, Taylor & Francis Journals, vol. 10(3), pages 175-193.
    4. Rey, David & Hammad, Ahmed W. & Saberi, Meead, 2023. "Vaccine allocation policy optimization and budget sharing mechanism using reinforcement learning," Omega, Elsevier, vol. 115(C).
    5. Gabriel G Katul & Assaad Mrad & Sara Bonetti & Gabriele Manoli & Anthony J Parolari, 2020. "Global convergence of COVID-19 basic reproduction number and estimation from early-time SIR dynamics," PLOS ONE, Public Library of Science, vol. 15(9), pages 1-22, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Constanza Fosco, 2012. "Spatial Difusion and Commuting Flows," Documentos de Trabajo en Economia y Ciencia Regional 30, Universidad Catolica del Norte, Chile, Department of Economics, revised Sep 2012.
    2. Jonas E. Arias & Jesús Fernández-Villaverde & Juan F. Rubio-Ramirez & Minchul Shin, 2021. "Bayesian Estimation of Epidemiological Models: Methods, Causality, and Policy Trade-Offs," Working Papers 21-18, Federal Reserve Bank of Philadelphia.
    3. Jiang, Jiehui & Ma, Jie, 2023. "Dynamic analysis of pandemic cross-regional transmission considering quarantine strategies in the context of limited medical resources," Applied Mathematics and Computation, Elsevier, vol. 450(C).
    4. Liang, Jinpeng & Zang, Guangzhi & Liu, Haitao & Zheng, Jianfeng & Gao, Ziyou, 2023. "Reducing passenger waiting time in oversaturated metro lines with passenger flow control policy," Omega, Elsevier, vol. 117(C).
    5. Saket Saurabh & Ayush Trivedi & Nithilaksh P. Lokesh & Bhagyashree Gaikwad, 2020. "Sustaining the economy under partial lockdown: A pandemic centric approach," Papers 2005.08273, arXiv.org.
    6. Mendonça, J.P. & Brum, Arthur A. & Lyra, M.L. & Lira, Sérgio A., 2024. "Evolutionary game dynamics and the phase portrait diversity in a pandemic scenario," Applied Mathematics and Computation, Elsevier, vol. 475(C).
    7. Lee, Chaeyoung & Kwak, Soobin & Kim, Sangkwon & Hwang, Youngjin & Choi, Yongho & Kim, Junseok, 2021. "Robust optimal parameter estimation for the susceptible-unidentified infected-confirmed model," Chaos, Solitons & Fractals, Elsevier, vol. 153(P1).
    8. Ida Johnsson & M. Hashem Pesaran & Cynthia Fan Yang, 2023. "Structural Econometric Estimation of the Basic Reproduction Number for Covid-19 across U.S. States and Selected Countries," CESifo Working Paper Series 10659, CESifo.
    9. Martínez-Guerra, Rafael & Flores-Flores, Juan Pablo, 2021. "An algorithm for the robust estimation of the COVID-19 pandemic’s population by considering undetected individuals," Applied Mathematics and Computation, Elsevier, vol. 405(C).
    10. Mahajan, Shveta & Kumar, Deepak & Verma, Atul Kumar & Sharma, Natasha, 2023. "Dynamic analysis of modified SEIR epidemic model with time delay in geographical networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 629(C).
    11. Liu, Shasha & Yamamoto, Toshiyuki, 2022. "Role of stay-at-home requests and travel restrictions in preventing the spread of COVID-19 in Japan," Transportation Research Part A: Policy and Practice, Elsevier, vol. 159(C), pages 1-16.
    12. Jonas E. Arias & Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez & Minchul Shin, 2021. "Bayesian Estimation of Epidemiological Models: Methods, Causality, and Policy Trade-Offs," CESifo Working Paper Series 8977, CESifo.
    13. Yin, Qian & Wang, Zhishuang & Xia, Chengyi & Dehmer, Matthias & Emmert-Streib, Frank & Jin, Zhen, 2020. "A novel epidemic model considering demographics and intercity commuting on complex dynamical networks," Applied Mathematics and Computation, Elsevier, vol. 386(C).
    14. Yi Xie & Ziheng Zhang & Yan Wu & Shuang Li & Liuyong Pang & Yong Li, 2024. "Time-Delay Dynamic Model and Cost-Effectiveness Analysis of Major Emergent Infectious Diseases with Transportation-Related Infection and Entry-Exit Screening," Mathematics, MDPI, vol. 12(13), pages 1-25, July.
    15. Jonas E. Arias & Jesús Fernández-Villaverde & Juan Rubio Ramírez & Minchul Shin, 2021. "The Causal Effects of Lockdown Policies on Health and Macroeconomic Outcomes," NBER Working Papers 28617, National Bureau of Economic Research, Inc.
    16. Pablo D. Fajgelbaum & Amit Khandelwal & Wookun Kim & Cristiano Mantovani & Edouard Schaal, 2021. "Optimal Lockdown in a Commuting Network," American Economic Review: Insights, American Economic Association, vol. 3(4), pages 503-522, December.
    17. José Ulises Márquez Urbina & Graciela González Farías & L Leticia Ramírez Ramírez & D Iván Rodríguez González, 2022. "A multi-source global-local model for epidemic management," PLOS ONE, Public Library of Science, vol. 17(1), pages 1-26, January.
    18. Chang, Sheryl L. & Piraveenan, Mahendra & Prokopenko, Mikhail, 2020. "Impact of network assortativity on epidemic and vaccination behaviour," Chaos, Solitons & Fractals, Elsevier, vol. 140(C).
    19. Westerink-Duijzer, L.E. & van Jaarsveld, W.L. & Wallinga, J. & Dekker, R., 2015. "Dose-optimal vaccine allocation over multiple populations," Econometric Institute Research Papers EI2015-29, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    20. Sefa Awaworyi Churchill & John Inekwe & Kris Ivanovski, 2023. "Has the COVID-19 pandemic converged across countries?," Empirical Economics, Springer, vol. 64(5), pages 2027-2052, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:matcom:v:226:y:2024:i:c:p:24-41. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/mathematics-and-computers-in-simulation/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.