IDEAS home Printed from https://ideas.repec.org/a/eee/matcom/v133y2017icp235-248.html
   My bibliography  Save this article

Simulation-based optimization of radiotherapy: Agent-based modeling and reinforcement learning

Author

Listed:
  • Jalalimanesh, Ammar
  • Shahabi Haghighi, Hamidreza
  • Ahmadi, Abbas
  • Soltani, Madjid

Abstract

Along with surgery and chemotherapy, radiotherapy is an effective way to treat cancer. Many cancer patients take delivery of radiation. The goal of radiotherapy is to destroy the tumor without damaging healthy tissue. Due to the complexity of the procedure, modeling and simulation can be useful for radiotherapy. In this research we propose a new approach to optimize dose calculation in radiotherapy. We consider fix schedule of irradiation and varying the fraction size during the treatment. The proposed approach contains two steps. At the first step, we develop an agent-based simulation of vascular tumor growth based on biological evidences. We consider a multi-scale model in which cellular and subcellular scales are observed. We consider heterogeneity of tumor oxygen diffusion and also the effects of cancer cells hypoxia on radiotherapy. Besides, different radiosensitivity of cells related to their cell-cycle phase is modeled. The agent-based model was implemented in NetLogo package. Based on this model, we simulate different scenarios of radiotherapy. At the second step, we propose an algorithm for the optimization of radiotherapy. Radiation dose and fractionation scheme are considered as two key elements of radiation therapy. To optimize the therapy we apply Q-learning algorithm. Finally, we combine the simulation and optimization compartments together using R-NetLogo package. By tuning the parameters of learning algorithm optimal treatment plans are achieved to cure tumor together with minimum side effects. Our research presents the power of agent-based approach combined with reinforcement learning for simulating and optimizing complex biological problems such as radiotherapy. The proposed modeling approach lets us to study different scenarios of tumor growth and radiotherapy. Furthermore, our optimization algorithm works fast and finds the best treatment plan.

Suggested Citation

  • Jalalimanesh, Ammar & Shahabi Haghighi, Hamidreza & Ahmadi, Abbas & Soltani, Madjid, 2017. "Simulation-based optimization of radiotherapy: Agent-based modeling and reinforcement learning," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 133(C), pages 235-248.
  • Handle: RePEc:eee:matcom:v:133:y:2017:i:c:p:235-248
    DOI: 10.1016/j.matcom.2016.05.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378475416300878
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.matcom.2016.05.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jiménez, Rolando Placeres & Hernandez, Eloy Ortiz, 2011. "Tumour–host dynamics under radiotherapy," Chaos, Solitons & Fractals, Elsevier, vol. 44(9), pages 685-692.
    2. Thiele, Jan C, 2014. "R Marries NetLogo: Introduction to the RNetLogo Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 58(i02).
    3. Geng Deng & Michael C. Ferris, 2008. "Neuro-dynamic programming for fractionated radiotherapy planning," Springer Optimization and Its Applications, in: Carlos J. S. Alves & Panos M. Pardalos & Luis Nunes Vicente (ed.), Optimization in Medicine, pages 47-70, Springer.
    4. S. A. Murphy, 2003. "Optimal dynamic treatment regimes," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(2), pages 331-355, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Farahani, Farzad Vasheghani & Ahmadi, Abbas & Zarandi, Mohammad Hossein Fazel, 2018. "Hybrid intelligent approach for diagnosis of the lung nodule from CT images using spatial kernelized fuzzy c-means and ensemble learning," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 149(C), pages 48-68.
    2. Lazebnik, Teddy, 2023. "Computational applications of extended SIR models: A review focused on airborne pandemics," Ecological Modelling, Elsevier, vol. 483(C).
    3. Maxim Kuznetsov & Andrey Kolobov, 2020. "Optimization of Dose Fractionation for Radiotherapy of a Solid Tumor with Account of Oxygen Effect and Proliferative Heterogeneity," Mathematics, MDPI, vol. 8(8), pages 1-20, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jin Wang & Donglin Zeng & D. Y. Lin, 2022. "Semiparametric single-index models for optimal treatment regimens with censored outcomes," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 28(4), pages 744-763, October.
    2. Ji Liu, 2024. "Education legislations that equalize: a study of compulsory schooling law reforms in post-WWII United States," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-12, December.
    3. Durlauf, Steven N. & Navarro, Salvador & Rivers, David A., 2016. "Model uncertainty and the effect of shall-issue right-to-carry laws on crime," European Economic Review, Elsevier, vol. 81(C), pages 32-67.
    4. Yusuke Narita, 2018. "Toward an Ethical Experiment," Cowles Foundation Discussion Papers 2127, Cowles Foundation for Research in Economics, Yale University.
    5. Xin Qiu & Donglin Zeng & Yuanjia Wang, 2018. "Estimation and evaluation of linear individualized treatment rules to guarantee performance," Biometrics, The International Biometric Society, vol. 74(2), pages 517-528, June.
    6. Yiwang Zhou & Peter X.K. Song & Haoda Fu, 2021. "Net benefit index: Assessing the influence of a biomarker for individualized treatment rules," Biometrics, The International Biometric Society, vol. 77(4), pages 1254-1264, December.
    7. Ruoqing Zhu & Ying-Qi Zhao & Guanhua Chen & Shuangge Ma & Hongyu Zhao, 2017. "Greedy outcome weighted tree learning of optimal personalized treatment rules," Biometrics, The International Biometric Society, vol. 73(2), pages 391-400, June.
    8. Zeyu Bian & Erica E. M. Moodie & Susan M. Shortreed & Sahir Bhatnagar, 2023. "Variable selection in regression‐based estimation of dynamic treatment regimes," Biometrics, The International Biometric Society, vol. 79(2), pages 988-999, June.
    9. Thomas A. Murray & Peter F. Thall & Ying Yuan & Sarah McAvoy & Daniel R. Gomez, 2017. "Robust Treatment Comparison Based on Utilities of Semi-Competing Risks in Non-Small-Cell Lung Cancer," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(517), pages 11-23, January.
    10. Yusuke Narita, 2018. "Experiment-as-Market: Incorporating Welfare into Randomized Controlled Trials," Cowles Foundation Discussion Papers 2127r, Cowles Foundation for Research in Economics, Yale University, revised May 2019.
    11. Michael Lechner & Stephan Wiehler, 2013. "Does the Order and Timing of Active Labour Market Programmes Matter?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 75(2), pages 180-212, April.
    12. Shuze Chen & David Simchi-Levi & Chonghuan Wang, 2024. "Experimenting on Markov Decision Processes with Local Treatments," Papers 2407.19618, arXiv.org, revised Oct 2024.
    13. Fanny A. Kluge & Tobias C. Vogt, 2020. "Intergenerational transfers within the family and the role for old age survival," MPIDR Working Papers WP-2020-021, Max Planck Institute for Demographic Research, Rostock, Germany.
    14. Vasilis Syrgkanis & Ruohan Zhan, 2023. "Post Reinforcement Learning Inference," Papers 2302.08854, arXiv.org, revised May 2024.
    15. Rich Benjamin & Moodie Erica E. M. & A. Stephens David, 2016. "Influence Re-weighted G-Estimation," The International Journal of Biostatistics, De Gruyter, vol. 12(1), pages 157-177, May.
    16. Stephens Alisa & Keele Luke & Joffe Marshall, 2016. "Generalized Structural Mean Models for Evaluating Depression as a Post-treatment Effect Modifier of a Jobs Training Intervention," Journal of Causal Inference, De Gruyter, vol. 4(2), pages 1-17, September.
    17. Peng Wu & Donglin Zeng & Haoda Fu & Yuanjia Wang, 2020. "On using electronic health records to improve optimal treatment rules in randomized trials," Biometrics, The International Biometric Society, vol. 76(4), pages 1075-1086, December.
    18. Luedtke Alexander R. & van der Laan Mark J., 2016. "Optimal Individualized Treatments in Resource-Limited Settings," The International Journal of Biostatistics, De Gruyter, vol. 12(1), pages 283-303, May.
    19. Weibin Mo & Yufeng Liu, 2022. "Efficient learning of optimal individualized treatment rules for heteroscedastic or misspecified treatment‐free effect models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(2), pages 440-472, April.
    20. Stephen Chick & Martin Forster & Paolo Pertile, 2017. "A Bayesian decision theoretic model of sequential experimentation with delayed response," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(5), pages 1439-1462, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:matcom:v:133:y:2017:i:c:p:235-248. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/mathematics-and-computers-in-simulation/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.