IDEAS home Printed from https://ideas.repec.org/a/kap/hcarem/v21y2018i3d10.1007_s10729-016-9388-9.html
   My bibliography  Save this article

Simulation-based approximate policy iteration for dynamic patient scheduling for radiation therapy

Author

Listed:
  • Yasin Gocgun

    (Istanbul Kemerburgaz University)

Abstract

We study radiation therapy scheduling problem where dynamically and stochastically arriving patients of different types are scheduled to future days. Unlike similar models in the literature, we consider cancellation of treatments. We formulate this dynamic multi-appointment patient scheduling problem as a Markov Decision Process (MDP). Since the MDP is intractable due to large state and action spaces, we employ a simulation-based approximate dynamic programming (ADP) approach to approximately solve our model. In particular, we develop Least-square based approximate policy iteration for solving our model. The performance of the ADP approach is compared with that of a myopic heuristic decision rule.

Suggested Citation

  • Yasin Gocgun, 2018. "Simulation-based approximate policy iteration for dynamic patient scheduling for radiation therapy," Health Care Management Science, Springer, vol. 21(3), pages 317-325, September.
    • Handle: RePEc:kap:hcarem:v:21:y:2018:i:3:d:10.1007_s10729-016-9388-9
    DOI: 10.1007/s10729-016-9388-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10729-016-9388-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10729-016-9388-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Novoa, Clara & Storer, Robert, 2009. "An approximate dynamic programming approach for the vehicle routing problem with stochastic demands," European Journal of Operational Research, Elsevier, vol. 196(2), pages 509-515, July.
    2. Kim, Minsun & Ghate, Archis & Phillips, Mark H., 2012. "A stochastic control formalism for dynamic biologically conformal radiation therapy," European Journal of Operational Research, Elsevier, vol. 219(3), pages 541-556.
    3. Jonathan Patrick & Martin L. Puterman & Maurice Queyranne, 2008. "Dynamic Multipriority Patient Scheduling for a Diagnostic Resource," Operations Research, INFORMS, vol. 56(6), pages 1507-1525, December.
    4. Jonathan Patrick, 2012. "A Markov decision model for determining optimal outpatient scheduling," Health Care Management Science, Springer, vol. 15(2), pages 91-102, June.
    5. Conforti, D. & Guerriero, F. & Guido, R., 2010. "Non-block scheduling with priority for radiotherapy treatments," European Journal of Operational Research, Elsevier, vol. 201(1), pages 289-296, February.
    6. Sauré, Antoine & Patrick, Jonathan & Tyldesley, Scott & Puterman, Martin L., 2012. "Dynamic multi-appointment patient scheduling for radiation therapy," European Journal of Operational Research, Elsevier, vol. 223(2), pages 573-584.
    7. Astaraky, Davood & Patrick, Jonathan, 2015. "A simulation based approximate dynamic programming approach to multi-class, multi-resource surgical scheduling," European Journal of Operational Research, Elsevier, vol. 245(1), pages 309-319.
    8. Misic, V.V. & Aleman, D.M. & Sharpe, M.B., 2010. "Neighborhood search approaches to non-coplanar beam orientation optimization for total marrow irradiation using IMRT," European Journal of Operational Research, Elsevier, vol. 205(3), pages 522-527, September.
    9. Lim, Gino J. & Cao, Wenhua, 2012. "A two-phase method for selecting IMRT treatment beam angles: Branch-and-Prune and local neighborhood search," European Journal of Operational Research, Elsevier, vol. 217(3), pages 609-618.
    10. Yasin Gocgun & Martin Puterman, 2014. "Dynamic scheduling with due dates and time windows: an application to chemotherapy patient appointment booking," Health Care Management Science, Springer, vol. 17(1), pages 60-76, March.
    11. Nan Liu & Serhan Ziya & Vidyadhar G. Kulkarni, 2010. "Dynamic Scheduling of Outpatient Appointments Under Patient No-Shows and Cancellations," Manufacturing & Service Operations Management, INFORMS, vol. 12(2), pages 347-364, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tu-San Pham & Louis-Martin Rousseau & Patrick Causmaecker, 2022. "A two-phase approach for the Radiotherapy Scheduling Problem," Health Care Management Science, Springer, vol. 25(2), pages 191-207, June.
    2. Kaining Shao & Wenjuan Fan & Zishu Yang & Shanlin Yang & Panos M. Pardalos, 2022. "A column generation approach for patient scheduling with setup time and deteriorating treatment duration," Operational Research, Springer, vol. 22(3), pages 2555-2586, July.
    3. Silva, Thiago A.O. & de Souza, Mauricio C., 2020. "Surgical scheduling under uncertainty by approximate dynamic programming," Omega, Elsevier, vol. 95(C).
    4. Bowen Pang & Xiaolei Xie & Feng Ju & James Pipe, 2022. "A dynamic sequential decision-making model on MRI real-time scheduling with simulation-based optimization," Health Care Management Science, Springer, vol. 25(3), pages 426-440, September.
    5. Shao, Kaining & Fan, Wenjuan & Lan, Shaowen & Kong, Min & Yang, Shanlin, 2023. "A column generation-based heuristic for brachytherapy patient scheduling with multiple treatment sessions considering radioactive source decay and time constraints," Omega, Elsevier, vol. 118(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ahmadi-Javid, Amir & Jalali, Zahra & Klassen, Kenneth J, 2017. "Outpatient appointment systems in healthcare: A review of optimization studies," European Journal of Operational Research, Elsevier, vol. 258(1), pages 3-34.
    2. Silva, Thiago A.O. & de Souza, Mauricio C., 2020. "Surgical scheduling under uncertainty by approximate dynamic programming," Omega, Elsevier, vol. 95(C).
    3. Adam Diamant, 2021. "Dynamic multistage scheduling for patient-centered care plans," Health Care Management Science, Springer, vol. 24(4), pages 827-844, December.
    4. Sauré, Antoine & Patrick, Jonathan & Tyldesley, Scott & Puterman, Martin L., 2012. "Dynamic multi-appointment patient scheduling for radiation therapy," European Journal of Operational Research, Elsevier, vol. 223(2), pages 573-584.
    5. Qu, Xiuli & Peng, Yidong & Shi, Jing & LaGanga, Linda, 2015. "An MDP model for walk-in patient admission management in primary care clinics," International Journal of Production Economics, Elsevier, vol. 168(C), pages 303-320.
    6. Agrawal, Deepak & Pang, Guodong & Kumara, Soundar, 2023. "Preference based scheduling in a healthcare provider network," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1318-1335.
    7. Camila Ramos & Alejandro Cataldo & Juan–Carlos Ferrer, 2020. "Appointment and patient scheduling in chemotherapy: a case study in Chilean hospitals," Annals of Operations Research, Springer, vol. 286(1), pages 411-439, March.
    8. Yasin Gocgun & Martin Puterman, 2014. "Dynamic scheduling with due dates and time windows: an application to chemotherapy patient appointment booking," Health Care Management Science, Springer, vol. 17(1), pages 60-76, March.
    9. Gang Du & Xinyue Li & Hui Hu & Xiaoling Ouyang, 2018. "Optimizing Daily Service Scheduling for Medical Diagnostic Equipment Considering Patient Satisfaction and Hospital Revenue," Sustainability, MDPI, vol. 10(9), pages 1-23, September.
    10. Dai, Jiajun & Geng, Na & Xie, Xiaolan, 2021. "Dynamic advance scheduling of outpatient appointments in a moving booking window," European Journal of Operational Research, Elsevier, vol. 292(2), pages 622-632.
    11. Antoine Sauré & Jonathan Patrick & Martin L. Puterman, 2015. "Simulation-Based Approximate Policy Iteration with Generalized Logistic Functions," INFORMS Journal on Computing, INFORMS, vol. 27(3), pages 579-595, August.
    12. Aditya Shetty & Harry Groenevelt & Vera Tilson, 2023. "Intraday dynamic rescheduling under patient no-shows," Health Care Management Science, Springer, vol. 26(3), pages 583-598, September.
    13. Andre A. Cire & Adam Diamant, 2022. "Dynamic scheduling of home care patients to medical providers," Production and Operations Management, Production and Operations Management Society, vol. 31(11), pages 4038-4056, November.
    14. Van-Anh Truong, 2015. "Optimal Advance Scheduling," Management Science, INFORMS, vol. 61(7), pages 1584-1597, July.
    15. Lauren E. Cipriano & Thomas A. Weber, 2018. "Population-level intervention and information collection in dynamic healthcare policy," Health Care Management Science, Springer, vol. 21(4), pages 604-631, December.
    16. Liping Zhou & Na Geng & Zhibin Jiang & Shan Jiang, 2022. "Integrated Multiresource Capacity Planning and Multitype Patient Scheduling," INFORMS Journal on Computing, INFORMS, vol. 34(1), pages 129-149, January.
    17. Li Luo & Ying Zhou & Bernard T. Han & Jialing Li, 2019. "An optimization model to determine appointment scheduling window for an outpatient clinic with patient no-shows," Health Care Management Science, Springer, vol. 22(1), pages 68-84, March.
    18. Esmaeil Keyvanshokooh & Pooyan Kazemian & Mohammad Fattahi & Mark P. Van Oyen, 2022. "Coordinated and Priority‐Based Surgical Care: An Integrated Distributionally Robust Stochastic Optimization Approach," Production and Operations Management, Production and Operations Management Society, vol. 31(4), pages 1510-1535, April.
    19. Na Geng & Xiaolan Xie, 2022. "Managing Advance Admission Requests for Obstetric Care," INFORMS Journal on Computing, INFORMS, vol. 34(2), pages 1224-1239, March.
    20. Xiang Ma & Antoine Sauré & Martin L. Puterman & Marianne Taylor & Scott Tyldesley, 2016. "Capacity planning and appointment scheduling for new patient oncology consults," Health Care Management Science, Springer, vol. 19(4), pages 347-361, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:hcarem:v:21:y:2018:i:3:d:10.1007_s10729-016-9388-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.