IDEAS home Printed from https://ideas.repec.org/a/spr/joptap/v175y2017i1d10.1007_s10957-017-1139-7.html
   My bibliography  Save this article

Optimal Timing to Initiate Medical Treatment for a Disease Evolving as a Semi-Markov Process

Author

Listed:
  • Mabel C. Chou

    (NUS Business School)

  • Mahmut Parlar

    (McMaster University)

  • Yun Zhou

    (McMaster University)

Abstract

In this paper, we consider the problem of the optimal timing to initiate a medical treatment. In the absence of treatment, we model the disease evolution as a semi-Markov process. The optimal time to initiate the treatment is a stopping time, which maximizes the total expected reward for the patient. We propose a stochastic dynamic programming formulation to find this stopping time. Under some plausible conditions, we show that the maximum total expected reward at the start of a health state will be smaller when the patient is in a more severe state. We then prove that the optimal policy for initializing the treatment is determined by a time threshold for each given health state. That is, in each health state, the treatment should be planned to start, when the patient’s duration time in the health state reaches (or exceeds, in the case of a late observation of the patient’s health status) a certain threshold level. We also present numerical examples to illustrate our model and to provide managerial insights.

Suggested Citation

  • Mabel C. Chou & Mahmut Parlar & Yun Zhou, 2017. "Optimal Timing to Initiate Medical Treatment for a Disease Evolving as a Semi-Markov Process," Journal of Optimization Theory and Applications, Springer, vol. 175(1), pages 194-217, October.
    • Handle: RePEc:spr:joptap:v:175:y:2017:i:1:d:10.1007_s10957-017-1139-7
    DOI: 10.1007/s10957-017-1139-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10957-017-1139-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10957-017-1139-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Andrea Pascucci, 2008. "Free boundary and optimal stopping problems for American Asian options," Finance and Stochastics, Springer, vol. 12(1), pages 21-41, January.
    2. Edward P. C. Kao, 1974. "Modeling the Movement of Coronary Patients within a Hospital by Semi-Markov Processes," Operations Research, INFORMS, vol. 22(4), pages 683-699, August.
    3. Steven M. Shechter & Matthew D. Bailey & Andrew J. Schaefer & Mark S. Roberts, 2008. "The Optimal Time to Initiate HIV Therapy Under Ordered Health States," Operations Research, INFORMS, vol. 56(1), pages 20-33, February.
    4. Tugce Martagan & Ananth Krishnamurthy & Christos T. Maravelias, 2016. "Optimal condition-based harvesting policies for biomanufacturing operations with failure risks," IISE Transactions, Taylor & Francis Journals, vol. 48(5), pages 440-461, May.
    5. Rongwen Wu & Michael C. Fu, 2003. "Optimal Exercise Policies and Simulation-Based Valuation for American-Asian Options," Operations Research, INFORMS, vol. 51(1), pages 52-66, February.
    6. Jingyu Zhang & Brian T. Denton & Hari Balasubramanian & Nilay D. Shah & Brant A. Inman, 2012. "Optimization of PSA Screening Policies," Medical Decision Making, , vol. 32(2), pages 337-349, March.
    7. Lisa M. Maillart & Julie Simmons Ivy & Scott Ransom & Kathleen Diehl, 2008. "Assessing Dynamic Breast Cancer Screening Policies," Operations Research, INFORMS, vol. 56(6), pages 1411-1427, December.
    8. Jennifer E. Mason & Darin A. England & Brian T. Denton & Steven A. Smith & Murat Kurt & Nilay D. Shah, 2012. "Optimizing Statin Treatment Decisions for Diabetes Patients in the Presence of Uncertain Future Adherence," Medical Decision Making, , vol. 32(1), pages 154-166, January.
    9. Brian T. Denton & Murat Kurt & Nilay D. Shah & Sandra C. Bryant & Steven A. Smith, 2009. "Optimizing the Start Time of Statin Therapy for Patients with Diabetes," Medical Decision Making, , vol. 29(3), pages 351-367, May.
    10. Steven Shechter & Oguzhan Alagoz & Mark Roberts, 2010. "Irreversible treatment decisions under consideration of the research and development pipeline for new therapies," IISE Transactions, Taylor & Francis Journals, vol. 42(9), pages 632-642.
    11. Oguzhan Alagoz & Lisa M. Maillart & Andrew J. Schaefer & Mark S. Roberts, 2004. "The Optimal Timing of Living-Donor Liver Transplantation," Management Science, INFORMS, vol. 50(10), pages 1420-1430, October.
    12. Xiao Liu & Jingrui Li & Khalifa Al-Khalifa & Abdelmagid Hamouda & David Coit & Elsayed Elsayed, 2013. "Condition-based maintenance for continuously monitored degrading systems with multiple failure modes," IISE Transactions, Taylor & Francis Journals, vol. 45(4), pages 422-435.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Naumzik, Christof & Feuerriegel, Stefan & Nielsen, Anne Molgaard, 2023. "Data-driven dynamic treatment planning for chronic diseases," European Journal of Operational Research, Elsevier, vol. 305(2), pages 853-867.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jonathan E. Helm & Mariel S. Lavieri & Mark P. Van Oyen & Joshua D. Stein & David C. Musch, 2015. "Dynamic Forecasting and Control Algorithms of Glaucoma Progression for Clinician Decision Support," Operations Research, INFORMS, vol. 63(5), pages 979-999, October.
    2. Zlatana Nenova & Jennifer Shang, 2022. "Personalized Chronic Disease Follow‐Up Appointments: Risk‐Stratified Care Through Big Data," Production and Operations Management, Production and Operations Management Society, vol. 31(2), pages 583-606, February.
    3. Boloori, Alireza & Saghafian, Soroush & Chakkera, Harini A. A. & Cook, Curtiss B., 2017. "Data-Driven Management of Post-transplant Medications: An APOMDP Approach," Working Paper Series rwp17-036, Harvard University, John F. Kennedy School of Government.
    4. Kotas, Jakob & Ghate, Archis, 2018. "Bayesian learning of dose–response parameters from a cohort under response-guided dosing," European Journal of Operational Research, Elsevier, vol. 265(1), pages 328-343.
    5. Mason, J.E. & Denton, B.T. & Shah, N.D. & Smith, S.A., 2014. "Optimizing the simultaneous management of blood pressure and cholesterol for type 2 diabetes patients," European Journal of Operational Research, Elsevier, vol. 233(3), pages 727-738.
    6. Dan Andrei Iancu & Nikolaos Trichakis & Do Young Yoon, 2021. "Monitoring with Limited Information," Management Science, INFORMS, vol. 67(7), pages 4233-4251, July.
    7. M. Reza Skandari & Steven M. Shechter & Nadia Zalunardo, 2015. "Optimal Vascular Access Choice for Patients on Hemodialysis," Manufacturing & Service Operations Management, INFORMS, vol. 17(4), pages 608-619, October.
    8. Hessam Bavafa & Sergei Savin & Christian Terwiesch, 2021. "Customizing Primary Care Delivery Using E‐Visits," Production and Operations Management, Production and Operations Management Society, vol. 30(11), pages 4306-4327, November.
    9. Gong, Jue & Liu, Shan, 2023. "Partially observable collaborative model for optimizing personalized treatment selection," European Journal of Operational Research, Elsevier, vol. 309(3), pages 1409-1419.
    10. Ting-Yu Ho & Shan Liu & Zelda B. Zabinsky, 2019. "A Multi-Fidelity Rollout Algorithm for Dynamic Resource Allocation in Population Disease Management," Health Care Management Science, Springer, vol. 22(4), pages 727-755, December.
    11. Jingyu Zhang & Brian T. Denton & Hari Balasubramanian & Nilay D. Shah & Brant A. Inman, 2012. "Optimization of Prostate Biopsy Referral Decisions," Manufacturing & Service Operations Management, INFORMS, vol. 14(4), pages 529-547, October.
    12. Anthony Bonifonte & Turgay Ayer & Benjamin Haaland, 2022. "An Analytics Approach to Guide Randomized Controlled Trials in Hypertension Management," Management Science, INFORMS, vol. 68(9), pages 6634-6647, September.
    13. Wenjuan Fan & Yang Zong & Subodha Kumar, 2022. "Optimal treatment of chronic kidney disease with uncertainty in obtaining a transplantable kidney: an MDP based approach," Annals of Operations Research, Springer, vol. 316(1), pages 269-302, September.
    14. Oguzhan Alagoz & Jagpreet Chhatwal & Elizabeth S. Burnside, 2013. "Optimal Policies for Reducing Unnecessary Follow-Up Mammography Exams in Breast Cancer Diagnosis," Decision Analysis, INFORMS, vol. 10(3), pages 200-224, September.
    15. M. Reza Skandari & Steven M. Shechter, 2021. "Patient-Type Bayes-Adaptive Treatment Plans," Operations Research, INFORMS, vol. 69(2), pages 574-598, March.
    16. Li, Y. & Zhu, M. & Klein, R. & Kong, N., 2014. "Using a partially observable Markov chain model to assess colonoscopy screening strategies – A cohort study," European Journal of Operational Research, Elsevier, vol. 238(1), pages 313-326.
    17. Hui Zhang & Christian Wernz & Danny R. Hughes, 2018. "A Stochastic Game Analysis of Incentives and Behavioral Barriers in Chronic Disease Management," Service Science, INFORMS, vol. 10(3), pages 302-319, September.
    18. Chris P. Lee & Glenn M. Chertow & Stefanos A. Zenios, 2008. "Optimal Initiation and Management of Dialysis Therapy," Operations Research, INFORMS, vol. 56(6), pages 1428-1449, December.
    19. Wesley J. Marrero & Mariel S. Lavieri & Jeremy B. Sussman, 2021. "Optimal cholesterol treatment plans and genetic testing strategies for cardiovascular diseases," Health Care Management Science, Springer, vol. 24(1), pages 1-25, March.
    20. Maryam Alimohammadi & W. Art Chaovalitwongse & Hubert J. Vesselle & Shengfan Zhang, 2023. "Utilizing Clinical Trial Data to Assess Timing of Surgical Treatment for Emphysema Patients," Medical Decision Making, , vol. 43(1), pages 110-124, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joptap:v:175:y:2017:i:1:d:10.1007_s10957-017-1139-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.