IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v316y2022i1d10.1007_s10479-020-03779-2.html
   My bibliography  Save this article

Optimal treatment of chronic kidney disease with uncertainty in obtaining a transplantable kidney: an MDP based approach

Author

Listed:
  • Wenjuan Fan

    (Hefei University of Technology
    Key Laboratory of Process Optimization and Intelligent Decision-Making of Ministry of Education)

  • Yang Zong

    (Hefei University of Technology
    Key Laboratory of Process Optimization and Intelligent Decision-Making of Ministry of Education)

  • Subodha Kumar

    (Temple University)

Abstract

Chronic kidney disease (CKD) is one of the most serious and prevalent health issues all over the world. The evolution of CKD can last for many years until the death of patients, and the method of treatment mainly includes medication, dialysis, and transplantation with the evolution of the disease. It has been validated by many empirical studies that for severe CKD patients, the optimal treatment is transplantation if a suitable kidney is available, otherwise the patients should initiate dialysis at a suitable time. It has also been validated that the initiation time of dialysis significantly impacts not only the direct treatment results, but also the success of a future possible kidney transplantation. Motivated by this consideration, we investigate the decision-making problem of the optimal treatment approach to maximize the patient’s total reward including pre-transplant reward and post-transplant reward (if applicable), considering the possibility of having a suitable kidney transplantation in the future. A Markov decision process model is established in which the status of the process is described by the patient health status. We present some structural properties of the decision-making problem, which are used to choose the optimal treatment approach in different health status of patients. We collect the clinical data in the simulation experiments to obtain the fitted curves of the evolution process of different CKD patients, and compare the simulation results with the actual clinical data to demonstrate the advantage of our model.

Suggested Citation

  • Wenjuan Fan & Yang Zong & Subodha Kumar, 2022. "Optimal treatment of chronic kidney disease with uncertainty in obtaining a transplantable kidney: an MDP based approach," Annals of Operations Research, Springer, vol. 316(1), pages 269-302, September.
    • Handle: RePEc:spr:annopr:v:316:y:2022:i:1:d:10.1007_s10479-020-03779-2
    DOI: 10.1007/s10479-020-03779-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-020-03779-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10479-020-03779-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Oguzhan Alagoz & Lisa M. Maillart & Andrew J. Schaefer & Mark S. Roberts, 2004. "The Optimal Timing of Living-Donor Liver Transplantation," Management Science, INFORMS, vol. 50(10), pages 1420-1430, October.
    2. Melanie Wyld & Rachael Lisa Morton & Andrew Hayen & Kirsten Howard & Angela Claire Webster, 2012. "A Systematic Review and Meta-Analysis of Utility-Based Quality of Life in Chronic Kidney Disease Treatments," PLOS Medicine, Public Library of Science, vol. 9(9), pages 1-10, September.
    3. Zeynep Erkin & Matthew D. Bailey & Lisa M. Maillart & Andrew J. Schaefer & Mark S. Roberts, 2010. "Eliciting Patients' Revealed Preferences: An Inverse Markov Decision Process Approach," Decision Analysis, INFORMS, vol. 7(4), pages 358-365, December.
    4. Sakine Batun & Andrew J. Schaefer & Atul Bhandari & Mark S. Roberts, 2018. "Optimal Liver Acceptance for Risk-Sensitive Patients," Service Science, INFORMS, vol. 10(3), pages 320-333, September.
    5. Chris P. Lee & Glenn M. Chertow & Stefanos A. Zenios, 2006. "A Simulation Model to Estimate the Cost and Effectiveness of Alternative Dialysis Initiation Strategies," Medical Decision Making, , vol. 26(5), pages 535-549, September.
    6. Diana M. Negoescu & Kostas Bimpikis & Margaret L. Brandeau & Dan A. Iancu, 2018. "Dynamic Learning of Patient Response Types: An Application to Treating Chronic Diseases," Management Science, INFORMS, vol. 64(8), pages 3469-3488, August.
    7. Steven M. Shechter & Matthew D. Bailey & Andrew J. Schaefer & Mark S. Roberts, 2008. "The Optimal Time to Initiate HIV Therapy Under Ordered Health States," Operations Research, INFORMS, vol. 56(1), pages 20-33, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chris P. Lee & Glenn M. Chertow & Stefanos A. Zenios, 2008. "Optimal Initiation and Management of Dialysis Therapy," Operations Research, INFORMS, vol. 56(6), pages 1428-1449, December.
    2. Mason, J.E. & Denton, B.T. & Shah, N.D. & Smith, S.A., 2014. "Optimizing the simultaneous management of blood pressure and cholesterol for type 2 diabetes patients," European Journal of Operational Research, Elsevier, vol. 233(3), pages 727-738.
    3. Oguzhan Alagoz & Jagpreet Chhatwal & Elizabeth S. Burnside, 2013. "Optimal Policies for Reducing Unnecessary Follow-Up Mammography Exams in Breast Cancer Diagnosis," Decision Analysis, INFORMS, vol. 10(3), pages 200-224, September.
    4. M. Reza Skandari & Steven M. Shechter & Nadia Zalunardo, 2015. "Optimal Vascular Access Choice for Patients on Hemodialysis," Manufacturing & Service Operations Management, INFORMS, vol. 17(4), pages 608-619, October.
    5. Hessam Bavafa & Sergei Savin & Christian Terwiesch, 2021. "Customizing Primary Care Delivery Using E‐Visits," Production and Operations Management, Production and Operations Management Society, vol. 30(11), pages 4306-4327, November.
    6. Zlatana Nenova & Jennifer Shang, 2022. "Personalized Chronic Disease Follow‐Up Appointments: Risk‐Stratified Care Through Big Data," Production and Operations Management, Production and Operations Management Society, vol. 31(2), pages 583-606, February.
    7. Ting-Yu Ho & Shan Liu & Zelda B. Zabinsky, 2019. "A Multi-Fidelity Rollout Algorithm for Dynamic Resource Allocation in Population Disease Management," Health Care Management Science, Springer, vol. 22(4), pages 727-755, December.
    8. Kang, Yuncheol & Sawyer, Amy M. & Griffin, Paul M. & Prabhu, Vittaldas V., 2016. "Modelling adherence behaviour for the treatment of obstructive sleep apnoea," European Journal of Operational Research, Elsevier, vol. 249(3), pages 1005-1013.
    9. Sarang Deo & Seyed Iravani & Tingting Jiang & Karen Smilowitz & Stephen Samuelson, 2013. "Improving Health Outcomes Through Better Capacity Allocation in a Community-Based Chronic Care Model," Operations Research, INFORMS, vol. 61(6), pages 1277-1294, December.
    10. Naumzik, Christof & Feuerriegel, Stefan & Nielsen, Anne Molgaard, 2023. "Data-driven dynamic treatment planning for chronic diseases," European Journal of Operational Research, Elsevier, vol. 305(2), pages 853-867.
    11. Lauren E. Cipriano & Thomas A. Weber, 2018. "Population-level intervention and information collection in dynamic healthcare policy," Health Care Management Science, Springer, vol. 21(4), pages 604-631, December.
    12. Anahita Khojandi & Oleg Shylo & Maryam Zokaeinikoo, 2019. "Automatic EEG classification: a path to smart and connected sleep interventions," Annals of Operations Research, Springer, vol. 276(1), pages 169-190, May.
    13. Anthony Bonifonte & Turgay Ayer & Benjamin Haaland, 2022. "An Analytics Approach to Guide Randomized Controlled Trials in Hypertension Management," Management Science, INFORMS, vol. 68(9), pages 6634-6647, September.
    14. M. Reza Skandari & Steven M. Shechter, 2021. "Patient-Type Bayes-Adaptive Treatment Plans," Operations Research, INFORMS, vol. 69(2), pages 574-598, March.
    15. Jonathan E. Helm & Mariel S. Lavieri & Mark P. Van Oyen & Joshua D. Stein & David C. Musch, 2015. "Dynamic Forecasting and Control Algorithms of Glaucoma Progression for Clinician Decision Support," Operations Research, INFORMS, vol. 63(5), pages 979-999, October.
    16. Mabel C. Chou & Mahmut Parlar & Yun Zhou, 2017. "Optimal Timing to Initiate Medical Treatment for a Disease Evolving as a Semi-Markov Process," Journal of Optimization Theory and Applications, Springer, vol. 175(1), pages 194-217, October.
    17. Klein, Michael G. & Verter, Vedat & Moses, Brian G., 2020. "Designing a rural network of dialysis facilities," European Journal of Operational Research, Elsevier, vol. 282(3), pages 1088-1100.
    18. Kotas, Jakob & Ghate, Archis, 2018. "Bayesian learning of dose–response parameters from a cohort under response-guided dosing," European Journal of Operational Research, Elsevier, vol. 265(1), pages 328-343.
    19. Muge Capan & Julie S. Ivy & James R. Wilson & Jeanne M. Huddleston, 2017. "A stochastic model of acute-care decisions based on patient and provider heterogeneity," Health Care Management Science, Springer, vol. 20(2), pages 187-206, June.
    20. Preil, Deniz & Krapp, Michael, 2022. "Bandit-based inventory optimisation: Reinforcement learning in multi-echelon supply chains," International Journal of Production Economics, Elsevier, vol. 252(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:316:y:2022:i:1:d:10.1007_s10479-020-03779-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.