IDEAS home Printed from https://ideas.repec.org/h/spr/isochp/978-3-319-47766-4_6.html
   My bibliography  Save this book chapter

Markov Decision Processes for Screening and Treatment of Chronic Diseases

In: Markov Decision Processes in Practice

Author

Listed:
  • Lauren N. Steimle

    (University of Michigan)

  • Brian T. Denton

    (University of Michigan)

Abstract

In recent years, Markov decision processes (MDPs) and partially observable Markov decision processes (POMDPs) have found important applications to medical decision making in the context of prevention, screening, and treatment of diseases. In this chapter, we provide a review of state-of-the-art models and methods that have been applied to chronic diseases. We provide a tutorial about how to formulate and solve these important problems emphasizing some of the challenges specific to chronic diseases such as diabetes, heart disease, and cancer. Then, we illustrate important considerations for model formulation and solution methods through two examples. The first example is an MDP model for optimal control of drug treatment decisions for managing the risk of heart disease and stroke in patients with type 2 diabetes. The second example is a POMDP model for optimal design of biomarker-based screening policies in the context of prostate cancer. We end the chapter with a discussion of the challenges of using MDPs and POMDPs for medical contexts and describe some important future directions for research.

Suggested Citation

  • Lauren N. Steimle & Brian T. Denton, 2017. "Markov Decision Processes for Screening and Treatment of Chronic Diseases," International Series in Operations Research & Management Science, in: Richard J. Boucherie & Nico M. van Dijk (ed.), Markov Decision Processes in Practice, chapter 0, pages 189-222, Springer.
    • Handle: RePEc:spr:isochp:978-3-319-47766-4_6
    DOI: 10.1007/978-3-319-47766-4_6
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lili Wang & Lei Si & Fiona Cocker & Andrew J. Palmer & Kristy Sanderson, 2018. "A Systematic Review of Cost-of-Illness Studies of Multimorbidity," Applied Health Economics and Health Policy, Springer, vol. 16(1), pages 15-29, February.
    2. Ting-Yu Ho & Shan Liu & Zelda B. Zabinsky, 2019. "A Multi-Fidelity Rollout Algorithm for Dynamic Resource Allocation in Population Disease Management," Health Care Management Science, Springer, vol. 22(4), pages 727-755, December.
    3. Malek Ebadi & Raha Akhavan-Tabatabaei, 2021. "Personalized Cotesting Policies for Cervical Cancer Screening: A POMDP Approach," Mathematics, MDPI, vol. 9(6), pages 1-20, March.
    4. Zlatana Nenova & Jennifer Shang, 2022. "Personalized Chronic Disease Follow‐Up Appointments: Risk‐Stratified Care Through Big Data," Production and Operations Management, Production and Operations Management Society, vol. 31(2), pages 583-606, February.
    5. Zheng Zhang & Brian T. Denton & Todd M. Morgan, 2022. "Optimization of active surveillance strategies for heterogeneous patients with prostate cancer," Production and Operations Management, Production and Operations Management Society, vol. 31(11), pages 4021-4037, November.
    6. Topuz, Kazim & Urban, Timothy L. & Yildirim, Mehmet B., 2024. "A Markovian score model for evaluating provider performance for continuity of care—An explainable analytics approach," European Journal of Operational Research, Elsevier, vol. 317(2), pages 341-351.
    7. Hussein El Hajj & Douglas R. Bish & Ebru K. Bish & Denise M. Kay, 2022. "Novel Pooling Strategies for Genetic Testing, with Application to Newborn Screening," Management Science, INFORMS, vol. 68(11), pages 7994-8014, November.
    8. Daniel F. Otero-Leon & Mariel S. Lavieri & Brian T. Denton & Jeremy Sussman & Rodney A. Hayward, 2023. "Monitoring policy in the context of preventive treatment of cardiovascular disease," Health Care Management Science, Springer, vol. 26(1), pages 93-116, March.
    9. Otten, Maarten & Timmer, Judith & Witteveen, Annemieke, 2020. "Stratified breast cancer follow-up using a continuous state partially observable Markov decision process," European Journal of Operational Research, Elsevier, vol. 281(2), pages 464-474.
    10. Anne-France Viet & Stéphane Krebs & Olivier Rat-Aspert & Laurent Jeanpierre & Catherine Belloc & Pauline Ezanno, 2018. "A modelling framework based on MDP to coordinate farmers' disease control decisions at a regional scale," PLOS ONE, Public Library of Science, vol. 13(6), pages 1-20, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:isochp:978-3-319-47766-4_6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.