IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v38y2018i7p797-809.html
   My bibliography  Save this article

Optimal Information Collection Policies in a Markov Decision Process Framework

Author

Listed:
  • Lauren E. Cipriano
  • Jeremy D. Goldhaber-Fiebert
  • Shan Liu
  • Thomas A. Weber

Abstract

Background. The cost-effectiveness and value of additional information about a health technology or program may change over time because of trends affecting patient cohorts and/or the intervention. Delaying information collection even for parameters that do not change over time may be optimal. Methods. We present a stochastic dynamic programming approach to simultaneously identify the optimal intervention and information collection policies. We use our framework to evaluate birth cohort hepatitis C virus (HCV) screening. We focus on how the presence of a time-varying parameter (HCV prevalence) affects the optimal information collection policy for a parameter assumed constant across birth cohorts: liver fibrosis stage distribution for screen-detected diagnosis at age 50. Results. We prove that it may be optimal to delay information collection until a time when the information more immediately affects decision making. For the example of HCV screening, given initial beliefs, the optimal policy (at 2010) was to continue screening and collect information about the distribution of liver fibrosis at screen-detected diagnosis in 12 years, increasing the expected incremental net monetary benefit (INMB) by $169.5 million compared to current guidelines. Conclusions. The option to delay information collection until the information is sufficiently likely to influence decisions can increase efficiency. A dynamic programming framework enables an assessment of the marginal value of information and determines the optimal policy, including when and how much information to collect.

Suggested Citation

  • Lauren E. Cipriano & Jeremy D. Goldhaber-Fiebert & Shan Liu & Thomas A. Weber, 2018. "Optimal Information Collection Policies in a Markov Decision Process Framework," Medical Decision Making, , vol. 38(7), pages 797-809, October.
    • Handle: RePEc:sae:medema:v:38:y:2018:i:7:p:797-809
    DOI: 10.1177/0272989X18793401
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X18793401
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0272989X18793401?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Laura J. Kornish & Ralph L. Keeney, 2008. "Repeated Commit-or-Defer Decisions with a Deadline: The Influenza Vaccine Composition," Operations Research, INFORMS, vol. 56(3), pages 527-541, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lin, Qi & Zhao, Qiuhong & Lev, Benjamin, 2022. "Influenza vaccine supply chain coordination under uncertain supply and demand," European Journal of Operational Research, Elsevier, vol. 297(3), pages 930-948.
    2. Guo, Feiyu & Cao, Erbao, 2021. "Can reference points explain vaccine hesitancy? A new perspective on their formation and updating," Omega, Elsevier, vol. 99(C).
    3. Shivam Gupta & Anupam Agrawal & Jennifer K. Ryan, 2023. "Agile contracting: Managing incentives under uncertain needs," Production and Operations Management, Production and Operations Management Society, vol. 32(3), pages 972-988, March.
    4. Peng Sun & Liu Yang & Francis de Véricourt, 2009. "Selfish Drug Allocation for Containing an International Influenza Pandemic at the Onset," Operations Research, INFORMS, vol. 57(6), pages 1320-1332, December.
    5. Soo-Haeng Cho, 2010. "The Optimal Composition of Influenza Vaccines Subject to Random Production Yields," Manufacturing & Service Operations Management, INFORMS, vol. 12(2), pages 256-277, November.
    6. Duijzer, Lotty Evertje & van Jaarsveld, Willem & Dekker, Rommert, 2018. "The benefits of combining early aspecific vaccination with later specific vaccination," European Journal of Operational Research, Elsevier, vol. 271(2), pages 606-619.
    7. Lauren E. Cipriano & Thomas A. Weber, 2018. "Population-level intervention and information collection in dynamic healthcare policy," Health Care Management Science, Springer, vol. 21(4), pages 604-631, December.
    8. Niu, Baozhuang & Dong, Jian & Liu, Yaoqi, 2021. "Incentive alignment for blockchain adoption in medicine supply chains," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 152(C).
    9. Stephen E. Chick & Sameer Hasija & Javad Nasiry, 2017. "Information Elicitation and Influenza Vaccine Production," Operations Research, INFORMS, vol. 65(1), pages 75-96, February.
    10. Osman Y. Özaltın & Oleg A. Prokopyev & Andrew J. Schaefer & Mark S. Roberts, 2011. "Optimizing the Societal Benefits of the Annual Influenza Vaccine: A Stochastic Programming Approach," Operations Research, INFORMS, vol. 59(5), pages 1131-1143, October.
    11. Kargar, Bahareh & MohajerAnsari, Pedram & Esra Büyüktahtakın, İ. & Jahani, Hamed & Talluri, Sri, 2024. "Data-driven modeling for designing a sustainable and efficient vaccine supply chain: A COVID-19 case study," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 184(C).
    12. Muckstadt, John A. & Klein, Michael G. & Jackson, Peter L. & Gougelet, Robert M. & Hupert, Nathaniel, 2023. "Efficient and effective large-scale vaccine distribution," International Journal of Production Economics, Elsevier, vol. 262(C).
    13. Alexandar Angelus & Özalp Özer, 2022. "On the large‐scale production of a new vaccine," Production and Operations Management, Production and Operations Management Society, vol. 31(7), pages 3043-3060, July.
    14. Canan Ulu & James E. Smith, 2009. "Uncertainty, Information Acquisition, and Technology Adoption," Operations Research, INFORMS, vol. 57(3), pages 740-752, June.
    15. Stephen E. Chick & Sameer Hasija & Javad Nasiry, 2017. "Information Elicitation and Influenza Vaccine Production," Operations Research, INFORMS, vol. 65(1), pages 75-96, February.
    16. Hamed Mamani & Stephen E. Chick & David Simchi-Levi, 2013. "A Game-Theoretic Model of International Influenza Vaccination Coordination," Management Science, INFORMS, vol. 59(7), pages 1650-1670, July.
    17. Osman Y. Özaltın & Oleg A. Prokopyev & Andrew J. Schaefer, 2018. "Optimal Design of the Seasonal Influenza Vaccine with Manufacturing Autonomy," INFORMS Journal on Computing, INFORMS, vol. 30(2), pages 371-387, May.
    18. Samii, Amir-Behzad & Pibernik, Richard & Yadav, Prashant & Vereecke, Ann, 2012. "Reservation and allocation policies for influenza vaccines," European Journal of Operational Research, Elsevier, vol. 222(3), pages 495-507.
    19. Duijzer, Lotty Evertje & van Jaarsveld, Willem & Dekker, Rommert, 2018. "Literature review: The vaccine supply chain," European Journal of Operational Research, Elsevier, vol. 268(1), pages 174-192.
    20. Choudhury, Nishat Alam & Ramkumar, M. & Schoenherr, Tobias & Singh, Shalabh, 2023. "The role of operations and supply chain management during epidemics and pandemics: Potential and future research opportunities," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 175(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:38:y:2018:i:7:p:797-809. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.