IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v34y2014i3p311-326.html
   My bibliography  Save this article

Estimating Multiparameter Partial Expected Value of Perfect Information from a Probabilistic Sensitivity Analysis Sample

Author

Listed:
  • Mark Strong
  • Jeremy E. Oakley
  • Alan Brennan

Abstract

The partial expected value of perfect information (EVPI) quantifies the expected benefit of learning the values of uncertain parameters in a decision model. Partial EVPI is commonly estimated via a 2-level Monte Carlo procedure in which parameters of interest are sampled in an outer loop, and then conditional on these, the remaining parameters are sampled in an inner loop. This is computationally demanding and may be difficult if correlation between input parameters results in conditional distributions that are hard to sample from. We describe a novel nonparametric regression-based method for estimating partial EVPI that requires only the probabilistic sensitivity analysis sample (i.e., the set of samples drawn from the joint distribution of the parameters and the corresponding net benefits). The method is applicable in a model of any complexity and with any specification of input parameter distribution. We describe the implementation of the method via 2 nonparametric regression modeling approaches, the Generalized Additive Model and the Gaussian process. We demonstrate in 2 case studies the superior efficiency of the regression method over the 2-level Monte Carlo method. R code is made available to implement the method.

Suggested Citation

  • Mark Strong & Jeremy E. Oakley & Alan Brennan, 2014. "Estimating Multiparameter Partial Expected Value of Perfect Information from a Probabilistic Sensitivity Analysis Sample," Medical Decision Making, , vol. 34(3), pages 311-326, April.
  • Handle: RePEc:sae:medema:v:34:y:2014:i:3:p:311-326
    DOI: 10.1177/0272989X13505910
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X13505910
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0272989X13505910?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. M. D. Stevenson & J. Oakley & J. B. Chilcott, 2004. "Gaussian Process Modeling in Conjunction with Individual Patient Simulation Modeling: A Case Study Describing the Calculation of Cost-Effectiveness Ratios for the Treatment of Established Osteoporosis," Medical Decision Making, , vol. 24(1), pages 89-100, January.
    2. Karl Claxton & John Posnett, 1996. "An economic approach to clinical trial design and research priority‐setting," Health Economics, John Wiley & Sons, Ltd., vol. 5(6), pages 513-524, November.
    3. Karl Claxton & John Posnett, "undated". "An Economic Approach to Clinical Trial Design and Research Priority Setting," Discussion Papers 96/19, Department of Economics, University of York.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Borgonovo, Emanuele & Hazen, Gordon B. & Jose, Victor Richmond R. & Plischke, Elmar, 2021. "Probabilistic sensitivity measures as information value," European Journal of Operational Research, Elsevier, vol. 289(2), pages 595-610.
    2. Straub, Daniel & Ehre, Max & Papaioannou, Iason, 2022. "Decision-theoretic reliability sensitivity," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    3. Emanuele Borgonovo & Alessandra Cillo & Curtis L. Smith, 2018. "On the Relationship between Safety and Decision Significance," Risk Analysis, John Wiley & Sons, vol. 38(8), pages 1541-1558, August.
    4. Emanuele Borgonovo & Alessandra Cillo, 2017. "Deciding with Thresholds: Importance Measures and Value of Information," Risk Analysis, John Wiley & Sons, vol. 37(10), pages 1828-1848, October.
    5. Andrew J Sutton & John V Lamont & R Mark Evans & Kate Williamson & Declan O’Rourke & Brian Duggan & Gurdeep S Sagoo & Cherith N Reid & Mark W Ruddock, 2018. "An early analysis of the cost-effectiveness of a diagnostic classifier for risk stratification of haematuria patients (DCRSHP) compared to flexible cystoscopy in the diagnosis of bladder cancer," PLOS ONE, Public Library of Science, vol. 13(8), pages 1-15, August.
    6. Emanuele Borgonovo & Gordon B. Hazen & Elmar Plischke, 2016. "A Common Rationale for Global Sensitivity Measures and Their Estimation," Risk Analysis, John Wiley & Sons, vol. 36(10), pages 1871-1895, October.
    7. Haag, Fridolin & Chennu, Arjun, 2023. "Assessing whether decisions are more sensitive to preference or prediction uncertainty with a value of information approach," Omega, Elsevier, vol. 121(C).
    8. Daniel W. Gladish & Ross Darnell & Peter J. Thorburn & Bhakti Haldankar, 2019. "Emulated Multivariate Global Sensitivity Analysis for Complex Computer Models Applied to Agricultural Simulators," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 24(1), pages 130-153, March.
    9. Whitney, Cory W. & Tabuti, John R.S. & Hensel, Oliver & Yeh, Ching-Hua & Gebauer, Jens & Luedeling, Eike, 2017. "Homegardens and the future of food and nutrition security in southwest Uganda," Agricultural Systems, Elsevier, vol. 154(C), pages 133-144.
    10. David Glynn & John Giardina & Julia Hatamyar & Ankur Pandya & Marta Soares & Noemi Kreif, 2024. "Integrating decision modeling and machine learning to inform treatment stratification," Health Economics, John Wiley & Sons, Ltd., vol. 33(8), pages 1772-1792, August.
    11. Andrew John Sutton & Gurdeep S Sagoo & Leon Jackson & Mike Fisher & Geoffrey Hamilton-Fairley & Andrea Murray & Adam Hill, 2020. "Cost-effectiveness of a new autoantibody test added to Computed Tomography (CT) compared to CT surveillance alone in the diagnosis of lung cancer amongst patients with indeterminate pulmonary nodules," PLOS ONE, Public Library of Science, vol. 15(9), pages 1-16, September.
    12. Dutta, Geetartha & Mukerji, Tapan & Eidsvik, Jo, 2019. "Value of information analysis for subsurface energy resources applications," Applied Energy, Elsevier, vol. 252(C), pages 1-1.
    13. Daniel W. Gladish & Daniel E. Pagendam & Luk J. M. Peeters & Petra M. Kuhnert & Jai Vaze, 2018. "Emulation Engines: Choice and Quantification of Uncertainty for Complex Hydrological Models," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 23(1), pages 39-62, March.
    14. Anna Heath & Ioanna Manolopoulou & Gianluca Baio, 2018. "Efficient Monte Carlo Estimation of the Expected Value of Sample Information Using Moment Matching," Medical Decision Making, , vol. 38(2), pages 163-173, February.
    15. Nasuh C. Buyukkaramikli & Peter Wigfield & Men Thi Hoang, 2021. "A MEA is a MEA is a MEA? Sequential decision making and the impact of different managed entry agreements at the manufacturer and payer level, using a case study for an oncology drug in England," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 22(1), pages 51-73, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Neil Hawkins & Mark Sculpher & David Epstein, 2005. "Cost-Effectiveness Analysis of Treatments for Chronic Disease: Using R to Incorporate Time Dependency of Treatment Response," Medical Decision Making, , vol. 25(5), pages 511-519, September.
    2. Rachael L. Fleurence, 2007. "Setting priorities for research: a practical application of 'payback' and expected value of information," Health Economics, John Wiley & Sons, Ltd., vol. 16(12), pages 1345-1357.
    3. Sofia Dias & Alex J. Sutton & Nicky J. Welton & A. E. Ades, 2013. "Evidence Synthesis for Decision Making 6," Medical Decision Making, , vol. 33(5), pages 671-678, July.
    4. Samer A. Kharroubi & Alan Brennan & Mark Strong, 2011. "Estimating Expected Value of Sample Information for Incomplete Data Models Using Bayesian Approximation," Medical Decision Making, , vol. 31(6), pages 839-852, November.
    5. Afschin Gandjour, 2010. "Investment in quality improvement: how to maximize the return," Health Economics, John Wiley & Sons, Ltd., vol. 19(1), pages 31-42, January.
    6. Nicky J. Welton & Jason J. Madan & Deborah M. Caldwell & Tim J. Peters & Anthony E. Ades, 2014. "Expected Value of Sample Information for Multi-Arm Cluster Randomized Trials with Binary Outcomes," Medical Decision Making, , vol. 34(3), pages 352-365, April.
    7. Mark Strong & Jeremy E. Oakley & Alan Brennan & Penny Breeze, 2015. "Estimating the Expected Value of Sample Information Using the Probabilistic Sensitivity Analysis Sample," Medical Decision Making, , vol. 35(5), pages 570-583, July.
    8. Hawre Jalal & Jeremy D. Goldhaber-Fiebert & Karen M. Kuntz, 2015. "Computing Expected Value of Partial Sample Information from Probabilistic Sensitivity Analysis Using Linear Regression Metamodeling," Medical Decision Making, , vol. 35(5), pages 584-595, July.
    9. Franck Maunoury & Anastasiia Motrunich & Maria Palka-Santini & Stéphanie F Bernatchez & Stéphane Ruckly & Jean-François Timsit, 2015. "Cost-Effectiveness Analysis of a Transparent Antimicrobial Dressing for Managing Central Venous and Arterial Catheters in Intensive Care Units," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-14, June.
    10. Sze Huey Tan & Keith R. Abrams & Sylwia Bujkiewicz, 2018. "Bayesian Multiparameter Evidence Synthesis to Inform Decision Making: A Case Study in Metastatic Hormone-Refractory Prostate Cancer," Medical Decision Making, , vol. 38(7), pages 834-848, October.
    11. Ana P. Johnson-Masotti & Purushottam W. Laud & Raymond G. Hoffmann & Matthew J. Hayat & Steven D. Pinkerton, 2004. "A Bayesian Approach to Net Health Benefits: An Illustration and Application to Modeling HIV Prevention," Medical Decision Making, , vol. 24(6), pages 634-653, November.
    12. Martin E. Backhouse, 1998. "An investment appraisal approach to clinical trial design," Health Economics, John Wiley & Sons, Ltd., vol. 7(7), pages 605-619, November.
    13. Michael Fairley & Lauren E. Cipriano & Jeremy D. Goldhaber-Fiebert, 2020. "Optimal Allocation of Research Funds under a Budget Constraint," Medical Decision Making, , vol. 40(6), pages 797-814, August.
    14. A C Bouman & A J ten Cate-Hoek & B L T Ramaekers & M A Joore, 2015. "Sample Size Estimation for Non-Inferiority Trials: Frequentist Approach versus Decision Theory Approach," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-14, June.
    15. Joanna Thorn & Joanna Coast & Lazaros Andronis, 2016. "Interpretation of the Expected Value of Perfect Information and Research Recommendations," Medical Decision Making, , vol. 36(3), pages 285-295, April.
    16. Hawre Jalal & Fernando Alarid-Escudero, 2018. "A Gaussian Approximation Approach for Value of Information Analysis," Medical Decision Making, , vol. 38(2), pages 174-188, February.
    17. A. E. Ades & G. Lu & K. Claxton, 2004. "Expected Value of Sample Information Calculations in Medical Decision Modeling," Medical Decision Making, , vol. 24(2), pages 207-227, March.
    18. Mark Strong & Jeremy E. Oakley, 2013. "An Efficient Method for Computing Single-Parameter Partial Expected Value of Perfect Information," Medical Decision Making, , vol. 33(6), pages 755-766, August.
    19. Oakley, Jeremy E. & Brennan, Alan & Tappenden, Paul & Chilcott, Jim, 2010. "Simulation sample sizes for Monte Carlo partial EVPI calculations," Journal of Health Economics, Elsevier, vol. 29(3), pages 468-477, May.
    20. Josh J. Carlson & Rahber Thariani & Josh Roth & Julie Gralow & N. Lynn Henry & Laura Esmail & Pat Deverka & Scott D. Ramsey & Laurence Baker & David L. Veenstra, 2013. "Value-of-Information Analysis within a Stakeholder-Driven Research Prioritization Process in a US Setting: An Application in Cancer Genomics," Medical Decision Making, , vol. 33(4), pages 463-471, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:34:y:2014:i:3:p:311-326. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.