IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v39y2019i4p347-359.html
   My bibliography  Save this article

Estimating the Expected Value of Sample Information across Different Sample Sizes Using Moment Matching and Nonlinear Regression

Author

Listed:
  • Anna Heath

    (The Hospital for Sick Children, Toronto, Canada and University of Toronto, Canada)

  • Ioanna Manolopoulou

    (Department of Statistical Science, University College London, London, UK)

  • Gianluca Baio

    (Department of Statistical Science, University College London, London, UK)

Abstract

Background. The expected value of sample information (EVSI) determines the economic value of any future study with a specific design aimed at reducing uncertainty about the parameters underlying a health economic model. This has potential as a tool for trial design; the cost and value of different designs could be compared to find the trial with the greatest net benefit. However, despite recent developments, EVSI analysis can be slow, especially when optimizing over a large number of different designs. Methods. This article develops a method to reduce the computation time required to calculate the EVSI across different sample sizes. Our method extends the moment-matching approach to EVSI estimation to optimize over different sample sizes for the underlying trial while retaining a similar computational cost to a single EVSI estimate. This extension calculates the posterior variance of the net monetary benefit across alternative sample sizes and then uses Bayesian nonlinear regression to estimate the EVSI across these sample sizes. Results. A health economic model developed to assess the cost-effectiveness of interventions for chronic pain demonstrates that this EVSI calculation method is fast and accurate for realistic models. This example also highlights how different trial designs can be compared using the EVSI. Conclusion. The proposed estimation method is fast and accurate when calculating the EVSI across different sample sizes. This will allow researchers to realize the potential of using the EVSI to determine an economically optimal trial design for reducing uncertainty in health economic models. Limitations. Our method involves rerunning the health economic model, which can be more computationally expensive than some recent alternatives, especially in complex models.

Suggested Citation

  • Anna Heath & Ioanna Manolopoulou & Gianluca Baio, 2019. "Estimating the Expected Value of Sample Information across Different Sample Sizes Using Moment Matching and Nonlinear Regression," Medical Decision Making, , vol. 39(4), pages 347-359, May.
  • Handle: RePEc:sae:medema:v:39:y:2019:i:4:p:347-359
    DOI: 10.1177/0272989X19837983
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X19837983
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0272989X19837983?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Alan Brennan & Samer A. Kharroubi, 2007. "Expected value of sample information for Weibull survival data," Health Economics, John Wiley & Sons, Ltd., vol. 16(11), pages 1205-1225, November.
    2. Alan Brennan & Samer A. Kharroubi, 2007. "Expected value of sample information for Weibull survival data," Health Economics, John Wiley & Sons, Ltd., vol. 16(11), pages 1205-1225.
    3. Karl Claxton & Mark Sculpher & Chris McCabe & Andrew Briggs & Ron Akehurst & Martin Buxton & John Brazier & Tony O'Hagan, 2005. "Probabilistic sensitivity analysis for NICE technology assessment: not an optional extra," Health Economics, John Wiley & Sons, Ltd., vol. 14(4), pages 339-347, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anna Heath, 2022. "Calculating Expected Value of Sample Information Adjusting for Imperfect Implementation," Medical Decision Making, , vol. 42(5), pages 626-636, July.
    2. Anna Heath & Mark Strong & David Glynn & Natalia Kunst & Nicky J. Welton & Jeremy D. Goldhaber-Fiebert, 2022. "Simulating Study Data to Support Expected Value of Sample Information Calculations: A Tutorial," Medical Decision Making, , vol. 42(2), pages 143-155, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Claire McKenna & Karl Claxton, 2011. "Addressing Adoption and Research Design Decisions Simultaneously," Medical Decision Making, , vol. 31(6), pages 853-865, November.
    2. Mark Strong & Jeremy E. Oakley & Alan Brennan & Penny Breeze, 2015. "Estimating the Expected Value of Sample Information Using the Probabilistic Sensitivity Analysis Sample," Medical Decision Making, , vol. 35(5), pages 570-583, July.
    3. Hawre Jalal & Jeremy D. Goldhaber-Fiebert & Karen M. Kuntz, 2015. "Computing Expected Value of Partial Sample Information from Probabilistic Sensitivity Analysis Using Linear Regression Metamodeling," Medical Decision Making, , vol. 35(5), pages 584-595, July.
    4. Andrew Willan & Simon Eckermann, 2012. "Value of Information and Pricing New Healthcare Interventions," PharmacoEconomics, Springer, vol. 30(6), pages 447-459, June.
    5. Hawre Jalal & Fernando Alarid-Escudero, 2018. "A Gaussian Approximation Approach for Value of Information Analysis," Medical Decision Making, , vol. 38(2), pages 174-188, February.
    6. Oakley, Jeremy E. & Brennan, Alan & Tappenden, Paul & Chilcott, Jim, 2010. "Simulation sample sizes for Monte Carlo partial EVPI calculations," Journal of Health Economics, Elsevier, vol. 29(3), pages 468-477, May.
    7. Nicolas A. Menzies, 2016. "An Efficient Estimator for the Expected Value of Sample Information," Medical Decision Making, , vol. 36(3), pages 308-320, April.
    8. Anna Heath & Natalia Kunst & Christopher Jackson & Mark Strong & Fernando Alarid-Escudero & Jeremy D. Goldhaber-Fiebert & Gianluca Baio & Nicolas A. Menzies & Hawre Jalal, 2020. "Calculating the Expected Value of Sample Information in Practice: Considerations from 3 Case Studies," Medical Decision Making, , vol. 40(3), pages 314-326, April.
    9. Anna Heath & Ioanna Manolopoulou & Gianluca Baio, 2018. "Efficient Monte Carlo Estimation of the Expected Value of Sample Information Using Moment Matching," Medical Decision Making, , vol. 38(2), pages 163-173, February.
    10. Hendrik Koffijberg & Claire Rothery & Kalipso Chalkidou & Janneke Grutters, 2018. "Value of Information Choices that Influence Estimates: A Systematic Review of Prevailing Considerations," Medical Decision Making, , vol. 38(7), pages 888-900, October.
    11. Dongzhe Hong & Lei Si & Minghuan Jiang & Hui Shao & Wai-kit Ming & Yingnan Zhao & Yan Li & Lizheng Shi, 2019. "Cost Effectiveness of Sodium-Glucose Cotransporter-2 (SGLT2) Inhibitors, Glucagon-Like Peptide-1 (GLP-1) Receptor Agonists, and Dipeptidyl Peptidase-4 (DPP-4) Inhibitors: A Systematic Review," PharmacoEconomics, Springer, vol. 37(6), pages 777-818, June.
    12. Isaac Corro Ramos & Maureen P. M. H. Rutten-van Mölken & Maiwenn J. Al, 2013. "The Role of Value-of-Information Analysis in a Health Care Research Priority Setting," Medical Decision Making, , vol. 33(4), pages 472-489, May.
    13. McKenna, Claire & Chalabi, Zaid & Epstein, David & Claxton, Karl, 2010. "Budgetary policies and available actions: A generalisation of decision rules for allocation and research decisions," Journal of Health Economics, Elsevier, vol. 29(1), pages 170-181, January.
    14. Peter J. Dodd & Debebe Shaweno & Chu-Chang Ku & Philippe Glaziou & Carel Pretorius & Richard J. Hayes & Peter MacPherson & Ted Cohen & Helen Ayles, 2023. "Transmission modeling to infer tuberculosis incidence prevalence and mortality in settings with generalized HIV epidemics," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    15. Emma McIntosh, 2006. "Using Discrete Choice Experiments within a Cost-Benefit Analysis Framework," PharmacoEconomics, Springer, vol. 24(9), pages 855-868, September.
    16. John Hutton, 2012. "‘Health Economics’ and the evolution of economic evaluation of health technologies," Health Economics, John Wiley & Sons, Ltd., vol. 21(1), pages 13-18, January.
    17. Sofia Dias & Alex J. Sutton & Nicky J. Welton & A. E. Ades, 2013. "Evidence Synthesis for Decision Making 6," Medical Decision Making, , vol. 33(5), pages 671-678, July.
    18. Stefano Conti & Karl Claxton, 2008. "Dimensions of design space: a decision-theoretic approach to optimal research design," Working Papers 038cherp, Centre for Health Economics, University of York.
    19. Nicky J. Welton & Jason J. Madan & Deborah M. Caldwell & Tim J. Peters & Anthony E. Ades, 2014. "Expected Value of Sample Information for Multi-Arm Cluster Randomized Trials with Binary Outcomes," Medical Decision Making, , vol. 34(3), pages 352-365, April.
    20. Anna Heath & Mark Strong & David Glynn & Natalia Kunst & Nicky J. Welton & Jeremy D. Goldhaber-Fiebert, 2022. "Simulating Study Data to Support Expected Value of Sample Information Calculations: A Tutorial," Medical Decision Making, , vol. 42(2), pages 143-155, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:39:y:2019:i:4:p:347-359. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.