IDEAS home Printed from https://ideas.repec.org/a/spr/pharme/v36y2018i8d10.1007_s40273-018-0650-5.html
   My bibliography  Save this article

Sensitivity Analysis for Not-at-Random Missing Data in Trial-Based Cost-Effectiveness Analysis: A Tutorial

Author

Listed:
  • Baptiste Leurent

    (London School of Hygiene and Tropical Medicine)

  • Manuel Gomes

    (University College London)

  • Rita Faria

    (University of York)

  • Stephen Morris

    (University College London)

  • Richard Grieve

    (London School of Hygiene and Tropical Medicine)

  • James R. Carpenter

    (London School of Hygiene and Tropical Medicine
    MRC Clinical Trials Unit at University College London)

Abstract

Cost-effectiveness analyses (CEA) of randomised controlled trials are a key source of information for health care decision makers. Missing data are, however, a common issue that can seriously undermine their validity. A major concern is that the chance of data being missing may be directly linked to the unobserved value itself [missing not at random (MNAR)]. For example, patients with poorer health may be less likely to complete quality-of-life questionnaires. However, the extent to which this occurs cannot be ascertained from the data at hand. Guidelines recommend conducting sensitivity analyses to assess the robustness of conclusions to plausible MNAR assumptions, but this is rarely done in practice, possibly because of a lack of practical guidance. This tutorial aims to address this by presenting an accessible framework and practical guidance for conducting sensitivity analysis for MNAR data in trial-based CEA. We review some of the methods for conducting sensitivity analysis, but focus on one particularly accessible approach, where the data are multiply-imputed and then modified to reflect plausible MNAR scenarios. We illustrate the implementation of this approach on a weight-loss trial, providing the software code. We then explore further issues around its use in practice.

Suggested Citation

  • Baptiste Leurent & Manuel Gomes & Rita Faria & Stephen Morris & Richard Grieve & James R. Carpenter, 2018. "Sensitivity Analysis for Not-at-Random Missing Data in Trial-Based Cost-Effectiveness Analysis: A Tutorial," PharmacoEconomics, Springer, vol. 36(8), pages 889-901, August.
  • Handle: RePEc:spr:pharme:v:36:y:2018:i:8:d:10.1007_s40273-018-0650-5
    DOI: 10.1007/s40273-018-0650-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40273-018-0650-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s40273-018-0650-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Elisabeth Fenwick & Bernie J. O'Brien & Andrew Briggs, 2004. "Cost‐effectiveness acceptability curves – facts, fallacies and frequently asked questions," Health Economics, John Wiley & Sons, Ltd., vol. 13(5), pages 405-415, May.
    2. Drummond, Michael F. & Sculpher, Mark J. & Claxton, Karl & Stoddart, Greg L. & Torrance, George W., 2015. "Methods for the Economic Evaluation of Health Care Programmes," OUP Catalogue, Oxford University Press, edition 4, number 9780199665884.
    3. Andrew Briggs & Taane Clark & Jane Wolstenholme & Philip Clarke, 2003. "Missing.... presumed at random: cost‐analysis of incomplete data," Health Economics, John Wiley & Sons, Ltd., vol. 12(5), pages 377-392, May.
    4. Rita Faria & Manuel Gomes & David Epstein & Ian White, 2014. "A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled Trials," PharmacoEconomics, Springer, vol. 32(12), pages 1157-1170, December.
    5. Baptiste Leurent & Manuel Gomes & James R. Carpenter, 2018. "Missing data in trial‐based cost‐effectiveness analysis: An incomplete journey," Health Economics, John Wiley & Sons, Ltd., vol. 27(6), pages 1024-1040, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. James Altunkaya’s journal round-up for 3rd September 2018
      by jamesaltunkaya in The Academic Health Economists' Blog on 2018-09-03 11:00:24

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anthony J. Hatswell & Ash Bullement & Michael Schlichting & Murtuza Bharmal, 2021. "What is the Impact of the Analysis Method Used for Health State Utility Values on QALYs in Oncology? A Simulation Study Comparing Progression-Based and Time-to-Death Approaches," Applied Health Economics and Health Policy, Springer, vol. 19(3), pages 389-401, May.
    2. Baptiste Leurent & Manuel Gomes & James R. Carpenter, 2018. "Missing data in trial‐based cost‐effectiveness analysis: An incomplete journey," Health Economics, John Wiley & Sons, Ltd., vol. 27(6), pages 1024-1040, June.
    3. Andrea Gabrio & Michael J. Daniels & Gianluca Baio, 2020. "A Bayesian parametric approach to handle missing longitudinal outcome data in trial‐based health economic evaluations," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(2), pages 607-629, February.
    4. Alexina J. Mason & Manuel Gomes & James Carpenter & Richard Grieve, 2021. "Flexible Bayesian longitudinal models for cost‐effectiveness analyses with informative missing data," Health Economics, John Wiley & Sons, Ltd., vol. 30(12), pages 3138-3158, December.
    5. Rachael Maree Hunter & Rob Anderson & Tim Kirkpatrick & Charlotte Lennox & Fiona Warren & Rod S. Taylor & Jenny Shaw & Mark Haddad & Alex Stirzaker & Mike Maguire & Richard Byng, 2022. "Economic evaluation of a complex intervention (Engager) for prisoners with common mental health problems, near to and after release: a cost-utility and cost-consequences analysis," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 23(2), pages 193-210, March.
    6. Alexina J. Mason & Manuel Gomes & Richard Grieve & James R. Carpenter, 2018. "A Bayesian framework for health economic evaluation in studies with missing data," Health Economics, John Wiley & Sons, Ltd., vol. 27(11), pages 1670-1683, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Salah Ghabri & Françoise F. Hamers & Jean Michel Josselin, 2016. "Exploring Uncertainty in Economic Evaluations of Drugs and Medical Devices: Lessons from the First Review of Manufacturers’ Submissions to the French National Authority for Health," PharmacoEconomics, Springer, vol. 34(6), pages 617-624, June.
    2. Rissanen, Elisa & Karjalainen, Piia & Kiviruusu, Olli & Kankaanpää, Eila & Aronen, Eeva T. & Haula, Taru & Sääksvuori, Lauri & Vornanen, Riitta & Linnosmaa, Ismo, 2024. "Cost-effectiveness of a parenting program to reduce children’s behavioral problems among families receiving child protection services and other family support services – A randomized controlled trial," Children and Youth Services Review, Elsevier, vol. 158(C).
    3. Janet MacNeil Vroomen & Iris Eekhout & Marcel G. Dijkgraaf & Hein van Hout & Sophia E. de Rooij & Martijn W. Heymans & Judith E. Bosmans, 2016. "Multiple imputation strategies for zero-inflated cost data in economic evaluations: which method works best?," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 17(8), pages 939-950, November.
    4. William Hollingworth & Christopher G. Fawsitt & Padraig Dixon & Larisa Duffy & Ricardo Araya & Tim J. Peters & Howard Thom & Nicky J. Welton & Nicola Wiles & Glyn Lewis, 2020. "Cost-Effectiveness of Sertraline in Primary Care According to Initial Severity and Duration of Depressive Symptoms: Findings from the PANDA RCT," PharmacoEconomics - Open, Springer, vol. 4(3), pages 427-438, September.
    5. Deidda, Manuela & Geue, Claudia & Kreif, Noemi & Dundas, Ruth & McIntosh, Emma, 2019. "A framework for conducting economic evaluations alongside natural experiments," Social Science & Medicine, Elsevier, vol. 220(C), pages 353-361.
    6. Matthew Franklin & James Lomas & Simon Walker & Tracey Young, 2019. "An Educational Review About Using Cost Data for the Purpose of Cost-Effectiveness Analysis," PharmacoEconomics, Springer, vol. 37(5), pages 631-643, May.
    7. Victoria K. Brennan & Georgina Jones & Stephen Radley & Simon Dixon, 2021. "Incorporating Process Utility into Cost-Effectiveness Analysis via a Bolt-On Domain to the SF-6D: An Exploratory Study," Applied Health Economics and Health Policy, Springer, vol. 19(5), pages 747-756, September.
    8. Alexina J. Mason & Manuel Gomes & James Carpenter & Richard Grieve, 2021. "Flexible Bayesian longitudinal models for cost‐effectiveness analyses with informative missing data," Health Economics, John Wiley & Sons, Ltd., vol. 30(12), pages 3138-3158, December.
    9. Andrea Gabrio & Alexina J. Mason & Gianluca Baio, 2017. "Handling Missing Data in Within-Trial Cost-Effectiveness Analysis: A Review with Future Recommendations," PharmacoEconomics - Open, Springer, vol. 1(2), pages 79-97, June.
    10. Mohamed El Alili & Johanna M. van Dongen & Jonas L. Esser & Martijn W. Heymans & Maurits W. van Tulder & Judith E. Bosmans, 2022. "A scoping review of statistical methods for trial‐based economic evaluations: The current state of play," Health Economics, John Wiley & Sons, Ltd., vol. 31(12), pages 2680-2699, December.
    11. Bernhard Michalowsky & Wolfgang Hoffmann & Kevin Kennedy & Feng Xie, 2020. "Is the whole larger than the sum of its parts? Impact of missing data imputation in economic evaluation conducted alongside randomized controlled trials," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 21(5), pages 717-728, July.
    12. Stephen Rocks & Daniela Berntson & Alejandro Gil-Salmerón & Mudathira Kadu & Nieves Ehrenberg & Viktoria Stein & Apostolos Tsiachristas, 2020. "Cost and effects of integrated care: a systematic literature review and meta-analysis," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 21(8), pages 1211-1221, November.
    13. Ifigeneia Mavranezouli & Joran Lokkerbol, 2017. "A Systematic Review and Critical Appraisal of Economic Evaluations of Pharmacological Interventions for People with Bipolar Disorder," PharmacoEconomics, Springer, vol. 35(3), pages 271-296, March.
    14. Baptiste Leurent & Manuel Gomes & Suzie Cro & Nicola Wiles & James R. Carpenter, 2020. "Reference‐based multiple imputation for missing data sensitivity analyses in trial‐based cost‐effectiveness analysis," Health Economics, John Wiley & Sons, Ltd., vol. 29(2), pages 171-184, February.
    15. Mohamed El Alili & Johanna M. Dongen & Keith S. Goldfeld & Martijn W. Heymans & Maurits W. Tulder & Judith E. Bosmans, 2020. "Taking the Analysis of Trial-Based Economic Evaluations to the Next Level: The Importance of Accounting for Clustering," PharmacoEconomics, Springer, vol. 38(11), pages 1247-1261, November.
    16. Mohamed El Alili & Johanna M. Dongen & Judith A. F. Huirne & Maurits W. Tulder & Judith E. Bosmans, 2017. "Reporting and Analysis of Trial-Based Cost-Effectiveness Evaluations in Obstetrics and Gynaecology," PharmacoEconomics, Springer, vol. 35(10), pages 1007-1033, October.
    17. Alexina J. Mason & Manuel Gomes & Richard Grieve & James R. Carpenter, 2018. "A Bayesian framework for health economic evaluation in studies with missing data," Health Economics, John Wiley & Sons, Ltd., vol. 27(11), pages 1670-1683, November.
    18. Irina Pokhilenko & Luca M. M. Janssen & Aggie T. G. Paulus & Ruben M. W. A. Drost & William Hollingworth & Joanna C. Thorn & Sian Noble & Judit Simon & Claudia Fischer & Susanne Mayer & Luis Salvador-, 2023. "Development of an Instrument for the Assessment of Health-Related Multi-sectoral Resource Use in Europe: The PECUNIA RUM," Applied Health Economics and Health Policy, Springer, vol. 21(2), pages 155-166, March.
    19. Chiranjeev Sanyal & Don Husereau, 2020. "Systematic Review of Economic Evaluations of Services Provided by Community Pharmacists," Applied Health Economics and Health Policy, Springer, vol. 18(3), pages 375-392, June.
    20. Saha, Sanjib & Gerdtham, Ulf-G. & Toresson, Håkan & Minthon, Lennart & Jarl, Johan, 2018. "Economic Evaluation of Interventions for Screening of Dementia," Working Papers 2018:20, Lund University, Department of Economics.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:pharme:v:36:y:2018:i:8:d:10.1007_s40273-018-0650-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.