IDEAS home Printed from https://ideas.repec.org/a/spr/eujhec/v21y2020i5d10.1007_s10198-020-01166-z.html
   My bibliography  Save this article

Is the whole larger than the sum of its parts? Impact of missing data imputation in economic evaluation conducted alongside randomized controlled trials

Author

Listed:
  • Bernhard Michalowsky

    (Site Rostock/Greifswald
    McMaster University
    Program for Health Economics and Outcome Measures (PHENOM))

  • Wolfgang Hoffmann

    (Site Rostock/Greifswald
    University Medicine Greifswald (UMG))

  • Kevin Kennedy

    (McMaster University
    Program for Health Economics and Outcome Measures (PHENOM))

  • Feng Xie

    (McMaster University
    Program for Health Economics and Outcome Measures (PHENOM)
    McMaster University)

Abstract

Outcomes in economic evaluations, such as health utilities and costs, are products of multiple variables, often requiring complete item responses to questionnaires. Therefore, missing data are very common in cost-effectiveness analyses. Multiple imputations (MI) are predominately recommended and could be made either for individual items or at the aggregate level. We, therefore, aimed to assess the precision of both MI approaches (the item imputation vs. aggregate imputation) on the cost-effectiveness results. The original data set came from a cluster-randomized, controlled trial and was used to describe the missing data pattern and compare the differences in the cost-effectiveness results between the two imputation approaches. A simulation study with different missing data scenarios generated based on a complete data set was used to assess the precision of both imputation approaches. For health utility and cost, patients more often had a partial (9% vs. 23%, respectively) rather than complete missing (4% vs. 0%). The imputation approaches differed in the cost-effectiveness results (the item imputation: − 61,079€/QALY vs. the aggregate imputation: 15,399€/QALY). Within the simulation study mean relative bias (

Suggested Citation

  • Bernhard Michalowsky & Wolfgang Hoffmann & Kevin Kennedy & Feng Xie, 2020. "Is the whole larger than the sum of its parts? Impact of missing data imputation in economic evaluation conducted alongside randomized controlled trials," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 21(5), pages 717-728, July.
    • Handle: RePEc:spr:eujhec:v:21:y:2020:i:5:d:10.1007_s10198-020-01166-z
    DOI: 10.1007/s10198-020-01166-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10198-020-01166-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10198-020-01166-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bernhard Michalowsky & Steffen Flessa & Tilly Eichler & Johannes Hertel & Adina Dreier & Ina Zwingmann & Diana Wucherer & Henriette Rau & Jochen René Thyrian & Wolfgang Hoffmann, 2018. "Healthcare utilization and costs in primary care patients with dementia: baseline results of the DelpHi-trial," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 19(1), pages 87-102, January.
    2. Rita Faria & Manuel Gomes & David Epstein & Ian White, 2014. "A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled Trials," PharmacoEconomics, Springer, vol. 32(12), pages 1157-1170, December.
    3. Sian Marie Noble & William Hollingworth & Kate Tilling, 2012. "Missing data in trial‐based cost‐effectiveness analysis: the current state of play," Health Economics, John Wiley & Sons, Ltd., vol. 21(2), pages 187-200, February.
    4. Jan B. Oostenbrink & Maiwenn J. Al, 2005. "The analysis of incomplete cost data due to dropout," Health Economics, John Wiley & Sons, Ltd., vol. 14(8), pages 763-776, August.
    5. David K. Blough & Scott Ramsey & Sean D. Sullivan & Roger Yusen, 2009. "The impact of using different imputation methods for missing quality of life scores on the estimation of the cost‐effectiveness of lung‐volume‐reduction surgery," Health Economics, John Wiley & Sons, Ltd., vol. 18(1), pages 91-101, January.
    6. Baptiste Leurent & Manuel Gomes & James R. Carpenter, 2018. "Missing data in trial‐based cost‐effectiveness analysis: An incomplete journey," Health Economics, John Wiley & Sons, Ltd., vol. 27(6), pages 1024-1040, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. Chris Sampson’s journal round-up for 27th July 2020
      by Chris Sampson in The Academic Health Economists' Blog on 2020-07-27 11:00:01

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mohamed El Alili & Johanna M. van Dongen & Jonas L. Esser & Martijn W. Heymans & Maurits W. van Tulder & Judith E. Bosmans, 2022. "A scoping review of statistical methods for trial‐based economic evaluations: The current state of play," Health Economics, John Wiley & Sons, Ltd., vol. 31(12), pages 2680-2699, December.
    2. Rita Faria & Manuel Gomes & David Epstein & Ian White, 2014. "A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled Trials," PharmacoEconomics, Springer, vol. 32(12), pages 1157-1170, December.
    3. Alexina J. Mason & Manuel Gomes & James Carpenter & Richard Grieve, 2021. "Flexible Bayesian longitudinal models for cost‐effectiveness analyses with informative missing data," Health Economics, John Wiley & Sons, Ltd., vol. 30(12), pages 3138-3158, December.
    4. Andrea Gabrio & Alexina J. Mason & Gianluca Baio, 2017. "Handling Missing Data in Within-Trial Cost-Effectiveness Analysis: A Review with Future Recommendations," PharmacoEconomics - Open, Springer, vol. 1(2), pages 79-97, June.
    5. Alexina J. Mason & Manuel Gomes & Richard Grieve & James R. Carpenter, 2018. "A Bayesian framework for health economic evaluation in studies with missing data," Health Economics, John Wiley & Sons, Ltd., vol. 27(11), pages 1670-1683, November.
    6. Baptiste Leurent & Manuel Gomes & Rita Faria & Stephen Morris & Richard Grieve & James R. Carpenter, 2018. "Sensitivity Analysis for Not-at-Random Missing Data in Trial-Based Cost-Effectiveness Analysis: A Tutorial," PharmacoEconomics, Springer, vol. 36(8), pages 889-901, August.
    7. Baptiste Leurent & Manuel Gomes & Suzie Cro & Nicola Wiles & James R. Carpenter, 2020. "Reference‐based multiple imputation for missing data sensitivity analyses in trial‐based cost‐effectiveness analysis," Health Economics, John Wiley & Sons, Ltd., vol. 29(2), pages 171-184, February.
    8. Andrea Gabrio & Catrin Plumpton & Sube Banerjee & Baptiste Leurent, 2022. "Linear mixed models to handle missing at random data in trial‐based economic evaluations," Health Economics, John Wiley & Sons, Ltd., vol. 31(6), pages 1276-1287, June.
    9. Abualbishr Alshreef & Allan J. Wailoo & Steven R. Brown & James P. Tiernan & Angus J. M. Watson & Katie Biggs & Mike Bradburn & Daniel Hind, 2017. "Cost-Effectiveness of Haemorrhoidal Artery Ligation versus Rubber Band Ligation for the Treatment of Grade II–III Haemorrhoids: Analysis Using Evidence from the HubBLe Trial," PharmacoEconomics - Open, Springer, vol. 1(3), pages 175-184, September.
    10. Rissanen, Elisa & Karjalainen, Piia & Kiviruusu, Olli & Kankaanpää, Eila & Aronen, Eeva T. & Haula, Taru & Sääksvuori, Lauri & Vornanen, Riitta & Linnosmaa, Ismo, 2024. "Cost-effectiveness of a parenting program to reduce children’s behavioral problems among families receiving child protection services and other family support services – A randomized controlled trial," Children and Youth Services Review, Elsevier, vol. 158(C).
    11. Janet MacNeil Vroomen & Iris Eekhout & Marcel G. Dijkgraaf & Hein van Hout & Sophia E. de Rooij & Martijn W. Heymans & Judith E. Bosmans, 2016. "Multiple imputation strategies for zero-inflated cost data in economic evaluations: which method works best?," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 17(8), pages 939-950, November.
    12. Stüber, Heiko & Grabka, Markus M. & Schnitzlein, Daniel D., 2023. "A tale of two data sets: comparing German administrative and survey data using wage inequality as an example," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 57, pages 1-8.
    13. Laura Pirhonen & Kristian Bolin & Elisabeth Hansson Olofsson & Andreas Fors & Inger Ekman & Karl Swedberg & Hanna Gyllensten, 2019. "Person-Centred Care in Patients with Acute Coronary Syndrome: Cost-Effectiveness Analysis Alongside a Randomised Controlled Trial," PharmacoEconomics - Open, Springer, vol. 3(4), pages 495-504, December.
    14. Richard Grieve & John Cairns & Simon G. Thompson, 2010. "Improving costing methods in multicentre economic evaluation: the use of multiple imputation for unit costs," Health Economics, John Wiley & Sons, Ltd., vol. 19(8), pages 939-954, August.
    15. William Hollingworth & Christopher G. Fawsitt & Padraig Dixon & Larisa Duffy & Ricardo Araya & Tim J. Peters & Howard Thom & Nicky J. Welton & Nicola Wiles & Glyn Lewis, 2020. "Cost-Effectiveness of Sertraline in Primary Care According to Initial Severity and Duration of Depressive Symptoms: Findings from the PANDA RCT," PharmacoEconomics - Open, Springer, vol. 4(3), pages 427-438, September.
    16. Matthew Franklin & James Lomas & Simon Walker & Tracey Young, 2019. "An Educational Review About Using Cost Data for the Purpose of Cost-Effectiveness Analysis," PharmacoEconomics, Springer, vol. 37(5), pages 631-643, May.
    17. Andrea Gabrio & Michael J. Daniels & Gianluca Baio, 2020. "A Bayesian parametric approach to handle missing longitudinal outcome data in trial‐based health economic evaluations," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(2), pages 607-629, February.
    18. Manuel Gomes & Karla Díaz-Ordaz & Richard Grieve & Michael G. Kenward, 2013. "Multiple Imputation Methods for Handling Missing Data in Cost-effectiveness Analyses That Use Data from Hierarchical Studies," Medical Decision Making, , vol. 33(8), pages 1051-1063, November.
    19. Padraig Dixon & William Hollingworth & Jonathan Benger & James Calvert & Melanie Chalder & Anna King & Stephanie MacNeill & Katherine Morton & Emily Sanderson & Sarah Purdy, 2020. "Observational Cost-Effectiveness Analysis Using Routine Data: Admission and Discharge Care Bundles for Patients with Chronic Obstructive Pulmonary Disease," PharmacoEconomics - Open, Springer, vol. 4(4), pages 657-667, December.
    20. Benjamin Thorpe & Orlagh Carroll & Linda Sharples, 2018. "Methods for Handling Unobserved Covariates in a Bayesian Update of a Cost-effectiveness Model," Medical Decision Making, , vol. 38(2), pages 150-162, February.

    More about this item

    Keywords

    Missing data; Multiple imputation; Cost-effectiveness analysis; Cost–utility analysis;
    All these keywords.

    JEL classification:

    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • C43 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Index Numbers and Aggregation
    • I1 - Health, Education, and Welfare - - Health
    • I10 - Health, Education, and Welfare - - Health - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:eujhec:v:21:y:2020:i:5:d:10.1007_s10198-020-01166-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.