IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v38y2018i2p200-211.html
   My bibliography  Save this article

Methods for Population-Adjusted Indirect Comparisons in Health Technology Appraisal

Author

Listed:
  • David M. Phillippo
  • Anthony E. Ades
  • Sofia Dias
  • Stephen Palmer
  • Keith R. Abrams
  • Nicky J. Welton

Abstract

Standard methods for indirect comparisons and network meta-analysis are based on aggregate data, with the key assumption that there is no difference between the trials in the distribution of effect-modifying variables. Methods which relax this assumption are becoming increasingly common for submissions to reimbursement agencies, such as the National Institute for Health and Care Excellence (NICE). These methods use individual patient data from a subset of trials to form population-adjusted indirect comparisons between treatments, in a specific target population. Recently proposed population adjustment methods include the Matching-Adjusted Indirect Comparison (MAIC) and the Simulated Treatment Comparison (STC). Despite increasing popularity, MAIC and STC remain largely untested. Furthermore, there is a lack of clarity about exactly how and when they should be applied in practice, and even whether the results are relevant to the decision problem. There is therefore a real and present risk that the assumptions being made in one submission to a reimbursement agency are fundamentally different to—or even incompatible with—the assumptions being made in another for the same indication. We describe the assumptions required for population-adjusted indirect comparisons, and demonstrate how these may be used to generate comparisons in any given target population. We distinguish between anchored and unanchored comparisons according to whether a common comparator arm is used or not. Unanchored comparisons make much stronger assumptions, which are widely regarded as infeasible. We provide recommendations on how and when population adjustment methods should be used, and the supporting analyses that are required to provide statistically valid, clinically meaningful, transparent and consistent results for the purposes of health technology appraisal. Simulation studies are needed to examine the properties of population adjustment methods and their robustness to breakdown of assumptions.

Suggested Citation

  • David M. Phillippo & Anthony E. Ades & Sofia Dias & Stephen Palmer & Keith R. Abrams & Nicky J. Welton, 2018. "Methods for Population-Adjusted Indirect Comparisons in Health Technology Appraisal," Medical Decision Making, , vol. 38(2), pages 200-211, February.
    • Handle: RePEc:sae:medema:v:38:y:2018:i:2:p:200-211
    DOI: 10.1177/0272989X17725740
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X17725740
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0272989X17725740?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hainmueller, Jens, 2012. "Entropy Balancing for Causal Effects: A Multivariate Reweighting Method to Produce Balanced Samples in Observational Studies," Political Analysis, Cambridge University Press, vol. 20(1), pages 25-46, January.
    2. Elizabeth A. Stuart & Stephen R. Cole & Catherine P. Bradshaw & Philip J. Leaf, 2011. "The use of propensity scores to assess the generalizability of results from randomized trials," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(2), pages 369-386, April.
    3. Erin Hartman & Richard Grieve & Roland Ramsahai & Jasjeet S. Sekhon, 2015. "From sample average treatment effect to population average treatment effect on the treated: combining experimental with observational studies to estimate population treatment effects," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(3), pages 757-778, June.
    4. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    5. J.Jaime Caro & K. Ishak, 2010. "No Head-to-Head Trial? Simulate the Missing Arms," PharmacoEconomics, Springer, vol. 28(10), pages 957-967, October.
    6. Kosuke Imai & Gary King & Elizabeth A. Stuart, 2008. "Misunderstandings between experimentalists and observationalists about causal inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(2), pages 481-502, April.
    7. Roderick J. Little & Sonya Vartivarian, "undated". "Does Weighting for Nonresponse Increase the Variance of Survey Means? (Conference Paper)," Mathematica Policy Research Reports 1e14e3c1234e4e85b49a9bba8, Mathematica Policy Research.
    8. Rod Little & Sonya Vartivarian, 2004. "Does Weighting for Nonresponse Increase the Variance of Survey Means?," The University of Michigan Department of Biostatistics Working Paper Series 1034, Berkeley Electronic Press.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jiyeon Kang & John Cairns, 2023. "“Don’t Think Twice, It’s All Right”: Using Additional Data to Reduce Uncertainty Regarding Oncologic Drugs Provided Through Managed Access Agreements in England," PharmacoEconomics - Open, Springer, vol. 7(1), pages 77-91, January.
    2. Sanjay Popat & Stephen V. Liu & Nicolas Scheuer & Grace G. Hsu & Alexandre Lockhart & Sreeram V. Ramagopalan & Frank Griesinger & Vivek Subbiah, 2022. "Addressing challenges with real-world synthetic control arms to demonstrate the comparative effectiveness of Pralsetinib in non-small cell lung cancer," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    3. Manuel Gomes & Nick Latimer & Marta Soares & Sofia Dias & Gianluca Baio & Nick Freemantle & Dalia Dawoud & Allan Wailoo & Richard Grieve, 2022. "Target Trial Emulation for Transparent and Robust Estimation of Treatment Effects for Health Technology Assessment Using Real-World Data: Opportunities and Challenges," PharmacoEconomics, Springer, vol. 40(6), pages 577-586, June.
    4. B. Muresan & C. Mamolo & J. C. Cappelleri & M. J. Postma & B. Heeg, 2021. "Cost-Effectiveness of Bosutinib for the Treatment of Adult Patients with Chronic Phase Chronic Myeloid Leukemia in the Second-Line Setting," Applied Health Economics and Health Policy, Springer, vol. 19(6), pages 929-940, November.
    5. Doug Coyle & Isabelle Durand-Zaleski & Jasmine Farrington & Louis Garrison & Johann-Matthias Graf von der Schulenburg & Wolfgang Greiner & Louise Longworth & Aurélie Meunier & Anne-Sophie Moutié & Ste, 2020. "HTA methodology and value frameworks for evaluation and policy making for cell and gene therapies," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 21(9), pages 1421-1437, December.
    6. Nan Qiao & Ralph Insinga & Thomas Burke & Gilberto Lopes, 2021. "Cost-Minimization Analysis of Pembrolizumab Monotherapy Versus Nivolumab in Combination with Ipilimumab as First-Line Treatment for Metastatic PD-L1-Positive Non-small Cell Lung Cancer: A US Payer Per," PharmacoEconomics - Open, Springer, vol. 5(4), pages 765-778, December.
    7. Dasom Lee & Shu Yang & Lin Dong & Xiaofei Wang & Donglin Zeng & Jianwen Cai, 2023. "Improving trial generalizability using observational studies," Biometrics, The International Biometric Society, vol. 79(2), pages 1213-1225, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dasom Lee & Shu Yang & Lin Dong & Xiaofei Wang & Donglin Zeng & Jianwen Cai, 2023. "Improving trial generalizability using observational studies," Biometrics, The International Biometric Society, vol. 79(2), pages 1213-1225, June.
    2. Kellie Ottoboni & Jason Poulos, 2019. "Estimating population average treatment effects from experiments with noncompliance," Papers 1901.02991, arXiv.org, revised Aug 2020.
    3. Ottoboni Kellie N. & Poulos Jason V., 2020. "Estimating population average treatment effects from experiments with noncompliance," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 108-130, January.
    4. Naoki Egami & Erin Hartman, 2021. "Covariate selection for generalizing experimental results: Application to a large‐scale development program in Uganda," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(4), pages 1524-1548, October.
    5. Wendy Chan, 2018. "Applications of Small Area Estimation to Generalization With Subclassification by Propensity Scores," Journal of Educational and Behavioral Statistics, , vol. 43(2), pages 182-224, April.
    6. Fan Li & Ashley L. Buchanan & Stephen R. Cole, 2022. "Generalizing trial evidence to target populations in non‐nested designs: Applications to AIDS clinical trials," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(3), pages 669-697, June.
    7. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
    8. Elizabeth A. Stuart & Anna Rhodes, 2017. "Generalizing Treatment Effect Estimates From Sample to Population: A Case Study in the Difficulties of Finding Sufficient Data," Evaluation Review, , vol. 41(4), pages 357-388, August.
    9. Elizabeth Tipton, 2021. "Beyond generalization of the ATE: Designing randomized trials to understand treatment effect heterogeneity," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(2), pages 504-521, April.
    10. Matthias Neuenkirch & Peter Tillmann, 2016. "Does A Good Central Banker Make A Difference?," Economic Inquiry, Western Economic Association International, vol. 54(3), pages 1541-1560, July.
    11. Elizabeth Tipton & Kelly Hallberg & Larry V. Hedges & Wendy Chan, 2017. "Implications of Small Samples for Generalization: Adjustments and Rules of Thumb," Evaluation Review, , vol. 41(5), pages 472-505, October.
    12. Espenlaub, Susanne & Goyal, Abhinav & Mohamed, Abdulkadir, 2020. "The impact of shareholders and creditors rights on IPO performance: An international study," The British Accounting Review, Elsevier, vol. 52(1).
    13. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    14. Jason J. Sauppe & Sheldon H. Jacobson & Edward C. Sewell, 2014. "Complexity and Approximation Results for the Balance Optimization Subset Selection Model for Causal Inference in Observational Studies," INFORMS Journal on Computing, INFORMS, vol. 26(3), pages 547-566, August.
    15. Elizabeth Tipton, 2013. "Stratified Sampling Using Cluster Analysis," Evaluation Review, , vol. 37(2), pages 109-139, April.
    16. Rui Chen & Guanhua Chen & Menggang Yu, 2023. "Entropy balancing for causal generalization with target sample summary information," Biometrics, The International Biometric Society, vol. 79(4), pages 3179-3190, December.
    17. Mehmet Ugur & Eshref Trushin, 2023. "Information asymmetry, risk aversion and R&D subsidies: effect-size heterogeneity and policy conundrums," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 32(8), pages 1190-1215, November.
    18. Jones, Andrew M. & Rice, Nigel & Zantomio, Francesca, 2020. "Acute health shocks and labour market outcomes: Evidence from the post crash era," Economics & Human Biology, Elsevier, vol. 36(C).
    19. Isaiah Andrews & Emily Oster, 2017. "A Simple Approximation for Evaluating External Validity Bias," NBER Working Papers 23826, National Bureau of Economic Research, Inc.
    20. Lisa Frey, 2018. "Tax certified individual auditors and effective tax rates," Business Research, Springer;German Academic Association for Business Research, vol. 11(1), pages 77-114, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:38:y:2018:i:2:p:200-211. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.