IDEAS home Printed from https://ideas.repec.org/a/wly/hlthec/v21y2012i6p695-714.html
   My bibliography  Save this article

A matching method for improving covariate balance in cost‐effectiveness analyses

Author

Listed:
  • Jasjeet Singh Sekhon
  • Richard D. Grieve

Abstract

In cost‐effectiveness analyses (CEA) that use randomized controlled trials (RCTs), covariates of prognostic importance may be imbalanced and warrant adjustment. In CEA that use non‐randomized studies (NRS), the selection on observables assumption must hold for regression and matching methods to be unbiased. Even in restricted circumstances when this assumption is plausible, a key concern is how to adjust for imbalances in observed confounders. If the propensity score is misspecified, the covariates in the matched sample will be imbalanced, which can lead to conditional bias. To address covariate imbalance in CEA based on RCTs and NRS, this paper considers Genetic Matching. This matching method uses a search algorithm to directly maximize covariate balance. We compare Genetic and propensity score matching in Monte Carlo simulations and two case studies, CEA of pulmonary artery catheterization, based on an RCT and an NRS. The simulations show that Genetic Matching reduces the conditional bias and root mean squared error compared with propensity score matching. Genetic Matching achieves better covariate balance than the unadjusted analyses of the RCT data. In the NRS, Genetic Matching improves on the balance obtained from propensity score matching and gives substantively different estimates of incremental cost‐effectiveness. We conclude that Genetic Matching can improve balance on measured covariates in CEA that use RCTs and NRS, but with NRS, this will be insufficient to reduce bias; the selection on observables assumption must also hold. Copyright © 2011 John Wiley & Sons, Ltd.

Suggested Citation

  • Jasjeet Singh Sekhon & Richard D. Grieve, 2012. "A matching method for improving covariate balance in cost‐effectiveness analyses," Health Economics, John Wiley & Sons, Ltd., vol. 21(6), pages 695-714, June.
  • Handle: RePEc:wly:hlthec:v:21:y:2012:i:6:p:695-714
    DOI: 10.1002/hec.1748
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/hec.1748
    Download Restriction: no

    File URL: https://libkey.io/10.1002/hec.1748?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Basu, A & Polsky, D & Manning, W G, 2008. "Use of propensity scores in non-linear response models: The case for health care expenditures," Health, Econometrics and Data Group (HEDG) Working Papers 08/11, HEDG, c/o Department of Economics, University of York.
    2. Paul Grootendorst, 2007. "A review of instrumental variables estimation in the applied health sciences," Social and Economic Dimensions of an Aging Population Research Papers 215, McMaster University.
    3. Nandita Mitra & Alka Indurkhya, 2005. "A propensity score approach to estimating the cost–effectiveness of medical therapies from observational data," Health Economics, John Wiley & Sons, Ltd., vol. 14(8), pages 805-815, August.
    4. Heinrich, Carolyn J., 2007. "Demand and Supply-Side Determinants of Conditional Cash Transfer Program Effectiveness," World Development, Elsevier, vol. 35(1), pages 121-143, January.
    5. Andrew R. Willan & Andrew H. Briggs & Jeffrey S. Hoch, 2004. "Regression methods for covariate adjustment and subgroup analysis for non‐censored cost‐effectiveness data," Health Economics, John Wiley & Sons, Ltd., vol. 13(5), pages 461-475, May.
    6. Jeffrey S. Hoch & Andrew H. Briggs & Andrew R. Willan, 2002. "Something old, something new, something borrowed, something blue: a framework for the marriage of health econometrics and cost‐effectiveness analysis," Health Economics, John Wiley & Sons, Ltd., vol. 11(5), pages 415-430, July.
    7. Mebane Jr., Walter R. & Sekhon, Jasjeet S., 2011. "Genetic Optimization Using Derivatives: The rgenoud Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 42(i11).
    8. Andrew M. Jones (ed.), 2006. "The Elgar Companion to Health Economics," Books, Edward Elgar Publishing, number 3572.
    9. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    10. Alberto Abadie & Guido W. Imbens, 2008. "On the Failure of the Bootstrap for Matching Estimators," Econometrica, Econometric Society, vol. 76(6), pages 1537-1557, November.
    11. Sekhon, Jasjeet S., 2011. "Multivariate and Propensity Score Matching Software with Automated Balance Optimization: The Matching package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 42(i07).
    12. Hopkins, Daniel J., 2010. "Politicized Places: Explaining Where and When Immigrants Provoke Local Opposition," American Political Science Review, Cambridge University Press, vol. 104(1), pages 40-60, February.
    13. Andrew Briggs & Richard Nixon & Simon Dixon & Simon Thompson, 2005. "Parametric modelling of cost data: some simulation evidence," Health Economics, John Wiley & Sons, Ltd., vol. 14(4), pages 421-428, April.
    14. Daniel Polsky & Anirban Basu, 2006. "Selection Bias in Observational Data," Chapters, in: Andrew M. Jones (ed.), The Elgar Companion to Health Economics, chapter 43, Edward Elgar Publishing.
    15. Anirban Basu & James J. Heckman & Salvador Navarro-Lozano & Sergio Urzua, 2007. "Use of instrumental variables in the presence of heterogeneity and self-selection: an application to treatments of breast cancer patients," Health Economics, John Wiley & Sons, Ltd., vol. 16(11), pages 1133-1157.
    16. Gordon, Sanford C., 2009. "Assessing Partisan Bias in Federal Public Corruption Prosecutions," American Political Science Review, Cambridge University Press, vol. 103(4), pages 534-554, November.
    17. Andrew M. Jones, 2007. "Identification of treatment effects in Health Economics," Health Economics, John Wiley & Sons, Ltd., vol. 16(11), pages 1127-1131, November.
    18. Kosuke Imai & Gary King & Elizabeth A. Stuart, 2008. "Misunderstandings between experimentalists and observationalists about causal inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(2), pages 481-502, April.
    19. Ho, Daniel E. & Imai, Kosuke & King, Gary & Stuart, Elizabeth A., 2007. "Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference," Political Analysis, Cambridge University Press, vol. 15(3), pages 199-236, July.
    20. Manning, Willard G. & Mullahy, John, 2001. "Estimating log models: to transform or not to transform?," Journal of Health Economics, Elsevier, vol. 20(4), pages 461-494, July.
    21. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    22. Andrew M. Jones, 2007. "Identification of treatment effects in Health Economics," Health Economics, John Wiley & Sons, Ltd., vol. 16(11), pages 1127-1131.
    23. Richard M. Nixon & Simon G. Thompson, 2005. "Methods for incorporating covariate adjustment, subgroup analysis and between‐centre differences into cost‐effectiveness evaluations," Health Economics, John Wiley & Sons, Ltd., vol. 14(12), pages 1217-1229, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Deidda, Manuela & Geue, Claudia & Kreif, Noemi & Dundas, Ruth & McIntosh, Emma, 2019. "A framework for conducting economic evaluations alongside natural experiments," Social Science & Medicine, Elsevier, vol. 220(C), pages 353-361.
    2. Cai, Yi & Sun, Yucheng & Qi, Wene & Yi, Famin, 2022. "Impact of smartphone use on production outsourcing: evidence from litchi farming in southern China," International Food and Agribusiness Management Review, International Food and Agribusiness Management Association, vol. 25(4), September.
    3. Philip Klein & Hedwig Blommestein & Maiwenn Al & Benedetta Pongiglione & Aleksandra Torbica & Saskia de Groot, 2022. "Real‐world evidence in health technology assessment of high‐risk medical devices: Fit for purpose?," Health Economics, John Wiley & Sons, Ltd., vol. 31(S1), pages 10-24, September.
    4. Tobias Bauckloh & Stefan Schaltegger & Sebastian Utz & Sebastian Zeile & Bernhard Zwergel, 2023. "Active First Movers vs. Late Free-Riders? An Empirical Analysis of UN PRI Signatories’ Commitment," Journal of Business Ethics, Springer, vol. 182(3), pages 747-781, January.
    5. Jason J. Sauppe & Sheldon H. Jacobson & Edward C. Sewell, 2014. "Complexity and Approximation Results for the Balance Optimization Subset Selection Model for Causal Inference in Observational Studies," INFORMS Journal on Computing, INFORMS, vol. 26(3), pages 547-566, August.
    6. Timothy Tyler Brown & Juan Pablo Atal, 2019. "How robust are reference pricing studies on outpatient medical procedures? Three different preprocessing techniques applied to difference‐in differences," Health Economics, John Wiley & Sons, Ltd., vol. 28(2), pages 280-298, February.
    7. Alarcón, Silverio & Sánchez, Mercedes, 2016. "Is there a virtuous circle relationship between innovation activities and exports? A comparison of food and agricultural firms," Food Policy, Elsevier, vol. 61(C), pages 70-79.
    8. Lindlbauer, Ivonne & Schreyögg, Jonas & Winter, Vera, 2016. "Changes in technical efficiency after quality management certification: A DEA approach using difference-in-difference estimation with genetic matching in the hospital industry," European Journal of Operational Research, Elsevier, vol. 250(3), pages 1026-1036.
    9. Mohamed El Alili & Johanna M. van Dongen & Jonas L. Esser & Martijn W. Heymans & Maurits W. van Tulder & Judith E. Bosmans, 2022. "A scoping review of statistical methods for trial‐based economic evaluations: The current state of play," Health Economics, John Wiley & Sons, Ltd., vol. 31(12), pages 2680-2699, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Noémi Kreif & Richard Grieve & M. Zia Sadique, 2013. "Statistical Methods For Cost‐Effectiveness Analyses That Use Observational Data: A Critical Appraisal Tool And Review Of Current Practice," Health Economics, John Wiley & Sons, Ltd., vol. 22(4), pages 486-500, April.
    2. Gomes, M & Grieve, R, 2011. "Estimating the Effects of Friendship Networks on Health Behaviors of Adolescents," Health, Econometrics and Data Group (HEDG) Working Papers 11/14, HEDG, c/o Department of Economics, University of York.
    3. Jones A.M & Rice N, 2009. "Econometric Evaluation of Health Policies," Health, Econometrics and Data Group (HEDG) Working Papers 09/09, HEDG, c/o Department of Economics, University of York.
    4. Manuel Gomes & Richard Grieve & Richard Nixon & Edmond S.‐W. Ng & James Carpenter & Simon G. Thompson, 2012. "Methods For Covariate Adjustment In Cost‐Effectiveness Analysis That Use Cluster Randomised Trials," Health Economics, John Wiley & Sons, Ltd., vol. 21(9), pages 1101-1118, September.
    5. Wumeng He & Orapan Nabangchang & Krista Erdman & Alex C. A. Vanko & Prapti Poudel & Chandra Giri & Jeffrey R. Vincent, 2023. "Inferring Economic Impacts from a Program’s Physical Outcomes: An Application to Forest Protection in Thailand," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 84(3), pages 845-876, March.
    6. Heinrich, Carolyn J. & Mueser, Peter R. & Troske, Kenneth & Jeon, Kyung-Seong & Kahvecioglu, Daver C., 2009. "New Estimates of Public Employment and Training Program Net Impacts: A Nonexperimental Evaluation of the Workforce Investment Act Program," IZA Discussion Papers 4569, Institute of Labor Economics (IZA).
    7. Ferraro, Paul J. & Miranda, Juan José, 2014. "The performance of non-experimental designs in the evaluation of environmental programs: A design-replication study using a large-scale randomized experiment as a benchmark," Journal of Economic Behavior & Organization, Elsevier, vol. 107(PA), pages 344-365.
    8. Martin Huber & Michael Lechner & Andreas Steinmayr, 2015. "Radius matching on the propensity score with bias adjustment: tuning parameters and finite sample behaviour," Empirical Economics, Springer, vol. 49(1), pages 1-31, August.
    9. Adeola Oyenubi & Martin Wittenberg, 2021. "Does the choice of balance-measure matter under genetic matching?," Empirical Economics, Springer, vol. 61(1), pages 489-502, July.
    10. Manuel Gomes & Richard Grieve & Richard Nixon & W. J. Edmunds, 2012. "Statistical Methods for Cost-Effectiveness Analyses That Use Data from Cluster Randomized Trials," Medical Decision Making, , vol. 32(1), pages 209-220, January.
    11. Blackman, Allen, 2015. "Strict versus mixed-use protected areas: Guatemala's Maya Biosphere Reserve," Ecological Economics, Elsevier, vol. 112(C), pages 14-24.
    12. Theodoros Mantopoulos & Paul M. Mitchell & Nicky J. Welton & Richard McManus & Lazaros Andronis, 2016. "Choice of statistical model for cost-effectiveness analysis and covariate adjustment: empirical application of prominent models and assessment of their results," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 17(8), pages 927-938, November.
    13. Noemi Kreif & Richard Grieve & Rosalba Radice & Zia Sadique & Roland Ramsahai & Jasjeet S. Sekhon, 2012. "Methods for Estimating Subgroup Effects in Cost-Effectiveness Analyses That Use Observational Data," Medical Decision Making, , vol. 32(6), pages 750-763, November.
    14. Dudel Christian & Garbuszus Jan Marvin & Ott Notburga & Werding Martin, 2017. "Matching as Non-Parametric Preprocessing for the Estimation of Equivalence Scales," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 237(2), pages 115-141, April.
    15. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2013. "The performance of estimators based on the propensity score," Journal of Econometrics, Elsevier, vol. 175(1), pages 1-21.
    16. Canavire-Bacarreza, Gustavo & Diaz-Gutierrez, Julian Eduardo & Hanauer, Merlin M., 2018. "Unintended consequences of conservation: Estimating the impact of protected areas on violence in Colombia," Journal of Environmental Economics and Management, Elsevier, vol. 89(C), pages 46-70.
    17. Bryan Keller & Elizabeth Tipton, 2016. "Propensity Score Analysis in R," Journal of Educational and Behavioral Statistics, , vol. 41(3), pages 326-348, June.
    18. Tymon Słoczyński, 2015. "The Oaxaca–Blinder Unexplained Component as a Treatment Effects Estimator," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 77(4), pages 588-604, August.
    19. Martin Huber & Michael Lechner & Giovanni Mellace, 2017. "Why Do Tougher Caseworkers Increase Employment? The Role of Program Assignment as a Causal Mechanism," The Review of Economics and Statistics, MIT Press, vol. 99(1), pages 180-183, March.
    20. Blackman, Allen & Goff, Leonard & Rivera Planter, Marisol, 2018. "Does eco-certification stem tropical deforestation? Forest Stewardship Council certification in Mexico," Journal of Environmental Economics and Management, Elsevier, vol. 89(C), pages 306-333.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:hlthec:v:21:y:2012:i:6:p:695-714. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.