IDEAS home Printed from https://ideas.repec.org/a/bla/biomet/v79y2023i3p2346-2356.html
   My bibliography  Save this article

How well can fine balance work for covariate balancing

Author

Listed:
  • Ruoqi Yu

Abstract

Fine balance is a matching technique to improve covariate balance in observational studies. It constrains a match to have identical distributions for some covariates without restricting who is matched to whom. However, despite its wide application and excellent performance in practice, there is very little theory indicating when the method is likely to succeed or fail and to what extent it can remove covariate imbalance. In order to answer these questions, this paper studies the limits of what is possible for covariate balancing using fine balance and near‐fine balance. The investigations suggest that given the distributions of the treated and control groups, in large samples, the maximum achievable balance by using fine balance only depends on the matching ratio (ie, the ratio of the sample size of the control group to that of the treated group). In addition, the results indicate how to estimate this matching ratio threshold without knowledge of the true distributions in finite samples. The findings are also illustrated by numerical studies in this paper.

Suggested Citation

  • Ruoqi Yu, 2023. "How well can fine balance work for covariate balancing," Biometrics, The International Biometric Society, vol. 79(3), pages 2346-2356, September.
  • Handle: RePEc:bla:biomet:v:79:y:2023:i:3:p:2346-2356
    DOI: 10.1111/biom.13771
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/biom.13771
    Download Restriction: no

    File URL: https://libkey.io/10.1111/biom.13771?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jesse Y. Hsu & José R. Zubizarreta & Dylan S. Small & Paul R. Rosenbaum, 2015. "Strong control of the familywise error rate in observational studies that discover effect modification by exploratory methods," Biometrika, Biometrika Trust, vol. 102(4), pages 767-782.
    2. Dan Yang & Dylan S. Small & Jeffrey H. Silber & Paul R. Rosenbaum, 2012. "Optimal Matching with Minimal Deviation from Fine Balance in a Study of Obesity and Surgical Outcomes," Biometrics, The International Biometric Society, vol. 68(2), pages 628-636, June.
    3. Gensler, Sonja & Leeflang, Peter & Skiera, Bernd, 2012. "Impact of online channel use on customer revenues and costs to serve: Considering product portfolios and self-selection," International Journal of Research in Marketing, Elsevier, vol. 29(2), pages 192-201.
    4. Ruoqi Yu & Paul R. Rosenbaum, 2019. "Directional penalties for optimal matching in observational studies," Biometrics, The International Biometric Society, vol. 75(4), pages 1380-1390, December.
    5. Rosenbaum, Paul R., 2010. "Design Sensitivity and Efficiency in Observational Studies," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 692-702.
    6. Samuel D. Pimentel & Frank Yoon & Luke Keele, 2015. "Variable-Ratio Matching with Fine Balance in a Study of the Peer Health Exchange," Mathematica Policy Research Reports 48f136c594194d14b494b8358, Mathematica Policy Research.
    7. Rosenbaum, Paul R. & Ross, Richard N. & Silber, Jeffrey H., 2007. "Minimum Distance Matched Sampling With Fine Balance in an Observational Study of Treatment for Ovarian Cancer," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 75-83, March.
    8. José R. Zubizarreta, 2012. "Using Mixed Integer Programming for Matching in an Observational Study of Kidney Failure After Surgery," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(500), pages 1360-1371, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ruoqi Yu, 2021. "Evaluating and improving a matched comparison of antidepressants and bone density," Biometrics, The International Biometric Society, vol. 77(4), pages 1276-1288, December.
    2. Jason J. Sauppe & Sheldon H. Jacobson, 2017. "The role of covariate balance in observational studies," Naval Research Logistics (NRL), John Wiley & Sons, vol. 64(4), pages 323-344, June.
    3. Bikram Karmakar, 2022. "An approximation algorithm for blocking of an experimental design," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(5), pages 1726-1750, November.
    4. Jason J. Sauppe & Sheldon H. Jacobson & Edward C. Sewell, 2014. "Complexity and Approximation Results for the Balance Optimization Subset Selection Model for Causal Inference in Observational Studies," INFORMS Journal on Computing, INFORMS, vol. 26(3), pages 547-566, August.
    5. Tian Heong Chan & Francis de Véricourt & Omar Besbes, 2019. "Contracting in Medical Equipment Maintenance Services: An Empirical Investigation," Management Science, INFORMS, vol. 65(3), pages 1136-1150, March.
    6. Hochbaum, Dorit S. & Rao, Xu & Sauppe, Jason, 2022. "Network flow methods for the minimum covariate imbalance problem," European Journal of Operational Research, Elsevier, vol. 300(3), pages 827-836.
    7. Samuel D. Pimentel & Lauren Vollmer Forrow & Jonathan Gellar & Jiaqi Li, 2020. "Optimal matching approaches in health policy evaluations under rolling enrolment," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(4), pages 1411-1435, October.
    8. Luke Keele & Steve Harris & Samuel D. Pimentel & Richard Grieve, 2020. "Stronger instruments and refined covariate balance in an observational study of the effectiveness of prompt admission to intensive care units," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(4), pages 1501-1521, October.
    9. Siyu Heng & Hyunseung Kang & Dylan S. Small & Colin B. Fogarty, 2021. "Increasing power for observational studies of aberrant response: An adaptive approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(3), pages 482-504, July.
    10. Pierluigi Montalbano & Silvia Nenci & Laura Dell'Agostino, 2022. "A non-parametric assessment of the effects of the Euro on GVC trade," International Economics, CEPII research center, issue 172, pages 56-76.
    11. Glazer Amanda K. & Pimentel Samuel D., 2023. "Robust inference for matching under rolling enrollment," Journal of Causal Inference, De Gruyter, vol. 11(1), pages 1-19, January.
    12. Siyu Heng & Dylan S. Small & Paul R. Rosenbaum, 2020. "Finding the strength in a weak instrument in a study of cognitive outcomes produced by Catholic high schools," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(3), pages 935-958, June.
    13. Cousineau, Martin & Verter, Vedat & Murphy, Susan A. & Pineau, Joelle, 2023. "Estimating causal effects with optimization-based methods: A review and empirical comparison," European Journal of Operational Research, Elsevier, vol. 304(2), pages 367-380.
    14. Bo Zhang, 2023. "Efficient algorithms for building representative matched pairs with enhanced generalizability," Biometrics, The International Biometric Society, vol. 79(4), pages 3981-3997, December.
    15. Martin Cousineau & Vedat Verter & Susan A. Murphy & Joelle Pineau, 2022. "Estimating causal effects with optimization-based methods: A review and empirical comparison," Papers 2203.00097, arXiv.org.
    16. Bo Zhang & Dylan S. Small, 2020. "A calibrated sensitivity analysis for matched observational studies with application to the effect of second‐hand smoke exposure on blood lead levels in children," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 69(5), pages 1285-1305, November.
    17. Bo, Hao & Galiani, Sebastian, 2021. "Assessing external validity," Research in Economics, Elsevier, vol. 75(3), pages 274-285.
    18. Nicholas Longford & Ioana C. Salagean, 2013. "A study of the labour market trajectories in the Grand Duchy of Luxembourg," Economics Working Papers 1396, Department of Economics and Business, Universitat Pompeu Fabra.
    19. Andrés Elberg & Pedro M. Gardete & Rosario Macera & Carlos Noton, 2019. "Dynamic effects of price promotions: field evidence, consumer search, and supply-side implications," Quantitative Marketing and Economics (QME), Springer, vol. 17(1), pages 1-58, March.
    20. Jacob Dorn & Kevin Guo, 2021. "Sharp Sensitivity Analysis for Inverse Propensity Weighting via Quantile Balancing," Papers 2102.04543, arXiv.org, revised Aug 2023.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:biomet:v:79:y:2023:i:3:p:2346-2356. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0006-341X .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.