IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v43y2018i1p3-31.html
   My bibliography  Save this article

Rebar: Reinforcing a Matching Estimator With Predictions From High-Dimensional Covariates

Author

Listed:
  • Adam C. Sales

    (University of Texas College of Education)

  • Ben B. Hansen
  • Brian Rowan

    (University of Michigan)

Abstract

In causal matching designs, some control subjects are often left unmatched, and some covariates are often left unmodeled. This article introduces “rebar,†a method using high-dimensional modeling to incorporate these commonly discarded data without sacrificing the integrity of the matching design. After constructing a match, a researcher uses the unmatched control subjects—the remnant—to fit a machine learning model predicting control potential outcomes as a function of the full covariate matrix. The resulting predictions in the matched set are used to adjust the causal estimate to reduce confounding bias. We present theoretical results to justify the method’s bias-reducing properties as well as a simulation study that demonstrates them. Additionally, we illustrate the method in an evaluation of a school-level comprehensive educational reform program in Arizona.

Suggested Citation

  • Adam C. Sales & Ben B. Hansen & Brian Rowan, 2018. "Rebar: Reinforcing a Matching Estimator With Predictions From High-Dimensional Covariates," Journal of Educational and Behavioral Statistics, , vol. 43(1), pages 3-31, February.
    • Handle: RePEc:sae:jedbes:v:43:y:2018:i:1:p:3-31
    DOI: 10.3102/1076998617731518
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998617731518
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998617731518?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Bishop, John H, 1997. "The Effect of National Standards and Curriculum-Based Exams on Achievement," American Economic Review, American Economic Association, vol. 87(2), pages 260-264, May.
    2. Rosenbaum, Paul R., 2010. "Design Sensitivity and Efficiency in Observational Studies," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 692-702.
    3. Zorn, Christopher, 2005. "A Solution to Separation in Binary Response Models," Political Analysis, Cambridge University Press, vol. 13(2), pages 157-170, April.
    4. Ben B. Hansen, 2008. "The prognostic analogue of the propensity score," Biometrika, Biometrika Trust, vol. 95(2), pages 481-488.
    5. Ho, Daniel E. & Imai, Kosuke & King, Gary & Stuart, Elizabeth A., 2007. "Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference," Political Analysis, Cambridge University Press, vol. 15(3), pages 199-236, July.
    6. Trevor Collier & Daniel Millimet, 2009. "Institutional arrangements in educational systems and student achievement: a cross-national analysis," Empirical Economics, Springer, vol. 37(2), pages 329-381, October.
    7. Samuel D. Pimentel & Dylan S. Small & Paul R. Rosenbaum, 2016. "Constructed Second Control Groups and Attenuation of Unmeasured Biases," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(515), pages 1157-1167, July.
    8. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    9. Alexis Diamond & Jasjeet S. Sekhon, 2013. "Genetic Matching for Estimating Causal Effects: A General Multivariate Matching Method for Achieving Balance in Observational Studies," The Review of Economics and Statistics, MIT Press, vol. 95(3), pages 932-945, July.
    10. Sekhon, Jasjeet S., 2011. "Multivariate and Propensity Score Matching Software with Automated Balance Optimization: The Matching package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 42(i07).
    11. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    12. Bishop, J., 1997. "The Effect of national Standards and Curriculum-Based Exams on Achievement," Papers 97-01, Cornell - Center for Advanced Human Resource Studies.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert J. Johnston & Klaus Moeltner, 2019. "Special Flood Hazard Effects on Coastal and Interior Home Values: One Size Does Not Fit All," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 74(1), pages 181-210, September.
    2. Pauline Leung & Zhuan Pei,, 2020. "Further Education During Unemployment," Working Papers 642, Princeton University, Department of Economics, Industrial Relations Section..
    3. Brent, Daniel A. & Ward, Michael B., 2019. "Price perceptions in water demand," Journal of Environmental Economics and Management, Elsevier, vol. 98(C).
    4. Stephen C. Nelson & Geoffrey P. R. Wallace, 2017. "Are IMF lending programs good or bad for democracy?," The Review of International Organizations, Springer, vol. 12(4), pages 523-558, December.
    5. Richard Aviles-Lopez & Juan de Dios Luna del Castillo & Miguel Ángel Montero-Alonso, 2023. "Exploratory Matching Model Search Algorithm (EMMSA) for Causal Analysis: Application to the Cardboard Industry," Mathematics, MDPI, vol. 11(21), pages 1-34, October.
    6. Roland R. Ramsahai, 2018. "Defining and estimating stochastic rate change in a dynamic general insurance portfolio," Papers 1810.10970, arXiv.org.
    7. Yang, Hongbo & Lupi, Frank & Zhang, Jindong & Liu, Jianguo, 2020. "Hidden cost of conservation: A demonstration using losses from human-wildlife conflicts under a payments for ecosystem services program," Ecological Economics, Elsevier, vol. 169(C).
    8. Canavire-Bacarreza, Gustavo & Diaz-Gutierrez, Julian Eduardo & Hanauer, Merlin M., 2018. "Unintended consequences of conservation: Estimating the impact of protected areas on violence in Colombia," Journal of Environmental Economics and Management, Elsevier, vol. 89(C), pages 46-70.
    9. Moeltner, Klaus & Blinn, Christine E. & Holmes, Thomas P., 2017. "Forest pests and home values: The importance of accuracy in damage assessment and geocoding of properties," Journal of Forest Economics, Elsevier, vol. 26(C), pages 46-55.
    10. Jasjeet Singh Sekhon & Richard D. Grieve, 2012. "A matching method for improving covariate balance in cost‐effectiveness analyses," Health Economics, John Wiley & Sons, Ltd., vol. 21(6), pages 695-714, June.
    11. Massimo Baldini & Daniele Pacifico & Federica Termini, 2015. "Imputation of missing expenditure information in standard household income surveys," Center for the Analysis of Public Policies (CAPP) 0116, Universita di Modena e Reggio Emilia, Dipartimento di Economia "Marco Biagi".
    12. Ferraro, Paul J. & Miranda, Juan José, 2014. "The performance of non-experimental designs in the evaluation of environmental programs: A design-replication study using a large-scale randomized experiment as a benchmark," Journal of Economic Behavior & Organization, Elsevier, vol. 107(PA), pages 344-365.
    13. Margaret E. Roberts & Brandon M. Stewart & Richard A. Nielsen, 2020. "Adjusting for Confounding with Text Matching," American Journal of Political Science, John Wiley & Sons, vol. 64(4), pages 887-903, October.
    14. Tobias Bauckloh & Stefan Schaltegger & Sebastian Utz & Sebastian Zeile & Bernhard Zwergel, 2023. "Active First Movers vs. Late Free-Riders? An Empirical Analysis of UN PRI Signatories’ Commitment," Journal of Business Ethics, Springer, vol. 182(3), pages 747-781, January.
    15. Modou Mar & Nadine Massard, 2021. "Animate the cluster or subsidize collaborative R&D? A multiple overlapping treatments approach to assess the impacts of the French cluster policy [The impact of R&D subsidies on R&D employment comp," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 30(4), pages 845-867.
    16. Riccardo D'Alberto & Francesco Pagliacci & Matteo Zavalloni, 2023. "A socioeconomic impact assessment of three Italian national parks," Journal of Regional Science, Wiley Blackwell, vol. 63(1), pages 114-147, January.
    17. Jason J. Sauppe & Sheldon H. Jacobson, 2017. "The role of covariate balance in observational studies," Naval Research Logistics (NRL), John Wiley & Sons, vol. 64(4), pages 323-344, June.
    18. Adeola Oyenubi & Martin Wittenberg, 2021. "Does the choice of balance-measure matter under genetic matching?," Empirical Economics, Springer, vol. 61(1), pages 489-502, July.
    19. España, F. & Arriagada, R. & Melo, O. & Foster, W., 2022. "Forest plantation subsidies: Impact evaluation of the Chilean case," Forest Policy and Economics, Elsevier, vol. 137(C).
    20. Fukui Hideki, 2023. "Evaluating Different Covariate Balancing Methods: A Monte Carlo Simulation," Statistics, Politics and Policy, De Gruyter, vol. 14(2), pages 205-326, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:43:y:2018:i:1:p:3-31. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.