IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2302.11715.html
   My bibliography  Save this paper

Variable Importance Matching for Causal Inference

Author

Listed:
  • Quinn Lanners
  • Harsh Parikh
  • Alexander Volfovsky
  • Cynthia Rudin
  • David Page

Abstract

Our goal is to produce methods for observational causal inference that are auditable, easy to troubleshoot, accurate for treatment effect estimation, and scalable to high-dimensional data. We describe a general framework called Model-to-Match that achieves these goals by (i) learning a distance metric via outcome modeling, (ii) creating matched groups using the distance metric, and (iii) using the matched groups to estimate treatment effects. Model-to-Match uses variable importance measurements to construct a distance metric, making it a flexible framework that can be adapted to various applications. Concentrating on the scalability of the problem in the number of potential confounders, we operationalize the Model-to-Match framework with LASSO. We derive performance guarantees for settings where LASSO outcome modeling consistently identifies all confounders (importantly without requiring the linear model to be correctly specified). We also provide experimental results demonstrating the method's auditability, accuracy, and scalability as well as extensions to more general nonparametric outcome modeling.

Suggested Citation

  • Quinn Lanners & Harsh Parikh & Alexander Volfovsky & Cynthia Rudin & David Page, 2023. "Variable Importance Matching for Causal Inference," Papers 2302.11715, arXiv.org, revised Jun 2023.
  • Handle: RePEc:arx:papers:2302.11715
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2302.11715
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2018. "Double/debiased machine learning for treatment and structural parameters," Econometrics Journal, Royal Economic Society, vol. 21(1), pages 1-68, February.
    2. Ho, Daniel E. & Imai, Kosuke & King, Gary & Stuart, Elizabeth A., 2007. "Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference," Political Analysis, Cambridge University Press, vol. 15(3), pages 199-236, July.
    3. Alexis Diamond & Jasjeet S. Sekhon, 2013. "Genetic Matching for Estimating Causal Effects: A General Multivariate Matching Method for Achieving Balance in Observational Studies," The Review of Economics and Statistics, MIT Press, vol. 95(3), pages 932-945, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gabriele Spilker & Tobias Böhmelt, 2013. "The impact of preferential trade agreements on governmental repression revisited," The Review of International Organizations, Springer, vol. 8(3), pages 343-361, September.
    2. Datta, Nirupam, 2015. "Evaluating Impacts of Watershed Development Program on Agricultural Productivity, Income, and Livelihood in Bhalki Watershed of Bardhaman District, West Bengal," World Development, Elsevier, vol. 66(C), pages 443-456.
    3. Guanghui Pan, 2024. "Methodological Foundations of Modern Causal Inference in Social Science Research," Papers 2408.00032, arXiv.org.
    4. Robert J. Johnston & Klaus Moeltner, 2019. "Special Flood Hazard Effects on Coastal and Interior Home Values: One Size Does Not Fit All," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 74(1), pages 181-210, September.
    5. Goller, Daniel & Lechner, Michael & Moczall, Andreas & Wolff, Joachim, 2020. "Does the estimation of the propensity score by machine learning improve matching estimation? The case of Germany's programmes for long term unemployed," Labour Economics, Elsevier, vol. 65(C).
    6. Margaret E. Roberts & Brandon M. Stewart & Richard A. Nielsen, 2020. "Adjusting for Confounding with Text Matching," American Journal of Political Science, John Wiley & Sons, vol. 64(4), pages 887-903, October.
    7. Cousineau, Martin & Verter, Vedat & Murphy, Susan A. & Pineau, Joelle, 2023. "Estimating causal effects with optimization-based methods: A review and empirical comparison," European Journal of Operational Research, Elsevier, vol. 304(2), pages 367-380.
    8. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    9. Kevin Arceneaux & Johanna Dunaway & Martin Johnson & Ryan J. Vander Wielen, 2020. "Strategic Candidate Entry and Congressional Elections in the Era of Fox News," American Journal of Political Science, John Wiley & Sons, vol. 64(2), pages 398-415, April.
    10. Jason J. Sauppe & Sheldon H. Jacobson & Edward C. Sewell, 2014. "Complexity and Approximation Results for the Balance Optimization Subset Selection Model for Causal Inference in Observational Studies," INFORMS Journal on Computing, INFORMS, vol. 26(3), pages 547-566, August.
    11. Leijten, Floris & Sim, Sarah & King, Henry & Verburg, Peter H., 2021. "Local deforestation spillovers induced by forest moratoria: Evidence from Indonesia," Land Use Policy, Elsevier, vol. 109(C).
    12. Peña-Longobardo, L.M. & Rodríguez-Sánchez, B. & Oliva-Moreno, J., 2021. "The impact of widowhood on wellbeing, health, and care use: A longitudinal analysis across Europe," Economics & Human Biology, Elsevier, vol. 43(C).
    13. Amanda Kennard, 2021. "My Brother’s Keeper: Other-regarding preferences and concern for global climate change," The Review of International Organizations, Springer, vol. 16(2), pages 345-376, April.
    14. Kaye Usry & Jason Husser & Aaron Sparks, 2022. "I'm Not a Scientist, I Just Know What I See: Hurricane experience and climate change acceptance," Social Science Quarterly, Southwestern Social Science Association, vol. 103(5), pages 1190-1201, September.
    15. Adam C. Sales & Ben B. Hansen & Brian Rowan, 2018. "Rebar: Reinforcing a Matching Estimator With Predictions From High-Dimensional Covariates," Journal of Educational and Behavioral Statistics, , vol. 43(1), pages 3-31, February.
    16. Tobias Bauckloh & Stefan Schaltegger & Sebastian Utz & Sebastian Zeile & Bernhard Zwergel, 2023. "Active First Movers vs. Late Free-Riders? An Empirical Analysis of UN PRI Signatories’ Commitment," Journal of Business Ethics, Springer, vol. 182(3), pages 747-781, January.
    17. Brent, Daniel A. & Ward, Michael B., 2019. "Price perceptions in water demand," Journal of Environmental Economics and Management, Elsevier, vol. 98(C).
    18. Riccardo D'Alberto & Francesco Pagliacci & Matteo Zavalloni, 2023. "A socioeconomic impact assessment of three Italian national parks," Journal of Regional Science, Wiley Blackwell, vol. 63(1), pages 114-147, January.
    19. Jason J. Sauppe & Sheldon H. Jacobson, 2017. "The role of covariate balance in observational studies," Naval Research Logistics (NRL), John Wiley & Sons, vol. 64(4), pages 323-344, June.
    20. Harsh Parikh & Carlos Varjao & Louise Xu & Eric Tchetgen Tchetgen, 2022. "Validating Causal Inference Methods," Papers 2202.04208, arXiv.org, revised Jul 2022.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2302.11715. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.