IDEAS home Printed from https://ideas.repec.org/p/diw/diwwpp/dp245.html
   My bibliography  Save this paper

Estimating Causal Effects with Matching Methods in the Presence and Absence of Bias Cancellation

Author

Listed:
  • Thomas A. DiPrete
  • Henriette Engelhardt

Abstract

This paper explores the implications of possible bias cancellation using Rubin-style matching methods with complete and incomplete data. After reviewing the naïve causal estimator and the approaches of Heckman and Rubin to the causal estimation problem, we show how missing data can complicate the estimation of average causal effects in different ways, depending upon the nature of the missing mechanism. While - contrary to published assertions in the literature - bias cancellation does not generally occur when the multivariate distribution of the errors is symmetric, bias cancellation has been observed to occur for the case where selection into training is the treatment variable, and earnings is the outcome variable. A substantive rationale for bias cancellation is offered, which conceptualizes bias cancellation as the result of a mixture process based on two distinct individual-level decision-making models. While the general properties are unknown, the existence of bias cancellation appears to reduce the average bias in both OLS and matching methods relative to the symmetric distribution case. Analysis of simulated data under a set of difference scenarios suggests that matching methods do better than OLS in reducing that portion of bias that comes purely from the error distribution (i.e., from "selection on unobservables"). This advantage is often found also for the incomplete data case. Matching appears to offer no advantage over OLS in reducing the impact of bias due purely to selection on unobservable variables when the error variables are generated by standard multivariate normal distributions, which lack the bias-cancellation property.

Suggested Citation

  • Thomas A. DiPrete & Henriette Engelhardt, 2001. "Estimating Causal Effects with Matching Methods in the Presence and Absence of Bias Cancellation," Discussion Papers of DIW Berlin 245, DIW Berlin, German Institute for Economic Research.
  • Handle: RePEc:diw:diwwpp:dp245
    as

    Download full text from publisher

    File URL: https://www.diw.de/documents/publikationen/73/diw_01.c.38513.de/dp245.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    2. James Heckman, 1997. "Instrumental Variables: A Study of Implicit Behavioral Assumptions Used in Making Program Evaluations," Journal of Human Resources, University of Wisconsin Press, vol. 32(3), pages 441-462.
    3. Joshua D. Angrist & Guido W. Imbens & D.B. Rubin, 1993. "Identification of Causal Effects Using Instrumental Variables," NBER Technical Working Papers 0136, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Per-Anders Edin & Peter Fredriksson & Olof Åslund, 2003. "Ethnic Enclaves and the Economic Success of Immigrants—Evidence from a Natural Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 329-357.
    2. Thomas A. Di Prete & Henriette Engelhardt, 2000. "Estimating causal effects with matching methods in the presence and absence of bias cancellation," MPIDR Working Papers WP-2000-013, Max Planck Institute for Demographic Research, Rostock, Germany.
    3. Sari Pekkala, 2002. "Migration and Individual Earnings in Finland: A Regional Perspective," Regional Studies, Taylor & Francis Journals, vol. 36(1), pages 13-24.
    4. Eric J. Tchetgen Tchetgen & Kathleen E. Wirth, 2017. "A general instrumental variable framework for regression analysis with outcome missing not at random," Biometrics, The International Biometric Society, vol. 73(4), pages 1123-1131, December.
    5. Aakvik, Arild & Salvanes, Kjell G. & Vaage, Kjell, 2003. "Measuring Heterogeneity in the Returns to Education in Norway Using Educational Reforms," IZA Discussion Papers 815, Institute of Labor Economics (IZA).
    6. Becker, Rolf, 2000. "Determinanten der Studierbereitschaft in Ostdeutschland : eine empirische Anwendung der Humankapital- und Werterwartungstheorie am Beispiel sächsicher Abiturienten in den Jahren 1996 und 1998 (Determi," Mitteilungen aus der Arbeitsmarkt- und Berufsforschung, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 33(2), pages 261-276.
    7. Daniel Polsky & Anirban Basu, 2012. "Selection Bias in Observational Data," Chapters, in: Andrew M. Jones (ed.), The Elgar Companion to Health Economics, Second Edition, chapter 46, Edward Elgar Publishing.
    8. James Heckman & Salvador Navarro-Lozano, 2004. "Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 30-57, February.
    9. Tamini, Lota D., 2011. "A nonparametric analysis of the impact of agri-environmental advisory activities on best management practice adoption: A case study of Québec," Ecological Economics, Elsevier, vol. 70(7), pages 1363-1374, May.
    10. James J. Heckman & Jeffrey A. Smith, 1999. "The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," NBER Working Papers 6983, National Bureau of Economic Research, Inc.
    11. Hunt, Richard A. & Song, Yue & Townsend, David M. & Stallkamp, Maximilian, 2021. "Internationalization of entrepreneurial firms: Leveraging real options reasoning through affordable loss logics," Journal of Business Research, Elsevier, vol. 133(C), pages 194-207.
    12. Thomas A. Diprete & Henriette Engelhardt, 2004. "Estimating Causal Effects With Matching Methods in the Presence and Absence of Bias Cancellation," Sociological Methods & Research, , vol. 32(4), pages 501-528, May.
    13. Ziggy Macdonald & Michael A. Shields, 2001. "The Impact of Alcohol Consumption on Occupational Attainment in England," Economica, London School of Economics and Political Science, vol. 68(271), pages 427-453, August.
    14. Thomas Andren & Daniela Andren, 2006. "Assessing the employment effects of vocational training using a one-factor model," Applied Economics, Taylor & Francis Journals, vol. 38(21), pages 2469-2486.
    15. Michael Lechner & Ruth Miquel, 2010. "Identification of the effects of dynamic treatments by sequential conditional independence assumptions," Empirical Economics, Springer, vol. 39(1), pages 111-137, August.
    16. Becker, Rolf, 2000. "Studierbereitschaft und Wahl von ingenieurwissenschaftlichen Studienfächern: Eine empirische Untersuchung sächsischer Abiturienten der Abschlussjahrgänge 1996, 1998 und 2000," Discussion Papers, Research Unit: Labor Market Policy and Employment FS I 00-210, WZB Berlin Social Science Center.
    17. Arthur Lewbel, 2007. "Estimation of Average Treatment Effects with Misclassification," Econometrica, Econometric Society, vol. 75(2), pages 537-551, March.
    18. R. Antonietti & D. Antonioli, 2007. "Conditional Leptokurtosis in Energy Prices: Multivariate Evidence from Futures Markets," Working Papers 594, Dipartimento Scienze Economiche, Universita' di Bologna.
    19. Zamarro, Gema, 2010. "Accounting for heterogeneous returns in sequential schooling decisions," Journal of Econometrics, Elsevier, vol. 156(2), pages 260-276, June.
    20. repec:wyi:journl:002082 is not listed on IDEAS
    21. Christian Belzil & Jörgen Hansen, 2012. "Characterizing the Instrumental Variable Identifying Assumption as Sample Selection Conditions," Working Papers hal-00753539, HAL.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:diw:diwwpp:dp245. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Bibliothek (email available below). General contact details of provider: https://edirc.repec.org/data/diwbede.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.