IDEAS home Printed from https://ideas.repec.org/a/sae/somere/v45y2016i1p3-40.html
   My bibliography  Save this article

Propensity Score–based Methods Versus MTE-based Methods in Causal Inference

Author

Listed:
  • Xiang Zhou
  • Yu Xie

Abstract

Since the seminal introduction of the propensity score (PS) by Rosenbaum and Rubin, PS-based methods have been widely used for drawing causal inferences in the behavioral and social sciences. However, the PS approach depends on the ignorability assumption: there are no unobserved confounders once observed covariates are taken into account. For situations where this assumption may be violated, Heckman and his associates have recently developed a novel approach based on marginal treatment effects (MTEs). In this article, we (1) explicate the consequences for PS-based methods when aspects of the ignorability assumption are violated, (2) compare PS-based methods and MTE-based methods by making a close examination of their identification assumptions and estimation performances, (3) apply these two approaches in estimating the economic return to college using data from the National Longitudinal Survey of Youth (NLSY) of 1979 and discuss their discrepancies in results. When there is a sorting gain but no systematic baseline difference between treated and untreated units given observed covariates, PS-based methods can identify the treatment effect of the treated (TT). The MTE approach performs best when there is a valid and strong instrumental variable (IV). In addition, this article introduces the “smoothing-difference PS-based method,†which enables us to uncover heterogeneity across people of different PSs in both counterfactual outcomes and treatment effects.

Suggested Citation

  • Xiang Zhou & Yu Xie, 2016. "Propensity Score–based Methods Versus MTE-based Methods in Causal Inference," Sociological Methods & Research, , vol. 45(1), pages 3-40, February.
  • Handle: RePEc:sae:somere:v:45:y:2016:i:1:p:3-40
    DOI: 10.1177/0049124114555199
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0049124114555199
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0049124114555199?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Willis, Robert J & Rosen, Sherwin, 1979. "Education and Self-Selection," Journal of Political Economy, University of Chicago Press, vol. 87(5), pages 7-36, October.
    2. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records," American Economic Review, American Economic Association, vol. 80(3), pages 313-336, June.
    3. Pedro Carneiro & James J. Heckman & Edward J. Vytlacil, 2011. "Estimating Marginal Returns to Education," American Economic Review, American Economic Association, vol. 101(6), pages 2754-2781, October.
    4. Shadish, William R. & Clark, M. H. & Steiner, Peter M., 2008. "Can Nonrandomized Experiments Yield Accurate Answers? A Randomized Experiment Comparing Random and Nonrandom Assignments," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1334-1344.
    5. DiPrete, Thomas A. & Gangl, Markus, 2004. "Assessing bias in the estimation of causal effects: Rosenbaum bounds on matching estimators and instrumental variables estimation with imperfect instruments," Discussion Papers, Research Unit: Labor Market Policy and Employment SP I 2004-101, WZB Berlin Social Science Center.
    6. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    7. Kane, Thomas J & Rouse, Cecilia Elena, 1995. "Labor-Market Returns to Two- and Four-Year College," American Economic Review, American Economic Association, vol. 85(3), pages 600-614, June.
    8. Patrick Puhani, 2000. "The Heckman Correction for Sample Selection and Its Critique," Journal of Economic Surveys, Wiley Blackwell, vol. 14(1), pages 53-68, February.
    9. repec:adr:anecst:y:2008:i:91-92:p:12 is not listed on IDEAS
    10. Asim Ansari & Kamel Jedidi, 2000. "Bayesian factor analysis for multilevel binary observations," Psychometrika, Springer;The Psychometric Society, vol. 65(4), pages 475-496, December.
    11. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    12. Stephen V. Cameron & Christopher Taber, 2004. "Estimation of Educational Borrowing Constraints Using Returns to Schooling," Journal of Political Economy, University of Chicago Press, vol. 112(1), pages 132-182, February.
    13. Angrist, Joshua D. & Krueger, Alan B., 1999. "Empirical strategies in labor economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 23, pages 1277-1366, Elsevier.
    14. Janet Currie & Enrico Moretti, 2003. "Mother's Education and the Intergenerational Transmission of Human Capital: Evidence from College Openings," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(4), pages 1495-1532.
    15. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    16. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records: Errata," American Economic Review, American Economic Association, vol. 80(5), pages 1284-1286, December.
    17. Richard Blundell & Lorraine Dearden & Barbara Sianesi, 2005. "Evaluating the effect of education on earnings: models, methods and results from the National Child Development Survey," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(3), pages 473-512, July.
    18. Heckman, James J. & Robb, Richard Jr., 1985. "Alternative methods for evaluating the impact of interventions : An overview," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 239-267.
    19. Robert Moffitt, 2008. "Estimating Marginal Treatment Effects in Heterogeneous Populations," Annals of Economics and Statistics, GENES, issue 91-92, pages 239-261.
    20. Griliches, Zvi, 1977. "Estimating the Returns to Schooling: Some Econometric Problems," Econometrica, Econometric Society, vol. 45(1), pages 1-22, January.
    21. Bjorklund, Anders & Moffitt, Robert, 1987. "The Estimation of Wage Gains and Welfare Gains in Self-selection," The Review of Economics and Statistics, MIT Press, vol. 69(1), pages 42-49, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pedro Carneiro & James J. Heckman & Edward J. Vytlacil, 2011. "Estimating Marginal Returns to Education," American Economic Review, American Economic Association, vol. 101(6), pages 2754-2781, October.
    2. Pedro Carneiro & Michael Lokshin & Nithin Umapathi, 2017. "Average and Marginal Returns to Upper Secondary Schooling in Indonesia," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(1), pages 16-36, January.
    3. P. Lovaglio & S. Verzillo, 2016. "Heterogeneous economic returns to higher education: evidence from Italy," Quality & Quantity: International Journal of Methodology, Springer, vol. 50(2), pages 791-822, March.
    4. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    5. Cornelissen, Thomas & Dustmann, Christian & Raute, Anna & Schönberg, Uta, 2016. "From LATE to MTE: Alternative methods for the evaluation of policy interventions," Labour Economics, Elsevier, vol. 41(C), pages 47-60.
    6. James J. Heckman, 2008. "The Principles Underlying Evaluation Estimators with an Application to Matching," Annals of Economics and Statistics, GENES, issue 91-92, pages 9-73.
    7. Idrisov, Georgiy (Идрисов, Георгий) & Taganov, B.V. (Таганов, Б.), 2016. "Research of the Effect of Growth of Openness of the Russian Economy on Income Inequality in Russia [Исследование Влияния Роста Открытости Российской Экономики На Неравенство Доходов Населения В Рос," Working Papers 3136, Russian Presidential Academy of National Economy and Public Administration.
    8. Rojas, Eugenio & Sánchez, Rafael & Villena, Mauricio G., 2016. "Credit constraints in higher education in a context of unobserved heterogeneity," Economics of Education Review, Elsevier, vol. 52(C), pages 225-250.
    9. Carneiro, Pedro & Lee, Sokbae, 2009. "Estimating distributions of potential outcomes using local instrumental variables with an application to changes in college enrollment and wage inequality," Journal of Econometrics, Elsevier, vol. 149(2), pages 191-208, April.
    10. Kédagni, Désiré, 2023. "Identifying treatment effects in the presence of confounded types," Journal of Econometrics, Elsevier, vol. 234(2), pages 479-511.
    11. Dr Mohammad Rafiqul Islam & Dr Nicholas Sim, 2021. "Education and Food Consumption Patterns: Quasi-Experimental Evidence from Indonesia," Papers 2109.08124, arXiv.org.
    12. Heckman, James J. & Lochner, Lance J. & Todd, Petra E., 2006. "Earnings Functions, Rates of Return and Treatment Effects: The Mincer Equation and Beyond," Handbook of the Economics of Education, in: Erik Hanushek & F. Welch (ed.), Handbook of the Economics of Education, edition 1, volume 1, chapter 7, pages 307-458, Elsevier.
    13. Tobias Klein, 2013. "College education and wages in the U.K.: estimating conditional average structural functions in nonadditive models with binary endogenous variables," Empirical Economics, Springer, vol. 44(1), pages 135-161, February.
    14. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    15. Karim Chalak & Halbert White, 2011. "Viewpoint: An extended class of instrumental variables for the estimation of causal effects," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 44(1), pages 1-51, February.
    16. Matthias Westphal & Daniel A Kamhöfer & Hendrik Schmitz, 2022. "Marginal College Wage Premiums Under Selection Into Employment," The Economic Journal, Royal Economic Society, vol. 132(646), pages 2231-2272.
    17. Imbens, Guido W., 2014. "Instrumental Variables: An Econometrician's Perspective," IZA Discussion Papers 8048, Institute of Labor Economics (IZA).
    18. Giuseppe Migali & Ian Walker, 2018. "Estimates of the Causal Effects of Education on Earnings over the Life Cycle with Cohort Effects and Endogenous Education," CESifo Economic Studies, CESifo Group, vol. 64(3), pages 516-544.
    19. Black, Dan A. & Joo, Joonhwi & LaLonde, Robert & Smith, Jeffrey A. & Taylor, Evan J., 2022. "Simple Tests for Selection: Learning More from Instrumental Variables," Labour Economics, Elsevier, vol. 79(C).
    20. John Engberg & Dennis Epple & Jason Imbrogno & Holger Sieg & Ron Zimmer, 2014. "Evaluating Education Programs That Have Lotteried Admission and Selective Attrition," Journal of Labor Economics, University of Chicago Press, vol. 32(1), pages 27-63.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:somere:v:45:y:2016:i:1:p:3-40. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.