IDEAS home Printed from https://ideas.repec.org/a/sbe/breart/v30y2010i2a3688.html
   My bibliography  Save this article

The Assumptions Underlying Evaluation Estimators

Author

Listed:
  • Heckman, James J.

Abstract

This paper reviews the basic principles underlying the identication of econometric evaluation estimators and their recent extensions. It considers the choice of the estimator in terms of the decision model used by agents and the information they have available. Building on Barros's pioneering work [Barros (1987), reprinted here] I apply the analysisto the method of matching.

Suggested Citation

  • Heckman, James J., 2010. "The Assumptions Underlying Evaluation Estimators," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 30(2), December.
    • Handle: RePEc:sbe:breart:v:30:y:2010:i:2:a:3688
    as

    Download full text from publisher

    File URL: https://periodicos.fgv.br/bre/article/view/3688
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Stephen V. Cameron & James J. Heckman, 1998. "Life Cycle Schooling and Dynamic Selection Bias: Models and Evidence for Five Cohorts of American Males," Journal of Political Economy, University of Chicago Press, vol. 106(2), pages 262-333, April.
    2. Richard Blundell & Alan Duncan & Costas Meghir, 1998. "Estimating Labor Supply Responses Using Tax Reforms," Econometrica, Econometric Society, vol. 66(4), pages 827-862, July.
    3. Hansen, Karsten T. & Heckman, James J. & Mullen, K.J.Kathleen J., 2004. "The effect of schooling and ability on achievement test scores," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 39-98.
    4. James J. Heckman, 2010. "Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 356-398, June.
    5. Guido W. Imbens & Whitney K. Newey, 2009. "Identification and Estimation of Triangular Simultaneous Equations Models Without Additivity," Econometrica, Econometric Society, vol. 77(5), pages 1481-1512, September.
    6. Guildo W. Imbens, 2003. "Sensitivity to Exogeneity Assumptions in Program Evaluation," American Economic Review, American Economic Association, vol. 93(2), pages 126-132, May.
    7. Angrist, Joshua D. & Krueger, Alan B., 1999. "Empirical strategies in labor economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 23, pages 1277-1366, Elsevier.
    8. Pedro Carneiro & Karsten T. Hansen & James J. Heckman, 2003. "Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College," NBER Working Papers 9546, National Bureau of Economic Research, Inc.
    9. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, May.
    10. Flavio Cunha & James Heckman & Salvador Navarro, 2005. "Separating uncertainty from heterogeneity in life cycle earnings," Oxford Economic Papers, Oxford University Press, vol. 57(2), pages 191-261, April.
    11. Richard W. Blundell & James L. Powell, 2004. "Endogeneity in Semiparametric Binary Response Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 71(3), pages 655-679.
    12. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521818728, October.
    13. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 487-535.
    14. Olsen, Randall J, 1980. "A Least Squares Correction for Selectivity Bias," Econometrica, Econometric Society, vol. 48(7), pages 1815-1820, November.
    15. Carneiro, Pedro & Hansen, Karsten T. & Heckman, James J., 2003. "Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College Choice," IZA Discussion Papers 767, Institute of Labor Economics (IZA).
    16. James J. Heckman, 2008. "Econometric Causality," International Statistical Review, International Statistical Institute, vol. 76(1), pages 1-27, April.
    17. Cunha, Flavio & Heckman, James J., 2007. "Identifying and Estimating the Distributions of Ex Post and Ex Ante Returns to Schooling," Labour Economics, Elsevier, vol. 14(6), pages 870-893, December.
    18. Michael Gerfin & Michael Lechner, 2002. "A Microeconometric Evaluation of the Active Labour Market Policy in Switzerland," Economic Journal, Royal Economic Society, vol. 112(482), pages 854-893, October.
    19. Joseph G. Altonji & Rosa L. Matzkin, 2005. "Cross Section and Panel Data Estimators for Nonseparable Models with Endogenous Regressors," Econometrica, Econometric Society, vol. 73(4), pages 1053-1102, July.
    20. Aakvik, A. & Heckman, J.J. & Vytlacil, E.J., 1999. "Training Effects on Employment when the Training Effects are Heterogenous : an Application to Norwegian Vocational Rehabilitation Programs," Norway; Department of Economics, University of Bergen 0599, Department of Economics, University of Bergen.
    21. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    22. Mathias Dewatripont & Lars Peter Hansen & Stephen Turnovsky, 2003. "Advances in Economics and Econometrics: Theory and Applications, Eighth World Congress," ULB Institutional Repository 2013/176003, ULB -- Universite Libre de Bruxelles.
    23. Yingyao Hu & Susanne M. Schennach, 2008. "Instrumental Variable Treatment of Nonclassical Measurement Error Models," Econometrica, Econometric Society, vol. 76(1), pages 195-216, January.
    24. Pedro Carneiro & Karsten T. Hansen & James J. Heckman, 2003. "2001 Lawrence R. Klein Lecture Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College Choice," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 44(2), pages 361-422, May.
    25. Hsiao,Cheng & Morimune,Kimio & Powell,James L. (ed.), 2001. "Nonlinear Statistical Modeling," Cambridge Books, Cambridge University Press, number 9780521662468, October.
    26. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    27. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521524131, October.
    28. Susan Athey & Guido W. Imbens, 2006. "Identification and Inference in Nonlinear Difference-in-Differences Models," Econometrica, Econometric Society, vol. 74(2), pages 431-497, March.
    29. Rosa L. Matzkin, 2003. "Nonparametric Estimation of Nonadditive Random Functions," Econometrica, Econometric Society, vol. 71(5), pages 1339-1375, September.
    30. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    31. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    32. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    33. Jinyong Hahn, 1998. "On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects," Econometrica, Econometric Society, vol. 66(2), pages 315-332, March.
    34. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    35. Ichimura, Hidehiko & Todd, Petra E., 2007. "Implementing Nonparametric and Semiparametric Estimators," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 74, Elsevier.
    36. Olley, G Steven & Pakes, Ariel, 1996. "The Dynamics of Productivity in the Telecommunications Equipment Industry," Econometrica, Econometric Society, vol. 64(6), pages 1263-1297, November.
    37. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521818742, October.
    38. Chen, Songnian, 1999. "Distribution-free estimation of the random coefficient dummy endogenous variable model," Journal of Econometrics, Elsevier, vol. 91(1), pages 171-199, July.
    39. Heckman, J.J. & Hotz, V.J., 1988. "Choosing Among Alternative Nonexperimental Methods For Estimating The Impact Of Social Programs: The Case Of Manpower Training," University of Chicago - Economics Research Center 88-12, Chicago - Economics Research Center.
    40. James Heckman & Salvador Navarro-Lozano, 2004. "Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 30-57, February.
    41. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521524117, October.
    42. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    43. Abbring, Jaap H. & Heckman, James J., 2007. "Econometric Evaluation of Social Programs, Part III: Distributional Treatment Effects, Dynamic Treatment Effects, Dynamic Discrete Choice, and General Equilibrium Policy Evaluation," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 72, Elsevier.
    44. Ahn, Hyungtaik & Powell, James L., 1993. "Semiparametric estimation of censored selection models with a nonparametric selection mechanism," Journal of Econometrics, Elsevier, vol. 58(1-2), pages 3-29, July.
    45. Stephen V. Cameron & James J. Heckman, 1998. "Life Cycle Schooling and Dynamic Selection Bias: Models and Evidence for Five Cohorts," NBER Working Papers 6385, National Bureau of Economic Research, Inc.
    46. Dennis Aigner, 1985. "The Residential Electricity Time-of-Use Pricing Experiments: What Have We Learned?," NBER Chapters, in: Social Experimentation, pages 11-54, National Bureau of Economic Research, Inc.
    47. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    48. Joshua D. Angrist & Kathryn Graddy & Guido W. Imbens, 2000. "The Interpretation of Instrumental Variables Estimators in Simultaneous Equations Models with an Application to the Demand for Fish," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 67(3), pages 499-527.
    49. Heckman, James J. & Robb, Richard Jr., 1985. "Alternative methods for evaluating the impact of interventions : An overview," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 239-267.
    50. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521818735, October.
    51. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521524124, October.
    52. Aakvik, Arild & Heckman, James J. & Vytlacil, Edward J., 2005. "Estimating treatment effects for discrete outcomes when responses to treatment vary: an application to Norwegian vocational rehabilitation programs," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 15-51.
    53. Abadie A., 2002. "Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 284-292, March.
    54. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    55. James Heckman, 1997. "Instrumental Variables: A Study of Implicit Behavioral Assumptions Used in Making Program Evaluations," Journal of Human Resources, University of Wisconsin Press, vol. 32(3), pages 441-462.
    56. Aigner, Dennis J. & Hsiao, Cheng & Kapteyn, Arie & Wansbeek, Tom, 1984. "Latent variable models in econometrics," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 23, pages 1321-1393, Elsevier.
    57. Bjorklund, Anders & Moffitt, Robert, 1987. "The Estimation of Wage Gains and Welfare Gains in Self-selection," The Review of Economics and Statistics, MIT Press, vol. 69(1), pages 42-49, February.
    58. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James J. Heckman, 2008. "The Principles Underlying Evaluation Estimators with an Application to Matching," Annals of Economics and Statistics, GENES, issue 91-92, pages 9-73.
    2. James J. Heckman & Rodrigo Pinto, 2022. "Causality and Econometrics," NBER Working Papers 29787, National Bureau of Economic Research, Inc.
    3. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    4. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    5. Heckman, James & Pinto, Rodrigo, 2024. "Econometric causality: The central role of thought experiments," Journal of Econometrics, Elsevier, vol. 243(1).
    6. James Heckman & Salvador Navarro-Lozano, 2004. "Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 30-57, February.
    7. Sebastian Galiani & Juan Pantano, 2021. "Structural Models: Inception and Frontier," NBER Working Papers 28698, National Bureau of Economic Research, Inc.
    8. Halbert White & Karim Chalak, 2013. "Identification and Identification Failure for Treatment Effects Using Structural Systems," Econometric Reviews, Taylor & Francis Journals, vol. 32(3), pages 273-317, November.
    9. Frolich, Markus, 2007. "Nonparametric IV estimation of local average treatment effects with covariates," Journal of Econometrics, Elsevier, vol. 139(1), pages 35-75, July.
    10. Heckman, James J. & Urzúa, Sergio, 2010. "Comparing IV with structural models: What simple IV can and cannot identify," Journal of Econometrics, Elsevier, vol. 156(1), pages 27-37, May.
    11. Richard Blundell & Lorraine Dearden & Barbara Sianesi, 2003. "Evaluating the impact of education on earnings in the UK: Models, methods and results from the NCDS," IFS Working Papers W03/20, Institute for Fiscal Studies.
    12. Heckman, James J. & Humphries, John Eric & Veramendi, Gregory, 2016. "Dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 191(2), pages 276-292.
    13. Heckman, James J. & Navarro, Salvador, 2007. "Dynamic discrete choice and dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 136(2), pages 341-396, February.
    14. Benjamin Williams, 2019. "Identification of a nonseparable model under endogeneity using binary proxies for unobserved heterogeneity," Quantitative Economics, Econometric Society, vol. 10(2), pages 527-563, May.
    15. Jones A.M & Rice N, 2009. "Econometric Evaluation of Health Policies," Health, Econometrics and Data Group (HEDG) Working Papers 09/09, HEDG, c/o Department of Economics, University of York.
    16. Gautier, Eric & Hoderlein, Stefan, 2011. "A triangular treatment effect model with random coefficients in the selection equation," TSE Working Papers 15-598, Toulouse School of Economics (TSE), revised 25 Aug 2015.
    17. James J. Heckman, 2005. "Micro Data, Heterogeneity and the Evaluation of Public Policy Part 2," The American Economist, Sage Publications, vol. 49(1), pages 16-44, March.
    18. Christian Dippel & Robert Gold & Stephan Heblich & Rodrigo Pinto, 2017. "Instrumental Variables and Causal Mechanisms: Unpacking the Effect of Trade on Workers and Voters," CESifo Working Paper Series 6816, CESifo.
    19. Martin Huber, 2012. "Identification of Average Treatment Effects in Social Experiments Under Alternative Forms of Attrition," Journal of Educational and Behavioral Statistics, , vol. 37(3), pages 443-474, June.
    20. Lewbel, Arthur, 2007. "Endogenous selection or treatment model estimation," Journal of Econometrics, Elsevier, vol. 141(2), pages 777-806, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sbe:breart:v:30:y:2010:i:2:a:3688. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Núcleo de Computação da FGV EPGE (email available below). General contact details of provider: https://edirc.repec.org/data/sbeeeea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.