Using Propensity Scoring to Estimate Program-Related Subgroup Impacts in Experimental Program Evaluations
Author
Abstract
Suggested Citation
DOI: 10.1177/0193841X06288736
Download full text from publisher
References listed on IDEAS
- Joseph L. Gastwirth & Abba M. Krieger & Paul R. Rosenbaum, 2000. "Asymptotic separability in sensitivity analysis," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(3), pages 545-555.
- repec:mpr:mprres:2956 is not listed on IDEAS
- repec:mpr:mprres:2950 is not listed on IDEAS
- repec:mpr:mprres:1966 is not listed on IDEAS
- James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998.
"Characterizing Selection Bias Using Experimental Data,"
Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
- James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," NBER Working Papers 6699, National Bureau of Economic Research, Inc.
- repec:mpr:mprres:1968 is not listed on IDEAS
- Roberto Agodini & Mark Dynarski, "undated". "Are Experiments the Only Option? A Look at Dropout Prevention Programs," Mathematica Policy Research Reports 51241adbf9fa4a26add6d54c5, Mathematica Policy Research.
- repec:mpr:mprres:2949 is not listed on IDEAS
- repec:mpr:mprres:3604 is not listed on IDEAS
- LaLonde, Robert J, 1986.
"Evaluating the Econometric Evaluations of Training Programs with Experimental Data,"
American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
- Robert J. LaLonde, 1984. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," Working Papers 563, Princeton University, Department of Economics, Industrial Relations Section..
- James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
- John Burghardt & Peter Z. Schochet, 2001. "National Job Corps Study: Impacts by Center Characteristics," Mathematica Policy Research Reports 79dc6705a88648e3881115389, Mathematica Policy Research.
- Sheena McConnell & Steven Glazerman, 2001. "National Job Corps Study: The Benefits and Costs of Job Corps," Mathematica Policy Research Reports 19ff8678a108410587c5dfad0, Mathematica Policy Research.
- Roberto Agodini & Mark Dynarski, 2004. "Are Experiments the Only Option? A Look at Dropout Prevention Programs," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 180-194, February.
- Peter Z. Schochet, 2001. "National Job Corps Study: Methodological Appendixes on the Impact Analysis," Mathematica Policy Research Reports c3abb7b819cd4bc5a09a865d6, Mathematica Policy Research.
- repec:mpr:mprres:2955 is not listed on IDEAS
- Peter Z. Schochet & John Burghardt & Steven Glazerman, 2001. "National Job Corps Study: The Impacts of Job Corps on Participants' Employment and Related Outcomes," Mathematica Policy Research Reports db6c4204b8e1408bb0c6289ec, Mathematica Policy Research.
- Terry Johnson & Mark Gritz & Russell Jackson & John Burghardt & Carol Boussy & Jan Leonard & Carlyn Orians, 1999. "National Job Corps Study: Report on the Process Analysis," Mathematica Policy Research Reports efc0cd05f0524a049779f797f, Mathematica Policy Research.
- James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
- repec:mpr:mprres:2951 is not listed on IDEAS
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Charles Meth, 2011. "Employer of Last Resort? South Africa’s Expanded Public Works Programme (EPWP)," SALDRU Working Papers 58, Southern Africa Labour and Development Research Unit, University of Cape Town.
- Quinn Moore & Sheena McConnell & Alan Werner & Tim Kautz & Kristen Joyce & Kelley Borradaile & Bethany Boland, "undated". "Evaluation of Employment Coaching for TANF and Related Populations: Evaluation Design Report," Mathematica Policy Research Reports 3f5e6ca2b92549d1823c3bbe8, Mathematica Policy Research.
- Green, Beth L. & Sanders, Mary Beth & Tarte, Jerod, 2017. "Using administrative data to evaluate the effectiveness of the Healthy Families Oregon home visiting program: 2-year impacts on child maltreatment & service utilization," Children and Youth Services Review, Elsevier, vol. 75(C), pages 77-86.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Ferraro, Paul J. & Miranda, Juan José, 2014. "The performance of non-experimental designs in the evaluation of environmental programs: A design-replication study using a large-scale randomized experiment as a benchmark," Journal of Economic Behavior & Organization, Elsevier, vol. 107(PA), pages 344-365.
- Fatih Unlu & Douglas Lee Lauen & Sarah Crittenden Fuller & Tiffany Berglund & Elc Estrera, 2021. "Can Quasi‐Experimental Evaluations That Rely On State Longitudinal Data Systems Replicate Experimental Results?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(2), pages 572-613, March.
- Ravallion, Martin, 2008.
"Evaluating Anti-Poverty Programs,"
Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 59, pages 3787-3846,
Elsevier.
- Ravallion, Martin, 2005. "Evaluating anti-poverty programs," Policy Research Working Paper Series 3625, The World Bank.
- Justine Burns & Malcolm Kewsell & Rebecca Thornton, 2009. "Evaluating the Impact of Health Programmes," SALDRU Working Papers 40, Southern Africa Labour and Development Research Unit, University of Cape Town.
- Kristen Harknett, 2006. "Does Receiving an Earnings Supplement Affect Union Formation? Estimating Effects for Program Participants Using Propensity Score Matching," Evaluation Review, , vol. 30(6), pages 741-778, December.
- Sudhanshu Handa & John A. Maluccio, 2010.
"Matching the Gold Standard: Comparing Experimental and Nonexperimental Evaluation Techniques for a Geographically Targeted Program,"
Economic Development and Cultural Change, University of Chicago Press, vol. 58(3), pages 415-447, April.
- Sudhanshu Handa & John Maluccio, 2008. "Matching the gold standard: Comparing experimental and non-experimental evaluation techniques for a geographically targeted program," Middlebury College Working Paper Series 0813, Middlebury College, Department of Economics.
- Vivian C. Wong & Peter M. Steiner & Kylie L. Anglin, 2018. "What Can Be Learned From Empirical Evaluations of Nonexperimental Methods?," Evaluation Review, , vol. 42(2), pages 147-175, April.
- Andrew P. Jaciw, 2016. "Assessing the Accuracy of Generalized Inferences From Comparison Group Studies Using a Within-Study Comparison Approach," Evaluation Review, , vol. 40(3), pages 199-240, June.
- Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2006.
"Moving the Goalposts: Addressing Limited Overlap in the Estimation of Average Treatment Effects by Changing the Estimand,"
NBER Technical Working Papers
0330, National Bureau of Economic Research, Inc.
- Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2006. "Moving the Goalposts: Addressing Limited Overlap in Estimation of Average Treatment Effects by Changing the Estimand," Working Papers 0608, University of Miami, Department of Economics.
- Crump, Richard K. & Hotz, V. Joseph & Imbens, Guido W. & Mitnik, Oscar A., 2006. "Moving the Goalposts: Addressing Limited Overlap in Estimation of Average Treatment Effects by Changing the Estimand," IZA Discussion Papers 2347, Institute of Labor Economics (IZA).
- A. Smith, Jeffrey & E. Todd, Petra, 2005.
"Does matching overcome LaLonde's critique of nonexperimental estimators?,"
Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
- Jeffrey Smith & Petra Todd, 2003. "Does Matching Overcome Lalonde's Critique of Nonexperimental Estimators?," University of Western Ontario, Centre for Human Capital and Productivity (CHCP) Working Papers 20035, University of Western Ontario, Centre for Human Capital and Productivity (CHCP).
- Dettmann, Eva & Becker, Claudia & Schmeißer, Christian, 2010. "Is there a Superior Distance Function for Matching in Small Samples?," IWH Discussion Papers 3/2010, Halle Institute for Economic Research (IWH).
- Díaz, Juan José & Jaramillo, Miguel, 2006.
"An Evaluation of the Peruvian "Youth Labor Training Program" - PROJOVEN,"
IDB Publications (Working Papers)
3000, Inter-American Development Bank.
- Juan Díaz & Miguel Jaramillo, 2006. "An Evaluation of the Peruvian "Youth Labor Training Program"-PROJOVEN," OVE Working Papers 1006, Inter-American Development Bank, Office of Evaluation and Oversight (OVE).
- James Heckman & Salvador Navarro-Lozano, 2004.
"Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models,"
The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 30-57, February.
- Heckman, James J. & Navarro, Salvador, 2003. "Using Matching, Instrumental Variables and Control Functions to Estimate Economic Choice Models," IZA Discussion Papers 768, Institute of Labor Economics (IZA).
- Heckman, James & Navarro-Lozano, Salvador, 2003. "Using matching, instrumental variables and control functions to estimate economic choice models," Working Paper Series 2003:4, IFAU - Institute for Evaluation of Labour Market and Education Policy.
- James J. Heckman & Salvador Navarro-Lozano, 2003. "Using Matching, Instrumental Variables and Control Functions to Estimate Economic Choice Models," NBER Working Papers 9497, National Bureau of Economic Research, Inc.
- Chambers, Jeff M. & Lint, Sandy & Thompson, Maggie G. & Carlson, Matthew W. & Graef, Michelle I., 2019. "Outcomes of the Iowa Parent Partner program evaluation: Stability of reunification and re-entry into foster care," Children and Youth Services Review, Elsevier, vol. 104(C), pages 1-1.
- Duncan Chaplin & Arif Mamun & Ali Protik & John Schurrer & Divya Vohra & Kristine Bos & Hannah Burak & Laura Meyer & Anca Dumitrescu & Christopher Ksoll & Thomas Cook, "undated". "Grid Electricity Expansion in Tanzania by MCC: Findings from a Rigorous Impact Evaluation, Final Report," Mathematica Policy Research Reports 144768f69008442e96369195e, Mathematica Policy Research.
- Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008.
"Using Randomization in Development Economics Research: A Toolkit,"
Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962,
Elsevier.
- Esther Duflo & Rachel Glennerster & Michael Kremer, 2006. "Using Randomization in Development Economics Research: A Toolkit," NBER Technical Working Papers 0333, National Bureau of Economic Research, Inc.
- Kremer, Michael & Glennerster, Rachel & Duflo, Esther, 2007. "Using Randomization in Development Economics Research: A Toolkit," CEPR Discussion Papers 6059, C.E.P.R. Discussion Papers.
- Esther Duflo & Rachel Glennerster & Michael Kremer, 2006. "Using Randomization in Development Economics Research: A Toolkit," CID Working Papers 138, Center for International Development at Harvard University.
- Guido W. Imbens & Jeffrey M. Wooldridge, 2009.
"Recent Developments in the Econometrics of Program Evaluation,"
Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
- Guido Imbens & Jeffrey M. Wooldridge, 2008. "Recent developments in the econometrics of program evaluation," CeMMAP working papers CWP24/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Wooldridge, Jeffrey M. & Imbens, Guido, 2009. "Recent Developments in the Econometrics of Program Evaluation," Scholarly Articles 3043416, Harvard University Department of Economics.
- Imbens, Guido W. & Wooldridge, Jeffrey M., 2008. "Recent Developments in the Econometrics of Program Evaluation," IZA Discussion Papers 3640, Institute of Labor Economics (IZA).
- Guido M. Imbens & Jeffrey M. Wooldridge, 2008. "Recent Developments in the Econometrics of Program Evaluation," NBER Working Papers 14251, National Bureau of Economic Research, Inc.
- Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007.
"Using State Administrative Data to Measure Program Performance,"
The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
- Peter R. Mueser & Kenneth Troske & Alexey Gorislavsky, 2003. "Using State Administrative Data to Measure Program Performance," Working Papers 0309, Department of Economics, University of Missouri.
- Mueser, Peter R. & Troske, Kenneth & Gorislavsky, Alexey, 2003. "Using State Administrative Data to Measure Program Performance," IZA Discussion Papers 786, Institute of Labor Economics (IZA).
- Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," Working Papers 0702, Department of Economics, University of Missouri.
- James J. Heckman & Jeffrey A. Smith, 1999. "The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," NBER Working Papers 6983, National Bureau of Economic Research, Inc.
- Donald, Stephen G. & Hsu, Yu-Chin, 2014.
"Estimation and inference for distribution functions and quantile functions in treatment effect models,"
Journal of Econometrics, Elsevier, vol. 178(P3), pages 383-397.
- Stephen G. Donald & Yu-Chin Hsu, 2012. "Estimation and Inference for Distribution Functions and Quantile Functions in Treatment Effect Models," IEAS Working Paper : academic research 12-A016, Institute of Economics, Academia Sinica, Taipei, Taiwan.
More about this item
Keywords
propensity scoring; experimental evaluations; specification tests; program impacts;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:31:y:2007:i:2:p:95-120. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.