IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v19y1995i4p347-373.html
   My bibliography  Save this article

Quasi-Experimental Estimates of the Effects of a Preschool Intervention

Author

Listed:
  • Arthur J. Reynolds

    (University of Wisconsin-Madison)

  • Judy A. Temple

    (Northern Illinois University)

Abstract

Estimates of program effects from a compensatory preschool intervention were investigated using several contemporary techniques of bias reduction. These included econometric simulta neous modeling, latent-variable structural modeling, and ordinary least squares regression. These techniques were applied to longitudinal data from Chicago's Child Parent Center preschool program, a Head Start-type intervention. Analyses of 806 Black children followed from kindergarten to Grade 6 indicated that the techniques, by and large, produced similar estimates of program impact on school achievement test scores. Effect sizes ranged from .43 to .67 at school entry to .24 to .30 at Grade 6 (7 years postprogram). These findings were robust across different model specifications and similar to those of randomized studies. The only differences among methods occurred at Grade 3. Findings suggest that different quasi-experi mental estimation methods that attempt to control for selection bias can generate similar estimates of the effects of an educational treatment.

Suggested Citation

  • Arthur J. Reynolds & Judy A. Temple, 1995. "Quasi-Experimental Estimates of the Effects of a Preschool Intervention," Evaluation Review, , vol. 19(4), pages 347-373, August.
    • Handle: RePEc:sae:evarev:v:19:y:1995:i:4:p:347-373
    DOI: 10.1177/0193841X9501900401
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X9501900401
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X9501900401?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. James J. Heckman & V. Joseph Hotz & Marcelo Dabos, 1987. "Do We Need Experimental Data To Evaluate the Impact of Manpower Training On Earnings?," Evaluation Review, , vol. 11(4), pages 395-427, August.
    2. Heckman, J.J. & Hotz, V.J., 1988. "Choosing Among Alternative Nonexperimental Methods For Estimating The Impact Of Social Programs: The Case Of Manpower Training," University of Chicago - Economics Research Center 88-12, Chicago - Economics Research Center.
    3. Lee, Lung-Fei, 1983. "Generalized Econometric Models with Selectivity," Econometrica, Econometric Society, vol. 51(2), pages 507-512, March.
    4. Manski, Charles F., 1975. "Maximum score estimation of the stochastic utility model of choice," Journal of Econometrics, Elsevier, vol. 3(3), pages 205-228, August.
    5. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    6. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    7. W. Steven Barnett, 1992. "Benefits of Compensatory Preschool Education," Journal of Human Resources, University of Wisconsin Press, vol. 27(2), pages 279-312.
    8. Burt S. Barnow, 1987. "The Impact of CETA Programs on Earnings: A Review of the Literature," Journal of Human Resources, University of Wisconsin Press, vol. 22(2), pages 157-193.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Steven Glazerman & Dan M. Levy & David Myers, 2003. "Nonexperimental Versus Experimental Estimates of Earnings Impacts," The ANNALS of the American Academy of Political and Social Science, , vol. 589(1), pages 63-93, September.
    2. Mersky, Joshua P. & Topitzes, James D. & Reynolds, Arthur J., 2011. "Maltreatment prevention through early childhood intervention: A confirmatory evaluation of the Chicago Child-Parent Center preschool program," Children and Youth Services Review, Elsevier, vol. 33(8), pages 1454-1463, August.
    3. A. J. Reynolds, "undated". "The Chicago Child-Parent Centers: A Longitudinal Study of Extended Early Childhood Intervention," Institute for Research on Poverty Discussion Papers 1126-97, University of Wisconsin Institute for Research on Poverty.
    4. Reynolds, Arthur J. & Ou, Suh-Ruu, 2010. "Early childhood to young adulthood: An introduction to the special issue," Children and Youth Services Review, Elsevier, vol. 32(8), pages 1045-1053, August.
    5. William T. Gormley Jr., 2007. "Early childhood care and education: Lessons and puzzles," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 26(3), pages 633-671.
    6. Humphreys, Keith & Phibbs, Ciaran S. & Moos, Rudolf H., 1996. "Addressing self-selection effects in evaluations of mutual help groups and professional mental health services: An introduction to two-stage sample selection models," Evaluation and Program Planning, Elsevier, vol. 19(4), pages 301-308, November.
    7. Hess, Brian, 2000. "Assessing program impact using latent growth modeling: a primer for the evaluator," Evaluation and Program Planning, Elsevier, vol. 23(4), pages 419-428, November.
    8. Reynolds, Arthur J., 1998. "Developing early childhood programs for children and families at risk: Research-based principles to promote long-term effectiveness," Children and Youth Services Review, Elsevier, vol. 20(6), pages 503-523, July.
    9. Christina F. Mondi & Arthur J. Reynolds & Brandt A. Richardson, 2020. "Early Childhood Education and Adult Depression: An Attrition Reanalysis With Inverse Propensity Score Weighting," Evaluation Review, , vol. 44(5-6), pages 379-409, October.
    10. J. A. Temple & A. J. Reynolds & W. T. Miedel, "undated". "Can Early Intervention Prevent High School Dropout? Evidence from the Chicago Child-Parent Centers," Institute for Research on Poverty Discussion Papers 1180-98, University of Wisconsin Institute for Research on Poverty.
    11. A. J. Reynolds & J. A. Temple, "undated". "Extended early childhood intervention and school achievement: Age 13 findings from the Chicago longitudinal study," Institute for Research on Poverty Discussion Papers 1095-96, University of Wisconsin Institute for Research on Poverty.
    12. Reynolds, Arthur J. & Temple, Judy A. & Ou, Suh-Ruu, 2010. "Preschool education, educational attainment, and crime prevention: Contributions of cognitive and non-cognitive skills," Children and Youth Services Review, Elsevier, vol. 32(8), pages 1054-1063, August.
    13. R. Riportella-Muller, "undated". "Consumer Perspectives on Medicaid Managed Care: Comparing Rural and Urban Enrollees," Institute for Research on Poverty Discussion Papers 1178-98, University of Wisconsin Institute for Research on Poverty.
    14. Reynolds, Arthur J. & Ou, Suh-Ruu, 2004. "Alterable predictors of child well-being in the Chicago longitudinal study," Children and Youth Services Review, Elsevier, vol. 26(1), pages 1-14, January.
    15. Reynolds, Arthur J., 2004. "Research on early childhood interventions in the confirmatory mode," Children and Youth Services Review, Elsevier, vol. 26(1), pages 15-38, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    2. Jeffrey Smith, 2000. "A Critical Survey of Empirical Methods for Evaluating Active Labor Market Policies," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 136(III), pages 247-268, September.
    3. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    4. Regner, Hakan, 2002. "A nonexperimental evaluation of training programs for the unemployed in Sweden," Labour Economics, Elsevier, vol. 9(2), pages 187-206, April.
    5. Metcalf, Charles E., 1997. "The Advantages of Experimental Designs for Evaluating Sex Education Programs," Children and Youth Services Review, Elsevier, vol. 19(7), pages 507-523, November.
    6. David H. Dean & Robert C. Dolan & Robert M. Schmidt, 1999. "Evaluating the Vocational Rehabilitation Program Using Longitudinal Data," Evaluation Review, , vol. 23(2), pages 162-189, April.
    7. Arriagada, Ana-Maria, 1989. "The effect of job training on Peruvian women's employment and wages," Policy Research Working Paper Series 241, The World Bank.
    8. Astrid Grasdal, 2001. "The performance of sample selection estimators to control for attrition bias," Health Economics, John Wiley & Sons, Ltd., vol. 10(5), pages 385-398, July.
    9. O'Higgins, Niall, 2001. "Youth unemployment and employment policy: a global perspective," MPRA Paper 23698, University Library of Munich, Germany.
    10. Robert J. LaLonde, 2003. "Employment and Training Programs," NBER Chapters, in: Means-Tested Transfer Programs in the United States, pages 517-586, National Bureau of Economic Research, Inc.
    11. Eric Rasmusen, 1995. "Observed Choice, Estimation, and Optimism About Policy Changes," Econometrics 9506004, University Library of Munich, Germany, revised 16 Jun 1995.
    12. Denis Conniffe & Vanessa Gash & Philip J. O'Connell, 2000. "Evaluating State Programmes - “Natural Experiments” and Propensity Scores," The Economic and Social Review, Economic and Social Studies, vol. 31(4), pages 283-308.
    13. Mona Said, 2003. "The Distribution of Gender and Public Sector Pay Premia: Evidence from the Egyptian Organised Sector," Working Papers 132, Department of Economics, SOAS University of London, UK.
    14. James Heckman & Salvador Navarro-Lozano, 2004. "Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 30-57, February.
    15. Brian Bell & Richard Blundell & John Reenen, 1999. "Getting the Unemployed Back to Work: The Role of Targeted Wage Subsidies," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 6(3), pages 339-360, August.
    16. Robert Moffitt, 1991. "Program Evaluation With Nonexperimental Data," Evaluation Review, , vol. 15(3), pages 291-314, June.
    17. Breen, Richard, 1991. "Education, Employment And Training In The Youth Labour Market," Research Series, Economic and Social Research Institute (ESRI), number GRS152.
    18. Peter Z. Schochet & John Burghardt & Sheena McConnell, 2006. "National Job Corps Study and Longer-Term Follow-Up Study: Impact and Benefit-Cost Findings Using Survey and Summary Earnings Records Data," Mathematica Policy Research Reports 8074f4e4499d4e2ab1de13747, Mathematica Policy Research.
    19. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    20. Fabian Bornhorst, 2009. "How Good Are Ex Ante Program Evaluation Techniques? The Case of School Enrollment in PROGRESA," IMF Working Papers 2009/187, International Monetary Fund.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:19:y:1995:i:4:p:347-373. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.