IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v25y2001i1p3-28.html
   My bibliography  Save this article

Statistical Power for Nonequivalent Pretest-Posttest Designs

Author

Listed:
  • J. Michael Oakes

    (New England Research Institutes)

  • Henry A. Feldman

    (New England Research Institutes)

Abstract

Nonequivalent controlled pretest-posttest designs are central to evaluation science, yet no practical and unified approach for estimating power in the two most widely used analytic approaches to these designs exists. This article fills the gap by presenting and comparing useful, unified power formulas for ANCOVA and change-score analyses, indicating the implications of each on sample-size requirements. The authors close with practical recommendations for evaluators. Mathematical details and a simple spreadsheet approach are included in appendices.

Suggested Citation

  • J. Michael Oakes & Henry A. Feldman, 2001. "Statistical Power for Nonequivalent Pretest-Posttest Designs," Evaluation Review, , vol. 25(1), pages 3-28, February.
    • Handle: RePEc:sae:evarev:v:25:y:2001:i:1:p:3-28
    DOI: 10.1177/0193841X0102500101
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X0102500101
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X0102500101?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Heckman, J.J. & Hotz, V.J., 1988. "Choosing Among Alternative Nonexperimental Methods For Estimating The Impact Of Social Programs: The Case Of Manpower Training," University of Chicago - Economics Research Center 88-12, Chicago - Economics Research Center.
    2. Friedlander, Daniel & Robins, Philip K, 1995. "Evaluating Program Evaluations: New Evidence on Commonly Used Nonexperimental Methods," American Economic Review, American Economic Association, vol. 85(4), pages 923-937, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    2. de Crombrugghe, D.P.I. & Espinoza, H. & Heijke, J.A.M., 2010. "Job-training programmes with low completion rates: the case of Projoven-Peru," ROA Research Memorandum 004, Maastricht University, Research Centre for Education and the Labour Market (ROA).
    3. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    4. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    5. V. Joseph Hotz & Guido W. Imbens & Jacob A. Klerman, 2006. "Evaluating the Differential Effects of Alternative Welfare-to-Work Training Components: A Reanalysis of the California GAIN Program," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 521-566, July.
    6. Astrid Grasdal, 2001. "The performance of sample selection estimators to control for attrition bias," Health Economics, John Wiley & Sons, Ltd., vol. 10(5), pages 385-398, July.
    7. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    8. Hervé Cardot & Antonio Musolesi, 2019. "Modeling temporal treatment effects with zero inflated semi-parametric regression models: the case of local development policies in France," SEEDS Working Papers 0219, SEEDS, Sustainability Environmental Economics and Dynamics Studies, revised Jan 2019.
    9. Deborah A. Cobb‐Clark & Thomas Crossley, 2003. "Econometrics for Evaluations: An Introduction to Recent Developments," The Economic Record, The Economic Society of Australia, vol. 79(247), pages 491-511, December.
    10. Vivian C. Wong & Peter M. Steiner, 2018. "Designs of Empirical Evaluations of Nonexperimental Methods in Field Settings," Evaluation Review, , vol. 42(2), pages 176-213, April.
    11. Carlos A. Flores & Oscar A. Mitnik, 2009. "Evaluating Nonexperimental Estimators for Multiple Treatments: Evidence from Experimental Data," Working Papers 2010-10, University of Miami, Department of Economics.
    12. Antonio Musolesi & Hervé Cardot, 2017. "Modeling temporal treatment effects with zero inflated semi-parametric regression models: the case of local development policies in France," Working Papers 2017036, University of Ferrara, Department of Economics.
    13. Bryson, Alex & Dorsett, Richard & Purdon, Susan, 2002. "The use of propensity score matching in the evaluation of active labour market policies," LSE Research Online Documents on Economics 4993, London School of Economics and Political Science, LSE Library.
    14. Jorgen Hansen & Xingfei Liu, 2015. "Estimating labour supply responses and welfare participation: Using a natural experiment to validate a structural labour supply model," Canadian Journal of Economics, Canadian Economics Association, vol. 48(5), pages 1831-1854, December.
    15. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    16. Hervé Cardot & Antonio Musolesi, 2018. "Modeling temporal treatment effects with zero inflated semi-parametric regression models: the case of local development policies in France," SEEDS Working Papers 0718, SEEDS, Sustainability Environmental Economics and Dynamics Studies, revised Mar 2018.
    17. Fitzenberger, Bernd & Prey, Hedwig, 1996. "Training in East Germany: An evaluation of the effects on employment and wages," Discussion Papers 36, University of Konstanz, Center for International Labor Economics (CILE).
    18. Elizabeth Ty Wilde & Robinson Hollister, 2007. "How close is close enough? Evaluating propensity score matching using data from a class size reduction experiment," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 26(3), pages 455-477.
    19. Hervé Cardot & Antonio Musolesi, 2020. "Modeling temporal treatment effects with zero inflated semi-parametric regression models: The case of local development policies in France," Post-Print hal-02394810, HAL.
    20. Raymond STRUYK & Kirill CHAGIN, 2006. "Estimating the impact of job-search assistance: Assessment of a Russian programme targeting very low-income families," International Labour Review, International Labour Organization, vol. 145(3), pages 221-239, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:25:y:2001:i:1:p:3-28. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.