IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v26y2002i5p545-572.html
   My bibliography  Save this article

Addressing Self-Selection Bias in Quasi-Experimental Evaluations of Whole-School Reform

Author

Listed:
  • Robert Bifulco

    (Duke University)

Abstract

This article discusses potential sources of self-selection bias in quasi-experimental evaluations of whole-school reform models and considers how individual student-level data might be used to provide valid impact estimates. Although repeated pretreatment and posttreatment measures of student performance can provide unbiased estimates under relatively weak assumptions, such data are difficult to obtain. The article develops an instrumental variable strategy that can be used to improve on common value-added estimators when only posttreatment measures of performance are available. Using data from New York City, the author shows that the instrumental variable strategy can provide estimates of model impacts similar to those provided by a difference-in-differences estimator provided that appropriate instruments are used.

Suggested Citation

  • Robert Bifulco, 2002. "Addressing Self-Selection Bias in Quasi-Experimental Evaluations of Whole-School Reform," Evaluation Review, , vol. 26(5), pages 545-572, October.
    • Handle: RePEc:sae:evarev:v:26:y:2002:i:5:p:545-572
    DOI: 10.1177/019384102236523
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/019384102236523
    Download Restriction: no
    File URL: https://libkey.io/10.1177/019384102236523?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrea Pufahl & Christoph R. Weiss, 2009. "Evaluating the effects of farm programmes: results from propensity score matching," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 36(1), pages 79-101, March.
    2. Gautier, Pieter & van Vuuren, Aico & Siegmann, Arjen, 2007. "The Effect of the Theo van Gogh Murder on House Prices in Amsterdam," CEPR Discussion Papers 6175, C.E.P.R. Discussion Papers.
    3. Dettmann, E. & Becker, C. & Schmeißer, C., 2011. "Distance functions for matching in small samples," Computational Statistics & Data Analysis, Elsevier, vol. 55(5), pages 1942-1960, May.
    4. Guy Stecklov & Paul Winters & Marco Stampini & Benjamin Davis, 2003. "Can Public Transfers Reduce Mexican Migration? A study based on randomized experimental data," Working Papers 03-16, Agricultural and Development Economics Division of the Food and Agriculture Organization of the United Nations (FAO - ESA).
    5. James J. Heckman, 1991. "Randomization and Social Policy Evaluation Revisited," NBER Technical Working Papers 0107, National Bureau of Economic Research, Inc.
    6. Belot, Michèle & James, Jonathan, 2014. "A new perspective on the issue of selection bias in randomized controlled field experiments," Economics Letters, Elsevier, vol. 124(3), pages 326-328.
    7. Federico Ciliberto & Elie Tamer, 2009. "Market Structure and Multiple Equilibria in Airline Markets," Econometrica, Econometric Society, vol. 77(6), pages 1791-1828, November.
    8. Nicola Pavoni & G. L. Violante, 2007. "Optimal Welfare-to-Work Programs," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(1), pages 283-318.
    9. Michael Lechner & Ruth Miquel & Conny Wunsch, 2011. "Long‐Run Effects Of Public Sector Sponsored Training In West Germany," Journal of the European Economic Association, European Economic Association, vol. 9(4), pages 742-784, August.
    10. Frölich, Markus & Lechner, Michael, 2010. "Exploiting Regional Treatment Intensity for the Evaluation of Labor Market Policies," Journal of the American Statistical Association, American Statistical Association, vol. 105(491), pages 1014-1029.
    11. Kölling, Arnd, 2013. "Wirtschaftsförderung, Produktivität und betriebliche Arbeitsnachfrage - Eine Kausalanalyse mit Betriebspaneldaten -," VfS Annual Conference 2013 (Duesseldorf): Competition Policy and Regulation in a Global Economic Order 79843, Verein für Socialpolitik / German Economic Association.
    12. Peter Bäckström & Erika Sandow & Olle Westerlund, 2016. "Commuting and timing of retirement," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 56(1), pages 125-152, January.
    13. Stefan Boes, 2013. "Nonparametric analysis of treatment effects in ordered response models," Empirical Economics, Springer, vol. 44(1), pages 81-109, February.
    14. Victor Chernozhukov & Iván Fernández‐Val & Blaise Melly, 2013. "Inference on Counterfactual Distributions," Econometrica, Econometric Society, vol. 81(6), pages 2205-2268, November.
    15. Barbara Sianesi, 2002. "Swedish active labour market programmes in the 1990s: overall effectiveness and differential performance," IFS Working Papers W02/03, Institute for Fiscal Studies.
    16. Omar Al-Ubaydli & John List & Claire Mackevicius & Min Sok Lee & Dana Suskind, 2019. "How Can Experiments Play a Greater Role in Public Policy? 12 Proposals from an Economic Model of Scaling," Artefactual Field Experiments 00679, The Field Experiments Website.
    17. Albrecht, James & van den Berg, Gerard J & Vroman, Susan, 2004. "The knowledge lift: The Swedish adult education program that aimed to eliminate low worker skill levels," Working Paper Series 2004:17, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    18. Bronwyn Hall & Alessandro Maffioli, 2008. "Evaluating the impact of technology development funds in emerging economies: evidence from Latin America," The European Journal of Development Research, Taylor and Francis Journals, vol. 20(2), pages 172-198.
    19. Brian Graversen & Brian Larsen, 2013. "Is there a threat effect of mandatory activation programmes for the long-term unemployed?," Empirical Economics, Springer, vol. 44(2), pages 1031-1051, April.
    20. Engel, Dirk, 2002. "The Impact of Venture Capital on Firm Growth: An Empirical Investigation," ZEW Discussion Papers 02-02, ZEW - Leibniz Centre for European Economic Research.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:26:y:2002:i:5:p:545-572. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.