IDEAS home Printed from https://ideas.repec.org/p/iek/wpaper/0721.html
   My bibliography  Save this paper

Difference in Generalized-Differences with Panel Data: Effects of Moving from Private to Public School on Test Scores

Author

Listed:
  • Myoung-jae Lee

    (Department of Economics, Korea University)

Abstract

Difference in differences (DD) relies on the key identifying condition that the untreated response variable would have grown equally across the control and treatment groups; i.e., the ¡®time effects¡¯ across the groups are the same. This condition can be rewritten as the ¡®group effects¡¯ across the time points being the same, with which this paper generalizes DD to difference in generalized-differences (DG). DG is indexed by a parameter ¥ç, and includes DD as a special case when ¥ç = 1. This makes it possible to use DG as a sensitivity analysis for DD by trying values of ¥ç other than one. Going further from sensitivity analysis, one may desire to fix ¥ç. For this, we provide a way to get a benchmark value of ¥ç using a dynamic panel data model for the control group. An empirical analysis is provided for the effects of moving from private to public school on test scores. In the empirical analysis, (i) DD magnitude is fairly sensitive to changes in ¥ç around one, but its statistical significance is not, (ii) ¥ç is significantly smaller than one in math score (and possibly in science score), and (iii) DG yields a significant negative effect of about 3-5% for reading score, but the effects are ambiguous or insignificant for the other scores. ¥ç being less than 1 means that, had the movers to public school stayed, the score gap between the movers and stayers would have narrowed. That is, the move to public school is likely to have been involuntary.

Suggested Citation

  • Myoung-jae Lee, 2007. "Difference in Generalized-Differences with Panel Data: Effects of Moving from Private to Public School on Test Scores," Discussion Paper Series 0721, Institute of Economic Research, Korea University.
    • Handle: RePEc:iek:wpaper:0721
    as

    Download full text from publisher

    File URL: http://econ.korea.ac.kr/~ri/WorkingPapers/w0721.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    2. Joseph G. Altonji & Todd E. Elder & Christopher R. Taber, 2005. "Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 151-184, February.
    3. Guildo W. Imbens, 2003. "Sensitivity to Exogeneity Assumptions in Program Evaluation," American Economic Review, American Economic Association, vol. 93(2), pages 126-132, May.
    4. Angrist, Joshua D. & Krueger, Alan B., 1999. "Empirical strategies in labor economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 23, pages 1277-1366, Elsevier.
    5. Card, David & Sullivan, Daniel G, 1988. "Measuring the Effect of Subsidized Training Programs on Movements in and out of Employment," Econometrica, Econometric Society, vol. 56(3), pages 497-530, May.
    6. Julie Berry Cullen & Brian A. Jacob & Steven Levitt, 2003. "The Effect of School Choice on Student Outcomes: Evidence from Randomized Lotteries," NBER Working Papers 10113, National Bureau of Economic Research, Inc.
    7. Cecilia Elena Rouse, 1998. "Private School Vouchers and Student Achievement: An Evaluation of the Milwaukee Parental Choice Program," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 113(2), pages 553-602.
    8. Derek Neal, 1998. "What have we learned about the benefits of private schooling?," Economic Policy Review, Federal Reserve Bank of New York, vol. 4(Mar), pages 79-86.
    9. Derek Neal, 2002. "How Vouchers Could Change the Market for Education," Journal of Economic Perspectives, American Economic Association, vol. 16(4), pages 25-44, Fall.
    10. Meyer, Bruce D, 1995. "Natural and Quasi-experiments in Economics," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(2), pages 151-161, April.
    11. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    12. Myoung-Jae Lee, 2004. "Selection correction and sensitivity analysis for ordered treatment effect on count response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 19(3), pages 323-337.
    13. Myoung‐jae Lee & Unto Häkkinen & Gunnar Rosenqvist, 2007. "Finding the best treatment under heavy censoring and hidden bias," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 170(1), pages 133-147, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Myoung Lee & Sang Lee, 2009. "Sensitivity analysis of job-training effects on reemployment for Korean women," Empirical Economics, Springer, vol. 36(1), pages 81-107, February.
    2. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    3. Greenstone, Michael & Gayer, Ted, 2009. "Quasi-experimental and experimental approaches to environmental economics," Journal of Environmental Economics and Management, Elsevier, vol. 57(1), pages 21-44, January.
    4. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    5. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2017. "Unobservable, but unimportant? The relevance of usually unobserved variables for the evaluation of labor market policies," Labour Economics, Elsevier, vol. 46(C), pages 14-25.
    6. Matthew A. Masten & Alexandre Poirier & Linqi Zhang, 2024. "Assessing Sensitivity to Unconfoundedness: Estimation and Inference," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(1), pages 1-13, January.
    7. Jean-Michel Plassard & Nhu Tran Thi Thanh, 2009. "Liberté de choix des élèves et concurrence des établissements : un survey de l'analyse du pilotage des systèmes éducatifs par les quasi-marchés," Revue d'économie industrielle, De Boeck Université, vol. 0(2), pages 99-130.
    8. Joseph Hotz, V. & Imbens, Guido W. & Mortimer, Julie H., 2005. "Predicting the efficacy of future training programs using past experiences at other locations," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 241-270.
    9. Chang, Pao-Li & Lee, Myoung-Jae, 2011. "The WTO trade effect," Journal of International Economics, Elsevier, vol. 85(1), pages 53-71, September.
    10. Michael Lechner, 2000. "An Evaluation of Public-Sector-Sponsored Continuous Vocational Training Programs in East Germany," Journal of Human Resources, University of Wisconsin Press, vol. 35(2), pages 347-375.
    11. Chakravarty, Shubha & Lundberg, Mattias & Nikolov, Plamen & Zenker, Juliane, 2019. "Vocational training programs and youth labor market outcomes: Evidence from Nepal," Journal of Development Economics, Elsevier, vol. 136(C), pages 71-110.
    12. David Card & Pablo Ibarrarán & Ferdinando Regalia & David Rosas-Shady & Yuri Soares, 2011. "The Labor Market Impacts of Youth Training in the Dominican Republic," Journal of Labor Economics, University of Chicago Press, vol. 29(2), pages 267-300.
    13. Dettmann, E. & Becker, C. & Schmeißer, C., 2011. "Distance functions for matching in small samples," Computational Statistics & Data Analysis, Elsevier, vol. 55(5), pages 1942-1960, May.
    14. Böhlmark, Anders & Lindahl, Mikael, 2007. "The Impact of School Choice on Pupil Achievement, Segregation and Costs: Swedish Evidence," IZA Discussion Papers 2786, Institute of Labor Economics (IZA).
    15. Aki Kangasharju, 2007. "Do Wage Subsidies Increase Employment in Subsidized Firms?," Economica, London School of Economics and Political Science, vol. 74(293), pages 51-67, February.
    16. Christian Volpe Martincus & Jerónimo Carballo, 2010. "Is Export Promotion Effective in Developing Countries? Firm-Level Evidence on the Intensive and Extensive Margins of Exports," IDB Publications (Working Papers) 36763, Inter-American Development Bank.
    17. Abbring, Jaap H. & van den Berg, Gerard J., 2003. "A Simple Procedure for the Evaluation of Treatment Effects on Duration Variables," IZA Discussion Papers 810, Institute of Labor Economics (IZA).
    18. Alberto Abadie & Guido W. Imbens, 2002. "Simple and Bias-Corrected Matching Estimators for Average Treatment Effects," NBER Technical Working Papers 0283, National Bureau of Economic Research, Inc.
    19. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2006. "Moving the Goalposts: Addressing Limited Overlap in the Estimation of Average Treatment Effects by Changing the Estimand," NBER Technical Working Papers 0330, National Bureau of Economic Research, Inc.
    20. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2009. "Dealing with limited overlap in estimation of average treatment effects," Biometrika, Biometrika Trust, vol. 96(1), pages 187-199.

    More about this item

    Keywords

    treatment effect; difference in differences; panel data; private-school effect;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iek:wpaper:0721. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kim, Jisoo (email available below). General contact details of provider: https://edirc.repec.org/data/ierkukr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.