IDEAS home Printed from https://ideas.repec.org/p/hal/psewpa/halshs-00849071.html
   My bibliography  Save this paper

Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls

Author

Listed:
  • Laurent Gobillon

    (PSE - Paris-Jourdan Sciences Economiques - ENS-PSL - École normale supérieure - Paris - PSL - Université Paris Sciences et Lettres - INRA - Institut National de la Recherche Agronomique - EHESS - École des hautes études en sciences sociales - ENPC - École des Ponts ParisTech - CNRS - Centre National de la Recherche Scientifique, PSE - Paris School of Economics - UP1 - Université Paris 1 Panthéon-Sorbonne - ENS-PSL - École normale supérieure - Paris - PSL - Université Paris Sciences et Lettres - EHESS - École des hautes études en sciences sociales - ENPC - École des Ponts ParisTech - CNRS - Centre National de la Recherche Scientifique - INRAE - Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement, INED - Institut national d'études démographiques)

  • Thierry Magnac

    (TSE-R - Toulouse School of Economics - UT Capitole - Université Toulouse Capitole - UT - Université de Toulouse - INRA - Institut National de la Recherche Agronomique - EHESS - École des hautes études en sciences sociales - CNRS - Centre National de la Recherche Scientifique)

Abstract

In this paper, we investigate the use of interactive e¤ect or linear factor models in regional policy evaluation. We contrast treatment effect estimates obtained by Bai (2009)'s least squares method with the popular difference in difference estimates as well as with estimates obtained using synthetic control approaches as developed by Abadie and coauthors. We show that difference in differences are generically biased and we derive the support conditions that are required for the application of synthetic controls. We construct an extensive set of Monte Carlo experiments to compare the performance of these estimation methods in small samples. As an empirical illustration, we also apply them to the evaluation of the impact on local unemployment of an enterprise zone policy implemented in France in the 1990s.

Suggested Citation

  • Laurent Gobillon & Thierry Magnac, 2013. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls," PSE Working Papers halshs-00849071, HAL.
    • Handle: RePEc:hal:psewpa:halshs-00849071
    Note: View the original document on HAL open archive server: https://shs.hal.science/halshs-00849071
    as

    Download full text from publisher

    File URL: https://shs.hal.science/halshs-00849071/document
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Pedro Carneiro & Karsten T. Hansen & James J. Heckman, 2003. "Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College," NBER Working Papers 9546, National Bureau of Economic Research, Inc.
    2. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    3. Carneiro, Pedro & Hansen, Karsten T. & Heckman, James J., 2003. "Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College Choice," IZA Discussion Papers 767, Institute of Labor Economics (IZA).
    4. Catherine Doz & Domenico Giannone & Lucrezia Reichlin, 2012. "A Quasi–Maximum Likelihood Approach for Large, Approximate Dynamic Factor Models," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1014-1024, November.
    5. Pedro Carneiro & Karsten T. Hansen & James J. Heckman, 2003. "2001 Lawrence R. Klein Lecture Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College Choice," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 44(2), pages 361-422, May.
    6. Jeffrey M. Wooldridge, 2005. "Fixed-Effects and Related Estimators for Correlated Random-Coefficient and Treatment-Effect Panel Data Models," The Review of Economics and Statistics, MIT Press, vol. 87(2), pages 385-390, May.
    7. Ahn, Seung C. & Lee, Young H. & Schmidt, Peter, 2013. "Panel data models with multiple time-varying individual effects," Journal of Econometrics, Elsevier, vol. 174(1), pages 1-14.
    8. Alberto Abadie & Guido W. Imbens, 2011. "Bias-Corrected Matching Estimators for Average Treatment Effects," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(1), pages 1-11, January.
    9. Susan Athey & Guido W. Imbens, 2006. "Identification and Inference in Nonlinear Difference-in-Differences Models," Econometrica, Econometric Society, vol. 74(2), pages 431-497, March.
    10. Gobillon, Laurent & Magnac, Thierry & Selod, Harris, 2012. "Do unemployed workers benefit from enterprise zones? The French experience," Journal of Public Economics, Elsevier, vol. 96(9-10), pages 881-892.
    11. Hyungsik Roger Moon & Martin Weidner, 2015. "Linear Regression for Panel With Unknown Number of Factors as Interactive Fixed Effects," Econometrica, Econometric Society, vol. 83(4), pages 1543-1579, July.
    12. Ahn, Seung Chan & Hoon Lee, Young & Schmidt, Peter, 2001. "GMM estimation of linear panel data models with time-varying individual effects," Journal of Econometrics, Elsevier, vol. 101(2), pages 219-255, April.
    13. Onatski, Alexei, 2012. "Asymptotics of the principal components estimator of large factor models with weakly influential factors," Journal of Econometrics, Elsevier, vol. 168(2), pages 244-258.
    14. Dukpa Kim & Tatsushi Oka, 2014. "Divorce Law Reforms And Divorce Rates In The Usa: An Interactive Fixed‐Effects Approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(2), pages 231-245, March.
    15. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    16. Pesaran, M. Hashem & Tosetti, Elisa, 2011. "Large panels with common factors and spatial correlation," Journal of Econometrics, Elsevier, vol. 161(2), pages 182-202, April.
    17. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    18. Victor Chernozhukov & Sokbae Lee & Adam M. Rosen, 2013. "Intersection Bounds: Estimation and Inference," Econometrica, Econometric Society, vol. 81(2), pages 667-737, March.
    19. Moon, Hyungsik Roger & Weidner, Martin, 2017. "Dynamic Linear Panel Regression Models With Interactive Fixed Effects," Econometric Theory, Cambridge University Press, vol. 33(1), pages 158-195, February.
    20. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    21. Cheng Hsiao & H. Steve Ching & Shui Ki Wan, 2012. "A Panel Data Approach For Program Evaluation: Measuring The Benefits Of Political And Economic Integration Of Hong Kong With Mainland China," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(5), pages 705-740, August.
    22. James J. Heckman & Vytlacil, Edward J., 2007. "Econometric Evaluation of Social Programs, Part I: Causal Models, Structural Models and Econometric Policy Evaluation," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 70, Elsevier.
    23. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    24. Westerlund, J. & Urbain, J.R.Y.J., 2011. "Cross sectional averages or principal components?," Research Memorandum 053, Maastricht University, Maastricht Research School of Economics of Technology and Organization (METEOR).
    25. M. Hashem Pesaran, 2006. "Estimation and Inference in Large Heterogeneous Panels with a Multifactor Error Structure," Econometrica, Econometric Society, vol. 74(4), pages 967-1012, July.
    26. Richard Blundell & Monica Costa Dias & Costas Meghir & John Van Reenen, 2004. "Evaluating the Employment Impact of a Mandatory Job Search Program," Journal of the European Economic Association, MIT Press, vol. 2(4), pages 569-606, June.
    27. repec:hal:pseose:hal-00812979 is not listed on IDEAS
    28. Timothy G. Conley & Christopher R. Taber, 2011. "Inference with "Difference in Differences" with a Small Number of Policy Changes," The Review of Economics and Statistics, MIT Press, vol. 93(1), pages 113-125, February.
    29. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    30. Alexei Onatski & Marcelo Moreira J. & Marc Hallin, 2011. "Asymptotic Power of Sphericity Tests for High-Dimensional Data," Working Papers ECARES ECARES 2011-018, ULB -- Universite Libre de Bruxelles.
    31. Matias Busso & Jesse Gregory & Patrick Kline, 2013. "Assessing the Incidence and Efficiency of a Prominent Place Based Policy," American Economic Review, American Economic Association, vol. 103(2), pages 897-947, April.
    32. Jushan Bai, 2009. "Panel Data Models With Interactive Fixed Effects," Econometrica, Econometric Society, vol. 77(4), pages 1229-1279, July.
    33. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    34. repec:hal:journl:peer-00796743 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:hal:pseose:halshs-00849071 is not listed on IDEAS
    2. Callaway, Brantly & Karami, Sonia, 2023. "Treatment effects in interactive fixed effects models with a small number of time periods," Journal of Econometrics, Elsevier, vol. 233(1), pages 184-208.
    3. Freeman, Hugo & Weidner, Martin, 2023. "Linear panel regressions with two-way unobserved heterogeneity," Journal of Econometrics, Elsevier, vol. 237(1).
    4. Susan Athey & Mohsen Bayati & Nikolay Doudchenko & Guido Imbens & Khashayar Khosravi, 2021. "Matrix Completion Methods for Causal Panel Data Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1716-1730, October.
    5. Victor Chernozhukov & Kaspar Wüthrich & Yinchu Zhu, 2021. "An Exact and Robust Conformal Inference Method for Counterfactual and Synthetic Controls," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1849-1864, October.
    6. Wei Shi & Lung-fei Lee, 2018. "The effects of gun control on crimes: a spatial interactive fixed effects approach," Empirical Economics, Springer, vol. 55(1), pages 233-263, August.
    7. Su, Liangjun & Jin, Sainan & Zhang, Yonghui, 2015. "Specification test for panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 186(1), pages 222-244.
    8. Hugo Freeman & Martin Weidner, 2021. "Linear Panel Regressions with Two-Way Unobserved Heterogeneity," Papers 2109.11911, arXiv.org, revised Aug 2022.
    9. Milda Norkuté & Vasilis Sarafidis & Takashi Yamagata, 2018. "Instrumental Variable Estimation of Dynamic Linear Panel Data Models with Defactored Regressors and a Multifactor Error Structure," ISER Discussion Paper 1019, Institute of Social and Economic Research, Osaka University.
    10. Hugo Freeman & Martin Weidner, 2021. "Linear panel regressions with two-way unobserved heterogeneity," CeMMAP working papers CWP39/21, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    11. Ruofan Xu & Jiti Gao & Tatsushi Oka & Yoon-Jae Whang, 2022. "Quantile Random-Coefficient Regression with Interactive Fixed Effects: Heterogeneous Group-Level Policy Evaluation," Papers 2208.03632, arXiv.org, revised Nov 2024.
    12. Ruofan Xu & Jiti Gao & Tatsushi Oka & Yoon-Jae Whang, 2022. "Estimation of Heterogeneous Treatment Effects Using Quantile Regression with Interactive Fixed Effects," Monash Econometrics and Business Statistics Working Papers 13/22, Monash University, Department of Econometrics and Business Statistics.
    13. Li, Kunpeng & Cui, Guowei & Lu, Lina, 2020. "Efficient estimation of heterogeneous coefficients in panel data models with common shocks," Journal of Econometrics, Elsevier, vol. 216(2), pages 327-353.
    14. Shi, Wei & Lee, Lung-fei, 2018. "A spatial panel data model with time varying endogenous weights matrices and common factors," Regional Science and Urban Economics, Elsevier, vol. 72(C), pages 6-34.
    15. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    16. Norkutė, Milda & Sarafidis, Vasilis & Yamagata, Takashi & Cui, Guowei, 2021. "Instrumental variable estimation of dynamic linear panel data models with defactored regressors and a multifactor error structure," Journal of Econometrics, Elsevier, vol. 220(2), pages 416-446.
    17. Laurent Gobillon & François-Charles Wolff, 2015. "Évaluer l’effet des politiques publiques locales avec les contrôles synthétiques et les modèles à facteurs : Une application au marché du poisson français," PSE Working Papers halshs-01183455, HAL.
    18. Mohitosh Kejriwal & Xiaoxiao Li & Linh Nguyen & Evan Totty, 2024. "The efficacy of ability proxies for estimating the returns to schooling: A factor model‐based evaluation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(1), pages 3-21, January.
    19. Evan Totty, 2017. "The Effect Of Minimum Wages On Employment: A Factor Model Approach," Economic Inquiry, Western Economic Association International, vol. 55(4), pages 1712-1737, October.
    20. Li, Xingyu & Shen, Yan & Zhou, Qiankun, 2024. "Confidence intervals of treatment effects in panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 240(1).
    21. Georg Keilbar & Juan M. Rodriguez-Poo & Alexandra Soberon & Weining Wang, 2022. "A semiparametric approach for interactive fixed effects panel data models," Papers 2201.11482, arXiv.org, revised Mar 2023.

    More about this item

    Keywords

    Policy evaluation; Linear factor models; Synthetic controls; Economic geography; Enterprise zones;
    All these keywords.

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • H53 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Welfare Programs
    • J64 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Unemployment: Models, Duration, Incidence, and Job Search
    • R11 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - General Regional Economics - - - Regional Economic Activity: Growth, Development, Environmental Issues, and Changes

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:psewpa:halshs-00849071. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.