IDEAS home Printed from https://ideas.repec.org/p/crs/wpaper/2014-18.html
   My bibliography  Save this paper

Fuzzy Changes-in-Changes

Author

Listed:
  • Clément de Chaisemartin

    (Warwick University)

  • Xavier d'Haultfoeuille

    (CREST-LMI)

Abstract

The changes-in-changes model extends the widely used difference-in-differences to situations where outcomes may evolve heterogeneously. Contrary to difference-in-differences, this model is invariant to the scaling of the outcome. This paper develops an instrumental variable changes-in-changes model, to allow for situations in which perfect control and treatment groups cannot be defined, so that some units may be treated in the "control group", while some units may remain untreated in the "treatment group". This is the case for instance with repeated cross sections, if the treatment is not tied to a strict rule. Under a mild strengthening of the changes-in-changes model, treatment effects in a population of compliers are point identified when the treatment rate does not change in the control group, and partially identified otherwise. We show that simple plug-in estimators of treatment effects are asymptotically normal and that the bootstrap is valid. Finally, we use our results to reanalyze findings in Field (2007) and Duflo (2001).

Suggested Citation

  • Clément de Chaisemartin & Xavier d'Haultfoeuille, 2014. "Fuzzy Changes-in-Changes," Working Papers 2014-18, Center for Research in Economics and Statistics.
    • Handle: RePEc:crs:wpaper:2014-18
    as

    Download full text from publisher

    File URL: http://crest.science/RePEc/wpstorage/2014-18.pdf
    File Function: Crest working paper version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Mirko Draca & Stephen Machin & Robert Witt, 2011. "Panic on the Streets of London: Police, Crime, and the July 2005 Terror Attacks," American Economic Review, American Economic Association, vol. 101(5), pages 2157-2181, August.
    2. Victor Chernozhukov & Iván Fernández‐Val & Blaise Melly, 2013. "Inference on Counterfactual Distributions," Econometrica, Econometric Society, vol. 81(6), pages 2205-2268, November.
    3. Esther Duflo, 2001. "Schooling and Labor Market Consequences of School Construction in Indonesia: Evidence from an Unusual Policy Experiment," American Economic Review, American Economic Association, vol. 91(4), pages 795-813, September.
    4. Anders Akerman & Ingvil Gaarder & Magne Mogstad, 2015. "The Skill Complementarity of Broadband Internet," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(4), pages 1781-1824.
    5. Xiaohong Chen & Oliver Linton & Ingrid Van Keilegom, 2003. "Estimation of Semiparametric Models when the Criterion Function Is Not Smooth," Econometrica, Econometric Society, vol. 71(5), pages 1591-1608, September.
    6. de Chaisemartin, Clement & D'Haultfoeuille, Xavier, 2014. "Fuzzy Changes-in Changes," CAGE Online Working Paper Series 184, Competitive Advantage in the Global Economy (CAGE).
    7. Katz, Lawrence F. & Autor, David H., 1999. "Changes in the wage structure and earnings inequality," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 26, pages 1463-1555, Elsevier.
    8. Lance Lochner & Enrico Moretti, 2004. "The Effect of Education on Crime: Evidence from Prison Inmates, Arrests, and Self-Reports," American Economic Review, American Economic Association, vol. 94(1), pages 155-189, March.
    9. Horowitz, Joel L & Manski, Charles F, 1995. "Identification and Robustness with Contaminated and Corrupted Data," Econometrica, Econometric Society, vol. 63(2), pages 281-302, March.
    10. Victor Chernozhukov & Iv·n Fern·ndez-Val & Alfred Galichon, 2010. "Quantile and Probability Curves Without Crossing," Econometrica, Econometric Society, vol. 78(3), pages 1093-1125, May.
    11. Stéphane Bonhomme & Ulrich Sauder, 2011. "Recovering Distributions in Difference-in-Differences Models: A Comparison of Selective and Comprehensive Schooling," The Review of Economics and Statistics, MIT Press, vol. 93(2), pages 479-494, May.
    12. Alberto Abadie & Matthew M. Chingos & Martin R. West, 2018. "Endogenous Stratification in Randomized Experiments," The Review of Economics and Statistics, MIT Press, vol. 100(4), pages 567-580, October.
    13. C de Chaisemartin & X D’HaultfŒuille, 2018. "Fuzzy Differences-in-Differences," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(2), pages 999-1028.
    14. Field, Erica Marie, 2005. "Property Rights and Investment in Urban Slums," Scholarly Articles 3634150, Harvard University Department of Economics.
    15. Richard Blundell & Monica Costa Dias & Costas Meghir & John Van Reenen, 2004. "Evaluating the Employment Impact of a Mandatory Job Search Program," Journal of the European Economic Association, MIT Press, vol. 2(4), pages 569-606, June.
    16. Erica Field, 2007. "Entitled to Work: Urban Property Rights and Labor Supply in Peru," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(4), pages 1561-1602.
    17. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    18. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    19. Robin Burgess & Rohini Pande, 2005. "Do Rural Banks Matter? Evidence from the Indian Social Banking Experiment," American Economic Review, American Economic Association, vol. 95(3), pages 780-795, June.
    20. Donald W. K. Andrews & Gustavo Soares, 2010. "Inference for Parameters Defined by Moment Inequalities Using Generalized Moment Selection," Econometrica, Econometric Society, vol. 78(1), pages 119-157, January.
    21. Jacob Mincer & Boyan Jovanovic, 1981. "Labor Mobility and Wages," NBER Chapters, in: Studies in Labor Markets, pages 21-64, National Bureau of Economic Research, Inc.
    22. repec:hal:wpspec:info:hdl:2441/5rkqqmvrn4tl22s9mc4b6ga2g is not listed on IDEAS
    23. Xavier d'Haultfoeuille & Stefan Hoderlein & Yuya Sasaki, 2013. "Nonlinear difference-in-differences in repeated cross sections with continuous treatments," CeMMAP working papers CWP40/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    24. Erica Field, 2005. "Property Rights and Investment in Urban Slums," Journal of the European Economic Association, MIT Press, vol. 3(2-3), pages 279-290, 04/05.
    25. Joshua Angrist & Victor Chernozhukov & Iván Fernández-Val, 2006. "Quantile Regression under Misspecification, with an Application to the U.S. Wage Structure," Econometrica, Econometric Society, vol. 74(2), pages 539-563, March.
    26. Joshua D. Angrist & Kathryn Graddy & Guido W. Imbens, 2000. "The Interpretation of Instrumental Variables Estimators in Simultaneous Equations Models with an Application to the Demand for Fish," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 67(3), pages 499-527.
    27. Heckman, James J. & Robb, Richard Jr., 1985. "Alternative methods for evaluating the impact of interventions : An overview," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 239-267.
    28. repec:hal:spmain:info:hdl:2441/5rkqqmvrn4tl22s9mc4b6ga2g is not listed on IDEAS
    29. Guido W. Imbens & Donald B. Rubin, 1997. "Estimating Outcome Distributions for Compliers in Instrumental Variables Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 555-574.
    30. Abadie A., 2002. "Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 284-292, March.
    31. Edward Vytlacil, 2002. "Independence, Monotonicity, and Latent Index Models: An Equivalence Result," Econometrica, Econometric Society, vol. 70(1), pages 331-341, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. C de Chaisemartin & X D’HaultfŒuille, 2018. "Fuzzy Differences-in-Differences," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(2), pages 999-1028.
    2. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    3. de Chaisemartin, Clement & D'Haultfoeuille, Xavier, "undated". "Supplement to Fuzzy Differences-in-Differences," Economic Research Papers 270217, University of Warwick - Department of Economics.
    4. Manea, Roxana Elena & Piraino, Patrizio & Viarengo, Martina, 2023. "Crime, inequality and subsidized housing: Evidence from South Africa," World Development, Elsevier, vol. 168(C).
    5. Clément de Chaisemartin & Xavier D'Haultfœuille, 2020. "Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects," American Economic Review, American Economic Association, vol. 110(9), pages 2964-2996, September.
    6. Susan Athey & Guido W. Imbens, 2006. "Identification and Inference in Nonlinear Difference-in-Differences Models," Econometrica, Econometric Society, vol. 74(2), pages 431-497, March.
    7. Claudia Noack, 2021. "Sensitivity of LATE Estimates to Violations of the Monotonicity Assumption," Papers 2106.06421, arXiv.org.
    8. Blaise Melly und Kaspar W thrich, 2016. "Local quantile treatment effects," Diskussionsschriften dp1605, Universitaet Bern, Departement Volkswirtschaft.
    9. Juan Carlos Escanciano & Lin Zhu, 2013. "Set inferences and sensitivity analysis in semiparametric conditionally identified models," CeMMAP working papers CWP55/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    10. Victor Chernozhukov & Iván Fernández‐Val & Blaise Melly, 2013. "Inference on Counterfactual Distributions," Econometrica, Econometric Society, vol. 81(6), pages 2205-2268, November.
    11. Frandsen, Brigham R. & Frölich, Markus & Melly, Blaise, 2012. "Quantile treatment effects in the regression discontinuity design," Journal of Econometrics, Elsevier, vol. 168(2), pages 382-395.
    12. Patrick Kline & Christopher R. Walters, 2019. "On Heckits, LATE, and Numerical Equivalence," Econometrica, Econometric Society, vol. 87(2), pages 677-696, March.
    13. Matthew Collin & Justin Sandefur & Andrew Zeitlin, 2015. "Falling Off the Map: The Impact of Formalizing (Some) Informal Settlements in Tanzania," CSAE Working Paper Series 2015-09, Centre for the Study of African Economies, University of Oxford.
    14. Pereda-Fernández, Santiago, 2023. "Identification and estimation of triangular models with a binary treatment," Journal of Econometrics, Elsevier, vol. 234(2), pages 585-623.
    15. Martin Huber & Giovanni Mellace, 2014. "Testing exclusion restrictions and additive separability in sample selection models," Empirical Economics, Springer, vol. 47(1), pages 75-92, August.
    16. Franklin, Simon, 2020. "Enabled to work: The impact of government housing on slum dwellers in South Africa," Journal of Urban Economics, Elsevier, vol. 118(C).
    17. Zhang, Hongliang, 2016. "Identification of treatment effects under imperfect matching with an application to Chinese elite schools," Journal of Public Economics, Elsevier, vol. 142(C), pages 56-82.
    18. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    19. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    20. Lechner, Michael, 2011. "The Estimation of Causal Effects by Difference-in-Difference Methods," Foundations and Trends(R) in Econometrics, now publishers, vol. 4(3), pages 165-224, November.

    More about this item

    Keywords

    differences-in-differences; changes-in-changes; imperfect compliance; instrumental variables; quantile treatment effects; partial identification;
    All these keywords.

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:crs:wpaper:2014-18. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Secretariat General (email available below). General contact details of provider: https://edirc.repec.org/data/crestfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.