IDEAS home Printed from https://ideas.repec.org/p/kob/dpaper/dp2024-22.html
   My bibliography  Save this paper

Instrumented Difference-in-Differences with Heterogeneous Treatment Effects

Author

Listed:
  • Sho Miyaji

    (Graduate School of Economics, The University of Tokyo and Junior Research Fellow, Research Institute for Economics & Business Administration (RIEB), Kobe University, JAPAN)

Abstract

Many studies exploit variation in the timing of policy adoption across units as an instrument for treatment, and use instrumental variable techniques. This paper formalizes the underlying identification strategy as an instrumented difference-in-differences (DIDIV). In a simple setting with two periods and two groups, our DID-IV design mainly consists of a monotonicity assumption, and parallel trends assumptions in the treatment and the outcome. In this design, a Wald-DID estimand, which scales the DID estimand of the outcome by the DID estimand of the treatment, captures the local average treatment effect on the treated (LATET). In contrast to Fuzzy DID design considered in de Chaisemartin and D'Haultfoeuille (2018), our DID-IV design does not ex-ante require strong restrictions on the treatment adoption behavior across units, and our target parameter, the LATET, is policy-relevant if the instrument is based on the policy change of interest to the researcher. We extend the canonical DID-IV design to multiple period settings with the staggered adoption of the instrument across units, which we call a staggered DID-IV design. We propose an estimation method in staggered DID-IV design that is robust to treatment effect heterogeneity. We illustrate our findings in the setting of Oreopoulos (2006), estimating returns to schooling in the United Kingdom. In this application, the two-way fixed effects instrumental variable regression, which is the conventional approach to implement a staggered DID-IV design, yields a negative estimate, whereas our estimation method indicates the substantial gain from schooling.

Suggested Citation

  • Sho Miyaji, 2024. "Instrumented Difference-in-Differences with Heterogeneous Treatment Effects," Discussion Paper Series DP2024-22, Research Institute for Economics & Business Administration, Kobe University.
  • Handle: RePEc:kob:dpaper:dp2024-22
    as

    Download full text from publisher

    File URL: https://www.rieb.kobe-u.ac.jp/academic/ra/dp/English/DP2024-22.pdf
    File Function: First version, 2024
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Clément de Chaisemartin & Xavier D'Haultfœuille, 2020. "Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects," American Economic Review, American Economic Association, vol. 110(9), pages 2964-2996, September.
    2. Esther Duflo, 2001. "Schooling and Labor Market Consequences of School Construction in Indonesia: Evidence from an Unusual Policy Experiment," American Economic Review, American Economic Association, vol. 91(4), pages 795-813, September.
    3. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, May.
    4. Rucker C. Johnson & C. Kirabo Jackson, 2019. "Reducing Inequality through Dynamic Complementarity: Evidence from Head Start and Public School Spending," American Economic Journal: Economic Policy, American Economic Association, vol. 11(4), pages 310-349, November.
    5. Manudeep Bhuller & Tarjei Havnes & Edwin Leuven & Magne Mogstad, 2013. "Broadband Internet: An Information Superhighway to Sex Crime?," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 80(4), pages 1237-1266.
    6. Edward Vytlacil & James J. Heckman, 2001. "Policy-Relevant Treatment Effects," American Economic Review, American Economic Association, vol. 91(2), pages 107-111, May.
    7. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    8. Sandra E. Black & Paul J. Devereux & Kjell G. Salvanes, 2005. "Why the Apple Doesn't Fall Far: Understanding Intergenerational Transmission of Human Capital," American Economic Review, American Economic Association, vol. 95(1), pages 437-449, March.
    9. Philip Oreopoulos, 2006. "Estimating Average and Local Average Treatment Effects of Education when Compulsory Schooling Laws Really Matter," American Economic Review, American Economic Association, vol. 96(1), pages 152-175, March.
    10. Costas Meghir & Mårten Palme & Emilia Simeonova, 2018. "Education and Mortality: Evidence from a Social Experiment," American Economic Journal: Applied Economics, American Economic Association, vol. 10(2), pages 234-256, April.
    11. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    12. Michal Kolesár & Christoph Rothe, 2018. "Inference in Regression Discontinuity Designs with a Discrete Running Variable," American Economic Review, American Economic Association, vol. 108(8), pages 2277-2304, August.
    13. Athey, Susan & Imbens, Guido W., 2022. "Design-based analysis in Difference-In-Differences settings with staggered adoption," Journal of Econometrics, Elsevier, vol. 226(1), pages 62-79.
    14. Olivier Deschênes & Michael Greenstone & Joseph S. Shapiro, 2017. "Defensive Investments and the Demand for Air Quality: Evidence from the NOx Budget Program," American Economic Review, American Economic Association, vol. 107(10), pages 2958-2989, October.
    15. repec:oup:emjrnl:v:25:y:2022:i:3:p:531-553. is not listed on IDEAS
    16. Erica Field, 2007. "Entitled to Work: Urban Property Rights and Labor Supply in Peru," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(4), pages 1561-1602.
    17. Sun, Liyang & Abraham, Sarah, 2021. "Estimating dynamic treatment effects in event studies with heterogeneous treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 175-199.
    18. Petter Lundborg & Anton Nilsson & Dan-Olof Rooth, 2014. "Parental Education and Offspring Outcomes: Evidence from the Swedish Compulsory School Reform," American Economic Journal: Applied Economics, American Economic Association, vol. 6(1), pages 253-278, January.
    19. Imai, Kosuke & Kim, In Song, 2021. "On the Use of Two-Way Fixed Effects Regression Models for Causal Inference with Panel Data," Political Analysis, Cambridge University Press, vol. 29(3), pages 405-415, July.
    20. Edward Vytlacil, 2002. "Independence, Monotonicity, and Latent Index Models: An Equivalence Result," Econometrica, Econometric Society, vol. 70(1), pages 331-341, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sho Miyaji, 2024. "Instrumented Difference-in-Differences with Heterogeneous Treatment Effects," Papers 2405.12083, arXiv.org, revised Jul 2024.
    2. Sho Miyaji, 2024. "Two-way fixed effects instrumental variable regressions in staggered DID-IV designs," Papers 2405.16467, arXiv.org.
    3. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    4. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    5. Pedro Carneiro & Michael Lokshin & Nithin Umapathi, 2017. "Average and Marginal Returns to Upper Secondary Schooling in Indonesia," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(1), pages 16-36, January.
    6. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    7. OKUDAIRA Hiroko & TAKIZAWA Miho & YAMANOUCHI Kenta, 2022. "Does Employee Downsizing Work? Evidence from Product Innovation at Manufacturing Plants," Discussion papers 22015, Research Institute of Economy, Trade and Industry (RIETI).
    8. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    9. Pinotti, Paolo & Bhalotra, Sonia & Britto, Diogo & Sampaio, Breno, 2021. "Job Displacement, Unemployment Benefits and Domestic Violence," CEPR Discussion Papers 16350, C.E.P.R. Discussion Papers.
    10. Cl'ement de Chaisemartin & Xavier D'Haultf{oe}uille, 2021. "Two-Way Fixed Effects and Differences-in-Differences with Heterogeneous Treatment Effects: A Survey," Papers 2112.04565, arXiv.org, revised Jun 2022.
    11. Bhuller, Manudeep & Sigstad, Henrik, 2024. "2SLS with multiple treatments," Journal of Econometrics, Elsevier, vol. 242(1).
    12. Lorenzo Cappellari & Daniele Checchi & Marco Ovidi, 2022. "The effects of schooling on cognitive skills: evidence from education expansions," DISCE - Working Papers del Dipartimento di Economia e Finanza def122, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    13. Baker, Andrew C. & Larcker, David F. & Wang, Charles C.Y., 2022. "How much should we trust staggered difference-in-differences estimates?," Journal of Financial Economics, Elsevier, vol. 144(2), pages 370-395.
    14. Philip Marx & Elie Tamer & Xun Tang, 2022. "Parallel Trends and Dynamic Choices," Papers 2207.06564, arXiv.org, revised Aug 2023.
    15. Kline, Brendan, 2024. "Classical p-values and the Bayesian posterior probability that the hypothesis is approximately true," Journal of Econometrics, Elsevier, vol. 240(1).
    16. Jorge Rodríguez & Fernando Saltiel & Sergio Urzúa, 2022. "Dynamic treatment effects of job training," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(2), pages 242-269, March.
    17. Timo Schenk, 2023. "Time-Weighted Difference-in-Differences: Accounting for Common Factors in Short T Panels," Tinbergen Institute Discussion Papers 23-004/III, Tinbergen Institute.
    18. Li, Ping & Zhang, ZhongXiang, 2023. "The effects of new energy vehicle subsidies on air quality: Evidence from China," Energy Economics, Elsevier, vol. 120(C).
    19. Xin Nie & Jianxian Wu & Han Wang & Weijuan Li & Chengdao Huang & Lihua Li, 2022. "Contributing to carbon peak: Estimating the causal impact of eco‐industrial parks on low‐carbon development in China," Journal of Industrial Ecology, Yale University, vol. 26(4), pages 1578-1593, August.
    20. Ashesh Rambachan & Jonathan Roth, 2020. "Design-Based Uncertainty for Quasi-Experiments," Papers 2008.00602, arXiv.org, revised Feb 2024.

    More about this item

    Keywords

    Difference-in-differences; Instrumental variable; Local average treatment effect; Returns to education;
    All these keywords.

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kob:dpaper:dp2024-22. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Office of Promoting Research Collaboration, Research Institute for Economics & Business Administration, Kobe University (email available below). General contact details of provider: https://edirc.repec.org/data/rikobjp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.