IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2411.18772.html
   My bibliography  Save this paper

Difference-in-differences Design with Outcomes Missing Not at Random

Author

Listed:
  • Sooahn Shin

Abstract

This paper addresses one of the most prevalent problems encountered by political scientists working with difference-in-differences (DID) design: missingness in panel data. A common practice for handling missing data, known as complete case analysis, is to drop cases with any missing values over time. A more principled approach involves using nonparametric bounds on causal effects or applying inverse probability weighting based on baseline covariates. Yet, these methods are general remedies that often under-utilize the assumptions already imposed on panel structure for causal identification. In this paper, I outline the pitfalls of complete case analysis and propose an alternative identification strategy based on principal strata. To be specific, I impose parallel trends assumption within each latent group that shares the same missingness pattern (e.g., always-respondents, if-treated-respondents) and leverage missingness rates over time to estimate the proportions of these groups. Building on this, I tailor Lee bounds, a well-known nonparametric bounds under selection bias, to partially identify the causal effect within the DID design. Unlike complete case analysis, the proposed method does not require independence between treatment selection and missingness patterns, nor does it assume homogeneous effects across these patterns.

Suggested Citation

  • Sooahn Shin, 2024. "Difference-in-differences Design with Outcomes Missing Not at Random," Papers 2411.18772, arXiv.org.
  • Handle: RePEc:arx:papers:2411.18772
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2411.18772
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Constantine E. Frangakis & Donald B. Rubin, 2002. "Principal Stratification in Causal Inference," Biometrics, The International Biometric Society, vol. 58(1), pages 21-29, March.
    2. Martin Bisgaard & Rune Slothuus, 2018. "Partisan Elites as Culprits? How Party Cues Shape Partisan Perceptual Gaps," American Journal of Political Science, John Wiley & Sons, vol. 62(2), pages 456-469, April.
    3. Eric J. Tchetgen Tchetgen & Kathleen E. Wirth, 2017. "A general instrumental variable framework for regression analysis with outcome missing not at random," Biometrics, The International Biometric Society, vol. 73(4), pages 1123-1131, December.
    4. Imai, Kosuke, 2008. "Sharp bounds on the causal effects in randomized experiments with "truncation-by-death"," Statistics & Probability Letters, Elsevier, vol. 78(2), pages 144-149, February.
    5. Linbo Wang & Xiao-Hua Zhou & Thomas S. Richardson, 2017. "Identification and estimation of causal effects with outcomes truncated by death," Biometrika, Biometrika Trust, vol. 104(3), pages 597-612.
    6. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shanshan Luo & Wei Li & Yangbo He, 2023. "Causal inference with outcomes truncated by death in multiarm studies," Biometrics, The International Biometric Society, vol. 79(1), pages 502-513, March.
    2. Gilbert Peter B. & Blette Bryan S. & Hudgens Michael G. & Shepherd Bryan E., 2020. "Post-randomization Biomarker Effect Modification Analysis in an HIV Vaccine Clinical Trial," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 54-69, January.
    3. Huber, Martin & Meier, Jonas & Wallimann, Hannes, 2022. "Business analytics meets artificial intelligence: Assessing the demand effects of discounts on Swiss train tickets," Transportation Research Part B: Methodological, Elsevier, vol. 163(C), pages 22-39.
    4. Bartalotti, Otávio & Kédagni, Désiré & Possebom, Vitor, 2023. "Identifying marginal treatment effects in the presence of sample selection," Journal of Econometrics, Elsevier, vol. 234(2), pages 565-584.
    5. Simon Calmar Andersen & Louise Beuchert & Phillip Heiler & Helena Skyt Nielsen, 2023. "A Guide to Impact Evaluation under Sample Selection and Missing Data: Teacher's Aides and Adolescent Mental Health," Papers 2308.04963, arXiv.org.
    6. Michela Bia & German Blanco & Marie Valentova, 2021. "The Causal Impact of Taking Parental Leave on Wages: Evidence from 2005 to 2015," LISER Working Paper Series 2021-08, Luxembourg Institute of Socio-Economic Research (LISER).
    7. Gilbert Peter B. & Blette Bryan S. & Shepherd Bryan E. & Hudgens Michael G., 2020. "Post-randomization Biomarker Effect Modification Analysis in an HIV Vaccine Clinical Trial," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 54-69, January.
    8. Gayani Rathnayake & Akanksha Negi & Otavio Bartalotti & Xueyan Zhao, 2024. "Difference-in-Differences with Sample Selection," Papers 2411.09221, arXiv.org, revised Dec 2024.
    9. Alessandra Mattei & Fabrizia Mealli & Barbara Pacini, 2014. "Identification of causal effects in the presence of nonignorable missing outcome values," Biometrics, The International Biometric Society, vol. 70(2), pages 278-288, June.
    10. Phillip Heiler & Asbj{o}rn Kaufmann & Bezirgen Veliyev, 2024. "Treatment Evaluation at the Intensive and Extensive Margins," Papers 2412.11179, arXiv.org.
    11. Mealli Fabrizia & Mattei Alessandra, 2012. "A Refreshing Account of Principal Stratification," The International Journal of Biostatistics, De Gruyter, vol. 8(1), pages 1-19, April.
    12. McGovern, Mark E. & Canning, David & Bärnighausen, Till, 2018. "Accounting for non-response bias using participation incentives and survey design: An application using gift vouchers," Economics Letters, Elsevier, vol. 171(C), pages 239-244.
    13. Giovanni Mellace & Roberto Rocci, 2011. "Principal Stratification in sample selection problems with non normal error terms," CEIS Research Paper 194, Tor Vergata University, CEIS, revised 02 May 2011.
    14. Markus Frölich & Martin Huber, 2014. "Treatment Evaluation With Multiple Outcome Periods Under Endogeneity and Attrition," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1697-1711, December.
    15. Martin Huber & Giovanni Mellace, 2014. "Testing exclusion restrictions and additive separability in sample selection models," Empirical Economics, Springer, vol. 47(1), pages 75-92, August.
    16. VanderWeele Tyler J, 2011. "Principal Stratification -- Uses and Limitations," The International Journal of Biostatistics, De Gruyter, vol. 7(1), pages 1-14, July.
    17. Flores, Carlos A. & Flores-Lagunes, Alfonso, 2009. "Identification and Estimation of Causal Mechanisms and Net Effects of a Treatment under Unconfoundedness," IZA Discussion Papers 4237, Institute of Labor Economics (IZA).
    18. Dustin M. Long & Michael G. Hudgens, 2013. "Sharpening Bounds on Principal Effects with Covariates," Biometrics, The International Biometric Society, vol. 69(4), pages 812-819, December.
    19. Phillip Heiler, 2022. "Heterogeneous Treatment Effect Bounds under Sample Selection with an Application to the Effects of Social Media on Political Polarization," Papers 2209.04329, arXiv.org, revised Jul 2024.
    20. Wenlong Ji & Lihua Lei & Asher Spector, 2023. "Model-Agnostic Covariate-Assisted Inference on Partially Identified Causal Effects," Papers 2310.08115, arXiv.org, revised Nov 2024.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2411.18772. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.