IDEAS home Printed from https://ideas.repec.org/a/inm/ormksc/v42y2023i4p746-767.html
   My bibliography  Save this article

Augmented Difference-in-Differences

Author

Listed:
  • Kathleen T. Li

    (McCombs School of Business, University of Texas at Austin, Austin, Texas 78705)

  • Christophe Van den Bulte

    (The Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania 19104)

Abstract

Marketing scientists often estimate causal effects using data from pre/post test/control quasi-experimental settings. We propose a new, easy-to-implement augmented difference-in-differences (ADID) method that complements existing approaches to estimate the average treatment effect on the treated (ATT) from such data. Its advantage over the difference-in-differences method is that it can better handle heterogeneity between treatment and control units and, hence, requires a less stringent causal identification assumption. Its advantages over more flexible approaches like the synthetic control method are that it is easy to implement, provides easy-to-compute confidence intervals, and can be applied to data where the synthetic control and related methods cannot be applied or may not be well suited. Examples are data with short pre- and posttreatment periods or with a large number of treatment and control units. Using analytical proofs, simulations, and nine empirical applications, we document the attractive properties of ADID and provide guidance on what method(s) to use when. With the addition of ADID in their toolkit, marketers are better equipped to address important causal research questions in a wider range of data structures.

Suggested Citation

  • Kathleen T. Li & Christophe Van den Bulte, 2023. "Augmented Difference-in-Differences," Marketing Science, INFORMS, vol. 42(4), pages 746-767, July.
  • Handle: RePEc:inm:ormksc:v:42:y:2023:i:4:p:746-767
    DOI: 10.1287/mksc.2022.1406
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mksc.2022.1406
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mksc.2022.1406?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Maria Petrova & Ananya Sen & Pinar Yildirim, 2021. "Social Media and Political Contributions: The Impact of New Technology on Political Competition," Management Science, INFORMS, vol. 67(5), pages 2997-3021, May.
    2. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    3. Kathleen T. Li, 2020. "Statistical Inference for Average Treatment Effects Estimated by Synthetic Control Methods," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(532), pages 2068-2083, December.
    4. André Bonfrer & Pradeep K. Chintagunta & John H. Roberts & David Corkindale, 2020. "Assessing the Sales Impact of Plain Packaging Regulation for Cigarettes: Evidence from Australia," Marketing Science, INFORMS, vol. 39(1), pages 234-252, January.
    5. Li, Kathleen T. & Bell, David R., 2017. "Estimation of average treatment effects with panel data: Asymptotic theory and implementation," Journal of Econometrics, Elsevier, vol. 197(1), pages 65-75.
    6. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    7. Alberto Abadie, 2021. "Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 391-425, June.
    8. Jianqing Fan & Ricardo Masini & Marcelo C. Medeiros, 2022. "Do We Exploit all Information for Counterfactual Analysis? Benefits of Factor Models and Idiosyncratic Correction," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(538), pages 574-590, April.
    9. Nikolay Doudchenko & Guido W. Imbens, 2016. "Balancing, Regression, Difference-In-Differences and Synthetic Control Methods: A Synthesis," NBER Working Papers 22791, National Bureau of Economic Research, Inc.
    10. Cheng Hsiao & H. Steve Ching & Shui Ki Wan, 2012. "A Panel Data Approach For Program Evaluation: Measuring The Benefits Of Political And Economic Integration Of Hong Kong With Mainland China," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(5), pages 705-740, August.
    11. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jared Amani Greathouse & Mani Bayani & Jason Coupet, 2023. "Splash! Robustifying Donor Pools for Policy Studies," Papers 2308.13688, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2022. "Same Root Different Leaves: Time Series and Cross-Sectional Methods in Panel Data," Papers 2207.14481, arXiv.org, revised Oct 2022.
    2. Li, Xingyu & Shen, Yan & Zhou, Qiankun, 2024. "Confidence intervals of treatment effects in panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 240(1).
    3. Joseph Fry, 2023. "A Method of Moments Approach to Asymptotically Unbiased Synthetic Controls," Papers 2312.01209, arXiv.org, revised Mar 2024.
    4. Viviano, Davide & Bradic, Jelena, 2023. "Synthetic Learner: Model-free inference on treatments over time," Journal of Econometrics, Elsevier, vol. 234(2), pages 691-713.
    5. Echevarría, Cruz A. & Hasancebi, Serhat & García-Enríquez, Javier, 2022. "Economic Effects of Macao’s Integration with Mainland China: A Causal Inference Study," Journal of Economic Integration, Center for Economic Integration, Sejong University, vol. 37(2), pages 179-215.
    6. Andrii Melnychuk, 2024. "Synthetic Controls with spillover effects: A comparative study," Papers 2405.01645, arXiv.org.
    7. Carvalho, Carlos & Masini, Ricardo & Medeiros, Marcelo C., 2018. "ArCo: An artificial counterfactual approach for high-dimensional panel time-series data," Journal of Econometrics, Elsevier, vol. 207(2), pages 352-380.
    8. Gharehgozli, Orkideh, 2021. "An empirical comparison between a regression framework and the Synthetic Control Method," The Quarterly Review of Economics and Finance, Elsevier, vol. 81(C), pages 70-81.
    9. David Gilchrist & Thomas Emery & Nuno Garoupa & Rok Spruk, 2023. "Synthetic Control Method: A tool for comparative case studies in economic history," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 409-445, April.
    10. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2023. "Same Root Different Leaves: Time Series and Cross‐Sectional Methods in Panel Data," Econometrica, Econometric Society, vol. 91(6), pages 2125-2154, November.
    11. Jianqing Fan & Ricardo Masini & Marcelo C. Medeiros, 2022. "Do We Exploit all Information for Counterfactual Analysis? Benefits of Factor Models and Idiosyncratic Correction," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(538), pages 574-590, April.
    12. Xin, Mengwei & Shalaby, Amer & Feng, Shumin & Zhao, Hu, 2021. "Impacts of COVID-19 on urban rail transit ridership using the Synthetic Control Method," Transport Policy, Elsevier, vol. 111(C), pages 1-16.
    13. Carlos Viana de Carvalho & Ricardo Masini & Marcelo Cunha Medeiros, 2016. "The perils of Counterfactual Analysis with Integrated Processes," Textos para discussão 654, Department of Economics PUC-Rio (Brazil).
    14. Luya Wang & Jeffrey S. Racine & Qiaoyu Wang, 2024. "Bootstrap Inference on a Factor Model Based Average Treatment Effects Estimator," Department of Economics Working Papers 2024-03, McMaster University.
    15. Ignacio Martinez & Jaume Vives-i-Bastida, 2022. "Bayesian and Frequentist Inference for Synthetic Controls," Papers 2206.01779, arXiv.org, revised Jul 2024.
    16. Kathleen T. Li, 2024. "Frontiers: A Simple Forward Difference-in-Differences Method," Marketing Science, INFORMS, vol. 43(2), pages 267-279, March.
    17. Bruno Ferman & Cristine Pinto, 2021. "Synthetic controls with imperfect pretreatment fit," Quantitative Economics, Econometric Society, vol. 12(4), pages 1197-1221, November.
    18. Luis Costa & Vivek F. Farias & Patricio Foncea & Jingyuan (Donna) Gan & Ayush Garg & Ivo Rosa Montenegro & Kumarjit Pathak & Tianyi Peng & Dusan Popovic, 2023. "Generalized Synthetic Control for TestOps at ABI: Models, Algorithms, and Infrastructure," Interfaces, INFORMS, vol. 53(5), pages 336-349, September.
    19. Masahiro Kato & Akari Ohda & Masaaki Imaizumi, 2023. "Asymptotically Unbiased Synthetic Control Methods by Distribution Matching," Papers 2307.11127, arXiv.org, revised May 2024.
    20. Victor Chernozhukov & Kaspar Wüthrich & Yinchu Zhu, 2019. "Inference on average treatment effects in aggregate panel data settings," CeMMAP working papers CWP32/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormksc:v:42:y:2023:i:4:p:746-767. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.