IDEAS home Printed from https://ideas.repec.org/a/eee/ecolet/v207y2021ics0165176521002925.html
   My bibliography  Save this article

A simple and robust counterfactual impact evaluation

Author

Listed:
  • Du, Zaichao
  • Pei, Pei

Abstract

This paper proposes a simple and robust method for evaluating the effect of a policy intervention or an event of interest. As confirmed by some Monte Carlo studies, our method produces more robust and accurate counterfactuals than the existing methods.

Suggested Citation

  • Du, Zaichao & Pei, Pei, 2021. "A simple and robust counterfactual impact evaluation," Economics Letters, Elsevier, vol. 207(C).
    • Handle: RePEc:eee:ecolet:v:207:y:2021:i:c:s0165176521002925
    DOI: 10.1016/j.econlet.2021.110015
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0165176521002925
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.econlet.2021.110015?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    2. Cheng Hsiao & H. Steve Ching & Shui Ki Wan, 2012. "A Panel Data Approach For Program Evaluation: Measuring The Benefits Of Political And Economic Integration Of Hong Kong With Mainland China," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(5), pages 705-740, August.
    3. Bai, ChongEn & Li, Qi & Ouyang, Min, 2014. "Property taxes and home prices: A tale of two cities," Journal of Econometrics, Elsevier, vol. 180(1), pages 1-15.
    4. Du, Zaichao & Zhang, Lin, 2015. "Home-purchase restriction, property tax and housing price in China: A counterfactual analysis," Journal of Econometrics, Elsevier, vol. 188(2), pages 558-568.
    5. Li, Kathleen T. & Bell, David R., 2017. "Estimation of average treatment effects with panel data: Asymptotic theory and implementation," Journal of Econometrics, Elsevier, vol. 197(1), pages 65-75.
    6. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carvalho, Carlos & Masini, Ricardo & Medeiros, Marcelo C., 2018. "ArCo: An artificial counterfactual approach for high-dimensional panel time-series data," Journal of Econometrics, Elsevier, vol. 207(2), pages 352-380.
    2. Shi, Zhentao & Huang, Jingyi, 2023. "Forward-selected panel data approach for program evaluation," Journal of Econometrics, Elsevier, vol. 234(2), pages 512-535.
    3. Hongjun Li & Zheng Li & Cheng Hsiao, 2023. "Assessing the impacts of pandemic and the increase in minimum down payment rate on Shanghai housing prices," Empirical Economics, Springer, vol. 64(6), pages 2661-2682, June.
    4. Carlos Viana de Carvalho & Ricardo Masini & Marcelo Cunha Medeiros, 2016. "The perils of Counterfactual Analysis with Integrated Processes," Textos para discussão 654, Department of Economics PUC-Rio (Brazil).
    5. Shih-Chih Chen & Jianing Hou & De Xiao, 2018. "“One Belt, One Road” Initiative to Stimulate Trade in China: A Counter-Factual Analysis," Sustainability, MDPI, vol. 10(9), pages 1-13, September.
    6. Zhentao Shi & Jingyi Huang, 2019. "Forward-Selected Panel Data Approach for Program Evaluation," Papers 1908.05894, arXiv.org, revised Apr 2021.
    7. Sayoni Roychowdhury & Indrila Ganguly & Abhik Ghosh, 2021. "Robust Estimation of Average Treatment Effects from Panel Data," Papers 2112.13228, arXiv.org, revised Dec 2022.
    8. Fu, Yifan & Zhong, Shiquan & Ling, Shuai & He, Zhengbing, 2024. "Closing the loophole of vehicle ownership restriction: The impact of non-local vehicle restriction on new vehicle registrations and air pollution," Transportation Research Part A: Policy and Practice, Elsevier, vol. 185(C).
    9. Viviano, Davide & Bradic, Jelena, 2023. "Synthetic Learner: Model-free inference on treatments over time," Journal of Econometrics, Elsevier, vol. 234(2), pages 691-713.
    10. Andrii Melnychuk, 2024. "Synthetic Controls with spillover effects: A comparative study," Papers 2405.01645, arXiv.org.
    11. Du, Zaichao & Yin, Hua & Zhang, Lin, 2022. "Foreign buyer taxes and house prices in Canada: A tale of two cities," Journal of Housing Economics, Elsevier, vol. 55(C).
    12. Chirok Han, 2020. "Exact Trend Control in Estimating Treatment Effects Using Panel Data with Heterogenous Trends," Papers 2012.08988, arXiv.org.
    13. Fujiki, Hiroshi & Hsiao, Cheng, 2015. "Disentangling the effects of multiple treatments—Measuring the net economic impact of the 1995 great Hanshin-Awaji earthquake," Journal of Econometrics, Elsevier, vol. 186(1), pages 66-73.
    14. Pengyue Wu & Wenjing Xu & Jing Ma, 2024. "Policy Evolution and Effect Evaluation of Zhejiang Manufacturing Industry Based on Text Data," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(1), pages 2895-2932, March.
    15. Luya Wang & Jeffrey S. Racine & Qiaoyu Wang, 2024. "Bootstrap Inference on a Factor Model Based Average Treatment Effects Estimator," Department of Economics Working Papers 2024-03, McMaster University.
    16. Bruno Ferman & Cristine Pinto, 2021. "Synthetic controls with imperfect pretreatment fit," Quantitative Economics, Econometric Society, vol. 12(4), pages 1197-1221, November.
    17. Wang, Huiqiang, 2016. "Estimating the health impacts of food safety interventions: Optimal counterfactual selections via information criteria in small samples," Food Policy, Elsevier, vol. 63(C), pages 44-52.
    18. Anderson, Heather M. & Gao, Jiti & Turnip, Guido & Vahid, Farshid & Wei, Wei, 2023. "Estimating the effect of an EU-ETS type scheme in Australia using a synthetic treatment approach," Energy Economics, Elsevier, vol. 125(C).
    19. Victor Chernozhukov & Kaspar Wüthrich & Yinchu Zhu, 2019. "Inference on average treatment effects in aggregate panel data settings," CeMMAP working papers CWP32/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    20. Victor Chernozhukov & Kaspar Wuthrich & Yinchu Zhu, 2018. "A $t$-test for synthetic controls," Papers 1812.10820, arXiv.org, revised Jan 2024.

    More about this item

    Keywords

    Impact evaluation; Counterfactual;

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C33 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Models with Panel Data; Spatio-temporal Models
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecolet:v:207:y:2021:i:c:s0165176521002925. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ecolet .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.