IDEAS home Printed from https://ideas.repec.org/p/crs/wpaper/2025-03.html
   My bibliography  Save this paper

Under the null of valid specification, pre-tests cannot make post-test inference liberal

Author

Listed:
  • Clément de Chaisemartin

    (Sciences Po Paris)

  • Xavier D’Haultfoeuille

    (CREST-ENSAE)

Abstract

Consider a parameter of interest, which can be consistently estimated under some conditions. Suppose also that we can at least partly test these conditions with specification tests. We consider the common practice of conducting inference on the parameter of interest conditional on not rejecting these tests. We show that if the tested conditions hold, conditional inference is valid, though possibly conservative. This holds generally, without imposing any assumption on the asymptotic dependence between the estimator of the parameter of interest and the specification test.

Suggested Citation

  • Clément de Chaisemartin & Xavier D’Haultfoeuille, 2025. "Under the null of valid specification, pre-tests cannot make post-test inference liberal," Working Papers 2025-03, Center for Research in Economics and Statistics.
    • Handle: RePEc:crs:wpaper:2025-03
    as

    Download full text from publisher

    File URL: http://crest.science/RePEc/wpstorage/2025-03.pdf
    File Function: CREST working paper version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Toru Kitagawa, 2015. "A Test for Instrument Validity," Econometrica, Econometric Society, vol. 83(5), pages 2043-2063, September.
    3. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    4. Sun, Liyang & Abraham, Sarah, 2021. "Estimating dynamic treatment effects in event studies with heterogeneous treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 175-199.
    5. Lee, David S., 2008. "Randomized experiments from non-random selection in U.S. House elections," Journal of Econometrics, Elsevier, vol. 142(2), pages 675-697, February.
    6. Angelini, Giovanni & Cavaliere, Giuseppe & Fanelli, Luca, 2024. "An identification and testing strategy for proxy-SVARs with weak proxies," Journal of Econometrics, Elsevier, vol. 238(2).
    7. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    8. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    9. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    10. Jonathan Roth, 2022. "Pretest with Caution: Event-Study Estimates after Testing for Parallel Trends," American Economic Review: Insights, American Economic Association, vol. 4(3), pages 305-322, September.
    11. José Luis Montiel Olea & Mikkel Plagborg‐Møller, 2019. "Simultaneous confidence bands: Theory, implementation, and an application to SVARs," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(1), pages 1-17, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    2. Arne Henningsen & Guy Low & David Wuepper & Tobias Dalhaus & Hugo Storm & Dagim Belay & Stefan Hirsch, 2024. "Estimating Causal Effects with Observational Data: Guidelines for Agricultural and Applied Economists," IFRO Working Paper 2024/03, University of Copenhagen, Department of Food and Resource Economics.
    3. Yoichi Arai & Yu‐Chin Hsu & Toru Kitagawa & Ismael Mourifié & Yuanyuan Wan, 2022. "Testing identifying assumptions in fuzzy regression discontinuity designs," Quantitative Economics, Econometric Society, vol. 13(1), pages 1-28, January.
    4. Volker Schöer & Debra Shepherd, 2013. "Compulsory tutorial programmes and performance in undergraduate microeconomics: A regression discontinuity design," Working Papers 27/2013, Stellenbosch University, Department of Economics.
    5. David Card & David S. Lee & Zhuan Pei & Andrea Weber, 2015. "Inference on Causal Effects in a Generalized Regression Kink Design," Econometrica, Econometric Society, vol. 83, pages 2453-2483, November.
    6. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    7. John DiNardo & David S. Lee, 2010. "Program Evaluation and Research Designs," Working Papers 1228, Princeton University, Department of Economics, Industrial Relations Section..
    8. Juan Carlos Calcagno & Bridget Terry Long, 2008. "The Impact of Postsecondary Remediation Using a Regression Discontinuity Approach: Addressing Endogenous Sorting and Noncompliance," NBER Working Papers 14194, National Bureau of Economic Research, Inc.
    9. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    10. Hsu, Yu-Chin & Shiu, Ji-Liang & Wan, Yuanyuan, 2024. "Testing identification conditions of LATE in fuzzy regression discontinuity designs," Journal of Econometrics, Elsevier, vol. 241(1).
    11. DiNardo, John & Lee, David S., 2011. "Program Evaluation and Research Designs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 5, pages 463-536, Elsevier.
    12. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    13. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    14. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    15. Jiang, Wei & Lu, Yi & Xie, Huihua, 2020. "Education and mental health: Evidence and mechanisms," Journal of Economic Behavior & Organization, Elsevier, vol. 180(C), pages 407-437.
    16. Porter, Jack & Yu, Ping, 2015. "Regression discontinuity designs with unknown discontinuity points: Testing and estimation," Journal of Econometrics, Elsevier, vol. 189(1), pages 132-147.
    17. Strazzeri, Maurizio, 2021. "Assessing the Role of Asylum Policies in Refugees' Labor Market Integration: The Case of Protection Statuses in the German Asylum System," VfS Annual Conference 2021 (Virtual Conference): Climate Economics 242395, Verein für Socialpolitik / German Economic Association.
    18. Steven F. Koch, 2017. "User Fee Abolition and the Demand for Public Health Care," South African Journal of Economics, Economic Society of South Africa, vol. 85(2), pages 242-258, June.
    19. Dor Leventer & Daniel Nevo, 2024. "Correcting invalid regression discontinuity designs with multiple time period data," Papers 2408.05847, arXiv.org, revised Feb 2025.
    20. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:crs:wpaper:2025-03. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Secretariat General (email available below). General contact details of provider: https://edirc.repec.org/data/crestfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.