IDEAS home Printed from https://ideas.repec.org/a/eee/ecolet/v120y2013i3p389-391.html
   My bibliography  Save this article

A simple test for the ignorability of non-compliance in experiments

Author

Listed:
  • Huber, Martin

Abstract

This paper proposes a simple method for testing whether non-compliance in experiments is ignorable, i.e., not jointly related to the treatment and the outcome. The approach consists of (i) regressing the outcome variable on a constant, the treatment, the assignment indicator, and the treatment/assignment interaction and (ii) testing whether the coefficients on the latter two variables are jointly equal to zero. A brief simulation study illustrates the finite sample properties of the test.

Suggested Citation

  • Huber, Martin, 2013. "A simple test for the ignorability of non-compliance in experiments," Economics Letters, Elsevier, vol. 120(3), pages 389-391.
    • Handle: RePEc:eee:ecolet:v:120:y:2013:i:3:p:389-391
    DOI: 10.1016/j.econlet.2013.05.018
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0165176513002553
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.econlet.2013.05.018?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Stephen G. Donald & Yu-Chin Hsu & Robert P. Lieli, 2014. "Testing the Unconfoundedness Assumption via Inverse Probability Weighted Estimators of (L)ATT," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(3), pages 395-415, July.
    2. de Luna, Xavier & Johansson, Per, 2012. "Testing for Nonparametric Identification of Causal Effects in the Presence of a Quasi-Instrument," IZA Discussion Papers 6692, Institute of Labor Economics (IZA).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Black, Dan A. & Joo, Joonhwi & LaLonde, Robert & Smith, Jeffrey A. & Taylor, Evan J., 2022. "Simple Tests for Selection: Learning More from Instrumental Variables," Labour Economics, Elsevier, vol. 79(C).
    2. Tarek Azzam & Michael Bates & David Fairris, 2019. "Do Learning Communities Increase First Year College Retention? Testing Sample Selection and External Validity of Randomized Control Trials," Working Papers 202002, University of California at Riverside, Department of Economics.
    3. Martin Huber, 2019. "An introduction to flexible methods for policy evaluation," Papers 1910.00641, arXiv.org.
    4. Nicolas Apfel & Julia Hatamyar & Martin Huber & Jannis Kueck, 2024. "Learning control variables and instruments for causal analysis in observational data," Papers 2407.04448, arXiv.org.
    5. Azzam, Tarek & Bates, Michael D. & Fairris, David, 2022. "Do learning communities increase first year college retention? Evidence from a randomized control trial," Economics of Education Review, Elsevier, vol. 89(C).
    6. Amanda E Kowalski, 2023. "Behaviour within a Clinical Trial and Implications for Mammography Guidelines," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(1), pages 432-462.
    7. Huber Martin & Wüthrich Kaspar, 2019. "Local Average and Quantile Treatment Effects Under Endogeneity: A Review," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-27, January.
    8. Khalil, Umair & Yıldız, Neşe, 2022. "A test of the selection on observables assumption using a discontinuously distributed covariate," Journal of Econometrics, Elsevier, vol. 226(2), pages 423-450.
    9. Huber, Martin & Wüthrich, Kaspar, 2017. "Evaluating local average and quantile treatment effects under endogeneity based on instruments: a review," FSES Working Papers 479, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    10. Martin Huber & Jannis Kueck, 2022. "Testing the identification of causal effects in observational data," Papers 2203.15890, arXiv.org, revised Jun 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gerry H. Makepeace & Michael J. Peel, 2013. "Combining information from Heckman and matching estimators: testing and controlling for hidden bias," Economics Bulletin, AccessEcon, vol. 33(3), pages 2422-2436.
    2. Huber Martin & Wüthrich Kaspar, 2019. "Local Average and Quantile Treatment Effects Under Endogeneity: A Review," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-27, January.
    3. de Luna, Xavier & Johansson, Per, 2012. "Testing for Nonparametric Identification of Causal Effects in the Presence of a Quasi-Instrument," IZA Discussion Papers 6692, Institute of Labor Economics (IZA).
    4. Wei Huang & Oliver Linton & Zheng Zhang, 2021. "A Unified Framework for Specification Tests of Continuous Treatment Effect Models," Papers 2102.08063, arXiv.org, revised Sep 2021.
    5. Donald, Stephen G. & Hsu, Yu-Chin, 2014. "Estimation and inference for distribution functions and quantile functions in treatment effect models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 383-397.
    6. Tymon Sloczynski & S. Derya Uysal & Jeffrey M. Wooldridge & Derya Uysal, 2022. "Doubly Robust Estimation of Local Average Treatment Effects Using Inverse Probability Weighted Regression Adjustment," CESifo Working Paper Series 10105, CESifo.
    7. Jason Abrevaya & Yu-Chin Hsu & Robert P. Lieli, 2015. "Estimating Conditional Average Treatment Effects," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(4), pages 485-505, October.
    8. Black, Dan A. & Joo, Joonhwi & LaLonde, Robert & Smith, Jeffrey A. & Taylor, Evan J., 2022. "Simple Tests for Selection: Learning More from Instrumental Variables," Labour Economics, Elsevier, vol. 79(C).
    9. Fang, Ying & Tang, Shengfang & Cai, Zongwu & Lin, Ming, 2020. "An alternative test for conditional unconfoundedness using auxiliary variables," Economics Letters, Elsevier, vol. 194(C).
    10. Tymon S{l}oczy'nski, 2020. "When Should We (Not) Interpret Linear IV Estimands as LATE?," Papers 2011.06695, arXiv.org, revised Oct 2024.
    11. Shengfang Tang & Zongwu Cai & Ying Fang & Ming Lin, 2019. "Testing Unconfoundedness Assumption Using Auxiliary Variables," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 201905, University of Kansas, Department of Economics, revised Mar 2019.
    12. Bedoya Arguelles,Guadalupe & Bittarello,Luca & Davis,Jonathan Martin Villars & Mittag,Nikolas Karl & Bedoya Arguelles,Guadalupe & Bittarello,Luca & Davis,Jonathan Martin Villars & Mittag,Nikolas Karl, 2017. "Distributional impact analysis: toolkit and illustrations of impacts beyond the average treatment effect," Policy Research Working Paper Series 8139, The World Bank.
    13. Hsu Yu-Chin & Huber Martin & Lai Tsung-Chih, 2019. "Nonparametric estimation of natural direct and indirect effects based on inverse probability weighting," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-20, January.
    14. Donald, Stephen G. & Hsu, Yu-Chin & Lieli, Robert P., 2014. "Inverse probability weighted estimation of local average treatment effects: A higher order MSE expansion," Statistics & Probability Letters, Elsevier, vol. 95(C), pages 132-138.
    15. Ying Fang & Ming Lin & Shengfang Tang & Zongwu Cai, 2021. "Testing Conditional Independence in Macroeconomic Policy Evaluation for Time Series Data," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202118, University of Kansas, Department of Economics, revised Sep 2021.
    16. Zongwu Cai & Ying Fang & Ming Lin & Shengfang Tang, 2020. "Testing Unconfoundedness Assumption Using Auxiliary Variables," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202004, University of Kansas, Department of Economics, revised Feb 2020.
    17. Martin Huber & Jannis Kueck, 2022. "Testing the identification of causal effects in observational data," Papers 2203.15890, arXiv.org, revised Jun 2023.
    18. Slichter, David, 2020. "Smile: A Simple Diagnostic for Selection on Observables," MPRA Paper 99921, University Library of Munich, Germany.
    19. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    20. Zeqin Liu & Zongwu Cai & Ying Fang & Ming Lin, 2019. "Statistical Analysis and Evaluation of Macroeconomic Policies: A Selective Review," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 201904, University of Kansas, Department of Economics, revised Mar 2019.

    More about this item

    Keywords

    Experiment; Treatment effects; Non-compliance; Endogeneity; Test;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecolet:v:120:y:2013:i:3:p:389-391. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ecolet .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.