IDEAS home Printed from https://ideas.repec.org/p/ucr/wpaper/201902.html
   My bibliography  Save this paper

A Combined Estimator of Regression Models with Measurement Errors

Author

Listed:
  • Tae-Hwy Lee

    (Department of Economics, University of California Riverside)

  • Bai Huang

    (CUFE)

  • Aman Ullah

    (UCR)

Abstract

When the regressors are observed with measurement errors, the OLS estimator is inconsistent and typically the use of the IV estimator is recommended. In this paper we place this recommendation under scrutiny, especially (i) when the instruments are weak and (ii) when there are many instruments. Following Hansen (2017), we use the Hausman (1978) test for errors in variables to combine OLS and IV estimators. The combined estimator has the asymptotic risk strictly less than that of the IV estimator. Then we show some useful findings for small samples based on the Monte Carlo simulations. In terms of the mean squared error risk, we find that (a) typically OLS gets worse as the measurement error gets larger while IV is more robust and better than OLS, (b) OLS can be better than IV when the measurement error is small, and (c) the combined estimator outperforms IV as the asymptotic result predicts. (a) and (b) are true only when the instruments are not weak and when there are not many instruments. However, when the instruments are weak or when there are many instruments: (c) still holds as it is a theorem, but (a), (b) turn out to become quite the opposite, i.e., OLS can be much better than IV even when measurement error is large. This happens because IV is known to be inconsistent with weak instruments and many instruments (Staiger and Stock 1997, Bekker 1994), and can be much worse than OLS, making the combined estimator close to OLS. In that case, the typical recommendation to use IV should be guided by the combined estimator, and IV and the combined estimator need to be regularized for weak instruments and many instruments.

Suggested Citation

  • Tae-Hwy Lee & Bai Huang & Aman Ullah, 2017. "A Combined Estimator of Regression Models with Measurement Errors," Working Papers 201902, University of California at Riverside, Department of Economics.
  • Handle: RePEc:ucr:wpaper:201902
    as

    Download full text from publisher

    File URL: https://economics.ucr.edu/repec/ucr/wpaper/201902.pdf
    File Function: First version, 2017
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Matthew Harding & Jerry Hausman & Christopher J. Palmer, 2016. "Finite Sample BIAS Corrected IV Estimation for Weak and Many Instruments," Advances in Econometrics, in: Essays in Honor of Aman Ullah, volume 36, pages 245-273, Emerald Group Publishing Limited.
    2. Carrasco, Marine, 2012. "A regularization approach to the many instruments problem," Journal of Econometrics, Elsevier, vol. 170(2), pages 383-398.
    3. Victor Chernozhukov & Christian Hansen & Martin Spindler, 2015. "Post-Selection and Post-Regularization Inference in Linear Models with Many Controls and Instruments," American Economic Review, American Economic Association, vol. 105(5), pages 486-490, May.
    4. Whitney K. Newey & Frank Windmeijer, 2009. "Generalized Method of Moments With Many Weak Moment Conditions," Econometrica, Econometric Society, vol. 77(3), pages 687-719, May.
    5. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    6. Bruce E. Hansen, 2017. "Stein-like 2SLS estimator," Econometric Reviews, Taylor & Francis Journals, vol. 36(6-9), pages 840-852, October.
    7. Cheng, Xu & Liao, Zhipeng, 2015. "Select the valid and relevant moments: An information-based LASSO for GMM with many moments," Journal of Econometrics, Elsevier, vol. 186(2), pages 443-464.
    8. Bekker, Paul A, 1994. "Alternative Approximations to the Distributions of Instrumental Variable Estimators," Econometrica, Econometric Society, vol. 62(3), pages 657-681, May.
    9. A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012. "Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain," Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
    10. Chao, John & Swanson, Norman R., 2007. "Alternative approximations of the bias and MSE of the IV estimator under weak identification with an application to bias correction," Journal of Econometrics, Elsevier, vol. 137(2), pages 515-555, April.
    11. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    12. Hansen, Christian & Hausman, Jerry & Newey, Whitney, 2008. "Estimation With Many Instrumental Variables," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 398-422.
    13. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    14. Alexander Chudik & George Kapetanios & M. Hashem Pesaran, 2016. "Big Data Analytics: A New Perspective," CESifo Working Paper Series 5824, CESifo.
    15. DiTraglia, Francis J., 2016. "Using invalid instruments on purpose: Focused moment selection and averaging for GMM," Journal of Econometrics, Elsevier, vol. 195(2), pages 187-208.
    16. Victor Chernozhukov & Christian Hansen, 2005. "An IV Model of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 73(1), pages 245-261, January.
    17. V. Chernozhukov & C. Hansen, 2013. "Quantile Models with Endogeneity," Annual Review of Economics, Annual Reviews, vol. 5(1), pages 57-81, May.
    18. Caner, Mehmet, 2009. "Lasso-Type Gmm Estimator," Econometric Theory, Cambridge University Press, vol. 25(1), pages 270-290, February.
    19. Victor Chernozhukov & Christian Hansen, 2004. "The Effects of 401(K) Participation on the Wealth Distribution: An Instrumental Quantile Regression Analysis," The Review of Economics and Statistics, MIT Press, vol. 86(3), pages 735-751, August.
    20. Chernozhukov, Victor & Hansen, Christian, 2006. "Instrumental quantile regression inference for structural and treatment effect models," Journal of Econometrics, Elsevier, vol. 132(2), pages 491-525, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guo, Zijian & Kang, Hyunseung & Cai, T. Tony & Small, Dylan S., 2018. "Testing endogeneity with high dimensional covariates," Journal of Econometrics, Elsevier, vol. 207(1), pages 175-187.
    2. Frank Windmeijer & Helmut Farbmacher & Neil Davies & George Davey Smith, 2019. "On the Use of the Lasso for Instrumental Variables Estimation with Some Invalid Instruments," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(527), pages 1339-1350, July.
    3. Carrasco, Marine & Tchuente, Guy, 2015. "Regularized LIML for many instruments," Journal of Econometrics, Elsevier, vol. 186(2), pages 427-442.
    4. Xu Cheng & Zhipeng Liao, 2012. "Select the Valid and Relevant Moments: A One-Step Procedure for GMM with Many Moments," PIER Working Paper Archive 12-045, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    5. Marine Carrasco & Guy Tchuente, 2016. "Efficient Estimation with Many Weak Instruments Using Regularization Techniques," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1609-1637, December.
    6. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    7. Anna Mikusheva & Liyang Sun, 2024. "Weak identification with many instruments," The Econometrics Journal, Royal Economic Society, vol. 27(2), pages -28.
    8. Guy Tchuente, 2019. "Weak Identification and Estimation of Social Interaction Models," Papers 1902.06143, arXiv.org.
    9. Guy Tchuente, 2021. "A Note on the Topology of the First Stage of 2SLS with Many Instruments," Papers 2106.15003, arXiv.org.
    10. Sølvsten, Mikkel, 2020. "Robust estimation with many instruments," Journal of Econometrics, Elsevier, vol. 214(2), pages 495-512.
    11. Hao Hao & Bai Huang & Tae-hwy Lee, 2024. "Model averaging estimation of panel data models with many instruments and boosting," Journal of Applied Statistics, Taylor & Francis Journals, vol. 51(1), pages 53-69, January.
    12. Alena Skolkova, 2023. "Instrumental Variable Estimation with Many Instruments Using Elastic-Net IV," CERGE-EI Working Papers wp759, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    13. Hansen, Christian & Kozbur, Damian, 2014. "Instrumental variables estimation with many weak instruments using regularized JIVE," Journal of Econometrics, Elsevier, vol. 182(2), pages 290-308.
    14. Yiqi Lin & Frank Windmeijer & Xinyuan Song & Qingliang Fan, 2022. "On the instrumental variable estimation with many weak and invalid instruments," Papers 2207.03035, arXiv.org, revised Dec 2023.
    15. A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012. "Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain," Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
    16. Dakyung Seong, 2022. "Binary response model with many weak instruments," Papers 2201.04811, arXiv.org, revised Jun 2024.
    17. Lim, Dennis & Wang, Wenjie & Zhang, Yichong, 2024. "A conditional linear combination test with many weak instruments," Journal of Econometrics, Elsevier, vol. 238(2).
    18. repec:bla:ecorec:v:91:y:2015:i::p:1-24 is not listed on IDEAS
    19. Dennis Lim & Wenjie Wang & Yichong Zhang, 2022. "A Conditional Linear Combination Test with Many Weak Instruments," Papers 2207.11137, arXiv.org, revised Apr 2023.
    20. Zhaonan Qu & Yongchan Kwon, 2024. "Distributionally Robust Instrumental Variables Estimation," Papers 2410.15634, arXiv.org.
    21. Zhu, Ying, 2013. "Sparse Linear Models and Two-Stage Estimation in High-Dimensional Settings with Possibly Many Endogenous Regressors," MPRA Paper 49846, University Library of Munich, Germany.

    More about this item

    Keywords

    OLS; IV; measurement errors; weak instruments; many instruments; regularized combined estimator.;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C33 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Models with Panel Data; Spatio-temporal Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ucr:wpaper:201902. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kelvin Mac (email available below). General contact details of provider: https://edirc.repec.org/data/deucrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.