IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v170y2012i2p383-398.html
   My bibliography  Save this article

A regularization approach to the many instruments problem

Author

Listed:
  • Carrasco, Marine

Abstract

This paper focuses on the estimation of a finite dimensional parameter in a linear model where the number of instruments is very large or infinite. In order to improve the small sample properties of standard instrumental variable (IV) estimators, we propose three modified IV estimators based on three different ways of inverting the covariance matrix of the instruments. These inverses involve a regularization or smoothing parameter. It should be stressed that no restriction on the number of instruments is needed and that all the instruments are used in the estimation. We show that the three estimators are asymptotically normal and attain the semiparametric efficiency bound. Higher-order analysis of the MSE reveals that the bias of the modified estimators does not depend on the number of instruments. Finally, we suggest a data-driven method for selecting the regularization parameter. Interestingly, our regularization techniques lead to a consistent nonparametric estimation of the optimal instrument.

Suggested Citation

  • Carrasco, Marine, 2012. "A regularization approach to the many instruments problem," Journal of Econometrics, Elsevier, vol. 170(2), pages 383-398.
    • Handle: RePEc:eee:econom:v:170:y:2012:i:2:p:383-398
    DOI: 10.1016/j.jeconom.2012.05.012
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407612001248
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jeconom.2012.05.012?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bai, Jushan & Ng, Serena, 2010. "Instrumental Variable Estimation In A Data Rich Environment," Econometric Theory, Cambridge University Press, vol. 26(6), pages 1577-1606, December.
    2. Manuel A. Domínguez & Ignacio N. Lobato, 2004. "Consistent Estimation of Models Defined by Conditional Moment Restrictions," Econometrica, Econometric Society, vol. 72(5), pages 1601-1615, September.
    3. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    4. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    5. Donald, Stephen G & Newey, Whitney K, 2001. "Choosing the Number of Instruments," Econometrica, Econometric Society, vol. 69(5), pages 1161-1191, September.
    6. Andersen, Torben G & Sorensen, Bent E, 1996. "GMM Estimation of a Stochastic Volatility Model: A Monte Carlo Study," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(3), pages 328-352, July.
    7. Linton, Oliver, 2002. "Edgeworth approximations for semiparametric instrumental variable estimators and test statistics," Journal of Econometrics, Elsevier, vol. 106(2), pages 325-368, February.
    8. Corbae,Dean & Durlauf,Steven N. & Hansen,Bruce E. (ed.), 2006. "Econometric Theory and Practice," Cambridge Books, Cambridge University Press, number 9780521807234, September.
    9. Bekker, Paul A, 1994. "Alternative Approximations to the Distributions of Instrumental Variable Estimators," Econometrica, Econometric Society, vol. 62(3), pages 657-681, May.
    10. Chen, Xiaohong & Linton, Oliver & Jacho-Chávez, David T., 2009. "An alternative way of computing efficient instrumental variable estimators," LSE Research Online Documents on Economics 58016, London School of Economics and Political Science, LSE Library.
    11. Carrasco, Marine & Florens, Jean-Pierre, 2000. "Generalization Of Gmm To A Continuum Of Moment Conditions," Econometric Theory, Cambridge University Press, vol. 16(6), pages 797-834, December.
    12. Doran, Howard E. & Schmidt, Peter, 2006. "GMM estimators with improved finite sample properties using principal components of the weighting matrix, with an application to the dynamic panel data model," Journal of Econometrics, Elsevier, vol. 133(1), pages 387-409, July.
    13. Carrasco, Marine & Florens, Jean-Pierre & Renault, Eric, 2007. "Linear Inverse Problems in Structural Econometrics Estimation Based on Spectral Decomposition and Regularization," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 77, Elsevier.
    14. Eastwood, Brian J. & Gallant, A. Ronald, 1991. "Adaptive Rules for Seminonparametric Estimators That Achieve Asymptotic Normality," Econometric Theory, Cambridge University Press, vol. 7(3), pages 307-340, September.
    15. Kuersteiner, Guido M., 2001. "Optimal instrumental variables estimation for ARMA models," Journal of Econometrics, Elsevier, vol. 104(2), pages 359-405, September.
    16. Carrasco, Marine & Chernov, Mikhail & Florens, Jean-Pierre & Ghysels, Eric, 2007. "Efficient estimation of general dynamic models with a continuum of moment conditions," Journal of Econometrics, Elsevier, vol. 140(2), pages 529-573, October.
    17. Hansen, Christian & Hausman, Jerry & Newey, Whitney, 2008. "Estimation With Many Instrumental Variables," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 398-422.
    18. Yuichi Kitamura & Gautam Tripathi & Hyungtaik Ahn, 2004. "Empirical Likelihood-Based Inference in Conditional Moment Restriction Models," Econometrica, Econometric Society, vol. 72(6), pages 1667-1714, November.
    19. Donald, Stephen G. & Imbens, Guido W. & Newey, Whitney K., 2003. "Empirical likelihood estimation and consistent tests with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 117(1), pages 55-93, November.
    20. Chamberlain, Gary & Rothschild, Michael, 1983. "Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets," Econometrica, Econometric Society, vol. 51(5), pages 1281-1304, September.
    21. Okui, Ryo, 2011. "Instrumental variable estimation in the presence of many moment conditions," Journal of Econometrics, Elsevier, vol. 165(1), pages 70-86.
    22. Dagenais, Marcel G. & Dagenais, Denyse L., 1997. "Higher moment estimators for linear regression models with errors in the variables," Journal of Econometrics, Elsevier, vol. 76(1-2), pages 193-221.
    23. Joshua D. Angrist & Alan B. Keueger, 1991. "Does Compulsory School Attendance Affect Schooling and Earnings?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 979-1014.
    24. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    25. Kuersteiner, Guido M., 2012. "Kernel-weighted GMM estimators for linear time series models," Journal of Econometrics, Elsevier, vol. 170(2), pages 399-421.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carrasco, Marine & Tchuente, Guy, 2015. "Regularized LIML for many instruments," Journal of Econometrics, Elsevier, vol. 186(2), pages 427-442.
    2. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    3. Gospodinov, Nikolay & Otsu, Taisuke, 2012. "Local GMM estimation of time series models with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 170(2), pages 476-490.
    4. Guy Tchuente, 2019. "Weak Identification and Estimation of Social Interaction Models," Papers 1902.06143, arXiv.org.
    5. Guy Tchuente, 2016. "Estimation of social interaction models using regularization," Studies in Economics 1607, School of Economics, University of Kent.
    6. repec:bla:ecorec:v:91:y:2015:i::p:1-24 is not listed on IDEAS
    7. Pierre Chaussé, 2011. "Generalized empirical likelihood for a continuum of moment conditions," Working Papers 1104, University of Waterloo, Department of Economics, revised Oct 2011.
    8. Hansen, Christian & Kozbur, Damian, 2014. "Instrumental variables estimation with many weak instruments using regularized JIVE," Journal of Econometrics, Elsevier, vol. 182(2), pages 290-308.
    9. Carrasco, Marine & Kotchoni, Rachidi, 2017. "Efficient Estimation Using The Characteristic Function," Econometric Theory, Cambridge University Press, vol. 33(2), pages 479-526, April.
    10. Stéphane Goutte & David Guerreiro & Bilel Sanhaji & Sophie Saglio & Julien Chevallier, 2019. "International Financial Markets," Post-Print halshs-02183053, HAL.
    11. Yoonseok Lee & Yu Zhou, 2015. "Averaged Instrumental Variables Estimators," Center for Policy Research Working Papers 180, Center for Policy Research, Maxwell School, Syracuse University.
    12. M. E. Bontempi & I. Mammi, 2014. "pca2: implementing a strategy to reduce the instrument count in panel GMM," Working Papers wp960, Dipartimento Scienze Economiche, Universita' di Bologna.
    13. Ai, Chunrong & Chen, Xiaohong, 2012. "The semiparametric efficiency bound for models of sequential moment restrictions containing unknown functions," Journal of Econometrics, Elsevier, vol. 170(2), pages 442-457.
    14. Stanislav Anatolyev, 2007. "Optimal Instruments In Time Series: A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 21(1), pages 143-173, February.
    15. Marine Carrasco & Guy Tchuente, 2016. "Efficient Estimation with Many Weak Instruments Using Regularization Techniques," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1609-1637, December.
    16. Zhenhong Huang & Chen Wang & Jianfeng Yao, 2023. "A specification test for the strength of instrumental variables," Papers 2302.14396, arXiv.org.
    17. Parente, Paulo M.D.C. & Smith, Richard J., 2017. "Tests of additional conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 200(1), pages 1-16.
    18. Thomas Wiemann, 2023. "Optimal Categorical Instrumental Variables," Papers 2311.17021, arXiv.org, revised May 2024.
    19. Anatolyev, Stanislav & Gospodinov, Nikolay, 2011. "Specification Testing In Models With Many Instruments," Econometric Theory, Cambridge University Press, vol. 27(2), pages 427-441, April.
    20. Kohtaro Hitomi & Masamune Iwasawa & Yoshihiko Nishiyama, 2018. "Rate Optimal Specification Test When the Number of Instruments is Large," KIER Working Papers 986, Kyoto University, Institute of Economic Research.
    21. Daniel A. Ackerberg & Paul J. Devereux, 2009. "Improved JIVE Estimators for Overidentified Linear Models with and without Heteroskedasticity," The Review of Economics and Statistics, MIT Press, vol. 91(2), pages 351-362, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:170:y:2012:i:2:p:383-398. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.