IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2409.10030.html
   My bibliography  Save this paper

On LASSO Inference for High Dimensional Predictive Regression

Author

Listed:
  • Zhan Gao
  • Ji Hyung Lee
  • Ziwei Mei
  • Zhentao Shi

Abstract

LASSO introduces shrinkage bias into estimated coefficients, which can adversely affect the desirable asymptotic normality and invalidate the standard inferential procedure based on the $t$-statistic. The desparsified LASSO has emerged as a well-known remedy for this issue. In the context of high dimensional predictive regression, the desparsified LASSO faces an additional challenge: the Stambaugh bias arising from nonstationary regressors. To restore the standard inferential procedure, we propose a novel estimator called IVX-desparsified LASSO (XDlasso). XDlasso eliminates the shrinkage bias and the Stambaugh bias simultaneously and does not require prior knowledge about the identities of nonstationary and stationary regressors. We establish the asymptotic properties of XDlasso for hypothesis testing, and our theoretical findings are supported by Monte Carlo simulations. Applying our method to real-world applications from the FRED-MD database -- which includes a rich set of control variables -- we investigate two important empirical questions: (i) the predictability of the U.S. stock returns based on the earnings-price ratio, and (ii) the predictability of the U.S. inflation using the unemployment rate.

Suggested Citation

  • Zhan Gao & Ji Hyung Lee & Ziwei Mei & Zhentao Shi, 2024. "On LASSO Inference for High Dimensional Predictive Regression," Papers 2409.10030, arXiv.org.
  • Handle: RePEc:arx:papers:2409.10030
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2409.10030
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Benati, Luca, 2015. "The long-run Phillips curve: A structural VAR investigation," Journal of Monetary Economics, Elsevier, vol. 76(C), pages 15-28.
    2. Peter C. B. Phillips & Zhentao Shi, 2021. "Boosting: Why You Can Use The Hp Filter," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 62(2), pages 521-570, May.
    3. Smeekes, Stephan & Wijler, Etienne, 2018. "Macroeconomic forecasting using penalized regression methods," International Journal of Forecasting, Elsevier, vol. 34(3), pages 408-430.
    4. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2021. "Economic Predictions With Big Data: The Illusion of Sparsity," Econometrica, Econometric Society, vol. 89(5), pages 2409-2437, September.
    5. Alexei Onatski & Chen Wang, 2018. "Alternative Asymptotics for Cointegration Tests in Large VARs," Econometrica, Econometric Society, vol. 86(4), pages 1465-1478, July.
    6. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2018. "Double/debiased machine learning for treatment and structural parameters," Econometrics Journal, Royal Economic Society, vol. 21(1), pages 1-68, February.
    7. Demetrescu, Matei & Georgiev, Iliyan & Rodrigues, Paulo M.M. & Taylor, A.M. Robert, 2023. "Extensions to IVX methods of inference for return predictability," Journal of Econometrics, Elsevier, vol. 237(2).
    8. Qingliang Fan & Zijian Guo & Ziwei Mei & Cun-Hui Zhang, 2023. "Inference for Nonlinear Endogenous Treatment Effects Accounting for High-Dimensional Covariate Complexity," Papers 2310.08063, arXiv.org, revised Jun 2024.
    9. A. W. Phillips, 1958. "The Relation Between Unemployment and the Rate of Change of Money Wage Rates in the United Kingdom, 1861–1957," Economica, London School of Economics and Political Science, vol. 25(100), pages 283-299, November.
    10. Michael Jansson & Marcelo J. Moreira, 2006. "Optimal Inference in Regression Models with Nearly Integrated Regressors," Econometrica, Econometric Society, vol. 74(3), pages 681-714, May.
    11. Andrii Babii & Eric Ghysels & Jonas Striaukas, 2022. "Machine Learning Time Series Regressions With an Application to Nowcasting," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1094-1106, June.
    12. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    13. Lee, Ji Hyung, 2016. "Predictive quantile regression with persistent covariates: IVX-QR approach," Journal of Econometrics, Elsevier, vol. 192(1), pages 105-118.
    14. Smeekes, Stephan & Wijler, Etienne, 2021. "An automated approach towards sparse single-equation cointegration modelling," Journal of Econometrics, Elsevier, vol. 221(1), pages 247-276.
    15. Koo, Bonsoo & Anderson, Heather M. & Seo, Myung Hwan & Yao, Wenying, 2020. "High-dimensional predictive regression in the presence of cointegration," Journal of Econometrics, Elsevier, vol. 219(2), pages 456-477.
    16. Caner, Mehmet & Kock, Anders Bredahl, 2018. "Asymptotically honest confidence regions for high dimensional parameters by the desparsified conservative Lasso," Journal of Econometrics, Elsevier, vol. 203(1), pages 143-168.
    17. Magdalinos, Tassos & Phillips, Peter C.B., 2009. "Limit Theory For Cointegrated Systems With Moderately Integrated And Moderately Explosive Regressors," Econometric Theory, Cambridge University Press, vol. 25(2), pages 482-526, April.
    18. Ke-Li Xu & Lauren Cohen, 2020. "Testing for Multiple-Horizon Predictability: Direct Regression Based versus Implication Based," The Review of Financial Studies, Society for Financial Studies, vol. 33(9), pages 4403-4443.
    19. Phillips, Peter C.B. & Magdalinos, Tassos, 2007. "Limit theory for moderate deviations from a unit root," Journal of Econometrics, Elsevier, vol. 136(1), pages 115-130, January.
    20. Victor Chernozhukov & Juan Carlos Escanciano & Hidehiko Ichimura & Whitney K. Newey & James M. Robins, 2022. "Locally Robust Semiparametric Estimation," Econometrica, Econometric Society, vol. 90(4), pages 1501-1535, July.
    21. Cai, Zongwu & Chen, Haiqiang & Liao, Xiaosai, 2023. "A new robust inference for predictive quantile regression," Journal of Econometrics, Elsevier, vol. 234(1), pages 227-250.
    22. Marcelo C. Medeiros & Gabriel F. R. Vasconcelos & Álvaro Veiga & Eduardo Zilberman, 2021. "Forecasting Inflation in a Data-Rich Environment: The Benefits of Machine Learning Methods," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 98-119, January.
    23. Ziwei Mei & Zhentao Shi, 2022. "On LASSO for High Dimensional Predictive Regression," Papers 2212.07052, arXiv.org, revised Jan 2024.
    24. Fukang Zhu & Zongwu Cai & Liang Peng, 2014. "Predictive regressions for macroeconomic data," Papers 1404.7642, arXiv.org.
    25. Xianyang Zhang & Guang Cheng, 2017. "Simultaneous Inference for High-Dimensional Linear Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(518), pages 757-768, April.
    26. Peter C. B. Phillips, 2015. "Halbert White Jr. Memorial JFEC Lecture: Pitfalls and Possibilities in Predictive Regression†," Journal of Financial Econometrics, Oxford University Press, vol. 13(3), pages 521-555.
    27. Phillips, Peter C.B. & Lee, Ji Hyung, 2013. "Predictive regression under various degrees of persistence and robust long-horizon regression," Journal of Econometrics, Elsevier, vol. 177(2), pages 250-264.
    28. Dominguez, Kathryn M & Fair, Ray C & Shapiro, Matthew D, 1988. "Forecasting the Depression: Harvard versus Yale," American Economic Review, American Economic Association, vol. 78(4), pages 595-612, September.
    29. Campbell, John Y. & Yogo, Motohiro, 2006. "Efficient tests of stock return predictability," Journal of Financial Economics, Elsevier, vol. 81(1), pages 27-60, July.
    30. Adamek, Robert & Smeekes, Stephan & Wilms, Ines, 2023. "Lasso inference for high-dimensional time series," Journal of Econometrics, Elsevier, vol. 235(2), pages 1114-1143.
    31. A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012. "Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain," Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
    32. Bingduo Yang & Wei Long & Liang Peng & Zongwu Cai, 2020. "Testing the Predictability of U.S. Housing Price Index Returns Based on an IVX-AR Model," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(532), pages 1598-1619, December.
    33. Alexandros Kostakis & Tassos Magdalinos & Michalis P. Stamatogiannis, 2015. "Robust Econometric Inference for Stock Return Predictability," The Review of Financial Studies, Society for Financial Studies, vol. 28(5), pages 1506-1553.
    34. Robert W. Dimand & John Geanakoplos, 2005. "Celebrating Irving Fisher: The Legacy of a Great Economist," American Journal of Economics and Sociology, Wiley Blackwell, vol. 64(1), pages 3-18, January.
    35. Yash Deshpande & Adel Javanmard & Mohammad Mehrabi, 2023. "Online Debiasing for Adaptively Collected High-Dimensional Data With Applications to Time Series Analysis," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(542), pages 1126-1139, April.
    36. Gold, David & Lederer, Johannes & Tao, Jing, 2020. "Inference for high-dimensional instrumental variables regression," Journal of Econometrics, Elsevier, vol. 217(1), pages 79-111.
    37. Tu, Yundong & Xie, Xinling, 2023. "Penetrating sporadic return predictability," Journal of Econometrics, Elsevier, vol. 237(1).
    38. Phillips, Peter C.B. & Lee, Ji Hyung, 2016. "Robust econometric inference with mixed integrated and mildly explosive regressors," Journal of Econometrics, Elsevier, vol. 192(2), pages 433-450.
    39. Mei, Ziwei & Shi, Zhentao, 2024. "On LASSO for high dimensional predictive regression," Journal of Econometrics, Elsevier, vol. 242(2).
    40. Granger, C. W. J. & Newbold, P., 1974. "Spurious regressions in econometrics," Journal of Econometrics, Elsevier, vol. 2(2), pages 111-120, July.
    41. Liu, Xiaohui & Yang, Bingduo & Cai, Zongwu & Peng, Liang, 2019. "A unified test for predictability of asset returns regardless of properties of predicting variables," Journal of Econometrics, Elsevier, vol. 208(1), pages 141-159.
    42. Victor Chernozhukov & Whitney K. Newey & Rahul Singh, 2022. "Automatic Debiased Machine Learning of Causal and Structural Effects," Econometrica, Econometric Society, vol. 90(3), pages 967-1027, May.
    43. Stambaugh, Robert F., 1999. "Predictive regressions," Journal of Financial Economics, Elsevier, vol. 54(3), pages 375-421, December.
    44. Bingduo Yang & Xiaohui Liu & Liang Peng & Zongwu Cai, 2021. "Unified Tests for a Dynamic Predictive Regression," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(3), pages 684-699, July.
    45. Rongmao Zhang & Peter Robinson & Qiwei Yao, 2019. "Identifying Cointegration by Eigenanalysis," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 916-927, April.
    46. Fan, Rui & Lee, Ji Hyung, 2019. "Predictive quantile regressions under persistence and conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 213(1), pages 261-280.
    47. Zhentao Shi, 2016. "Estimation of Sparse Structural Parameters with Many Endogenous Variables," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1582-1608, December.
    48. Cun-Hui Zhang & Stephanie S. Zhang, 2014. "Confidence intervals for low dimensional parameters in high dimensional linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(1), pages 217-242, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lee, Ji Hyung & Shi, Zhentao & Gao, Zhan, 2022. "On LASSO for predictive regression," Journal of Econometrics, Elsevier, vol. 229(2), pages 322-349.
    2. Cai, Zongwu & Chen, Haiqiang & Liao, Xiaosai, 2023. "A new robust inference for predictive quantile regression," Journal of Econometrics, Elsevier, vol. 234(1), pages 227-250.
    3. Tu, Yundong & Xie, Xinling, 2023. "Penetrating sporadic return predictability," Journal of Econometrics, Elsevier, vol. 237(1).
    4. Christis Katsouris, 2023. "Structural Break Detection in Quantile Predictive Regression Models with Persistent Covariates," Papers 2302.05193, arXiv.org.
    5. Zongwu Cai & Haiqiang Chen & Xiaosai Liao, 2020. "A New Robust Inference for Predictive Quantile Regression," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202002, University of Kansas, Department of Economics, revised Feb 2020.
    6. Ziwei Mei & Zhentao Shi, 2022. "On LASSO for High Dimensional Predictive Regression," Papers 2212.07052, arXiv.org, revised Jan 2024.
    7. Christis Katsouris, 2023. "Predictability Tests Robust against Parameter Instability," Papers 2307.15151, arXiv.org.
    8. Liu, Yanbo & Phillips, Peter C.B., 2023. "Robust inference with stochastic local unit root regressors in predictive regressions," Journal of Econometrics, Elsevier, vol. 235(2), pages 563-591.
    9. Yang, Bingduo & Long, Wei & Yang, Zihui, 2022. "Testing predictability of stock returns under possible bubbles," Journal of Empirical Finance, Elsevier, vol. 68(C), pages 246-260.
    10. Yijie Fei & Yiu Lim Lui & Jun Yu, 2024. "Testing Predictability in the Presence of Persistent Errors," Working Papers 202401, University of Macau, Faculty of Business Administration.
    11. Andersen, Torben G. & Varneskov, Rasmus T., 2021. "Consistent inference for predictive regressions in persistent economic systems," Journal of Econometrics, Elsevier, vol. 224(1), pages 215-244.
    12. Xiaosai Liao & Xinjue Li & Qingliang Fan, 2024. "Robust Inference for Multiple Predictive Regressions with an Application on Bond Risk Premia," Papers 2401.01064, arXiv.org.
    13. Christis Katsouris, 2023. "Unified Inference for Dynamic Quantile Predictive Regression," Papers 2309.14160, arXiv.org, revised Nov 2023.
    14. Zongwu Cai & Seong Yeon Chang, 2018. "A New Test In A Predictive Regression with Structural Breaks," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 201811, University of Kansas, Department of Economics, revised Dec 2018.
    15. Demetrescu, Matei & Rodrigues, Paulo M.M. & Taylor, A.M. Robert, 2023. "Transformed regression-based long-horizon predictability tests," Journal of Econometrics, Elsevier, vol. 237(2).
    16. Demetrescu, Matei & Rodrigues, Paulo M.M., 2022. "Residual-augmented IVX predictive regression," Journal of Econometrics, Elsevier, vol. 227(2), pages 429-460.
    17. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    18. Demetrescu, Matei & Georgiev, Iliyan & Rodrigues, Paulo M.M. & Taylor, A.M. Robert, 2023. "Extensions to IVX methods of inference for return predictability," Journal of Econometrics, Elsevier, vol. 237(2).
    19. Bingduo Yang & Xiaohui Liu & Liang Peng & Zongwu Cai, 2018. "Unified Tests for a Dynamic Predictive Regression," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 201808, University of Kansas, Department of Economics, revised Sep 2018.
    20. Christis Katsouris, 2023. "Bootstrapping Nonstationary Autoregressive Processes with Predictive Regression Models," Papers 2307.14463, arXiv.org.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2409.10030. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.