IDEAS home Printed from https://ideas.repec.org/p/usg/econwp/201327.html
   My bibliography  Save this paper

Oracle Properties and Finite Sample Inference of the Adaptive Lasso for Time Series Regression Models

Author

Listed:
  • Audrino, Francesco
  • Camponovo, Lorenzo

Abstract

We derive new theoretical results on the properties of the adaptive least absolute shrinkage and selection operator (adaptive lasso) for time series regression models. In particular we investigate the question of how to conduct finite sample inference on the parameters given an adaptive lasso model for some fixed value of the shrinkage parameter. Central in this study is the test of the hypothesis that a given adaptive lasso parameter equals zero, which therefore tests for a false positive. To this end we construct a simple (conservative) testing procedure and show, theoretically and empirically through extensive Monte Carlo simulations, that the adaptive lasso combines efficient parameter estimation, variable selection, and valid finite sample inference in one step. Moreover, we analytically derive a bias correction factor that is able to significantly improve the empirical coverage of the test on the active variables. Finally, we apply the introduced testing procedure to investigate the relation between the short rate dynamics and the economy, thereby providing a statistical foundation (from a model choice perspective) to the classic Taylor rule monetary policy model.

Suggested Citation

  • Audrino, Francesco & Camponovo, Lorenzo, 2013. "Oracle Properties and Finite Sample Inference of the Adaptive Lasso for Time Series Regression Models," Economics Working Paper Series 1327, University of St. Gallen, School of Economics and Political Science.
  • Handle: RePEc:usg:econwp:2013:27
    as

    Download full text from publisher

    File URL: http://ux-tauri.unisg.ch/RePEc/usg/econwp/EWP-1327.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    2. Moench, Emanuel, 2008. "Forecasting the yield curve in a data-rich environment: A no-arbitrage factor-augmented VAR approach," Journal of Econometrics, Elsevier, vol. 146(1), pages 26-43, September.
    3. Richard Clarida & Jordi Galí & Mark Gertler, 2000. "Monetary Policy Rules and Macroeconomic Stability: Evidence and Some Theory," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(1), pages 147-180.
    4. Francesco Audrino & Simon D. Knaus, 2016. "Lassoing the HAR Model: A Model Selection Perspective on Realized Volatility Dynamics," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1485-1521, December.
    5. Anders Bredahl Kock, 2012. "On the Oracle Property of the Adaptive Lasso in Stationary and Nonstationary Autoregressions," CREATES Research Papers 2012-05, Department of Economics and Business Economics, Aarhus University.
    6. Marcelo C. Medeiros & Eduardo F. Mendes, 2012. "Estimating High-Dimensional Time Series Models," CREATES Research Papers 2012-37, Department of Economics and Business Economics, Aarhus University.
    7. Dewachter, Hans & Lyrio, Marco, 2006. "Macro Factors and the Term Structure of Interest Rates," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(1), pages 119-140, February.
    8. Glenn D. Rudebusch, 2010. "Macro‐Finance Models Of Interest Rates And The Economy," Manchester School, University of Manchester, vol. 78(s1), pages 25-52, September.
    9. Nardi, Y. & Rinaldo, A., 2011. "Autoregressive process modeling via the Lasso procedure," Journal of Multivariate Analysis, Elsevier, vol. 102(3), pages 528-549, March.
    10. Hsu, Nan-Jung & Hung, Hung-Lin & Chang, Ya-Mei, 2008. "Subset selection for vector autoregressive processes using Lasso," Computational Statistics & Data Analysis, Elsevier, vol. 52(7), pages 3645-3657, March.
    11. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    12. Ang, Andrew & Piazzesi, Monika, 2003. "A no-arbitrage vector autoregression of term structure dynamics with macroeconomic and latent variables," Journal of Monetary Economics, Elsevier, vol. 50(4), pages 745-787, May.
    13. Kock, Anders Bredahl & Callot, Laurent, 2015. "Oracle inequalities for high dimensional vector autoregressions," Journal of Econometrics, Elsevier, vol. 186(2), pages 325-344.
    14. Filipova, Kameliya & Audrino, Francesco & De Giorgi, Enrico, 2014. "Monetary policy regimes: Implications for the yield curve and bond pricing," Journal of Financial Economics, Elsevier, vol. 113(3), pages 427-454.
    15. Hansheng Wang & Guodong Li & Chih‐Ling Tsai, 2007. "Regression coefficient and autoregressive order shrinkage and selection via the lasso," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(1), pages 63-78, February.
    16. Andrews, Donald W.K. & Guggenberger, Patrik, 2010. "ASYMPTOTIC SIZE AND A PROBLEM WITH SUBSAMPLING AND WITH THE m OUT OF n BOOTSTRAP," Econometric Theory, Cambridge University Press, vol. 26(2), pages 426-468, April.
    17. Chatterjee, A. & Lahiri, S. N., 2011. "Bootstrapping Lasso Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 608-625.
    18. Song, Song & Bickel, Peter J., 2011. "Large vector auto regressions," SFB 649 Discussion Papers 2011-048, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    19. Taylor, John B., 1993. "Discretion versus policy rules in practice," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 39(1), pages 195-214, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Audrino, Francesco & Camponovo, Lorenzo & Roth, Constantin, 2015. "Testing the lag structure of assets’ realized volatility dynamics," Economics Working Paper Series 1501, University of St. Gallen, School of Economics and Political Science.
    2. Marcelo C. Medeiros & Eduardo F. Mendes, 2015. "l1-Regularization of High-Dimensional Time-Series Models with Flexible Innovations," Textos para discussão 636, Department of Economics PUC-Rio (Brazil).
    3. Francesco Audrino & Simon D. Knaus, 2016. "Lassoing the HAR Model: A Model Selection Perspective on Realized Volatility Dynamics," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1485-1521, December.
    4. Medeiros, Marcelo C. & Mendes, Eduardo F., 2016. "ℓ1-regularization of high-dimensional time-series models with non-Gaussian and heteroskedastic errors," Journal of Econometrics, Elsevier, vol. 191(1), pages 255-271.
    5. Ding, Yi & Kambouroudis, Dimos & McMillan, David G., 2021. "Forecasting realised volatility: Does the LASSO approach outperform HAR?," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 74(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Medeiros, Marcelo C. & Mendes, Eduardo F., 2016. "ℓ1-regularization of high-dimensional time-series models with non-Gaussian and heteroskedastic errors," Journal of Econometrics, Elsevier, vol. 191(1), pages 255-271.
    2. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    3. Kascha, Christian & Trenkler, Carsten, 2015. "Forecasting VARs, model selection, and shrinkage," Working Papers 15-07, University of Mannheim, Department of Economics.
    4. Marcelo C. Medeiros & Eduardo F. Mendes, 2017. "Adaptive LASSO estimation for ARDL models with GARCH innovations," Econometric Reviews, Taylor & Francis Journals, vol. 36(6-9), pages 622-637, October.
    5. Marcelo C. Medeiros & Eduardo F. Mendes, 2015. "l1-Regularization of High-Dimensional Time-Series Models with Flexible Innovations," Textos para discussão 636, Department of Economics PUC-Rio (Brazil).
    6. Marcelo C. Medeiros & Eduardo F. Mendes, 2012. "Estimating High-Dimensional Time Series Models," CREATES Research Papers 2012-37, Department of Economics and Business Economics, Aarhus University.
    7. Hamed Haselimashhadi & Veronica Vinciotti, 2018. "Penalised inference for lagged dependent regression in the presence of autocorrelated residuals," METRON, Springer;Sapienza Università di Roma, vol. 76(1), pages 49-68, April.
    8. Smeekes, Stephan & Wijler, Etienne, 2018. "Macroeconomic forecasting using penalized regression methods," International Journal of Forecasting, Elsevier, vol. 34(3), pages 408-430.
    9. repec:hum:wpaper:sfb649dp2016-047 is not listed on IDEAS
    10. Matteo Barigozzi & Christian Brownlees, 2019. "NETS: Network estimation for time series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(3), pages 347-364, April.
    11. Florian Ziel, 2015. "Iteratively reweighted adaptive lasso for conditional heteroscedastic time series with applications to AR-ARCH type processes," Papers 1502.06557, arXiv.org, revised Dec 2015.
    12. Carlo A. Favero & Arie E. Gozluklu & Haoxi Yang, 2016. "Demographics and the Behavior of Interest Rates," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 64(4), pages 732-776, November.
    13. Audrino, Francesco & Camponovo, Lorenzo & Roth, Constantin, 2015. "Testing the lag structure of assets’ realized volatility dynamics," Economics Working Paper Series 1501, University of St. Gallen, School of Economics and Political Science.
    14. Ziel, Florian, 2016. "Iteratively reweighted adaptive lasso for conditional heteroscedastic time series with applications to AR–ARCH type processes," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 773-793.
    15. Ding, Yi & Kambouroudis, Dimos & McMillan, David G., 2021. "Forecasting realised volatility: Does the LASSO approach outperform HAR?," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 74(C).
    16. Zbonakova, L. & Härdle, W.K. & Wang, W., 2016. "Time Varying Quantile Lasso," Working Papers 16/07, Department of Economics, City University London.
    17. Kaya, Huseyin, 2013. "The yield curve and the macroeconomy: Evidence from Turkey," Economic Modelling, Elsevier, vol. 32(C), pages 100-107.
    18. Diego Vidaurre & Concha Bielza & Pedro Larrañaga, 2013. "A Survey of L1 Regression," International Statistical Review, International Statistical Institute, vol. 81(3), pages 361-387, December.
    19. Francesco Audrino & Simon D. Knaus, 2016. "Lassoing the HAR Model: A Model Selection Perspective on Realized Volatility Dynamics," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1485-1521, December.
    20. Kock, Anders Bredahl & Callot, Laurent, 2015. "Oracle inequalities for high dimensional vector autoregressions," Journal of Econometrics, Elsevier, vol. 186(2), pages 325-344.
    21. Zbonakova, Lenka & Härdle, Wolfgang Karl & Wang, Weining, 2016. "Time varying quantile Lasso," SFB 649 Discussion Papers 2016-047, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.

    More about this item

    Keywords

    Adaptive lasso; Time series; Oracle properties; Finite sample inference; Taylor rule monetary policy model.;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • E43 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Interest Rates: Determination, Term Structure, and Effects

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:usg:econwp:2013:27. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/vwasgch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.