IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v100y2016icp773-793.html
   My bibliography  Save this article

Iteratively reweighted adaptive lasso for conditional heteroscedastic time series with applications to AR–ARCH type processes

Author

Listed:
  • Ziel, Florian

Abstract

Shrinkage algorithms are of great importance in almost every area of statistics due to the increasing impact of big data. Especially time series analysis benefits from efficient and rapid estimation techniques such as the lasso. However, currently lasso type estimators for autoregressive time series models still focus on models with homoscedastic residuals. Therefore, an iteratively reweighted adaptive lasso algorithm for the estimation of time series models under conditional heteroscedasticity is presented in a high-dimensional setting. The asymptotic behaviour of the resulting estimator is analysed. It is found that the proposed estimation procedure performs substantially better than its homoscedastic counterpart. A special case of the algorithm is suitable to compute the estimated multivariate AR–ARCH type models efficiently. Extensions to the model like periodic AR–ARCH, threshold AR–ARCH or ARMA–GARCH are discussed. Finally, different simulation results and applications to electricity market data and returns of metal prices are shown.

Suggested Citation

  • Ziel, Florian, 2016. "Iteratively reweighted adaptive lasso for conditional heteroscedastic time series with applications to AR–ARCH type processes," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 773-793.
    • Handle: RePEc:eee:csdana:v:100:y:2016:i:c:p:773-793
    DOI: 10.1016/j.csda.2015.11.016
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947315002996
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2015.11.016?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Robert Tibshirani & Michael Saunders & Saharon Rosset & Ji Zhu & Keith Knight, 2005. "Sparsity and smoothness via the fused lasso," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(1), pages 91-108, February.
    2. Ziel, Florian & Steinert, Rick & Husmann, Sven, 2015. "Efficient modeling and forecasting of electricity spot prices," Energy Economics, Elsevier, vol. 47(C), pages 98-111.
    3. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    4. Mak, T. K. & Wong, H. & Li, W. K., 1997. "Estimation of nonlinear time series with conditional heteroscedastic variances by iteratively weighted least squares," Computational Statistics & Data Analysis, Elsevier, vol. 24(2), pages 169-178, April.
    5. Christian Francq & Jean-Michel Zakoïan, 2013. "Optimal predictions of powers of conditionally heteroscedastic processes," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(2), pages 345-367, March.
    6. Harchaoui, Z. & Lévy-Leduc, C., 2010. "Multiple Change-Point Estimation With a Total Variation Penalty," Journal of the American Statistical Association, American Statistical Association, vol. 105(492), pages 1480-1493.
    7. Gefang, Deborah, 2014. "Bayesian doubly adaptive elastic-net Lasso for VAR shrinkage," International Journal of Forecasting, Elsevier, vol. 30(1), pages 1-11.
    8. Ren, Yunwen & Xiao, Zhiguo & Zhang, Xinsheng, 2013. "Two-step adaptive model selection for vector autoregressive processes," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 349-364.
    9. Wang, Hansheng & Li, Guodong & Jiang, Guohua, 2007. "Robust Regression Shrinkage and Consistent Variable Selection Through the LAD-Lasso," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 347-355, July.
    10. Hansheng Wang & Guodong Li & Chih‐Ling Tsai, 2007. "Regression coefficient and autoregressive order shrinkage and selection via the lasso," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(1), pages 63-78, February.
    11. MArcelo C. Medeiros & Eduardo F.Mendes, 2012. "Estimating High-Dimensional Time Series Models," Textos para discussão 602, Department of Economics PUC-Rio (Brazil).
    12. Zhang, Yiyun & Li, Runze & Tsai, Chih-Ling, 2010. "Regularization Parameter Selections via Generalized Information Criterion," Journal of the American Statistical Association, American Statistical Association, vol. 105(489), pages 312-323.
    13. Rabemananjara, R & Zakoian, J M, 1993. "Threshold Arch Models and Asymmetries in Volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(1), pages 31-49, Jan.-Marc.
    14. Ngai Hang Chan & Chun Yip Yau & Rong-Mao Zhang, 2014. "Group LASSO for Structural Break Time Series," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 590-599, June.
    15. Ling, Shiqing, 2007. "Self-weighted and local quasi-maximum likelihood estimators for ARMA-GARCH/IGARCH models," Journal of Econometrics, Elsevier, vol. 140(2), pages 849-873, October.
    16. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    17. Choi, Nam Hee & Li, William & Zhu, Ji, 2010. "Variable Selection With the Strong Heredity Constraint and Its Oracle Property," Journal of the American Statistical Association, American Statistical Association, vol. 105(489), pages 354-364.
    18. Nardi, Y. & Rinaldo, A., 2011. "Autoregressive process modeling via the Lasso procedure," Journal of Multivariate Analysis, Elsevier, vol. 102(3), pages 528-549, March.
    19. Hsu, Nan-Jung & Hung, Hung-Lin & Chang, Ya-Mei, 2008. "Subset selection for vector autoregressive processes using Lasso," Computational Statistics & Data Analysis, Elsevier, vol. 52(7), pages 3645-3657, March.
    20. Abdelhakim Aknouche & Eid Al-Eid, 2012. "Asymptotic inference of unstable periodic ARCH processes," Statistical Inference for Stochastic Processes, Springer, vol. 15(1), pages 61-79, April.
    21. Ren, Yunwen & Zhang, Xinsheng, 2010. "Subset selection for vector autoregressive processes via adaptive Lasso," Statistics & Probability Letters, Elsevier, vol. 80(23-24), pages 1705-1712, December.
    22. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Florian Ziel & Rafal Weron, 2016. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate models," HSC Research Reports HSC/16/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    2. Ziel, Florian & Steinert, Rick, 2016. "Electricity price forecasting using sale and purchase curves: The X-Model," Energy Economics, Elsevier, vol. 59(C), pages 435-454.
    3. Rostami-Tabar, Bahman & Ziel, Florian, 2022. "Anticipating special events in Emergency Department forecasting," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1197-1213.
    4. Smeekes, Stephan & Wijler, Etienne, 2018. "Macroeconomic forecasting using penalized regression methods," International Journal of Forecasting, Elsevier, vol. 34(3), pages 408-430.
    5. Bartosz Uniejewski, 2024. "Regularization for electricity price forecasting," Papers 2404.03968, arXiv.org.
    6. Simon Hirsch & Jonathan Berrisch & Florian Ziel, 2024. "Online Distributional Regression," Papers 2407.08750, arXiv.org, revised Aug 2024.
    7. Bartosz Uniejewski & Jakub Nowotarski & Rafał Weron, 2016. "Automated Variable Selection and Shrinkage for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 9(8), pages 1-22, August.
    8. Jens Kley-Holsteg & Florian Ziel, 2020. "Probabilistic Multi-Step-Ahead Short-Term Water Demand Forecasting with Lasso," Papers 2005.04522, arXiv.org.
    9. Jiajia Li & Yucong Liu & Houjian Li & Abbas Ali Chandio, 2021. "Heterogeneous Driving Factors of Carbon Emissions Embedded in China’s Export: An Application of the LASSO Model," IJERPH, MDPI, vol. 18(19), pages 1-18, October.
    10. Ambach, Daniel & Schmid, Wolfgang, 2017. "A new high-dimensional time series approach for wind speed, wind direction and air pressure forecasting," Energy, Elsevier, vol. 135(C), pages 833-850.
    11. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    12. Aknouche, Abdelhakim & Al-Eid, Eid & Demouche, Nacer, 2016. "Generalized quasi-maximum likelihood inference for periodic conditionally heteroskedastic models," MPRA Paper 75770, University Library of Munich, Germany, revised 19 Dec 2016.
    13. Abdelhakim Aknouche & Eid Al-Eid & Nacer Demouche, 2018. "Generalized quasi-maximum likelihood inference for periodic conditionally heteroskedastic models," Statistical Inference for Stochastic Processes, Springer, vol. 21(3), pages 485-511, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Florian Ziel, 2015. "Iteratively reweighted adaptive lasso for conditional heteroscedastic time series with applications to AR-ARCH type processes," Papers 1502.06557, arXiv.org, revised Dec 2015.
    2. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    3. Kascha, Christian & Trenkler, Carsten, 2015. "Forecasting VARs, model selection, and shrinkage," Working Papers 15-07, University of Mannheim, Department of Economics.
    4. Diego Vidaurre & Concha Bielza & Pedro Larrañaga, 2013. "A Survey of L1 Regression," International Statistical Review, International Statistical Institute, vol. 81(3), pages 361-387, December.
    5. Marcelo C. Medeiros & Eduardo F. Mendes, 2015. "l1-Regularization of High-Dimensional Time-Series Models with Flexible Innovations," Textos para discussão 636, Department of Economics PUC-Rio (Brazil).
    6. Florian Ziel & Rick Steinert & Sven Husmann, 2014. "Efficient Modeling and Forecasting of the Electricity Spot Price," Papers 1402.7027, arXiv.org, revised Oct 2014.
    7. Camila Epprecht & Dominique Guegan & Álvaro Veiga & Joel Correa da Rosa, 2017. "Variable selection and forecasting via automated methods for linear models: LASSO/adaLASSO and Autometrics," Post-Print halshs-00917797, HAL.
    8. Loann David Denis Desboulets, 2018. "A Review on Variable Selection in Regression Analysis," Econometrics, MDPI, vol. 6(4), pages 1-27, November.
    9. Audrino, Francesco & Camponovo, Lorenzo, 2013. "Oracle Properties and Finite Sample Inference of the Adaptive Lasso for Time Series Regression Models," Economics Working Paper Series 1327, University of St. Gallen, School of Economics and Political Science.
    10. Medeiros, Marcelo C. & Mendes, Eduardo F., 2016. "ℓ1-regularization of high-dimensional time-series models with non-Gaussian and heteroskedastic errors," Journal of Econometrics, Elsevier, vol. 191(1), pages 255-271.
    11. Marcelo C. Medeiros & Eduardo F. Mendes, 2017. "Adaptive LASSO estimation for ARDL models with GARCH innovations," Econometric Reviews, Taylor & Francis Journals, vol. 36(6-9), pages 622-637, October.
    12. Justin B. Post & Howard D. Bondell, 2013. "Factor Selection and Structural Identification in the Interaction ANOVA Model," Biometrics, The International Biometric Society, vol. 69(1), pages 70-79, March.
    13. Jonathan Boss & Alexander Rix & Yin‐Hsiu Chen & Naveen N. Narisetty & Zhenke Wu & Kelly K. Ferguson & Thomas F. McElrath & John D. Meeker & Bhramar Mukherjee, 2021. "A hierarchical integrative group least absolute shrinkage and selection operator for analyzing environmental mixtures," Environmetrics, John Wiley & Sons, Ltd., vol. 32(8), December.
    14. Matteo Barigozzi & Marc Hallin, 2015. "Networks, Dynamic Factors, and the Volatility Analysis of High-Dimensional Financial Series," Papers 1510.05118, arXiv.org, revised Jul 2016.
    15. Xiaofei Wu & Rongmei Liang & Hu Yang, 2022. "Penalized and constrained LAD estimation in fixed and high dimension," Statistical Papers, Springer, vol. 63(1), pages 53-95, February.
    16. Ziel, Florian & Steinert, Rick & Husmann, Sven, 2015. "Efficient modeling and forecasting of electricity spot prices," Energy Economics, Elsevier, vol. 47(C), pages 98-111.
    17. Sandra Stankiewicz, 2015. "Forecasting Euro Area Macroeconomic Variables with Bayesian Adaptive Elastic Net," Working Paper Series of the Department of Economics, University of Konstanz 2015-12, Department of Economics, University of Konstanz.
    18. Fan, Rui & Lee, Ji Hyung & Shin, Youngki, 2023. "Predictive quantile regression with mixed roots and increasing dimensions: The ALQR approach," Journal of Econometrics, Elsevier, vol. 237(2).
    19. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    20. Mkhadri, Abdallah & Ouhourane, Mohamed, 2013. "An extended variable inclusion and shrinkage algorithm for correlated variables," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 631-644.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:100:y:2016:i:c:p:773-793. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.