IDEAS home Printed from https://ideas.repec.org/a/spr/stpapr/v65y2024i5d10.1007_s00362-023-01472-7.html
   My bibliography  Save this article

Active-set based block coordinate descent algorithm in group LASSO for self-exciting threshold autoregressive model

Author

Listed:
  • Muhammad Jaffri Mohd Nasir

    (Universiti Malaysia Kelantan)

  • Ramzan Nazim Khan

    (The University of Western Australia)

  • Gopalan Nair

    (The University of Western Australia)

  • Darfiana Nur

    (The University of Western Australia)

Abstract

Group LASSO (gLASSO) estimator has been recently proposed to estimate thresholds for the self-exciting threshold autoregressive model, and a group least angle regression (gLAR) algorithm has been applied to obtain an approximate solution to the optimization problem. Although gLAR algorithm is computationally fast, it has been reported that the algorithm tends to estimate too many irrelevant thresholds along with the relevant ones. This paper develops an active-set based block coordinate descent (aBCD) algorithm as an exact optimization method for gLASSO to improve the performance of estimating relevant thresholds. Methods and strategy for choosing the appropriate values of shrinkage parameter for gLASSO are also discussed. To consistently estimate relevant thresholds from the threshold set obtained by the gLASSO, the backward elimination algorithm (BEA) is utilized. We evaluate numerical efficiency of the proposed algorithms, along with the Single-Line-Search (SLS) and the gLAR algorithms through simulated data and real data sets. Simulation studies show that the SLS and aBCD algorithms have similar performance in estimating thresholds although the latter method is much faster. In addition, the aBCD-BEA can sometimes outperform gLAR-BEA in terms of estimating the correct number of thresholds under certain conditions. The results from case studies have also shown that aBCD-BEA performs better in identifying important thresholds.

Suggested Citation

  • Muhammad Jaffri Mohd Nasir & Ramzan Nazim Khan & Gopalan Nair & Darfiana Nur, 2024. "Active-set based block coordinate descent algorithm in group LASSO for self-exciting threshold autoregressive model," Statistical Papers, Springer, vol. 65(5), pages 2973-3006, July.
    • Handle: RePEc:spr:stpapr:v:65:y:2024:i:5:d:10.1007_s00362-023-01472-7
    DOI: 10.1007/s00362-023-01472-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00362-023-01472-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00362-023-01472-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Marcella Niglio & Cosimo Damiano Vitale, 2015. "Threshold Vector Arma Models," Communications in Statistics - Theory and Methods, Taylor & Francis Journals, vol. 44(14), pages 2911-2923, July.
    2. Bruce E. Hansen, 2000. "Sample Splitting and Threshold Estimation," Econometrica, Econometric Society, vol. 68(3), pages 575-604, May.
    3. Wai-Sum Chan & Albert Wong & Howell Tong, 2004. "Some Nonlinear Threshold Autoregressive Time Series Models for Actuarial Use," North American Actuarial Journal, Taylor & Francis Journals, vol. 8(4), pages 37-61.
    4. Wang, Hansheng & Leng, Chenlei, 2008. "A note on adaptive group lasso," Computational Statistics & Data Analysis, Elsevier, vol. 52(12), pages 5277-5286, August.
    5. Eddelbuettel, Dirk & Francois, Romain, 2011. "Rcpp: Seamless R and C++ Integration," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 40(i08).
    6. Hansheng Wang & Bo Li & Chenlei Leng, 2009. "Shrinkage tuning parameter selection with a diverging number of parameters," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(3), pages 671-683, June.
    7. Qian, Junhui & Su, Liangjun, 2016. "Shrinkage Estimation Of Regression Models With Multiple Structural Changes," Econometric Theory, Cambridge University Press, vol. 32(6), pages 1376-1433, December.
    8. Jushan Bai & Pierre Perron, 2003. "Computation and analysis of multiple structural change models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(1), pages 1-22.
    9. Harchaoui, Z. & Lévy-Leduc, C., 2010. "Multiple Change-Point Estimation With a Total Variation Penalty," Journal of the American Statistical Association, American Statistical Association, vol. 105(492), pages 1480-1493.
    10. Coakley, Jerry & Fuertes, Ana-Maria & Perez, Maria-Teresa, 2003. "Numerical issues in threshold autoregressive modeling of time series," Journal of Economic Dynamics and Control, Elsevier, vol. 27(11-12), pages 2219-2242, September.
    11. Ngai Hang Chan & Ching-Kang Ing & Yuanbo Li & Chun Yip Yau, 2017. "Threshold Estimation via Group Orthogonal Greedy Algorithm," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(2), pages 334-345, April.
    12. Gabriela Ciuperca, 2011. "Estimating nonlinear regression with and without change-points by the LAD method," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 63(4), pages 717-743, August.
    13. Hedibert F. Lopes & Esther Salazar, 2006. "Bayesian Model Uncertainty In Smooth Transition Autoregressions," Journal of Time Series Analysis, Wiley Blackwell, vol. 27(1), pages 99-117, January.
    14. Gonzalo, Jesus & Pitarakis, Jean-Yves, 2002. "Estimation and model selection based inference in single and multiple threshold models," Journal of Econometrics, Elsevier, vol. 110(2), pages 319-352, October.
    15. Li, Dong & Tong, Howell, 2016. "Nested sub-sample search algorithm for estimation of threshold models," LSE Research Online Documents on Economics 68880, London School of Economics and Political Science, LSE Library.
    16. Chun Yip Yau & Chong Man Tang & Thomas C. M. Lee, 2015. "Estimation of Multiple-Regime Threshold Autoregressive Models With Structural Breaks," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(511), pages 1175-1186, September.
    17. John Geweke & Nobuhiko Terui, 1993. "Bayesian Threshold Autoregressive Models For Nonlinear Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 14(5), pages 441-454, September.
    18. Jiazhu Pan & Qiang Xia & Jinshan Liu, 2017. "Bayesian analysis of multiple thresholds autoregressive model," Computational Statistics, Springer, vol. 32(1), pages 219-237, March.
    19. Ngai Hang Chan & Chun Yip Yau & Rong-Mao Zhang, 2014. "Group LASSO for Structural Break Time Series," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 590-599, June.
    20. Chan, Ngai Hang & Yau, Chun Yip & Zhang, Rong-Mao, 2015. "LASSO estimation of threshold autoregressive models," Journal of Econometrics, Elsevier, vol. 189(2), pages 285-296.
    21. Ming Yuan & Yi Lin, 2006. "Model selection and estimation in regression with grouped variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 49-67, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Karsten Schweikert, 2022. "Oracle Efficient Estimation of Structural Breaks in Cointegrating Regressions," Journal of Time Series Analysis, Wiley Blackwell, vol. 43(1), pages 83-104, January.
    2. Karsten Schweikert, 2020. "Oracle Efficient Estimation of Structural Breaks in Cointegrating Regressions," Papers 2001.07949, arXiv.org, revised Apr 2021.
    3. Chan, Ngai Hang & Yau, Chun Yip & Zhang, Rong-Mao, 2015. "LASSO estimation of threshold autoregressive models," Journal of Econometrics, Elsevier, vol. 189(2), pages 285-296.
    4. Chih‐Hao Chang & Kam‐Fai Wong & Wei‐Yee Lim, 2023. "Threshold estimation for continuous three‐phase polynomial regression models with constant mean in the middle regime," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 77(1), pages 4-47, February.
    5. Ma, Chenchen & Tu, Yundong, 2023. "Group fused Lasso for large factor models with multiple structural breaks," Journal of Econometrics, Elsevier, vol. 233(1), pages 132-154.
    6. Behrendt, Simon & Schweikert, Karsten, 2021. "A Note on Adaptive Group Lasso for Structural Break Time Series," Econometrics and Statistics, Elsevier, vol. 17(C), pages 156-172.
    7. Li, Dong & Tong, Howell, 2016. "Nested sub-sample search algorithm for estimation of threshold models," LSE Research Online Documents on Economics 68880, London School of Economics and Political Science, LSE Library.
    8. Ma, Chenchen & Tu, Yundong, 2023. "Shrinkage estimation of multiple threshold factor models," Journal of Econometrics, Elsevier, vol. 235(2), pages 1876-1892.
    9. Tu, Yundong & Xie, Xinling, 2023. "Penetrating sporadic return predictability," Journal of Econometrics, Elsevier, vol. 237(1).
    10. Li, Dong & Ling, Shiqing, 2012. "On the least squares estimation of multiple-regime threshold autoregressive models," Journal of Econometrics, Elsevier, vol. 167(1), pages 240-253.
    11. Artem Prokhorov & Peter Radchenko & Alexander Semenov & Anton Skrobotov, 2024. "Change-Point Detection in Time Series Using Mixed Integer Programming," Papers 2408.05665, arXiv.org.
    12. Karsten Schweikert, 2022. "Detecting Multiple Structural Breaks in Systems of Linear Regression Equations with Integrated and Stationary Regressors," Papers 2201.05430, arXiv.org, revised Sep 2024.
    13. Fei Jin & Lung-fei Lee, 2018. "Lasso Maximum Likelihood Estimation of Parametric Models with Singular Information Matrices," Econometrics, MDPI, vol. 6(1), pages 1-24, February.
    14. Ngai Hang Chan & Chun Yip Yau & Rong-Mao Zhang, 2014. "Group LASSO for Structural Break Time Series," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 590-599, June.
    15. Alessandro Casini & Pierre Perron, 2018. "Structural Breaks in Time Series," Boston University - Department of Economics - Working Papers Series WP2019-02, Boston University - Department of Economics.
    16. Urquhart, Andrew & Zhang, Hanxiong, 2019. "Is Bitcoin a hedge or safe haven for currencies? An intraday analysis," International Review of Financial Analysis, Elsevier, vol. 63(C), pages 49-57.
    17. Jin, Fei & Lee, Lung-fei, 2018. "Irregular N2SLS and LASSO estimation of the matrix exponential spatial specification model," Journal of Econometrics, Elsevier, vol. 206(2), pages 336-358.
    18. Degui Li & Junhui Qian & Liangjun Su, 2016. "Panel Data Models With Interactive Fixed Effects and Multiple Structural Breaks," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1804-1819, October.
    19. Laurent Ferrara & Dominique Guégan, 2006. "Detection of the Industrial Business Cycle using SETAR Models," Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2005(3), pages 353-371.
    20. Qian, Junhui & Su, Liangjun, 2016. "Shrinkage estimation of common breaks in panel data models via adaptive group fused Lasso," Journal of Econometrics, Elsevier, vol. 191(1), pages 86-109.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stpapr:v:65:y:2024:i:5:d:10.1007_s00362-023-01472-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.