IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v235y2023i2p1355-1377.html
   My bibliography  Save this article

Penalized time-varying model averaging

Author

Listed:
  • Sun, Yuying
  • Hong, Yongmiao
  • Wang, Shouyang
  • Zhang, Xinyu

Abstract

This paper proposes a new penalized time-varying model averaging method to determine optimal time-varying combination weights for candidate models, which avoids over-fitting and yields sparseness from various potential predictive variables. The asymptotic optimality and convergence rate of the selected weights are derived even when all candidate models are misspecified, and the consistency and normality of the proposed time-varying model averaging estimator are obtained when the true model is included in the candidate models. Simulation studies and empirical applications to inflation forecasting highlight the merits of the proposed method.

Suggested Citation

  • Sun, Yuying & Hong, Yongmiao & Wang, Shouyang & Zhang, Xinyu, 2023. "Penalized time-varying model averaging," Journal of Econometrics, Elsevier, vol. 235(2), pages 1355-1377.
    • Handle: RePEc:eee:econom:v:235:y:2023:i:2:p:1355-1377
    DOI: 10.1016/j.jeconom.2022.09.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407622002019
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jeconom.2022.09.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    2. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    3. Inoue, Atsushi & Jin, Lu & Rossi, Barbara, 2017. "Rolling window selection for out-of-sample forecasting with time-varying parameters," Journal of Econometrics, Elsevier, vol. 196(1), pages 55-67.
    4. Todd E. Clark & Michael W. McCracken, 2009. "Improving Forecast Accuracy By Combining Recursive And Rolling Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 50(2), pages 363-395, May.
    5. Gao, Yan & Zhang, Xinyu & Wang, Shouyang & Zou, Guohua, 2016. "Model averaging based on leave-subject-out cross-validation," Journal of Econometrics, Elsevier, vol. 192(1), pages 139-151.
    6. Gary Koop & Dimitris Korobilis, 2012. "Forecasting Inflation Using Dynamic Model Averaging," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(3), pages 867-886, August.
    7. Gerda Claeskens & Christophe Croux & Johan Van Kerckhoven, 2006. "Variable Selection for Logistic Regression Using a Prediction-Focused Information Criterion," Biometrics, The International Biometric Society, vol. 62(4), pages 972-979, December.
    8. Alexandre Belloni & Victor Chernozhukov & Christian Hansen & Damian Kozbur, 2016. "Inference in High-Dimensional Panel Models With an Application to Gun Control," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 590-605, October.
    9. Qingfeng Liu & Ryo Okui & Arihiro Yoshimura, 2016. "Generalized Least Squares Model Averaging," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1692-1752, December.
    10. Chen, Yu-chin & Turnovsky, Stephen J. & Zivot, Eric, 2014. "Forecasting inflation using commodity price aggregates," Journal of Econometrics, Elsevier, vol. 183(1), pages 117-134.
    11. Yuan, Zheng & Yang, Yuhong, 2005. "Combining Linear Regression Models: When and How?," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1202-1214, December.
    12. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    13. Steven Lehrer & Tian Xie, 2017. "Box Office Buzz: Does Social Media Data Steal the Show from Model Uncertainty When Forecasting for Hollywood?," The Review of Economics and Statistics, MIT Press, vol. 99(5), pages 749-755, December.
    14. Hsiao, Cheng & Wan, Shui Ki, 2014. "Is there an optimal forecast combination?," Journal of Econometrics, Elsevier, vol. 178(P2), pages 294-309.
    15. Huiyu Huang & Tae-Hwy Lee, 2010. "To Combine Forecasts or to Combine Information?," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 534-570.
    16. Steven J. Jordan & Andrew Vivian & Mark E. Wohar, 2018. "Stock returns forecasting with metals: sentiment vs. fundamentals," The European Journal of Finance, Taylor & Francis Journals, vol. 24(6), pages 458-477, April.
    17. Pesaran, M. Hashem & Timmermann, Allan, 2002. "Market timing and return prediction under model instability," Journal of Empirical Finance, Elsevier, vol. 9(5), pages 495-510, December.
    18. Graham Elliott & Allan Timmermann, 2016. "Economic Forecasting," Economics Books, Princeton University Press, edition 1, number 10740.
    19. Zhang, Xinyu & Liu, Chu-An, 2019. "Inference After Model Averaging In Linear Regression Models," Econometric Theory, Cambridge University Press, vol. 35(4), pages 816-841, August.
    20. Claeskens, Gerda & Magnus, Jan R. & Vasnev, Andrey L. & Wang, Wendun, 2016. "The forecast combination puzzle: A simple theoretical explanation," International Journal of Forecasting, Elsevier, vol. 32(3), pages 754-762.
    21. Cai, Zongwu, 2007. "Trending time-varying coefficient time series models with serially correlated errors," Journal of Econometrics, Elsevier, vol. 136(1), pages 163-188, January.
    22. Graham Elliott & Allan Timmermann, 2005. "Optimal Forecast Combination Under Regime Switching ," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 46(4), pages 1081-1102, November.
    23. Lundbergh, Stefan & Terasvirta, Timo & van Dijk, Dick, 2003. "Time-Varying Smooth Transition Autoregressive Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(1), pages 104-121, January.
    24. Liang, Hua & Li, Runze, 2009. "Variable Selection for Partially Linear Models With Measurement Errors," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 234-248.
    25. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    26. Francis X. Diebold & Peter Pauly, 1987. "Structural change and the combination of forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 6(1), pages 21-40.
    27. Yousuf, Kashif & Ng, Serena, 2021. "Boosting high dimensional predictive regressions with time varying parameters," Journal of Econometrics, Elsevier, vol. 224(1), pages 60-87.
    28. Sun, Yuying & Hong, Yongmiao & Lee, Tae-Hwy & Wang, Shouyang & Zhang, Xinyu, 2021. "Time-varying model averaging," Journal of Econometrics, Elsevier, vol. 222(2), pages 974-992.
    29. Hansen, Bruce E., 2008. "Least-squares forecast averaging," Journal of Econometrics, Elsevier, vol. 146(2), pages 342-350, October.
    30. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    31. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    32. Barbara Rossi & Atsushi Inoue, 2012. "Out-of-Sample Forecast Tests Robust to the Choice of Window Size," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(3), pages 432-453, April.
    33. Cheng, Xu & Hansen, Bruce E., 2015. "Forecasting with factor-augmented regression: A frequentist model averaging approach," Journal of Econometrics, Elsevier, vol. 186(2), pages 280-293.
    34. Qingfeng Liu & Ryo Okui, 2013. "Heteroscedasticity‐robust C(p) model averaging," Econometrics Journal, Royal Economic Society, vol. 16(3), pages 463-472, October.
    35. Bruce E. Hansen, 2014. "Model averaging, asymptotic risk, and regressor groups," Quantitative Economics, Econometric Society, vol. 5(3), pages 495-530, November.
    36. Xinyu Zhang & Dalei Yu & Guohua Zou & Hua Liang, 2016. "Optimal Model Averaging Estimation for Generalized Linear Models and Generalized Linear Mixed-Effects Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1775-1790, October.
    37. Pesaran, M. Hashem & Pick, Andreas, 2011. "Forecast Combination Across Estimation Windows," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(2), pages 307-318.
    38. Bin Chen & Yongmiao Hong, 2012. "Testing for Smooth Structural Changes in Time Series Models via Nonparametric Regression," Econometrica, Econometric Society, vol. 80(3), pages 1157-1183, May.
    39. Deutsch, Melinda & Granger, Clive W. J. & Terasvirta, Timo, 1994. "The combination of forecasts using changing weights," International Journal of Forecasting, Elsevier, vol. 10(1), pages 47-57, June.
    40. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    41. Liu, Chu-An, 2015. "Distribution theory of the least squares averaging estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 142-159.
    42. Michael Vogt, 2012. "Nonparametric regression for locally stationary time series," CeMMAP working papers CWP22/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    43. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    44. Graham Elliott & Allan Timmermann, 2016. "Forecasting in Economics and Finance," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 81-110, October.
    45. Paye, Bradley S. & Timmermann, Allan, 2006. "Instability of return prediction models," Journal of Empirical Finance, Elsevier, vol. 13(3), pages 274-315, June.
    46. Tomohiro Ando & Ker-Chau Li, 2014. "A Model-Averaging Approach for High-Dimensional Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(505), pages 254-265, March.
    47. Xinyu Zhang & Guohua Zou & Hua Liang & Raymond J. Carroll, 2020. "Parsimonious Model Averaging With a Diverging Number of Parameters," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(530), pages 972-984, April.
    48. P. M. Robinson, 1991. "Consistent Nonparametric Entropy-Based Testing," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(3), pages 437-453.
    49. Bruce E. Hansen, 2001. "The New Econometrics of Structural Change: Dating Breaks in U.S. Labour Productivity," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 117-128, Fall.
    50. Li, Degui & Linton, Oliver & Lu, Zudi, 2015. "A flexible semiparametric forecasting model for time series," Journal of Econometrics, Elsevier, vol. 187(1), pages 345-357.
    51. Raffaella Giacomini & Barbara Rossi, 2010. "Forecast comparisons in unstable environments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 595-620.
    52. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    53. Yongmiao Hong & Xia Wang & Shouyang Wang, 2017. "Testing Strict Stationarity With Applications To Macroeconomic Time Series," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 58(4), pages 1227-1277, November.
    54. Marcelo C. Medeiros & Gabriel F. R. Vasconcelos & Álvaro Veiga & Eduardo Zilberman, 2021. "Forecasting Inflation in a Data-Rich Environment: The Benefits of Machine Learning Methods," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 98-119, January.
    55. Lin, Chien-Fu Jeff & Terasvirta, Timo, 1994. "Testing the constancy of regression parameters against continuous structural change," Journal of Econometrics, Elsevier, vol. 62(2), pages 211-228, June.
    56. David F. Hendry & Michael P. Clements, 2004. "Pooling of forecasts," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 1-31, June.
    57. Conflitti, Cristina & De Mol, Christine & Giannone, Domenico, 2015. "Optimal combination of survey forecasts," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1096-1103.
    58. Chu‐An Liu & Biing‐Shen Kuo, 2016. "Model averaging in predictive regressions," Econometrics Journal, Royal Economic Society, vol. 19(2), pages 203-231, June.
    59. Su, Liangjun & Wang, Xia, 2017. "On time-varying factor models: Estimation and testing," Journal of Econometrics, Elsevier, vol. 198(1), pages 84-101.
    60. Liang, Hua & Zou, Guohua & Wan, Alan T. K. & Zhang, Xinyu, 2011. "Optimal Weight Choice for Frequentist Model Average Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1053-1066.
    61. Lucas, Robert Jr, 1976. "Econometric policy evaluation: A critique," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 1(1), pages 19-46, January.
    62. Jia Chen & Degui Li & Oliver Linton & Zudi Lu, 2018. "Semiparametric Ultra-High Dimensional Model Averaging of Nonlinear Dynamic Time Series," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 919-932, April.
    63. Pesaran, M. Hashem & Timmermann, Allan, 2007. "Selection of estimation window in the presence of breaks," Journal of Econometrics, Elsevier, vol. 137(1), pages 134-161, March.
    64. Li, Jiahan & Chen, Weiye, 2014. "Forecasting macroeconomic time series: LASSO-based approaches and their forecast combinations with dynamic factor models," International Journal of Forecasting, Elsevier, vol. 30(4), pages 996-1015.
    65. Jeremy Smith & Kenneth F. Wallis, 2009. "A Simple Explanation of the Forecast Combination Puzzle," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 331-355, June.
    66. Feng, Yang & Liu, Qingfeng & Okui, Ryo, 2020. "On the sparsity of Mallows model averaging estimator," Economics Letters, Elsevier, vol. 187(C).
    67. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    68. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    69. Liao, Jun & Zong, Xianpeng & Zhang, Xinyu & Zou, Guohua, 2019. "Model averaging based on leave-subject-out cross-validation for vector autoregressions," Journal of Econometrics, Elsevier, vol. 209(1), pages 35-60.
    70. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chen, Qitong & Hong, Yongmiao & Li, Haiqi, 2024. "Time-varying forecast combination for factor-augmented regressions with smooth structural changes," Journal of Econometrics, Elsevier, vol. 240(1).
    2. Mikihito Nishi, 2024. "Estimating Time-Varying Parameters of Various Smoothness in Linear Models via Kernel Regression," Papers 2406.14046, arXiv.org, revised Oct 2024.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Qitong & Hong, Yongmiao & Li, Haiqi, 2024. "Time-varying forecast combination for factor-augmented regressions with smooth structural changes," Journal of Econometrics, Elsevier, vol. 240(1).
    2. Sun, Yuying & Hong, Yongmiao & Lee, Tae-Hwy & Wang, Shouyang & Zhang, Xinyu, 2021. "Time-varying model averaging," Journal of Econometrics, Elsevier, vol. 222(2), pages 974-992.
    3. Chen, Yi-Ting & Liu, Chu-An, 2023. "Model averaging for asymptotically optimal combined forecasts," Journal of Econometrics, Elsevier, vol. 235(2), pages 592-607.
    4. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    5. Yuying Sun & Shaoxin Hong & Zongwu Cai, 2023. "Optimal Local Model Averaging for Divergent-Dimensional Functional-Coefficient Regressions," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202309, University of Kansas, Department of Economics, revised Sep 2023.
    6. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    7. Zhang, Xiaomeng & Zhang, Xinyu, 2023. "Optimal model averaging based on forward-validation," Journal of Econometrics, Elsevier, vol. 237(2).
    8. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    9. Zhang, Xinyu & Liu, Chu-An, 2023. "Model averaging prediction by K-fold cross-validation," Journal of Econometrics, Elsevier, vol. 235(1), pages 280-301.
    10. Liao, Jun & Zou, Guohua, 2020. "Corrected Mallows criterion for model averaging," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    11. Haowen Bao & Zongwu Cai & Yuying Sun & Shouyang Wang, 2023. "Penalized Model Averaging for High Dimensional Quantile Regressions," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202302, University of Kansas, Department of Economics, revised Jan 2023.
    12. Xiaojie Xu, 2020. "Corn Cash Price Forecasting," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(4), pages 1297-1320, August.
    13. Wei Qian & Craig A. Rolling & Gang Cheng & Yuhong Yang, 2019. "On the Forecast Combination Puzzle," Econometrics, MDPI, vol. 7(3), pages 1-26, September.
    14. Greenaway-McGrevy, Ryan, 2022. "Forecast combination for VARs in large N and T panels," International Journal of Forecasting, Elsevier, vol. 38(1), pages 142-164.
    15. Chen, Bin & Maung, Kenwin, 2023. "Time-varying forecast combination for high-dimensional data," Journal of Econometrics, Elsevier, vol. 237(2).
    16. Yousuf, Kashif & Ng, Serena, 2021. "Boosting high dimensional predictive regressions with time varying parameters," Journal of Econometrics, Elsevier, vol. 224(1), pages 60-87.
    17. Wenchao Xu & Xinyu Zhang, 2024. "On Asymptotic Optimality of Least Squares Model Averaging When True Model Is Included," Papers 2411.09258, arXiv.org.
    18. Liao, Jun & Zou, Guohua & Gao, Yan & Zhang, Xinyu, 2021. "Model averaging prediction for time series models with a diverging number of parameters," Journal of Econometrics, Elsevier, vol. 223(1), pages 190-221.
    19. Liao, Jun & Zong, Xianpeng & Zhang, Xinyu & Zou, Guohua, 2019. "Model averaging based on leave-subject-out cross-validation for vector autoregressions," Journal of Econometrics, Elsevier, vol. 209(1), pages 35-60.
    20. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.

    More about this item

    Keywords

    Model averaging; Asymptotic normality; LASSO; Time-varying weights; Sparsity;
    All these keywords.

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:235:y:2023:i:2:p:1355-1377. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.