IDEAS home Printed from https://ideas.repec.org/p/msh/ebswps/2020-16.html
   My bibliography  Save this paper

Bagging Weak Predictors

Author

Listed:
  • Eric Hillebrand
  • Manuel Lukas
  • Wei Wei

Abstract

Relations between economic variables are often not exploited for forecasting, suggesting that predictors are weak in the sense that the estimation uncertainty is larger than the bias from ignoring the relation. In this paper, we propose a novel bagging estimator designed for such predictors. Based on a test for finite-sample predictive ability, our estimator shrinks the OLS estimate not to zero, but towards the null of the test which equates squared bias with estimation variance, and we apply bagging to further reduce the estimation variance. We derive the asymptotic distribution and show that our estimator can substantially lower the MSE compared to the standard ttest bagging. An asymptotic shrinkage representation for the estimator that simplifies computation is provided. Monte Carlo simulations show that the predictor works well in small samples. In an empirical application, we find that our proposed estimators works well for inflation forecasting using unemployment or industrial production as predictors.

Suggested Citation

  • Eric Hillebrand & Manuel Lukas & Wei Wei, 2020. "Bagging Weak Predictors," Monash Econometrics and Business Statistics Working Papers 16/20, Monash University, Department of Econometrics and Business Statistics.
  • Handle: RePEc:msh:ebswps:2020-16
    as

    Download full text from publisher

    File URL: https://www.monash.edu/business/ebs/research/publications/ebs/wp16-2020.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    3. David Rapach & Jack Strauss, 2010. "Bagging or Combining (or Both)? An Analysis Based on Forecasting U.S. Employment Growth," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 511-533.
    4. Marine Carrasco & Barbara Rossi, 2016. "In-Sample Inference and Forecasting in Misspecified Factor Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 313-338, July.
    5. Laurence Ball & Sandeep Mazumder, 2019. "A Phillips Curve with Anchored Expectations and Short‐Term Unemployment," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 51(1), pages 111-137, February.
    6. Inoue, Atsushi & Kilian, Lutz, 2008. "How Useful Is Bagging in Forecasting Economic Time Series? A Case Study of U.S. Consumer Price Inflation," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 511-522, June.
    7. Stephen G. Cecchetti & Rita S. Chu & Charles Steindel, 2000. "The unreliability of inflation indicators," Current Issues in Economics and Finance, Federal Reserve Bank of New York, vol. 6(Apr).
    8. Jordan, Steven J. & Vivian, Andrew & Wohar, Mark E., 2017. "Forecasting market returns: bagging or combining?," International Journal of Forecasting, Elsevier, vol. 33(1), pages 102-120.
    9. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    10. Davide Pettenuzzo & Allan Timmermann, 2017. "Forecasting Macroeconomic Variables Under Model Instability," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(2), pages 183-201, April.
    11. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    12. James H. Stock & Mark W. Watson, 2012. "Generalized Shrinkage Methods for Forecasting Using Many Predictors," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(4), pages 481-493, June.
    13. Robert J. Gordon, 2013. "The Phillips Curve is Alive and Well: Inflation and the NAIRU During the Slow Recovery," NBER Working Papers 19390, National Bureau of Economic Research, Inc.
    14. Cheung, Yin-Wong & Chinn, Menzie D. & Pascual, Antonio Garcia, 2005. "Empirical exchange rate models of the nineties: Are any fit to survive?," Journal of International Money and Finance, Elsevier, vol. 24(7), pages 1150-1175, November.
    15. Pettenuzzo, Davide & Timmermann, Allan & Valkanov, Rossen, 2014. "Forecasting stock returns under economic constraints," Journal of Financial Economics, Elsevier, vol. 114(3), pages 517-553.
    16. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    17. Clark, Todd E. & McCracken, Michael W., 2012. "In-sample tests of predictive ability: A new approach," Journal of Econometrics, Elsevier, vol. 170(1), pages 1-14.
    18. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    19. Eric Hillebrand & Marcelo Medeiros, 2010. "The Benefits of Bagging for Forecast Models of Realized Volatility," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 571-593.
    20. de Jong, Robert M., 1997. "Central Limit Theorems for Dependent Heterogeneous Random Variables," Econometric Theory, Cambridge University Press, vol. 13(3), pages 353-367, June.
    21. Kim, Hyun Hak & Swanson, Norman R., 2014. "Forecasting financial and macroeconomic variables using data reduction methods: New empirical evidence," Journal of Econometrics, Elsevier, vol. 178(P2), pages 352-367.
    22. Andrew Patton & Dimitris Politis & Halbert White, 2009. "Correction to “Automatic Block-Length Selection for the Dependent Bootstrap” by D. Politis and H. White," Econometric Reviews, Taylor & Francis Journals, vol. 28(4), pages 372-375.
    23. James H. Stock & Mark W. Watson, 2007. "Erratum to "Why Has U.S. Inflation Become Harder to Forecast?"," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(7), pages 1849-1849, October.
    24. Dimitris Politis & Halbert White, 2004. "Automatic Block-Length Selection for the Dependent Bootstrap," Econometric Reviews, Taylor & Francis Journals, vol. 23(1), pages 53-70.
    25. Meese, Richard A. & Rogoff, Kenneth, 1983. "Empirical exchange rate models of the seventies : Do they fit out of sample?," Journal of International Economics, Elsevier, vol. 14(1-2), pages 3-24, February.
    26. Sainan Jin & Liangjun Su & Aman Ullah, 2014. "Robustify Financial Time Series Forecasting with Bagging," Econometric Reviews, Taylor & Francis Journals, vol. 33(5-6), pages 575-605, August.
    27. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    28. G. Elliott & C. Granger & A. Timmermann (ed.), 2013. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 2, number 2.
    29. Mark W. Watson, 2014. "Inflation Persistence, the NAIRU, and the Great Recession," American Economic Review, American Economic Association, vol. 104(5), pages 31-36, May.
    30. Haldrup, Niels & Meitz, Mika & Saikkonen, Pentti (ed.), 2014. "Essays in Nonlinear Time Series Econometrics," OUP Catalogue, Oxford University Press, number 9780199679959.
    31. Andrew Atkeson & Lee E. Ohanian, 2001. "Are Phillips curves useful for forecasting inflation?," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 25(Win), pages 2-11.
    32. Tae-Hwy Lee & Eric Hillebrand & Marcelo Medeiros, 2014. "Bagging Constrained Equity Premium Predictors," Working Papers 201421, University of California at Riverside, Department of Economics, revised Feb 2013.
    33. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Özen, Kadir & Yıldırım, Dilem, 2021. "Application of bagging in day-ahead electricity price forecasting and factor augmentation," Energy Economics, Elsevier, vol. 103(C).
    2. Philippe Goulet Coulombe, 2021. "The Macroeconomy as a Random Forest," Working Papers 21-05, Chair in macroeconomics and forecasting, University of Quebec in Montreal's School of Management.
    3. Philippe Goulet Coulombe, 2021. "To Bag is to Prune," Working Papers 21-03, Chair in macroeconomics and forecasting, University of Quebec in Montreal's School of Management, revised Jun 2021.
    4. Luo, Qin & Bu, Jinfeng & Xu, Weiju & Huang, Dengshi, 2023. "Stock market volatility prediction: Evidence from a new bagging model," International Review of Economics & Finance, Elsevier, vol. 87(C), pages 445-456.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nima Nonejad, 2021. "An Overview Of Dynamic Model Averaging Techniques In Time‐Series Econometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 35(2), pages 566-614, April.
    2. Nonejad, Nima, 2022. "Predicting equity premium out-of-sample by conditioning on newspaper-based uncertainty measures: A comparative study," International Review of Financial Analysis, Elsevier, vol. 83(C).
    3. Ribeiro, Pinho J., 2017. "Selecting exchange rate fundamentals by bootstrap," International Journal of Forecasting, Elsevier, vol. 33(4), pages 894-914.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Salisu, Afees A. & Ademuyiwa, Idris & Isah, Kazeem O., 2018. "Revisiting the forecasting accuracy of Phillips curve: The role of oil price," Energy Economics, Elsevier, vol. 70(C), pages 334-356.
    6. Nima Nonejad, 2021. "Bayesian model averaging and the conditional volatility process: an application to predicting aggregate equity returns by conditioning on economic variables," Quantitative Finance, Taylor & Francis Journals, vol. 21(8), pages 1387-1411, August.
    7. Luo, Qin & Bu, Jinfeng & Xu, Weiju & Huang, Dengshi, 2023. "Stock market volatility prediction: Evidence from a new bagging model," International Review of Economics & Finance, Elsevier, vol. 87(C), pages 445-456.
    8. Sun, Yuying & Hong, Yongmiao & Lee, Tae-Hwy & Wang, Shouyang & Zhang, Xinyu, 2021. "Time-varying model averaging," Journal of Econometrics, Elsevier, vol. 222(2), pages 974-992.
    9. Giovannelli, Alessandro & Massacci, Daniele & Soccorsi, Stefano, 2021. "Forecasting stock returns with large dimensional factor models," Journal of Empirical Finance, Elsevier, vol. 63(C), pages 252-269.
    10. Lyu, Zhichong & Ma, Feng & Zhang, Jixiang, 2023. "Oil futures volatility prediction: Bagging or combination?," International Review of Economics & Finance, Elsevier, vol. 87(C), pages 457-467.
    11. Souropanis, Ioannis & Vivian, Andrew, 2023. "Forecasting realized volatility with wavelet decomposition," Journal of Empirical Finance, Elsevier, vol. 74(C).
    12. Franz Xaver Zobl & Martin Ertl, 2021. "The Condemned Live Longer – New Evidence of the New Keynesian Phillips Curve in Central and Eastern Europe," Open Economies Review, Springer, vol. 32(4), pages 671-699, September.
    13. Nonejad, Nima, 2021. "Predicting equity premium using dynamic model averaging. Does the state–space representation matter?," The North American Journal of Economics and Finance, Elsevier, vol. 57(C).
    14. Nonejad, Nima, 2023. "Conditional out-of-sample predictability of aggregate equity returns and aggregate equity return volatility using economic variables," Journal of Empirical Finance, Elsevier, vol. 70(C), pages 91-122.
    15. Chen, Qitong & Hong, Yongmiao & Li, Haiqi, 2024. "Time-varying forecast combination for factor-augmented regressions with smooth structural changes," Journal of Econometrics, Elsevier, vol. 240(1).
    16. Matei Demetrescu & Christoph Hanck & Robinson Kruse‐Becher, 2022. "Robust inference under time‐varying volatility: A real‐time evaluation of professional forecasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 1010-1030, August.
    17. Ahmed, Shamim & Liu, Xiaoquan & Valente, Giorgio, 2016. "Can currency-based risk factors help forecast exchange rates?," International Journal of Forecasting, Elsevier, vol. 32(1), pages 75-97.
    18. Gary Koop & Dimitris Korobilis, 2023. "Bayesian Dynamic Variable Selection In High Dimensions," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(3), pages 1047-1074, August.
    19. João F. Caldeira & Rangan Gupta & Hudson S. Torrent, 2020. "Forecasting U.S. Aggregate Stock Market Excess Return: Do Functional Data Analysis Add Economic Value?," Mathematics, MDPI, vol. 8(11), pages 1-16, November.
    20. Jiahan Li & Ilias Tsiakas & Wei Wang, 2015. "Predicting Exchange Rates Out of Sample: Can Economic Fundamentals Beat the Random Walk?," Journal of Financial Econometrics, Oxford University Press, vol. 13(2), pages 293-341.

    More about this item

    Keywords

    inflation forecasting; bootstrap aggregation; estimation uncertainty; weak predictors; shrinkage methods;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2020-16. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Professor Xibin Zhang (email available below). General contact details of provider: https://edirc.repec.org/data/dxmonau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.