IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2312.05593.html
   My bibliography  Save this paper

Economic Forecasts Using Many Noises

Author

Listed:
  • Yuan Liao
  • Xinjie Ma
  • Andreas Neuhierl
  • Zhentao Shi

Abstract

This paper addresses a key question in economic forecasting: does pure noise truly lack predictive power? Economists typically conduct variable selection to eliminate noises from predictors. Yet, we prove a compelling result that in most economic forecasts, the inclusion of noises in predictions yields greater benefits than its exclusion. Furthermore, if the total number of predictors is not sufficiently large, intentionally adding more noises yields superior forecast performance, outperforming benchmark predictors relying on dimension reduction. The intuition lies in economic predictive signals being densely distributed among regression coefficients, maintaining modest forecast bias while diversifying away overall variance, even when a significant proportion of predictors constitute pure noises. One of our empirical demonstrations shows that intentionally adding 300~6,000 pure noises to the Welch and Goyal (2008) dataset achieves a noteworthy 10% out-of-sample R square accuracy in forecasting the annual U.S. equity premium. The performance surpasses the majority of sophisticated machine learning models.

Suggested Citation

  • Yuan Liao & Xinjie Ma & Andreas Neuhierl & Zhentao Shi, 2023. "Economic Forecasts Using Many Noises," Papers 2312.05593, arXiv.org, revised Dec 2023.
  • Handle: RePEc:arx:papers:2312.05593
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2312.05593
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bryan T. Kelly & Semyon Malamud & Kangying Zhou, 2022. "The Virtue of Complexity in Return Prediction," NBER Working Papers 30217, National Bureau of Economic Research, Inc.
    2. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    3. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2021. "Economic Predictions With Big Data: The Illusion of Sparsity," Econometrica, Econometric Society, vol. 89(5), pages 2409-2437, September.
    4. Jianqing Fan & Yuan Liao & Martina Mincheva, 2013. "Large covariance estimation by thresholding principal orthogonal complements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(4), pages 603-680, September.
    5. Ian W. R. Martin & Christian Wagner, 2019. "What Is the Expected Return on a Stock?," Journal of Finance, American Finance Association, vol. 74(4), pages 1887-1929, August.
    6. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    7. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    8. Jondeau, Eric & Zhang, Qunzi & Zhu, Xiaoneng, 2019. "Average skewness matters," Journal of Financial Economics, Elsevier, vol. 134(1), pages 29-47.
    9. So, Eric C., 2013. "A new approach to predicting analyst forecast errors: Do investors overweight analyst forecasts?," Journal of Financial Economics, Elsevier, vol. 108(3), pages 615-640.
    10. Riccardo Colacito & Eric Ghysels & Jinghan Meng & Wasin Siwasarit, 2016. "Skewness in Expected Macro Fundamentals and the Predictability of Equity Returns: Evidence and Theory," The Review of Financial Studies, Society for Financial Studies, vol. 29(8), pages 2069-2109.
    11. Fan, Jianqing & Ke, Yuan & Wang, Kaizheng, 2020. "Factor-adjusted regularized model selection," Journal of Econometrics, Elsevier, vol. 216(1), pages 71-85.
    12. Chen, Yong & Eaton, Gregory W. & Paye, Bradley S., 2018. "Micro(structure) before macro? The predictive power of aggregate illiquidity for stock returns and economic activity," Journal of Financial Economics, Elsevier, vol. 130(1), pages 48-73.
    13. Bekaert, Geert & Hoerova, Marie, 2014. "The VIX, the variance premium and stock market volatility," Journal of Econometrics, Elsevier, vol. 183(2), pages 181-192.
    14. Stephen H. Penman & Theodore Sougiannis, 1998. "A Comparison of Dividend, Cash Flow, and Earnings Approaches to Equity Valuation," Contemporary Accounting Research, John Wiley & Sons, vol. 15(3), pages 343-383, September.
    15. Bryan Kelly & Seth Pruitt, 2013. "Market Expectations in the Cross-Section of Present Values," Journal of Finance, American Finance Association, vol. 68(5), pages 1721-1756, October.
    16. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    17. Ian Martin, 2017. "What is the Expected Return on the Market?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(1), pages 367-433.
    18. Rapach, David E. & Ringgenberg, Matthew C. & Zhou, Guofu, 2016. "Short interest and aggregate stock returns," Journal of Financial Economics, Elsevier, vol. 121(1), pages 46-65.
    19. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2005. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 830-840, September.
    20. Ball, Ray & Nikolaev, Valeri V., 2022. "On earnings and cash flows as predictors of future cash flows," Journal of Accounting and Economics, Elsevier, vol. 73(1).
    21. Connor, Gregory & Korajczyk, Robert A., 1988. "Risk and return in an equilibrium APT : Application of a new test methodology," Journal of Financial Economics, Elsevier, vol. 21(2), pages 255-289, September.
    22. Møller, Stig V. & Rangvid, Jesper, 2015. "End-of-the-year economic growth and time-varying expected returns," Journal of Financial Economics, Elsevier, vol. 115(1), pages 136-154.
    23. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    24. Christopher S. Jones & Selale Tuzel, 2013. "New Orders and Asset Prices," The Review of Financial Studies, Society for Financial Studies, vol. 26(1), pages 115-157.
    25. Antoine Didisheim & Shikun (Barry) Ke & Bryan T. Kelly & Semyon Malamud, 2023. "Complexity in Factor Pricing Models," NBER Working Papers 31689, National Bureau of Economic Research, Inc.
    26. Jann Spiess & Guido Imbens & Amar Venugopal, 2023. "Double and Single Descent in Causal Inference with an Application to High-Dimensional Synthetic Control," Papers 2305.00700, arXiv.org, revised Oct 2023.
    27. Dashan Huang & Fuwei Jiang & Jun Tu & Guofu Zhou, 2015. "Investor Sentiment Aligned: A Powerful Predictor of Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 28(3), pages 791-837.
    28. Xi Chen & Yang Ha (Tony) Cho & Yiwei Dou & Baruch Lev, 2022. "Predicting Future Earnings Changes Using Machine Learning and Detailed Financial Data," Journal of Accounting Research, Wiley Blackwell, vol. 60(2), pages 467-515, May.
    29. Ng, Serena, 2013. "Variable Selection in Predictive Regressions," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 752-789, Elsevier.
    30. Hirshleifer, David & Hou, Kewei & Teoh, Siew Hong, 2009. "Accruals, cash flows, and aggregate stock returns," Journal of Financial Economics, Elsevier, vol. 91(3), pages 389-406, March.
    31. Victoria Atanasov & Stig V. Møller & Richard Priestley, 2020. "Consumption Fluctuations and Expected Returns," Journal of Finance, American Finance Association, vol. 75(3), pages 1677-1713, June.
    32. Antoine Didisheim & Shikun Ke & Bryan T. Kelly & Semyon Malamud, 2023. "Complexity in Factor Pricing Models," Swiss Finance Institute Research Paper Series 23-19, Swiss Finance Institute.
    33. Chava, Sudheer & Gallmeyer, Michael & Park, Heungju, 2015. "Credit conditions and stock return predictability," Journal of Monetary Economics, Elsevier, vol. 74(C), pages 117-132.
    34. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    35. Jushan Bai & Serena Ng, 2006. "Confidence Intervals for Diffusion Index Forecasts and Inference for Factor-Augmented Regressions," Econometrica, Econometric Society, vol. 74(4), pages 1133-1150, July.
    36. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yonghe Lu & Yanrong Yang & Terry Zhang, 2024. "Double Descent in Portfolio Optimization: Dance between Theoretical Sharpe Ratio and Estimation Accuracy," Papers 2411.18830, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhaoxing Gao & Ruey S. Tsay, 2023. "Supervised Dynamic PCA: Linear Dynamic Forecasting with Many Predictors," Papers 2307.07689, arXiv.org.
    2. Huang, Dashan & Li, Jiangyuan & Wang, Liyao, 2021. "Are disagreements agreeable? Evidence from information aggregation," Journal of Financial Economics, Elsevier, vol. 141(1), pages 83-101.
    3. Jianqing Fan & Ricardo Masini & Marcelo C. Medeiros, 2021. "Bridging factor and sparse models," Papers 2102.11341, arXiv.org, revised Sep 2022.
    4. Pedro Isaac Chavez-Lopez & Tae-Hwy Lee, 2025. "Quantile-Covariance Three-Pass Regression Filter," Working Papers 202501, University of California at Riverside, Department of Economics.
    5. Jiang, Fuwei & Kang, Jie & Meng, Lingchao, 2024. "Certainty of uncertainty for asset pricing," Journal of Empirical Finance, Elsevier, vol. 78(C).
    6. Bae, Juhee, 2024. "Factor-augmented forecasting in big data," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1660-1688.
    7. Dashan Huang & Fuwei Jiang & Kunpeng Li & Guoshi Tong & Guofu Zhou, 2022. "Scaled PCA: A New Approach to Dimension Reduction," Management Science, INFORMS, vol. 68(3), pages 1678-1695, March.
    8. Jianqing Fan & Kunpeng Li & Yuan Liao, 2020. "Recent Developments on Factor Models and its Applications in Econometric Learning," Papers 2009.10103, arXiv.org.
    9. Borup, Daniel & Christensen, Bent Jesper & Mühlbach, Nicolaj Søndergaard & Nielsen, Mikkel Slot, 2023. "Targeting predictors in random forest regression," International Journal of Forecasting, Elsevier, vol. 39(2), pages 841-868.
    10. Ziwei Mei & Zhentao Shi, 2022. "On LASSO for High Dimensional Predictive Regression," Papers 2212.07052, arXiv.org, revised Jan 2024.
    11. Kelly, Bryan & Pruitt, Seth, 2015. "The three-pass regression filter: A new approach to forecasting using many predictors," Journal of Econometrics, Elsevier, vol. 186(2), pages 294-316.
    12. Beyhum, Jad & Striaukas, Jonas, 2024. "Testing for sparse idiosyncratic components in factor-augmented regression models," Journal of Econometrics, Elsevier, vol. 244(1).
    13. Buncic, Daniel & Tischhauser, Martin, 2017. "Macroeconomic factors and equity premium predictability," International Review of Economics & Finance, Elsevier, vol. 51(C), pages 621-644.
    14. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    15. Wang, Yunqi & Zhou, Ti, 2023. "Out-of-sample equity premium prediction: The role of option-implied constraints," Journal of Empirical Finance, Elsevier, vol. 70(C), pages 199-226.
    16. Giovannelli, Alessandro & Massacci, Daniele & Soccorsi, Stefano, 2021. "Forecasting stock returns with large dimensional factor models," Journal of Empirical Finance, Elsevier, vol. 63(C), pages 252-269.
    17. Li, Jun & Wang, Huijun & Yu, Jianfeng, 2018. "Aggregate Expected Investment Growth and Stock Market Returns," ADBI Working Papers 808, Asian Development Bank Institute.
    18. Fan, Jianqing & Jiang, Bai & Sun, Qiang, 2022. "Bayesian factor-adjusted sparse regression," Journal of Econometrics, Elsevier, vol. 230(1), pages 3-19.
    19. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    20. Tae-Hwy Lee & Ekaterina Seregina, 2024. "Optimal Portfolio Using Factor Graphical Lasso," Journal of Financial Econometrics, Oxford University Press, vol. 22(3), pages 670-695.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2312.05593. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.