IDEAS home Printed from https://ideas.repec.org/a/eee/finana/v84y2022ics1057521922003441.html
   My bibliography  Save this article

Time-variation, multiple testing, and the factor zoo

Author

Listed:
  • Smith, Simon C.

Abstract

Bayesians circumvent the need for significance threshold correction when multiple testing and we recommend controlling the Type-S (sign), rather than the Type-1, error rate because it yields more reliable frequency properties for inferences. Our unified Bayesian framework, with theory-informed priors, identifies two breaks (2001 and 2008) in our 1980–2018 sample period. After each break the set of characteristics changes, and only market beta is selected in all regimes. In a portfolio application, the method generates significantly larger Sharpe ratios after transaction costs than a range of benchmark methods, including the same model that uses a Type-1 (not Type-S) error framework.

Suggested Citation

  • Smith, Simon C., 2022. "Time-variation, multiple testing, and the factor zoo," International Review of Financial Analysis, Elsevier, vol. 84(C).
    • Handle: RePEc:eee:finana:v:84:y:2022:i:c:s1057521922003441
    DOI: 10.1016/j.irfa.2022.102394
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1057521922003441
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.irfa.2022.102394?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2021. "Economic Predictions With Big Data: The Illusion of Sparsity," Econometrica, Econometric Society, vol. 89(5), pages 2409-2437, September.
    2. Shanken, Jay, 1992. "The Current State of the Arbitrage Pricing Theory," Journal of Finance, American Finance Association, vol. 47(4), pages 1569-1574, September.
    3. Jagannathan, Ravi & Wang, Zhenyu, 1996. "The Conditional CAPM and the Cross-Section of Expected Returns," Journal of Finance, American Finance Association, vol. 51(1), pages 3-53, March.
    4. Lewellen, Jonathan, 2015. "The Cross-section of Expected Stock Returns," Critical Finance Review, now publishers, vol. 4(1), pages 1-44, June.
    5. Stefano Giglio & Yuan Liao & Dacheng Xiu, 2021. "Thousands of Alpha Tests," NBER Chapters, in: Big Data: Long-Term Implications for Financial Markets and Firms, pages 3456, National Bureau of Economic Research, Inc.
    6. Guanhao Feng & Stefano Giglio & Dacheng Xiu, 2020. "Taming the Factor Zoo: A Test of New Factors," Journal of Finance, American Finance Association, vol. 75(3), pages 1327-1370, June.
    7. Ľluboš Pástor & Robert F. Stambaugh, 2001. "The Equity Premium and Structural Breaks," Journal of Finance, American Finance Association, vol. 56(4), pages 1207-1239, August.
    8. Barillas, Francisco & Kan, Raymond & Robotti, Cesare & Shanken, Jay, 2020. "Model Comparison with Sharpe Ratios," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 55(6), pages 1840-1874, September.
    9. Campbell R. Harvey & Yan Liu, 2020. "False (and Missed) Discoveries in Financial Economics," Journal of Finance, American Finance Association, vol. 75(5), pages 2503-2553, October.
    10. Joachim Freyberger & Andreas Neuhierl & Michael Weber & Andrew KarolyiEditor, 2020. "Dissecting Characteristics Nonparametrically," Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2326-2377.
    11. Pastor, Lubos & Stambaugh, Robert F., 2003. "Liquidity Risk and Expected Stock Returns," Journal of Political Economy, University of Chicago Press, vol. 111(3), pages 642-685, June.
    12. Francisco Barillas & Jay Shanken, 2018. "Comparing Asset Pricing Models," Journal of Finance, American Finance Association, vol. 73(2), pages 715-754, April.
    13. Campbell R. Harvey, 2017. "Presidential Address: The Scientific Outlook in Financial Economics," Journal of Finance, American Finance Association, vol. 72(4), pages 1399-1440, August.
    14. Eugene F Fama & Kenneth R French & Andrew KarolyiEditor, 2020. "Comparing Cross-Section and Time-Series Factor Models," Review of Finance, European Finance Association, vol. 33(5), pages 1891-1926.
    15. Tobias Adrian & Erkko Etula & Tyler Muir, 2014. "Financial Intermediaries and the Cross-Section of Asset Returns," Journal of Finance, American Finance Association, vol. 69(6), pages 2557-2596, December.
    16. Ľuboš Pástor & Robert F. Stambaugh, 1999. "Costs of Equity Capital and Model Mispricing," Journal of Finance, American Finance Association, vol. 54(1), pages 67-121, February.
    17. Lettau, Martin & Pelger, Markus, 2020. "Estimating latent asset-pricing factors," Journal of Econometrics, Elsevier, vol. 218(1), pages 1-31.
    18. Wachter, Jessica A. & Warusawitharana, Missaka, 2009. "Predictable returns and asset allocation: Should a skeptical investor time the market?," Journal of Econometrics, Elsevier, vol. 148(2), pages 162-178, February.
    19. John Y. Campbell, 2000. "Asset Pricing at the Millennium," Journal of Finance, American Finance Association, vol. 55(4), pages 1515-1567, August.
    20. Smith, Simon C. & Timmermann, Allan, 2022. "Have risk premia vanished?," Journal of Financial Economics, Elsevier, vol. 145(2), pages 553-576.
    21. Kozak, Serhiy & Nagel, Stefan & Santosh, Shrihari, 2020. "Shrinking the cross-section," Journal of Financial Economics, Elsevier, vol. 135(2), pages 271-292.
    22. Smith, Simon C. & Timmermann, Allan & Zhu, Yinchu, 2019. "Variable selection in panel models with breaks," Journal of Econometrics, Elsevier, vol. 212(1), pages 323-344.
    23. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    24. Martin Lettau & Sydney Ludvigson, 2001. "Resurrecting the (C)CAPM: A Cross-Sectional Test When Risk Premia Are Time-Varying," Journal of Political Economy, University of Chicago Press, vol. 109(6), pages 1238-1287, December.
    25. Kewei Hou & Chen Xue & Lu Zhang, 2020. "Replicating Anomalies," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2019-2133.
    26. Campbell R. Harvey & Yan Liu, 2020. "False (and Missed) Discoveries in Financial Economics," Papers 2006.04269, arXiv.org.
    27. Ledoit, Oliver & Wolf, Michael, 2008. "Robust performance hypothesis testing with the Sharpe ratio," Journal of Empirical Finance, Elsevier, vol. 15(5), pages 850-859, December.
    28. Siddhartha Chib & Xiaming Zeng & Lingxiao Zhao, 2020. "On Comparing Asset Pricing Models," Journal of Finance, American Finance Association, vol. 75(1), pages 551-577, February.
    29. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," The Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
    30. Bekaert, Geert & Harvey, Campbell R. & Lumsdaine, Robin L., 2002. "Dating the integration of world equity markets," Journal of Financial Economics, Elsevier, vol. 65(2), pages 203-247, August.
    31. Soosung Hwang & Alexandre Rubesam, 2022. "Bayesian Selection of Asset Pricing Factors Using Individual Stocks [Bayesian Variable Selection for the Seemingly Unrelated Regression Model with a Large Number of Predictors]," Journal of Financial Econometrics, Oxford University Press, vol. 20(4), pages 716-761.
    32. Victor DeMiguel & Alberto Martín-Utrera & Francisco J Nogales & Raman Uppal & Andrew KarolyiEditor, 2020. "A Transaction-Cost Perspective on the Multitude of Firm Characteristics," Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2180-2222.
    33. Fama, Eugene F & French, Kenneth R, 1992. "The Cross-Section of Expected Stock Returns," Journal of Finance, American Finance Association, vol. 47(2), pages 427-465, June.
    34. Dybvig, Philip H., 1983. "An explicit bound on individual assets' deviations from APT pricing in a finite economy," Journal of Financial Economics, Elsevier, vol. 12(4), pages 483-496, December.
    35. Tarun Chordia & Amit Goyal & Alessio Saretto & Andrew KarolyiEditor, 2020. "Anomalies and False Rejections," Review of Finance, European Finance Association, vol. 33(5), pages 2134-2179.
    36. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    37. Leeb, Hannes & Pötscher, Benedikt M., 2005. "Model Selection And Inference: Facts And Fiction," Econometric Theory, Cambridge University Press, vol. 21(1), pages 21-59, February.
    38. Gary Koop & Simon M. Potter, 2007. "Estimation and Forecasting in Models with Multiple Breaks," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(3), pages 763-789.
    39. Fama, Eugene F. & French, Kenneth R., 2015. "Incremental variables and the investment opportunity set," Journal of Financial Economics, Elsevier, vol. 117(3), pages 470-488.
    40. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    41. Dangl, Thomas & Halling, Michael, 2012. "Predictive regressions with time-varying coefficients," Journal of Financial Economics, Elsevier, vol. 106(1), pages 157-181.
    42. Eugene F Fama & Kenneth R French, 2020. "Comparing Cross-Section and Time-Series Factor Models," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 1891-1926.
    43. Jeremiah Green & John R. M. Hand & X. Frank Zhang, 2017. "The Characteristics that Provide Independent Information about Average U.S. Monthly Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 30(12), pages 4389-4436.
    44. Shleifer, Andrei & Vishny, Robert W, 1997. "The Limits of Arbitrage," Journal of Finance, American Finance Association, vol. 52(1), pages 35-55, March.
    45. Grinblatt, Mark & Titman, Sheridan, 1983. "Factor pricing in a finite economy," Journal of Financial Economics, Elsevier, vol. 12(4), pages 497-507, December.
    46. Alex Chinco & Adam D. Clark‐Joseph & Mao Ye, 2019. "Sparse Signals in the Cross‐Section of Returns," Journal of Finance, American Finance Association, vol. 74(1), pages 449-492, February.
    47. William F. Sharpe, 1964. "Capital Asset Prices: A Theory Of Market Equilibrium Under Conditions Of Risk," Journal of Finance, American Finance Association, vol. 19(3), pages 425-442, September.
    48. Michael Johannes & Arthur Korteweg & Nicholas Polson, 2014. "Sequential Learning, Predictability, and Optimal Portfolio Returns," Journal of Finance, American Finance Association, vol. 69(2), pages 611-644, April.
    49. Motohiro Yogo, 2006. "A Consumption‐Based Explanation of Expected Stock Returns," Journal of Finance, American Finance Association, vol. 61(2), pages 539-580, April.
    50. Doron Avramov & John C. Chao, 2006. "An Exact Bayes Test of Asset Pricing Models with Application to International Markets," The Journal of Business, University of Chicago Press, vol. 79(1), pages 293-324, January.
    51. Tarun Chordia & Amit Goyal & Alessio Saretto, 2020. "Anomalies and False Rejections," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2134-2179.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jinghua Wang & Geoffrey M. Ngene & Yan Shi & Ann Nduati Mungai, 2023. "An Investigation of the Predictability of Uncertainty Indices on Bitcoin Returns," JRFM, MDPI, vol. 16(10), pages 1-12, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Smith, Simon C., 2021. "International stock return predictability," International Review of Financial Analysis, Elsevier, vol. 78(C).
    2. Smith, Simon C. & Timmermann, Allan, 2022. "Have risk premia vanished?," Journal of Financial Economics, Elsevier, vol. 145(2), pages 553-576.
    3. Doron Avramov & Si Cheng & Lior Metzker & Stefan Voigt, 2023. "Integrating Factor Models," Journal of Finance, American Finance Association, vol. 78(3), pages 1593-1646, June.
    4. Sun, Chuanping, 2024. "Factor correlation and the cross section of asset returns: A correlation-robust machine learning approach," Journal of Empirical Finance, Elsevier, vol. 77(C).
    5. Svetlana Bryzgalova & Jiantao Huang & Christian Julliard, 2023. "Bayesian Solutions for the Factor Zoo: We Just Ran Two Quadrillion Models," Journal of Finance, American Finance Association, vol. 78(1), pages 487-557, February.
    6. Guillaume Coqueret, 2023. "Forking paths in financial economics," Papers 2401.08606, arXiv.org.
    7. Clarke, Charles, 2022. "The level, slope, and curve factor model for stocks," Journal of Financial Economics, Elsevier, vol. 143(1), pages 159-187.
    8. Söhnke M. Bartram & Harald Lohre & Peter F. Pope & Ananthalakshmi Ranganathan, 2021. "Navigating the factor zoo around the world: an institutional investor perspective," Journal of Business Economics, Springer, vol. 91(5), pages 655-703, July.
    9. Cakici, Nusret & Fieberg, Christian & Metko, Daniel & Zaremba, Adam, 2023. "Machine learning goes global: Cross-sectional return predictability in international stock markets," Journal of Economic Dynamics and Control, Elsevier, vol. 155(C).
    10. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    11. Siddhartha Chib & Simon C. Smith, 2024. "Factor Selection and Structural Breaks," Finance and Economics Discussion Series 2024-037, Board of Governors of the Federal Reserve System (U.S.).
    12. Kristoffer Pons Bertelsen, 2022. "The Prior Adaptive Group Lasso and the Factor Zoo," CREATES Research Papers 2022-05, Department of Economics and Business Economics, Aarhus University.
    13. Doron Avramov & Si Cheng & Lior Metzker, 2023. "Machine Learning vs. Economic Restrictions: Evidence from Stock Return Predictability," Management Science, INFORMS, vol. 69(5), pages 2587-2619, May.
    14. Rubesam, Alexandre, 2022. "Machine learning portfolios with equal risk contributions: Evidence from the Brazilian market," Emerging Markets Review, Elsevier, vol. 51(PB).
    15. Constantinos Kardaras & Hyeng Keun Koo & Johannes Ruf, 2022. "Estimation of growth in fund models," Papers 2208.02573, arXiv.org.
    16. Ma, Tian & Leong, Wen Jun & Jiang, Fuwei, 2023. "A latent factor model for the Chinese stock market," International Review of Financial Analysis, Elsevier, vol. 87(C).
    17. Harvey, Campbell R. & Liu, Yan, 2021. "Lucky factors," Journal of Financial Economics, Elsevier, vol. 141(2), pages 413-435.
    18. Guanhao Feng & Stefano Giglio & Dacheng Xiu, 2020. "Taming the Factor Zoo: A Test of New Factors," Journal of Finance, American Finance Association, vol. 75(3), pages 1327-1370, June.
    19. Caldeira, João F. & Santos, André A.P. & Torrent, Hudson S., 2023. "Semiparametric portfolios: Improving portfolio performance by exploiting non-linearities in firm characteristics," Economic Modelling, Elsevier, vol. 122(C).
    20. Mykola Babiak & Jozef Barunik, 2020. "Deep Learning, Predictability, and Optimal Portfolio Returns," CERGE-EI Working Papers wp677, The Center for Economic Research and Graduate Education - Economics Institute, Prague.

    More about this item

    Keywords

    Cross-section of expected returns; Firm characteristics; Type-1 errors; Type-S errors; Type-M errors; Multiple testing; Bayesian inference; Time-variation;
    All these keywords.

    JEL classification:

    • G10 - Financial Economics - - General Financial Markets - - - General (includes Measurement and Data)
    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:finana:v:84:y:2022:i:c:s1057521922003441. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620166 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.