IDEAS home Printed from https://ideas.repec.org/a/taf/quantf/v17y2017i8p1277-1304.html
   My bibliography  Save this article

Online learning of time-varying stochastic factor structure by variational sequential Bayesian factor analysis

Author

Listed:
  • Hui ‘Fox’ Ling
  • Christian Franzen

Abstract

Investment tasks include forecasting volatilities and correlations of assets and portfolios. One of the tools widely utilized is stochastic factor analysis on a set of correlated time-series (e.g. asset returns). Published time-series factor models require either sufficiently wide time windows of observed data or numeric solutions by simulations. We developed a ‘variational sequential Bayesian factor analysis’ (VSBFA) algorithm to make online learning of time-varying stochastic factor structure. The VSBFA is an analytic filter to estimate unknown factor scores, factor loadings and residual variances. The covariance matrix of the time-series predicted by the VSBFA can be decomposed into loadings-based covariance and specific variances, and the former can be expressed by ‘explanatory factors’ such as systematic components of various financial market indices. We compared the VSBFA with the most practiced factor model relying on wide data windows, the rolling PCA (principal components analysis), by applying them to 9-year daily returns of 200 simulated stocks with the ‘true’ daily data-generating model completely known, and by using them to forecast volatilities of long-only and long/short global stock portfolios with 25-year monthly returns of more than 800 stocks worldwide. Accuracy of the forecast covariance matrices is measured by a (symmetrized) Kullback–Leibler distance, and accuracy of the forecast portfolio volatilities is measured by bias statistic, log-likelihood, Q-statistic, and portfolio volatility minimization. The factor-based covariance and specific variances predicted by the best VSBFA are significantly more accurate than those by the best rolling PCA.

Suggested Citation

  • Hui ‘Fox’ Ling & Christian Franzen, 2017. "Online learning of time-varying stochastic factor structure by variational sequential Bayesian factor analysis," Quantitative Finance, Taylor & Francis Journals, vol. 17(8), pages 1277-1304, August.
  • Handle: RePEc:taf:quantf:v:17:y:2017:i:8:p:1277-1304
    DOI: 10.1080/14697688.2016.1268708
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/14697688.2016.1268708
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/14697688.2016.1268708?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jianqing Fan & Yuan Liao & Martina Mincheva, 2013. "Large covariance estimation by thresholding principal orthogonal complements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(4), pages 603-680, September.
    2. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    3. Zhou, Xiaocong & Nakajima, Jouchi & West, Mike, 2014. "Bayesian forecasting and portfolio decisions using dynamic dependent sparse factor models," International Journal of Forecasting, Elsevier, vol. 30(4), pages 963-980.
    4. Giovanni Motta & Hernando Ombao, 2012. "Evolutionary Factor Analysis of Replicated Time Series," Biometrics, The International Biometric Society, vol. 68(3), pages 825-836, September.
    5. Stock, James H. & Watson, Mark, 2011. "Dynamic Factor Models," Scholarly Articles 28469541, Harvard University Department of Economics.
    6. Koopman, Siem Jan & van der Wel, Michel, 2013. "Forecasting the US term structure of interest rates using a macroeconomic smooth dynamic factor model," International Journal of Forecasting, Elsevier, vol. 29(4), pages 676-694.
    7. Jianqing Fan & Alex Furger & Dacheng Xiu, 2016. "Incorporating Global Industrial Classification Standard Into Portfolio Allocation: A Simple Factor-Based Large Covariance Matrix Estimator With High-Frequency Data," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 489-503, October.
    8. Patton, Andrew J., 2011. "Volatility forecast comparison using imperfect volatility proxies," Journal of Econometrics, Elsevier, vol. 160(1), pages 246-256, January.
    9. Hui ‘Fox’ Ling & Douglas B. Stone, 2016. "Time-varying forecasts by variational approximation of sequential Bayesian inference," Quantitative Finance, Taylor & Francis Journals, vol. 16(1), pages 43-67, January.
    10. Jianqing Fan & Yingying Li & Ke Yu, 2012. "Vast Volatility Matrix Estimation Using High-Frequency Data for Portfolio Selection," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 412-428, March.
    11. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2014. "Dynamic factor models: A review of the literature," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2013(2), pages 73-107.
    12. Ormerod, J. T. & Wand, M. P., 2010. "Explaining Variational Approximations," The American Statistician, American Statistical Association, vol. 64(2), pages 140-153.
    13. Grimmer, Justin, 2011. "An Introduction to Bayesian Inference via Variational Approximations," Political Analysis, Cambridge University Press, vol. 19(1), pages 32-47, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    2. Thomas Conlon & John Cotter & Iason Kynigakis, 2021. "Machine Learning and Factor-Based Portfolio Optimization," Papers 2107.13866, arXiv.org.
    3. Fan, Jianqing & Kim, Donggyu, 2019. "Structured volatility matrix estimation for non-synchronized high-frequency financial data," Journal of Econometrics, Elsevier, vol. 209(1), pages 61-78.
    4. Xin-Bing Kong, 2017. "On the number of common factors with high-frequency data," Biometrika, Biometrika Trust, vol. 104(2), pages 397-410.
    5. Ding, Yi & Li, Yingying & Zheng, Xinghua, 2021. "High dimensional minimum variance portfolio estimation under statistical factor models," Journal of Econometrics, Elsevier, vol. 222(1), pages 502-515.
    6. Shin, Minseok & Kim, Donggyu & Fan, Jianqing, 2023. "Adaptive robust large volatility matrix estimation based on high-frequency financial data," Journal of Econometrics, Elsevier, vol. 237(1).
    7. Kong, Xin-Bing & Liu, Cheng, 2018. "Testing against constant factor loading matrix with large panel high-frequency data," Journal of Econometrics, Elsevier, vol. 204(2), pages 301-319.
    8. Li, Y-N. & Chen, J. & Linton, O., 2021. "Estimation of Common Factors for Microstructure Noise and Efficient Price in a High-frequency Dual Factor Model," Cambridge Working Papers in Economics 2150, Faculty of Economics, University of Cambridge.
    9. Barigozzi, Matteo & Trapani, Lorenzo, 2020. "Sequential testing for structural stability in approximate factor models," Stochastic Processes and their Applications, Elsevier, vol. 130(8), pages 5149-5187.
    10. Tae-Hwy Lee & Ekaterina Seregina, 2024. "Optimal Portfolio Using Factor Graphical Lasso," Journal of Financial Econometrics, Oxford University Press, vol. 22(3), pages 670-695.
    11. Jian, Zhihong & Deng, Pingjun & Zhu, Zhican, 2018. "High-dimensional covariance forecasting based on principal component analysis of high-frequency data," Economic Modelling, Elsevier, vol. 75(C), pages 422-431.
    12. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    13. Gianluca De Nard & Olivier Ledoit & Michael Wolf, 2018. "Factor models for portfolio selection in large dimensions: the good, the better and the ugly," ECON - Working Papers 290, Department of Economics - University of Zurich, revised Dec 2018.
    14. Choi, Sung Hoon & Kim, Donggyu, 2023. "Large volatility matrix analysis using global and national factor models," Journal of Econometrics, Elsevier, vol. 235(2), pages 1917-1933.
    15. Ruijun Bu & Degui Li & Oliver Linton & Hanchao Wang, 2022. "Nonparametric Estimation of Large Spot Volatility Matrices for High-Frequency Financial Data," Working Papers 202212, University of Liverpool, Department of Economics.
    16. Lam, Clifford, 2020. "High-dimensional covariance matrix estimation," LSE Research Online Documents on Economics 101667, London School of Economics and Political Science, LSE Library.
    17. Xinyu Song, 2019. "Large Volatility Matrix Prediction with High-Frequency Data," Papers 1907.01196, arXiv.org, revised Sep 2019.
    18. Kim, Donggyu & Song, Xinyu & Wang, Yazhen, 2022. "Unified discrete-time factor stochastic volatility and continuous-time Itô models for combining inference based on low-frequency and high-frequency," Journal of Multivariate Analysis, Elsevier, vol. 192(C).
    19. Duangnate, Kannika & Mjelde, James W., 2017. "Comparison of data-rich and small-scale data time series models generating probabilistic forecasts: An application to U.S. natural gas gross withdrawals," Energy Economics, Elsevier, vol. 65(C), pages 411-423.
    20. repec:cte:wsrepe:27047 is not listed on IDEAS
    21. Caner, Mehmet & Medeiros, Marcelo & Vasconcelos, Gabriel F.R., 2023. "Sharpe Ratio analysis in high dimensions: Residual-based nodewise regression in factor models," Journal of Econometrics, Elsevier, vol. 235(2), pages 393-417.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:quantf:v:17:y:2017:i:8:p:1277-1304. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/RQUF20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.