IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2407.03781.html
   My bibliography  Save this paper

Block-diagonal idiosyncratic covariance estimation in high-dimensional factor models for financial time series

Author

Listed:
  • Lucija v{Z}igni'c
  • Stjepan Beguv{s}i'c
  • Zvonko Kostanjv{c}ar

Abstract

Estimation of high-dimensional covariance matrices in latent factor models is an important topic in many fields and especially in finance. Since the number of financial assets grows while the estimation window length remains of limited size, the often used sample estimator yields noisy estimates which are not even positive definite. Under the assumption of latent factor models, the covariance matrix is decomposed into a common low-rank component and a full-rank idiosyncratic component. In this paper we focus on the estimation of the idiosyncratic component, under the assumption of a grouped structure of the time series, which may arise due to specific factors such as industries, asset classes or countries. We propose a generalized methodology for estimation of the block-diagonal idiosyncratic component by clustering the residual series and applying shrinkage to the obtained blocks in order to ensure positive definiteness. We derive two different estimators based on different clustering methods and test their performance using simulation and historical data. The proposed methods are shown to provide reliable estimates and outperform other state-of-the-art estimators based on thresholding methods.

Suggested Citation

  • Lucija v{Z}igni'c & Stjepan Beguv{s}i'c & Zvonko Kostanjv{c}ar, 2024. "Block-diagonal idiosyncratic covariance estimation in high-dimensional factor models for financial time series," Papers 2407.03781, arXiv.org.
  • Handle: RePEc:arx:papers:2407.03781
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2407.03781
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    2. Jianqing Fan & Yuan Liao & Han Liu, 2016. "An overview of the estimation of large covariance and precision matrices," Econometrics Journal, Royal Economic Society, vol. 19(1), pages 1-32, February.
    3. Fama, Eugene F. & French, Kenneth R., 2015. "A five-factor asset pricing model," Journal of Financial Economics, Elsevier, vol. 116(1), pages 1-22.
    4. Cai, Tony & Liu, Weidong, 2011. "Adaptive Thresholding for Sparse Covariance Matrix Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 672-684.
    5. Jianqing Fan & Alex Furger & Dacheng Xiu, 2016. "Incorporating Global Industrial Classification Standard Into Portfolio Allocation: A Simple Factor-Based Large Covariance Matrix Estimator With High-Frequency Data," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 489-503, October.
    6. Matthijs J. Warrens & Hanneke Hoef, 2022. "Understanding the Adjusted Rand Index and Other Partition Comparison Indices Based on Counting Object Pairs," Journal of Classification, Springer;The Classification Society, vol. 39(3), pages 487-509, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yutong Lu & Gesine Reinert & Mihai Cucuringu, 2023. "Co-trading networks for modeling dynamic interdependency structures and estimating high-dimensional covariances in US equity markets," Papers 2302.09382, arXiv.org, revised May 2024.
    2. Tae-Hwy Lee & Ekaterina Seregina, 2024. "Optimal Portfolio Using Factor Graphical Lasso," Journal of Financial Econometrics, Oxford University Press, vol. 22(3), pages 670-695.
    3. Lam, Clifford, 2020. "High-dimensional covariance matrix estimation," LSE Research Online Documents on Economics 101667, London School of Economics and Political Science, LSE Library.
    4. Gautam Sabnis & Debdeep Pati & Anirban Bhattacharya, 2019. "Compressed Covariance Estimation with Automated Dimension Learning," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 81(2), pages 466-481, December.
    5. Ruili Sun & Tiefeng Ma & Shuangzhe Liu & Milind Sathye, 2019. "Improved Covariance Matrix Estimation for Portfolio Risk Measurement: A Review," JRFM, MDPI, vol. 12(1), pages 1-34, March.
    6. M Hashem Pesaran & Takashi Yamagata, 2024. "Testing for Alpha in Linear Factor Pricing Models with a Large Number of Securities," Journal of Financial Econometrics, Oxford University Press, vol. 22(2), pages 407-460.
    7. Dai, Chaoxing & Lu, Kun & Xiu, Dacheng, 2019. "Knowing factors or factor loadings, or neither? Evaluating estimators of large covariance matrices with noisy and asynchronous data," Journal of Econometrics, Elsevier, vol. 208(1), pages 43-79.
    8. Kwangmin Jung & Donggyu Kim & Seunghyeon Yu, 2021. "Next Generation Models for Portfolio Risk Management: An Approach Using Financial Big Data," Papers 2102.12783, arXiv.org, revised Feb 2022.
    9. Aït-Sahalia, Yacine & Xiu, Dacheng, 2017. "Using principal component analysis to estimate a high dimensional factor model with high-frequency data," Journal of Econometrics, Elsevier, vol. 201(2), pages 384-399.
    10. Esra Ulasan & A. Özlem Önder, 2023. "Large portfolio optimisation approaches," Journal of Asset Management, Palgrave Macmillan, vol. 24(6), pages 485-497, October.
    11. Zou, Tao & Lan, Wei & Li, Runze & Tsai, Chih-Ling, 2022. "Inference on covariance-mean regression," Journal of Econometrics, Elsevier, vol. 230(2), pages 318-338.
    12. Chen, Dachuan & Mykland, Per A. & Zhang, Lan, 2024. "Realized regression with asynchronous and noisy high frequency and high dimensional data," Journal of Econometrics, Elsevier, vol. 239(2).
    13. Farnè, Matteo & Montanari, Angela, 2020. "A large covariance matrix estimator under intermediate spikiness regimes," Journal of Multivariate Analysis, Elsevier, vol. 176(C).
    14. Ding, Yi & Li, Yingying & Zheng, Xinghua, 2021. "High dimensional minimum variance portfolio estimation under statistical factor models," Journal of Econometrics, Elsevier, vol. 222(1), pages 502-515.
    15. Bakalli, Gaetan & Guerrier, Stéphane & Scaillet, Olivier, 2023. "A penalized two-pass regression to predict stock returns with time-varying risk premia," Journal of Econometrics, Elsevier, vol. 237(2).
    16. Sven Husmann & Antoniya Shivarova & Rick Steinert, 2019. "Cross-validated covariance estimators for high-dimensional minimum-variance portfolios," Papers 1910.13960, arXiv.org, revised Oct 2020.
    17. Kozak, Serhiy & Nagel, Stefan & Santosh, Shrihari, 2020. "Shrinking the cross-section," Journal of Financial Economics, Elsevier, vol. 135(2), pages 271-292.
    18. Kashlak, Adam B., 2021. "Non-asymptotic error controlled sparse high dimensional precision matrix estimation," Journal of Multivariate Analysis, Elsevier, vol. 181(C).
    19. Zhou Tang & Zhangsheng Yu & Cheng Wang, 2020. "A fast iterative algorithm for high-dimensional differential network," Computational Statistics, Springer, vol. 35(1), pages 95-109, March.
    20. Tae-Hwy Lee & Ekaterina Seregina, 2020. "Learning from Forecast Errors: A New Approach to Forecast Combination," Working Papers 202024, University of California at Riverside, Department of Economics.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2407.03781. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.