IDEAS home Printed from https://ideas.repec.org/a/sae/sagope/v13y2023i2p21582440231174777.html
   My bibliography  Save this article

A Best Linear Empirical Bayes Method for High-Dimensional Covariance Matrix Estimation

Author

Listed:
  • Jin Yuan
  • Xianghui Yuan

Abstract

Covariance matrix estimation plays a significant role in both in the theory and practice of portfolio analysis and risk management. This paper deals with the available data prior to developing a factor model to enhance covariance matrix estimation. Our work has two main outcomes. First, for a general linear model with unknown prior parameters, a class of best linear empirical Bayes estimators is established through two kinds of architectures to improve the estimation accuracy by utilizing additional data prior. The theoretical results indicate two key points: the proposed estimators are equivalent to the linear minimum mean-square error estimator when complete or sufficient partial data prior are provided; and the proposed estimators perform better than the optimal weighted least squares method, which ignores the data prior in each situation. Second, the proposed estimators are used for calculating a high-dimensional covariance matrix through factor models. The numerical example and the simulation results verify the effectiveness of our methods.

Suggested Citation

  • Jin Yuan & Xianghui Yuan, 2023. "A Best Linear Empirical Bayes Method for High-Dimensional Covariance Matrix Estimation," SAGE Open, , vol. 13(2), pages 21582440231, June.
  • Handle: RePEc:sae:sagope:v:13:y:2023:i:2:p:21582440231174777
    DOI: 10.1177/21582440231174777
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/21582440231174777
    Download Restriction: no

    File URL: https://libkey.io/10.1177/21582440231174777?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Fama, Eugene F & French, Kenneth R, 1992. "The Cross-Section of Expected Stock Returns," Journal of Finance, American Finance Association, vol. 47(2), pages 427-465, June.
    2. Stephen A. Ross, 2013. "The Arbitrage Theory of Capital Asset Pricing," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 1, pages 11-30, World Scientific Publishing Co. Pte. Ltd..
    3. Ross, Stephen A, 1977. "The Capital Asset Pricing Model (CAPM), Short-Sale Restrictions and Related Issues," Journal of Finance, American Finance Association, vol. 32(1), pages 177-183, March.
    4. Wang, Hanchao & Peng, Bin & Li, Degui & Leng, Chenlei, 2021. "Nonparametric estimation of large covariance matrices with conditional sparsity," Journal of Econometrics, Elsevier, vol. 223(1), pages 53-72.
    5. Olivier Ledoit & Michael Wolf, 2022. "The Power of (Non-)Linear Shrinking: A Review and Guide to Covariance Matrix Estimation [Design-Free Estimation of Variance Matrices]," Journal of Financial Econometrics, Oxford University Press, vol. 20(1), pages 187-218.
    6. Moura, Guilherme V. & Santos, André A.P. & Ruiz, Esther, 2020. "Comparing high-dimensional conditional covariance matrices: Implications for portfolio selection," Journal of Banking & Finance, Elsevier, vol. 118(C).
    7. Rong Zhu & Xinyu Zhang & Yanyuan Ma & Guohua Zou, 2021. "Model averaging estimation for high-dimensional covariance matrices with a network structure," The Econometrics Journal, Royal Economic Society, vol. 24(1), pages 177-197.
    8. Yucheng Sun & Wen Xu, 2022. "A Factor-Based Estimation of Integrated Covariance Matrix With Noisy High-Frequency Data," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(2), pages 770-784, April.
    9. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    10. Amine Ismail & Huyên Pham, 2019. "Robust Markowitz mean-variance portfolio selection under ambiguous covariance matrix," Post-Print hal-03947497, HAL.
    11. Aguilar, Omar & West, Mike, 2000. "Bayesian Dynamic Factor Models and Portfolio Allocation," Journal of Business & Economic Statistics, American Statistical Association, vol. 18(3), pages 338-357, July.
    12. Harris, Richard D.F. & Yilmaz, Fatih, 2010. "Estimation of the conditional variance-covariance matrix of returns using the intraday range," International Journal of Forecasting, Elsevier, vol. 26(1), pages 180-194, January.
    13. Amine Ismail & Huyên Pham, 2019. "Robust Markowitz mean‐variance portfolio selection under ambiguous covariance matrix," Mathematical Finance, Wiley Blackwell, vol. 29(1), pages 174-207, January.
    14. Wei Lan & Zheng Fang & Hansheng Wang & Chih-Ling Tsai, 2018. "Covariance Matrix Estimation via Network Structure," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(2), pages 359-369, April.
    15. Raj Agrawal & Uma Roy & Caroline Uhler, 2022. "Covariance Matrix Estimation under Total Positivity for Portfolio Selection [Monotone Comparative Statics under Uncertainty]," Journal of Financial Econometrics, Oxford University Press, vol. 20(2), pages 367-389.
    16. Chamberlain, Gary, 1983. "Funds, Factors, and Diversification in Arbitrage Pricing Models," Econometrica, Econometric Society, vol. 51(5), pages 1305-1323, September.
    17. Gianluca De Nard & Olivier Ledoit & Michael Wolf, 2021. "Factor Models for Portfolio Selection in Large Dimensions: The Good, the Better and the Ugly [Using Principal Component Analysis to Estimate a High Dimensional Factor Model with High-frequency Data," Journal of Financial Econometrics, Oxford University Press, vol. 19(2), pages 236-257.
    18. Lam, Clifford & Feng, Phoenix, 2018. "A nonparametric eigenvalue-regularized integrated covariance matrix estimator for asset return data," LSE Research Online Documents on Economics 88375, London School of Economics and Political Science, LSE Library.
    19. Vassallo, Danilo & Buccheri, Giuseppe & Corsi, Fulvio, 2021. "A DCC-type approach for realized covariance modeling with score-driven dynamics," International Journal of Forecasting, Elsevier, vol. 37(2), pages 569-586.
    20. Khatri, C. G., 1990. "Some properties of BLUE in a linear model and canonical correlations associated with linear transformations," Journal of Multivariate Analysis, Elsevier, vol. 34(2), pages 211-226, August.
    21. Fan, Jianqing & Fan, Yingying & Lv, Jinchi, 2008. "High dimensional covariance matrix estimation using a factor model," Journal of Econometrics, Elsevier, vol. 147(1), pages 186-197, November.
    22. Dong, Yingjie & Tse, Yiu-Kuen, 2020. "Forecasting large covariance matrix with high-frequency data using factor approach for the correlation matrix," Economics Letters, Elsevier, vol. 195(C).
    23. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bodnar, Taras & Reiß, Markus, 2016. "Exact and asymptotic tests on a factor model in low and large dimensions with applications," Journal of Multivariate Analysis, Elsevier, vol. 150(C), pages 125-151.
    2. Fan, Jianqing & Fan, Yingying & Lv, Jinchi, 2008. "High dimensional covariance matrix estimation using a factor model," Journal of Econometrics, Elsevier, vol. 147(1), pages 186-197, November.
    3. Fan, Qingliang & Wu, Ruike & Yang, Yanrong & Zhong, Wei, 2024. "Time-varying minimum variance portfolio," Journal of Econometrics, Elsevier, vol. 239(2).
    4. Francisco Peñaranda & Enrique Sentana, 2024. "Portfolio management with big data," Working Papers wp2024_2411, CEMFI.
    5. Yu, Xiufan & Yao, Jiawei & Xue, Lingzhou, 2024. "Power enhancement for testing multi-factor asset pricing models via Fisher’s method," Journal of Econometrics, Elsevier, vol. 239(2).
    6. De Nard, Gianluca & Zhao, Zhao, 2023. "Using, taming or avoiding the factor zoo? A double-shrinkage estimator for covariance matrices," Journal of Empirical Finance, Elsevier, vol. 72(C), pages 23-35.
    7. Jianqing Fan & Yuan Liao & Martina Mincheva, 2013. "Large covariance estimation by thresholding principal orthogonal complements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(4), pages 603-680, September.
    8. Qingliang Fan & Ruike Wu & Yanrong Yang, 2024. "Shocks-adaptive Robust Minimum Variance Portfolio for a Large Universe of Assets," Papers 2410.01826, arXiv.org.
    9. Gilles Boevi Koumou, 2020. "Diversification and portfolio theory: a review," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 34(3), pages 267-312, September.
    10. Fan, Jianqing & Liao, Yuan & Shi, Xiaofeng, 2015. "Risks of large portfolios," Journal of Econometrics, Elsevier, vol. 186(2), pages 367-387.
    11. Bai, Jushan & Ando, Tomohiro, 2013. "Multifactor asset pricing with a large number of observable risk factors and unobservable common and group-specific factors," MPRA Paper 52785, University Library of Munich, Germany, revised Dec 2013.
    12. repec:gnv:wpaper:unige:76321 is not listed on IDEAS
    13. Zura Kakushadze & Willie Yu, 2016. "Multifactor Risk Models and Heterotic CAPM," Papers 1602.04902, arXiv.org, revised Mar 2016.
    14. Joongyeub Yeo & George Papanicolaou, 2016. "Random matrix approach to estimation of high-dimensional factor models," Papers 1611.05571, arXiv.org, revised Nov 2017.
    15. Gregory Connor & Matthias Hagmann & Oliver Linton, 2007. "Efficient Estimation of a Semiparametric Characteristic- Based Factor Model of Security Returns," Swiss Finance Institute Research Paper Series 07-26, Swiss Finance Institute.
    16. Patrick Gagliardini & Elisa Ossola & Olivier Scaillet, 2016. "Time‐Varying Risk Premium in Large Cross‐Sectional Equity Data Sets," Econometrica, Econometric Society, vol. 84, pages 985-1046, May.
    17. M Hashem Pesaran & Takashi Yamagata, 2024. "Testing for Alpha in Linear Factor Pricing Models with a Large Number of Securities," Journal of Financial Econometrics, Oxford University Press, vol. 22(2), pages 407-460.
    18. Jiti Gao & Guangming Pan & Yanrong Yang, 2016. "CEstimation of Structural Breaks in Large Panels with Cross-Sectional Dependence," Monash Econometrics and Business Statistics Working Papers 12/16, Monash University, Department of Econometrics and Business Statistics.
    19. Jianqing Fan & Yuling Yan & Yuheng Zheng, 2024. "When can weak latent factors be statistically inferred?," Papers 2407.03616, arXiv.org, revised Sep 2024.
    20. M. Hashem Pesaran & Paolo Zaffaroni, 2008. "Optimal Asset Allocation with Factor Models for Large Portfolios," CESifo Working Paper Series 2326, CESifo.
    21. Markus Pelger, 2020. "Understanding Systematic Risk: A High‐Frequency Approach," Journal of Finance, American Finance Association, vol. 75(4), pages 2179-2220, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:sagope:v:13:y:2023:i:2:p:21582440231174777. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.