IDEAS home Printed from https://ideas.repec.org/a/sae/sagope/v13y2023i2p21582440231174777.html
   My bibliography  Save this article

A Best Linear Empirical Bayes Method for High-Dimensional Covariance Matrix Estimation

Author

Listed:
  • Jin Yuan
  • Xianghui Yuan

Abstract

Covariance matrix estimation plays a significant role in both in the theory and practice of portfolio analysis and risk management. This paper deals with the available data prior to developing a factor model to enhance covariance matrix estimation. Our work has two main outcomes. First, for a general linear model with unknown prior parameters, a class of best linear empirical Bayes estimators is established through two kinds of architectures to improve the estimation accuracy by utilizing additional data prior. The theoretical results indicate two key points: the proposed estimators are equivalent to the linear minimum mean-square error estimator when complete or sufficient partial data prior are provided; and the proposed estimators perform better than the optimal weighted least squares method, which ignores the data prior in each situation. Second, the proposed estimators are used for calculating a high-dimensional covariance matrix through factor models. The numerical example and the simulation results verify the effectiveness of our methods.

Suggested Citation

  • Jin Yuan & Xianghui Yuan, 2023. "A Best Linear Empirical Bayes Method for High-Dimensional Covariance Matrix Estimation," SAGE Open, , vol. 13(2), pages 21582440231, June.
    • Handle: RePEc:sae:sagope:v:13:y:2023:i:2:p:21582440231174777
    DOI: 10.1177/21582440231174777
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/21582440231174777
    Download Restriction: no
    File URL: https://libkey.io/10.1177/21582440231174777?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Olivier Ledoit & Michael Wolf, 2022. "The Power of (Non-)Linear Shrinking: A Review and Guide to Covariance Matrix Estimation [Design-Free Estimation of Variance Matrices]," Journal of Financial Econometrics, Oxford University Press, vol. 20(1), pages 187-218.
    2. Yucheng Sun & Wen Xu, 2022. "A Factor-Based Estimation of Integrated Covariance Matrix With Noisy High-Frequency Data," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(2), pages 770-784, April.
    3. Aguilar, Omar & West, Mike, 2000. "Bayesian Dynamic Factor Models and Portfolio Allocation," Journal of Business & Economic Statistics, American Statistical Association, vol. 18(3), pages 338-357, July.
    4. Wei Lan & Zheng Fang & Hansheng Wang & Chih-Ling Tsai, 2018. "Covariance Matrix Estimation via Network Structure," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(2), pages 359-369, April.
    5. Stephen A. Ross, 2013. "The Arbitrage Theory of Capital Asset Pricing," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 1, pages 11-30, World Scientific Publishing Co. Pte. Ltd..
    6. Amine Ismail & Huyên Pham, 2019. "Robust Markowitz mean-variance portfolio selection under ambiguous covariance matrix," Post-Print hal-03947497, HAL.
    7. Amine Ismail & Huyên Pham, 2019. "Robust Markowitz mean‐variance portfolio selection under ambiguous covariance matrix," Mathematical Finance, Wiley Blackwell, vol. 29(1), pages 174-207, January.
    8. Raj Agrawal & Uma Roy & Caroline Uhler, 2022. "Covariance Matrix Estimation under Total Positivity for Portfolio Selection [Monotone Comparative Statics under Uncertainty]," Journal of Financial Econometrics, Oxford University Press, vol. 20(2), pages 367-389.
    9. Chamberlain, Gary, 1983. "Funds, Factors, and Diversification in Arbitrage Pricing Models," Econometrica, Econometric Society, vol. 51(5), pages 1305-1323, September.
    10. Gianluca De Nard & Olivier Ledoit & Michael Wolf, 2021. "Factor Models for Portfolio Selection in Large Dimensions: The Good, the Better and the Ugly [Using Principal Component Analysis to Estimate a High Dimensional Factor Model with High-frequency Data," Journal of Financial Econometrics, Oxford University Press, vol. 19(2), pages 236-257.
    11. Dong, Yingjie & Tse, Yiu-Kuen, 2020. "Forecasting large covariance matrix with high-frequency data using factor approach for the correlation matrix," Economics Letters, Elsevier, vol. 195(C).
    12. Fama, Eugene F & French, Kenneth R, 1992. "The Cross-Section of Expected Stock Returns," Journal of Finance, American Finance Association, vol. 47(2), pages 427-465, June.
    13. Wang, Hanchao & Peng, Bin & Li, Degui & Leng, Chenlei, 2021. "Nonparametric estimation of large covariance matrices with conditional sparsity," Journal of Econometrics, Elsevier, vol. 223(1), pages 53-72.
    14. Rong Zhu & Xinyu Zhang & Yanyuan Ma & Guohua Zou, 2021. "Model averaging estimation for high-dimensional covariance matrices with a network structure," The Econometrics Journal, Royal Economic Society, vol. 24(1), pages 177-197.
    15. Lam, Clifford & Feng, Phoenix, 2018. "A nonparametric eigenvalue-regularized integrated covariance matrix estimator for asset return data," LSE Research Online Documents on Economics 88375, London School of Economics and Political Science, LSE Library.
    16. Vassallo, Danilo & Buccheri, Giuseppe & Corsi, Fulvio, 2021. "A DCC-type approach for realized covariance modeling with score-driven dynamics," International Journal of Forecasting, Elsevier, vol. 37(2), pages 569-586.
    17. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    18. Ross, Stephen A, 1977. "The Capital Asset Pricing Model (CAPM), Short-Sale Restrictions and Related Issues," Journal of Finance, American Finance Association, vol. 32(1), pages 177-183, March.
    19. Moura, Guilherme V. & Santos, André A.P. & Ruiz, Esther, 2020. "Comparing high-dimensional conditional covariance matrices: Implications for portfolio selection," Journal of Banking & Finance, Elsevier, vol. 118(C).
    20. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    21. Harris, Richard D.F. & Yilmaz, Fatih, 2010. "Estimation of the conditional variance-covariance matrix of returns using the intraday range," International Journal of Forecasting, Elsevier, vol. 26(1), pages 180-194, January.
    22. Khatri, C. G., 1990. "Some properties of BLUE in a linear model and canonical correlations associated with linear transformations," Journal of Multivariate Analysis, Elsevier, vol. 34(2), pages 211-226, August.
    23. Fan, Jianqing & Fan, Yingying & Lv, Jinchi, 2008. "High dimensional covariance matrix estimation using a factor model," Journal of Econometrics, Elsevier, vol. 147(1), pages 186-197, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bodnar, Taras & Reiß, Markus, 2016. "Exact and asymptotic tests on a factor model in low and large dimensions with applications," Journal of Multivariate Analysis, Elsevier, vol. 150(C), pages 125-151.
    2. Fan, Jianqing & Fan, Yingying & Lv, Jinchi, 2008. "High dimensional covariance matrix estimation using a factor model," Journal of Econometrics, Elsevier, vol. 147(1), pages 186-197, November.
    3. Fan, Qingliang & Wu, Ruike & Yang, Yanrong & Zhong, Wei, 2024. "Time-varying minimum variance portfolio," Journal of Econometrics, Elsevier, vol. 239(2).
    4. Yu, Xiufan & Yao, Jiawei & Xue, Lingzhou, 2024. "Power enhancement for testing multi-factor asset pricing models via Fisher’s method," Journal of Econometrics, Elsevier, vol. 239(2).
    5. De Nard, Gianluca & Zhao, Zhao, 2023. "Using, taming or avoiding the factor zoo? A double-shrinkage estimator for covariance matrices," Journal of Empirical Finance, Elsevier, vol. 72(C), pages 23-35.
    6. Jianqing Fan & Yuan Liao & Martina Mincheva, 2013. "Large covariance estimation by thresholding principal orthogonal complements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(4), pages 603-680, September.
    7. Gilles Boevi Koumou, 2020. "Diversification and portfolio theory: a review," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 34(3), pages 267-312, September.
    8. Francisco Peñaranda & Enrique Sentana, 2024. "Portfolio management with big data," Working Papers wp2024_2411, CEMFI.
    9. Fan, Jianqing & Liao, Yuan & Shi, Xiaofeng, 2015. "Risks of large portfolios," Journal of Econometrics, Elsevier, vol. 186(2), pages 367-387.
    10. Gregory Connor & Matthias Hagmann & Oliver Linton, 2007. "Efficient Estimation of a Semiparametric Characteristic- Based Factor Model of Security Returns," Swiss Finance Institute Research Paper Series 07-26, Swiss Finance Institute.
    11. Patrick Gagliardini & Elisa Ossola & Olivier Scaillet, 2016. "Time‐Varying Risk Premium in Large Cross‐Sectional Equity Data Sets," Econometrica, Econometric Society, vol. 84, pages 985-1046, May.
    12. M. Hashem Pesaran & Paolo Zaffaroni, 2008. "Optimal Asset Allocation with Factor Models for Large Portfolios," CESifo Working Paper Series 2326, CESifo.
    13. Ouysse, Rachida & Kohn, Robert, 2010. "Bayesian variable selection and model averaging in the arbitrage pricing theory model," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 3249-3268, December.
    14. Dai, Chaoxing & Lu, Kun & Xiu, Dacheng, 2019. "Knowing factors or factor loadings, or neither? Evaluating estimators of large covariance matrices with noisy and asynchronous data," Journal of Econometrics, Elsevier, vol. 208(1), pages 43-79.
    15. M Hashem Pesaran & Takashi Yamagata, 2024. "Testing for Alpha in Linear Factor Pricing Models with a Large Number of Securities," Journal of Financial Econometrics, Oxford University Press, vol. 22(2), pages 407-460.
    16. Zura Kakushadze, 2015. "Heterotic Risk Models," Papers 1508.04883, arXiv.org, revised Jan 2016.
    17. Zura Kakushadze & Willie Yu, 2016. "Statistical Risk Models," Papers 1602.08070, arXiv.org, revised Jan 2017.
    18. M. Hashem Pesaran & Paolo Zaffaroni, 2009. "Optimality and Diversifiability of Mean Variance and Arbitrage Pricing Portfolios," CESifo Working Paper Series 2857, CESifo.
    19. Noureddine Kouaissah & Amin Hocine, 2021. "Forecasting systemic risk in portfolio selection: The role of technical trading rules," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(4), pages 708-729, July.
    20. Simon Hediger & Jeffrey Näf & Marc S. Paolella & Paweł Polak, 2023. "Heterogeneous tail generalized common factor modeling," Digital Finance, Springer, vol. 5(2), pages 389-420, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:sagope:v:13:y:2023:i:2:p:21582440231174777. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.