IDEAS home Printed from https://ideas.repec.org/p/cdl/econwp/qt4kt5g2x3.html
   My bibliography  Save this paper

The Dispersion Bias

Author

Listed:
  • Goldberg, Lisa R
  • Papanicolaou, Alex
  • Shkolnik, Alex

Abstract

We identify and correct excess dispersion in the leading eigenvector of a sample covariance matrix when the number of variables vastly exceeds the number of observations. Our correction is datadriven, and it materially diminishes the substantial impact of estimation error on weights and risk forecasts of minimum variance portfolios. We quantify that impact with a novel metric, the optimization bias, which has a positive lower bound prior to correction and tends to zero almost surely after correction. Our analysis sheds light on aspects of how estimation error corrupts an estimated covariance matrix and is transmitted to portfolios via quadratic optimization.

Suggested Citation

  • Goldberg, Lisa R & Papanicolaou, Alex & Shkolnik, Alex, 2022. "The Dispersion Bias," Department of Economics, Working Paper Series qt4kt5g2x3, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
  • Handle: RePEc:cdl:econwp:qt4kt5g2x3
    as

    Download full text from publisher

    File URL: https://www.escholarship.org/uc/item/4kt5g2x3.pdf;origin=repeccitec
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Chamberlain, Gary & Rothschild, Michael, 1983. "Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets," Econometrica, Econometric Society, vol. 51(5), pages 1281-1304, September.
    2. Blume, Marshall E, 1975. "Betas and Their Regression Tendencies," Journal of Finance, American Finance Association, vol. 30(3), pages 785-795, June.
    3. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    4. Mark Britten‐Jones, 1999. "The Sampling Error in Estimates of Mean‐Variance Efficient Portfolio Weights," Journal of Finance, American Finance Association, vol. 54(2), pages 655-671, April.
    5. Victor DeMiguel & Lorenzo Garlappi & Francisco J. Nogales & Raman Uppal, 2009. "A Generalized Approach to Portfolio Optimization: Improving Performance by Constraining Portfolio Norms," Management Science, INFORMS, vol. 55(5), pages 798-812, May.
    6. Connor, Gregory & Korajczyk, Robert A., 1988. "Risk and return in an equilibrium APT : Application of a new test methodology," Journal of Financial Economics, Elsevier, vol. 21(2), pages 255-289, September.
    7. Bai, Jushan & Ng, Serena, 2008. "Large Dimensional Factor Analysis," Foundations and Trends(R) in Econometrics, now publishers, vol. 3(2), pages 89-163, June.
    8. Joel Bun & Jean-Philippe Bouchaud & Marc Potters, 2016. "Cleaning large correlation matrices: tools from random matrix theory," Papers 1610.08104, arXiv.org.
    9. Anderson, Robert M. & Bianchi, Stephen W. & Goldberg, Lisa R., 2012. "Will My Risk Parity Strategy Outperform?," Department of Economics, Working Paper Series qt23t2s950, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    10. Connor, Gregory & Korajczyk, Robert A., 1986. "Performance measurement with the arbitrage pricing theory : A new framework for analysis," Journal of Financial Economics, Elsevier, vol. 15(3), pages 373-394, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Catherine Doz & Domenico Giannone & Lucrezia Reichlin, 2012. "A Quasi–Maximum Likelihood Approach for Large, Approximate Dynamic Factor Models," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1014-1024, November.
    2. Gregory Connor & Robert A Korajczyk, 2024. "Semi-Strong Factors in Asset Returns," Journal of Financial Econometrics, Oxford University Press, vol. 22(1), pages 70-93.
    3. Zhuo Chen & Gregory Connor & Robert A Korajczyk, 2018. "A Performance Comparison of Large-n Factor Estimators," The Review of Asset Pricing Studies, Society for Financial Studies, vol. 8(1), pages 153-182.
    4. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2014. "Dynamic factor models: A review of the literature," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2013(2), pages 73-107.
    5. Konomi Tonogi & Jun-ichi Nakamura & Kazumi Asako, 2014. "Heterogeneity of Capital Stocks in Japan: Classification by Factor Analysis," Journal of Knowledge Management, Economics and Information Technology, ScientificPapers.org, vol. 4(2), pages 1-10, April.
    6. Tomohiro Ando & Ruey S. Tsay, 2009. "Model selection for generalized linear models with factor‐augmented predictors," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 25(3), pages 207-235, May.
    7. Giovanni Bonaccolto & Massimiliano Caporin & Sandra Paterlini, 2018. "Asset allocation strategies based on penalized quantile regression," Computational Management Science, Springer, vol. 15(1), pages 1-32, January.
    8. Maysam Khodayari Gharanchaei & Prabhu Prasad Panda & Xilin Chen, 2024. "Quantitative Investment Diversification Strategies via Various Risk Models," Papers 2407.01550, arXiv.org.
    9. Massacci, Daniele, 2017. "Least squares estimation of large dimensional threshold factor models," Journal of Econometrics, Elsevier, vol. 197(1), pages 101-129.
    10. Martin Lettau & Markus Pelger & Stijn Van Nieuwerburgh, 2020. "Factors That Fit the Time Series and Cross-Section of Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2274-2325.
    11. Goyal, Amit & Pérignon, Christophe & Villa, Christophe, 2008. "How common are common return factors across the NYSE and Nasdaq?," Journal of Financial Economics, Elsevier, vol. 90(3), pages 252-271, December.
    12. Kapetanios, G. & Pesaran, M. Hashem & Yamagata, T., 2011. "Panels with non-stationary multifactor error structures," Journal of Econometrics, Elsevier, vol. 160(2), pages 326-348, February.
    13. Li, Kunpeng & Li, Qi & Lu, Lina, 2018. "Quasi maximum likelihood analysis of high dimensional constrained factor models," Journal of Econometrics, Elsevier, vol. 206(2), pages 574-612.
    14. Mao Takongmo, Charles Olivier & Stevanovic, Dalibor, 2015. "Selection Of The Number Of Factors In Presence Of Structural Instability: A Monte Carlo Study," L'Actualité Economique, Société Canadienne de Science Economique, vol. 91(1-2), pages 177-233, Mars-Juin.
    15. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    16. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    17. Geweke, John & Zhou, Guofu, 1996. "Measuring the Pricing Error of the Arbitrage Pricing Theory," The Review of Financial Studies, Society for Financial Studies, vol. 9(2), pages 557-587.
    18. Tsionas, Mike G., 2016. "Parameters measuring bank risk and their estimation," European Journal of Operational Research, Elsevier, vol. 250(1), pages 291-304.
    19. Kar, Sabyasachi & Roy, Amrita & Sen, Kunal, 2019. "The double trap: Institutions and economic development," Economic Modelling, Elsevier, vol. 76(C), pages 243-259.
    20. António Rua & Francisco Craveiro Dias, 2008. "Determining the number of factors in approximate factor models with global and group-specific factors," Working Papers w200809, Banco de Portugal, Economics and Research Department.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cdl:econwp:qt4kt5g2x3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Lisa Schiff (email available below). General contact details of provider: https://edirc.repec.org/data/ibbrkus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.