IDEAS home Printed from https://ideas.repec.org/a/inm/oropre/v62y2014i4p957-972.html
   My bibliography  Save this article

Directed Principal Component Analysis

Author

Listed:
  • Yi-Hao Kao

    (Stanford University, Stanford, California 94305)

  • Benjamin Van Roy

    (Stanford University, Stanford, California 94305)

Abstract

We consider a problem involving estimation of a high-dimensional covariance matrix that is the sum of a diagonal matrix and a low-rank matrix, and making a decision based on the resulting estimate. Such problems arise, for example, in portfolio management, where a common approach employs principal component analysis (PCA) to estimate factors used in constructing the low-rank term of the covariance matrix. The decision problem is typically treated separately, with the estimated covariance matrix taken to be an input to an optimization problem. We propose directed PCA , an efficient algorithm that takes the decision objective into account when estimating the covariance matrix. Directed PCA effectively adjusts factors that would be produced by PCA so that they better guide the specific decision at hand. We demonstrate through computational studies that directed PCA yields significant benefit, and we prove theoretical results establishing that the degree of improvement over conventional PCA can be arbitrarily large.

Suggested Citation

  • Yi-Hao Kao & Benjamin Van Roy, 2014. "Directed Principal Component Analysis," Operations Research, INFORMS, vol. 62(4), pages 957-972, August.
  • Handle: RePEc:inm:oropre:v:62:y:2014:i:4:p:957-972
    DOI: 10.1287/opre.2014.1290
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/opre.2014.1290
    Download Restriction: no

    File URL: https://libkey.io/10.1287/opre.2014.1290?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Michael E. Tipping & Christopher M. Bishop, 1999. "Probabilistic Principal Component Analysis," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(3), pages 611-622.
    2. D. Goldfarb & G. Iyengar, 2003. "Robust Portfolio Selection Problems," Mathematics of Operations Research, INFORMS, vol. 28(1), pages 1-38, February.
    3. Johnstone, Iain M. & Lu, Arthur Yu, 2009. "On Consistency and Sparsity for Principal Components Analysis in High Dimensions," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 682-693.
    4. Pison, Greet & Rousseeuw, Peter J. & Filzmoser, Peter & Croux, Christophe, 2003. "Robust factor analysis," Journal of Multivariate Analysis, Elsevier, vol. 84(1), pages 145-172, January.
    5. Ioana Popescu, 2007. "Robust Mean-Covariance Solutions for Stochastic Optimization," Operations Research, INFORMS, vol. 55(1), pages 98-112, February.
    6. Donald Rubin & Dorothy Thayer, 1982. "EM algorithms for ML factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 47(1), pages 69-76, March.
    7. Omar Besbes & Robert Phillips & Assaf Zeevi, 2010. "Testing the Validity of a Demand Model: An Operations Perspective," Manufacturing & Service Operations Management, INFORMS, vol. 12(1), pages 162-183, June.
    8. repec:ucp:bkecon:9780226316529 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. den Boer, Arnoud V. & Sierag, Dirk D., 2021. "Decision-based model selection," European Journal of Operational Research, Elsevier, vol. 290(2), pages 671-686.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniel Bartz & Kerr Hatrick & Christian W. Hesse & Klaus-Robert Muller & Steven Lemm, 2011. "Directional Variance Adjustment: improving covariance estimates for high-dimensional portfolio optimization," Papers 1109.3069, arXiv.org, revised Mar 2012.
    2. Daniel Bartz & Kerr Hatrick & Christian W Hesse & Klaus-Robert Müller & Steven Lemm, 2013. "Directional Variance Adjustment: Bias Reduction in Covariance Matrices Based on Factor Analysis with an Application to Portfolio Optimization," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-14, July.
    3. Wang, Shao-Hsuan & Huang, Su-Yun, 2022. "Perturbation theory for cross data matrix-based PCA," Journal of Multivariate Analysis, Elsevier, vol. 190(C).
    4. Maillet, Bertrand & Tokpavi, Sessi & Vaucher, Benoit, 2015. "Global minimum variance portfolio optimisation under some model risk: A robust regression-based approach," European Journal of Operational Research, Elsevier, vol. 244(1), pages 289-299.
    5. Matteo Barigozzi, 2023. "Asymptotic equivalence of Principal Components and Quasi Maximum Likelihood estimators in Large Approximate Factor Models," Papers 2307.09864, arXiv.org, revised Jun 2024.
    6. Jonathan Li & Roy Kwon, 2013. "Portfolio selection under model uncertainty: a penalized moment-based optimization approach," Journal of Global Optimization, Springer, vol. 56(1), pages 131-164, May.
    7. Zhao, Jianhua & Shi, Lei, 2014. "Automated learning of factor analysis with complete and incomplete data," Computational Statistics & Data Analysis, Elsevier, vol. 72(C), pages 205-218.
    8. Panos Xidonas & Ralph Steuer & Christis Hassapis, 2020. "Robust portfolio optimization: a categorized bibliographic review," Annals of Operations Research, Springer, vol. 292(1), pages 533-552, September.
    9. Kobayashi, Ken & Takano, Yuichi & Nakata, Kazuhide, 2023. "Cardinality-constrained distributionally robust portfolio optimization," European Journal of Operational Research, Elsevier, vol. 309(3), pages 1173-1182.
    10. Matteo Barigozzi & Matteo Luciani, 2019. "Quasi Maximum Likelihood Estimation and Inference of Large Approximate Dynamic Factor Models via the EM algorithm," Papers 1910.03821, arXiv.org, revised Sep 2024.
    11. Dorota Toczydlowska & Gareth W. Peters & Man Chung Fung & Pavel V. Shevchenko, 2017. "Stochastic Period and Cohort Effect State-Space Mortality Models Incorporating Demographic Factors via Probabilistic Robust Principal Components," Risks, MDPI, vol. 5(3), pages 1-77, July.
    12. Joni Virta & Niko Lietzén & Henri Nyberg, 2024. "Robust signal dimension estimation via SURE," Statistical Papers, Springer, vol. 65(5), pages 3007-3038, July.
    13. Li Chen & Simai He & Shuzhong Zhang, 2011. "Tight Bounds for Some Risk Measures, with Applications to Robust Portfolio Selection," Operations Research, INFORMS, vol. 59(4), pages 847-865, August.
    14. Frank Fabozzi & Dashan Huang & Guofu Zhou, 2010. "Robust portfolios: contributions from operations research and finance," Annals of Operations Research, Springer, vol. 176(1), pages 191-220, April.
    15. Landgraf, Andrew J. & Lee, Yoonkyung, 2020. "Dimensionality reduction for binary data through the projection of natural parameters," Journal of Multivariate Analysis, Elsevier, vol. 180(C).
    16. Hong, David & Balzano, Laura & Fessler, Jeffrey A., 2018. "Asymptotic performance of PCA for high-dimensional heteroscedastic data," Journal of Multivariate Analysis, Elsevier, vol. 167(C), pages 435-452.
    17. Alireza Ghahtarani & Ahmed Saif & Alireza Ghasemi, 2022. "Robust portfolio selection problems: a comprehensive review," Operational Research, Springer, vol. 22(4), pages 3203-3264, September.
    18. Erick Delage & Yinyu Ye, 2010. "Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems," Operations Research, INFORMS, vol. 58(3), pages 595-612, June.
    19. Matteo Barigozzi, 2023. "Quasi Maximum Likelihood Estimation of High-Dimensional Factor Models: A Critical Review," Papers 2303.11777, arXiv.org, revised May 2024.
    20. Alireza Ghahtarani & Ahmed Saif & Alireza Ghasemi, 2021. "Robust Portfolio Selection Problems: A Comprehensive Review," Papers 2103.13806, arXiv.org, revised Jan 2022.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:oropre:v:62:y:2014:i:4:p:957-972. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.