IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1607.04883.html
   My bibliography  Save this paper

Statistical Industry Classification

Author

Listed:
  • Zura Kakushadze
  • Willie Yu

Abstract

We give complete algorithms and source code for constructing (multilevel) statistical industry classifications, including methods for fixing the number of clusters at each level (and the number of levels). Under the hood there are clustering algorithms (e.g., k-means). However, what should we cluster? Correlations? Returns? The answer turns out to be neither and our backtests suggest that these details make a sizable difference. We also give an algorithm and source code for building "hybrid" industry classifications by improving off-the-shelf "fundamental" industry classifications by applying our statistical industry classification methods to them. The presentation is intended to be pedagogical and geared toward practical applications in quantitative trading.

Suggested Citation

  • Zura Kakushadze & Willie Yu, 2016. "Statistical Industry Classification," Papers 1607.04883, arXiv.org, revised Dec 2018.
    • Handle: RePEc:arx:papers:1607.04883
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1607.04883
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    2. Zura Kakushadze & Willie Yu, 2016. "How to Combine a Billion Alphas," Papers 1603.05937, arXiv.org, revised Jun 2016.
    3. Zura Kakushadze & Willie Yu, 2016. "Statistical Risk Models," Papers 1602.08070, arXiv.org, revised Jan 2017.
    4. Connor, Gregory & Korajczyk, Robert A, 1993. "A Test for the Number of Factors in an Approximate Factor Model," Journal of Finance, American Finance Association, vol. 48(4), pages 1263-1291, September.
    5. Sugar, Catherine A. & James, Gareth M., 2003. "Finding the Number of Clusters in a Dataset: An Information-Theoretic Approach," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 750-763, January.
    6. Zura Kakushadze & Willie Yu, 2016. "Multifactor Risk Models and Heterotic CAPM," Papers 1602.04902, arXiv.org, revised Mar 2016.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zura Kakushadze & Willie Yu, 2017. "*K-means and Cluster Models for Cancer Signatures," Papers 1703.00703, arXiv.org, revised Jul 2017.
    2. Zura Kakushadze & Willie Yu, 2018. "Betas, Benchmarks and Beating the Market," Papers 1807.09919, arXiv.org.
    3. GUO-FITOUSSI, Liang, 2013. "A Comparison of the Finite Sample Properties of Selection Rules of Factor Numbers in Large Datasets," MPRA Paper 50005, University Library of Munich, Germany.
    4. Claudio Morana, 2014. "Factor Vector Autoregressive Estimation of Heteroskedastic Persistent and Non Persistent Processes Subject to Structural Breaks," Working Papers 273, University of Milano-Bicocca, Department of Economics, revised May 2014.
    5. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    6. Alain-Philippe Fortin & Patrick Gagliardini & O. Scaillet, 2022. "Eigenvalue tests for the number of latent factors in short panels," Swiss Finance Institute Research Paper Series 22-81, Swiss Finance Institute.
    7. Catherine Doz & Domenico Giannone & Lucrezia Reichlin, 2012. "A Quasi–Maximum Likelihood Approach for Large, Approximate Dynamic Factor Models," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1014-1024, November.
    8. Fan, Jianqing & Liao, Yuan & Shi, Xiaofeng, 2015. "Risks of large portfolios," Journal of Econometrics, Elsevier, vol. 186(2), pages 367-387.
    9. Norman R. Swanson & Nii Ayi Armah, 2011. "Diffusion Index Models and Index Proxies: Recent Results and New Directions," Departmental Working Papers 201114, Rutgers University, Department of Economics.
    10. Massacci, Daniele, 2017. "Least squares estimation of large dimensional threshold factor models," Journal of Econometrics, Elsevier, vol. 197(1), pages 101-129.
    11. Bai, Jushan & Ando, Tomohiro, 2013. "Multifactor asset pricing with a large number of observable risk factors and unobservable common and group-specific factors," MPRA Paper 52785, University Library of Munich, Germany, revised Dec 2013.
    12. Jushan Bai & Serena Ng, 2020. "Simpler Proofs for Approximate Factor Models of Large Dimensions," Papers 2008.00254, arXiv.org.
    13. Goyal, Amit & Pérignon, Christophe & Villa, Christophe, 2008. "How common are common return factors across the NYSE and Nasdaq?," Journal of Financial Economics, Elsevier, vol. 90(3), pages 252-271, December.
    14. Linton, Oliver & Xiao, Zhijie, 2019. "Efficient estimation of nonparametric regression in the presence of dynamic heteroskedasticity," Journal of Econometrics, Elsevier, vol. 213(2), pages 608-631.
    15. Chien-jung Ting & Yi-Long Hsiao, 2022. "Nowcasting the GDP in Taiwan and the Real-Time Tourism Data," Advances in Management and Applied Economics, SCIENPRESS Ltd, vol. 12(3), pages 1-2.
    16. Gagliardini, Patrick & Ossola, Elisa & Scaillet, Olivier, 2019. "A diagnostic criterion for approximate factor structure," Journal of Econometrics, Elsevier, vol. 212(2), pages 503-521.
    17. Shujie Ma & Oliver Linton & Jiti Gao, 2018. "Estimation in semiparametric quantile factor models," CeMMAP working papers CWP07/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    18. Aboura, Sofiane & Chevallier, Julien, 2017. "A new weighting-scheme for equity indexes," International Review of Financial Analysis, Elsevier, vol. 54(C), pages 159-175.
    19. Francisco Peñaranda & Enrique Sentana, 2024. "Portfolio management with big data," Working Papers wp2024_2411, CEMFI.
    20. Malevergne, Y. & Sornette, D., 2007. "Self-consistent asset pricing models," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 382(1), pages 149-171.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1607.04883. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.