IDEAS home Printed from https://ideas.repec.org/a/spr/snbeco/v2y2022i8d10.1007_s43546-022-00265-8.html
   My bibliography  Save this article

Comparison of empirical and shrinkage correlation algorithm for clustering methods in the futures market

Author

Listed:
  • Andrea Di Iura

    (Enel SpA)

Abstract

The correlation structure of the futures market obtained using daily data from 2009 to 2020 has been investigated to show how different sectors, such as energy or agriculture, produce a hierarchical clustering. The structure depends on the estimation of the correlation matrix; two techniques have been considered: the empirical and the shrinkage one. The networks obtained from those matrices differ from the presence of a hub, the UK Feed Wheat future, that drives the whole market if the shrinkage estimator for the correlation matrix is used. Additionally, an analysis of hierarchical structure changes in time adopting a measure of the similarity among clusters has been considered. It has been observed that the Ward criterion and the shrinkage estimation are the most robust to forecast the network structure.

Suggested Citation

  • Andrea Di Iura, 2022. "Comparison of empirical and shrinkage correlation algorithm for clustering methods in the futures market," SN Business & Economics, Springer, vol. 2(8), pages 1-17, August.
    • Handle: RePEc:spr:snbeco:v:2:y:2022:i:8:d:10.1007_s43546-022-00265-8
    DOI: 10.1007/s43546-022-00265-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s43546-022-00265-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s43546-022-00265-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    2. G. Bonanno & F. Lillo & R. N. Mantegna, 2001. "High-frequency cross-correlation in a set of stocks," Quantitative Finance, Taylor & Francis Journals, vol. 1(1), pages 96-104.
    3. Pawe{l} Sieczka & Janusz A. Ho{l}yst, 2008. "Correlations in commodity markets," Papers 0803.3884, arXiv.org, revised Jan 2009.
    4. Kocheturov, Anton & Batsyn, Mikhail & Pardalos, Panos M., 2014. "Dynamics of cluster structures in a financial market network," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 413(C), pages 523-533.
    5. G. Bonanno & G. Caldarelli & F. Lillo & S. Micciché & N. Vandewalle & R. Mantegna, 2004. "Networks of equities in financial markets," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 38(2), pages 363-371, March.
    6. Anirban Chakraborti & Ioane Muni Toke & Marco Patriarca & Frederic Abergel, 2011. "Econophysics review: I. Empirical facts," Quantitative Finance, Taylor & Francis Journals, vol. 11(7), pages 991-1012.
    7. Mantegna,Rosario N. & Stanley,H. Eugene, 2007. "Introduction to Econophysics," Cambridge Books, Cambridge University Press, number 9780521039871, September.
    8. R. Mantegna, 1999. "Hierarchical structure in financial markets," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 11(1), pages 193-197, September.
    9. Yanhui Liu & Pierre Cizeau & Martin Meyer & Chung-Kang Peng & H. Eugene Stanley, 1997. "Correlations in Economic Time Series," Papers cond-mat/9706021, arXiv.org.
    10. Gautier Marti & Philippe Very & Philippe Donnat & Frank Nielsen, 2015. "A proposal of a methodological framework with experimental guidelines to investigate clustering stability on financial time series," Papers 1509.05475, arXiv.org.
    11. Dong-Ming Song & Michele Tumminello & Wei-Xing Zhou & Rosario N. Mantegna, 2011. "Evolution of worldwide stock markets, correlation structure and correlation based graphs," Papers 1103.5555, arXiv.org.
    12. J. C. Gower & G. J. S. Ross, 1969. "Minimum Spanning Trees and Single Linkage Cluster Analysis," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 18(1), pages 54-64, March.
    13. Jensen, Mogens H. & Johansen, Anders & Simonsen, Ingve, 2003. "Inverse statistics in economics: the gain–loss asymmetry," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 324(1), pages 338-343.
    14. Laurent Laloux & Pierre Cizeau & Marc Potters & Jean-Philippe Bouchaud, 2000. "Random Matrix Theory And Financial Correlations," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 3(03), pages 391-397.
    15. Parameswaran Gopikrishnan & Vasiliki Plerou & Luis A. Nunes Amaral & Martin Meyer & H. Eugene Stanley, 1999. "Scaling of the distribution of fluctuations of financial market indices," Papers cond-mat/9905305, arXiv.org.
    16. Lawrence Hubert & Phipps Arabie, 1985. "Comparing partitions," Journal of Classification, Springer;The Classification Society, vol. 2(1), pages 193-218, December.
    17. Pagan, Adrian, 1996. "The econometrics of financial markets," Journal of Empirical Finance, Elsevier, vol. 3(1), pages 15-102, May.
    18. Giovanni Bonanno & Nicolas Vandewalle & Rosario N. Mantegna, 2000. "Taxonomy of Stock Market Indices," Papers cond-mat/0001268, arXiv.org, revised Aug 2000.
    19. Stephen Johnson, 1967. "Hierarchical clustering schemes," Psychometrika, Springer;The Psychometric Society, vol. 32(3), pages 241-254, September.
    20. Rama Cont & Marc Potters & Jean-Philippe Bouchaud, 1997. "Scaling in stock market data: stable laws and beyond," Science & Finance (CFM) working paper archive 9705087, Science & Finance, Capital Fund Management.
    21. T. Di Matteo & F. Pozzi & T. Aste, 2010. "The use of dynamical networks to detect the hierarchical organization of financial market sectors," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 73(1), pages 3-11, January.
    22. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    23. Jochen Papenbrock & Peter Schwendner, 2015. "Handling risk-on/risk-off dynamics with correlation regimes and correlation networks," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 29(2), pages 125-147, May.
    24. Materassi, Donatello & Innocenti, Giacomo, 2009. "Unveiling the connectivity structure of financial networks via high-frequency analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 388(18), pages 3866-3878.
    25. Anirban Chakraborti & Ioane Muni Toke & Marco Patriarca & Frédéric Abergel, 2011. "Econophysics review: I. Empirical facts," Post-Print hal-00621058, HAL.
    26. Black, Fischer & Scholes, Myron S, 1973. "The Pricing of Options and Corporate Liabilities," Journal of Political Economy, University of Chicago Press, vol. 81(3), pages 637-654, May-June.
    27. Giuseppe Buccheri & Stefano Marmi & Rosario N. Mantegna, 2013. "Evolution of correlation structure of industrial indices of US equity markets," Papers 1306.4769, arXiv.org.
    28. Namaki, A. & Shirazi, A.H. & Raei, R. & Jafari, G.R., 2011. "Network analysis of a financial market based on genuine correlation and threshold method," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 390(21), pages 3835-3841.
    29. Armine Karami & Raphael Benichou & Michael Benzaquen & Jean-Philippe Bouchaud, 2021. "Conditional Correlations and Principal Regression Analysis for Futures," Post-Print hal-02567501, HAL.
    30. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May.
    31. Tumminello, Michele & Lillo, Fabrizio & Mantegna, Rosario N., 2010. "Correlation, hierarchies, and networks in financial markets," Journal of Economic Behavior & Organization, Elsevier, vol. 75(1), pages 40-58, July.
    32. Liu, Yanhui & Cizeau, Pierre & Meyer, Martin & Peng, C.-K. & Eugene Stanley, H., 1997. "Correlations in economic time series," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 245(3), pages 437-440.
    33. Sieczka, Paweł & Hołyst, Janusz A., 2009. "Correlations in commodity markets," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 388(8), pages 1621-1630.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gautier Marti & Frank Nielsen & Miko{l}aj Bi'nkowski & Philippe Donnat, 2017. "A review of two decades of correlations, hierarchies, networks and clustering in financial markets," Papers 1703.00485, arXiv.org, revised Nov 2020.
    2. Andrea Giuseppe Di Iura & Giulia Terenzi, 2021. "A Bayesian analysis of gain-loss asymmetry," Papers 2104.06044, arXiv.org.
    3. Andrea Di Iura & Giulia Terenzi, 2022. "A Bayesian analysis of gain-loss asymmetry," SN Business & Economics, Springer, vol. 2(5), pages 1-23, May.
    4. Anirban Chakraborti & Ioane Muni Toke & Marco Patriarca & Frederic Abergel, 2011. "Econophysics review: I. Empirical facts," Quantitative Finance, Taylor & Francis Journals, vol. 11(7), pages 991-1012.
    5. Anirban Chakraborti & Ioane Muni Toke & Marco Patriarca & Frederic Abergel, 2011. "Econophysics review: II. Agent-based models," Quantitative Finance, Taylor & Francis Journals, vol. 11(7), pages 1013-1041.
    6. Anirban Chakraborti & Ioane Muni Toke & Marco Patriarca & Frédéric Abergel, 2011. "Econophysics review: I. Empirical facts," Post-Print hal-00621058, HAL.
    7. Marcin Wk{a}torek & Stanis{l}aw Dro.zd.z & Jaros{l}aw Kwapie'n & Ludovico Minati & Pawe{l} O'swik{e}cimka & Marek Stanuszek, 2020. "Multiscale characteristics of the emerging global cryptocurrency market," Papers 2010.15403, arXiv.org, revised Mar 2021.
    8. Restocchi, Valerio & McGroarty, Frank & Gerding, Enrico, 2019. "The stylized facts of prediction markets: Analysis of price changes," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 515(C), pages 159-170.
    9. Sandoval, Leonidas & Franca, Italo De Paula, 2012. "Correlation of financial markets in times of crisis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(1), pages 187-208.
    10. Radu T. Pruna & Maria Polukarov & Nicholas R. Jennings, 2016. "A new structural stochastic volatility model of asset pricing and its stylized facts," Papers 1604.08824, arXiv.org.
    11. Teh, Boon Kin & Goo, Yik Wen & Lian, Tong Wei & Ong, Wei Guang & Choi, Wen Ting & Damodaran, Mridula & Cheong, Siew Ann, 2015. "The Chinese Correction of February 2007: How financial hierarchies change in a market crash," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 424(C), pages 225-241.
    12. Sensoy, Ahmet & Tabak, Benjamin M., 2014. "Dynamic spanning trees in stock market networks: The case of Asia-Pacific," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 414(C), pages 387-402.
    13. Leal, Sandrine Jacob & Napoletano, Mauro, 2019. "Market stability vs. market resilience: Regulatory policies experiments in an agent-based model with low- and high-frequency trading," Journal of Economic Behavior & Organization, Elsevier, vol. 157(C), pages 15-41.
    14. Leonidas Sandoval Junior & Italo De Paula Franca, 2011. "Correlation of financial markets in times of crisis," Papers 1102.1339, arXiv.org, revised Mar 2011.
    15. Biondo, Alessio Emanuele, 2017. "Learning to forecast, risk aversion, and microstructural aspects of financial stability," Economics Discussion Papers 2017-104, Kiel Institute for the World Economy (IfW Kiel).
    16. Fa-Bin Shi & Xiao-Qian Sun & Jin-Hua Gao & Li Xu & Hua-Wei Shen & Xue-Qi Cheng, 2019. "Anomaly detection in Bitcoin market via price return analysis," PLOS ONE, Public Library of Science, vol. 14(6), pages 1-11, June.
    17. Sandoval, Leonidas, 2012. "Pruning a minimum spanning tree," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(8), pages 2678-2711.
    18. Nie, Chun-Xiao & Song, Fu-Tie, 2019. "Global Rényi index of the distance matrix," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 514(C), pages 902-915.
    19. Gang-Jin Wang & Chi Xie & Shou Chen, 2017. "Multiscale correlation networks analysis of the US stock market: a wavelet analysis," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 12(3), pages 561-594, October.
    20. Sandoval, Leonidas, 2014. "To lag or not to lag? How to compare indices of stock markets that operate on different times," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 403(C), pages 227-243.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:snbeco:v:2:y:2022:i:8:d:10.1007_s43546-022-00265-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.