IDEAS home Printed from https://ideas.repec.org/p/arx/papers/cond-mat-0304601.html
   My bibliography  Save this paper

Predictability of large future changes in major financial indices

Author

Listed:
  • D. Sornette

    (CNRS-Univ. Nice and UCLA)

  • W. -X. Zhou

    (UCLA)

Abstract

We present a systematic algorithm testing for the existence of collective self-organization in the behavior of agents in social systems, with a concrete empirical implementation on the Dow Jones Industrial Average index (DJIA) over the 20th century and on Hong Kong Hang Seng composite index (HSI) since 1969. The algorithm combines ideas from critical phenomena, the impact of agents' expectation, multi-scale analysis and the mathematical method of pattern recognition of sparse data. Trained on the three major crashes in DJIA of the century, our algorithm exhibits a remarkable ability for generalization and detects in advance 8 other significant drops or changes of regimes. An application to HSI gives promising results as well. The results are robust with respect to the variations of the recognition algorithm. We quantify the prediction procedure with error diagrams.

Suggested Citation

  • D. Sornette & W. -X. Zhou, 2003. "Predictability of large future changes in major financial indices," Papers cond-mat/0304601, arXiv.org, revised Aug 2004.
    • Handle: RePEc:arx:papers:cond-mat/0304601
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/cond-mat/0304601
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Brock, William A. & Hommes, Cars H., 1998. "Heterogeneous beliefs and routes to chaos in a simple asset pricing model," Journal of Economic Dynamics and Control, Elsevier, vol. 22(8-9), pages 1235-1274, August.
    2. Fama, Eugene F., 1998. "Market efficiency, long-term returns, and behavioral finance," Journal of Financial Economics, Elsevier, vol. 49(3), pages 283-306, September.
    3. D. Sornette & A. Johansen, 2001. "Significance of log-periodic precursors to financial crashes," Papers cond-mat/0106520, arXiv.org.
    4. Ide, Kayo & Sornette, Didier, 2002. "Oscillatory finite-time singularities in finance, population and rupture," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 307(1), pages 63-106.
    5. Eugene White & Frederic Mishkin, 2002. "U.S.Stock Market Crashes and Their Aftermath: Implications for Monetary Policy," Departmental Working Papers 200208, Rutgers University, Department of Economics.
    6. William A. Brock & Cars H. Hommes, 2001. "A Rational Route to Randomness," Chapters, in: W. D. Dechert (ed.), Growth Theory, Nonlinear Dynamics and Economic Modelling, chapter 16, pages 402-438, Edward Elgar Publishing.
    7. Armin Shmilovici & Yael Alon-Brimer & Shmuel Hauser, 2003. "Using a Stochastic Complexity Measure to Check the Efficient Market Hypothesis," Computational Economics, Springer;Society for Computational Economics, vol. 22(2), pages 273-284, October.
    8. Olivier J. Blanchard & Mark W. Watson, 1982. "Bubbles, Rational Expectations and Financial Markets," NBER Working Papers 0945, National Bureau of Economic Research, Inc.
    9. Orlean, Andre, 1995. "Bayesian interactions and collective dynamics of opinion: Herd behavior and mimetic contagion," Journal of Economic Behavior & Organization, Elsevier, vol. 28(2), pages 257-274, October.
    10. Sornette, D & Takayasu, H & Zhou, W.-X, 2003. "Finite-time singularity signature of hyperinflation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 325(3), pages 492-506.
    11. Didier Sornette & Wei-Xing Zhou, 2002. "The US 2000-2002 market descent: How much longer and deeper?," Quantitative Finance, Taylor & Francis Journals, vol. 2(6), pages 468-481.
    12. D. Sornette, 2003. "Critical Market Crashes," Papers cond-mat/0301543, arXiv.org.
    13. William A. Brock, 1993. "Pathways to randomness in the economy: Emergent nonlinearity and chaos in economics and finance," Estudios Económicos, El Colegio de México, Centro de Estudios Económicos, vol. 8(1), pages 3-55.
    14. D. Sornette & A. Johansen, 2001. "Significance of log-periodic precursors to financial crashes," Quantitative Finance, Taylor & Francis Journals, vol. 1(4), pages 452-471.
    15. Zhou, Wei-Xing & Sornette, Didier, 2003. "Renormalization group analysis of the 2000–2002 anti-bubble in the US S&P500 index: explanation of the hierarchy of five crashes and prediction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 330(3), pages 584-604.
    16. Kaboudan, M. A., 1996. "Chaos and forecasting : Howell Tong (Editor), 1995, (World Scientific, Singapore), 345 pp., [UK pound]38, ISBN 981-02-2126-6," International Journal of Forecasting, Elsevier, vol. 12(2), pages 304-306, June.
    17. Brock, William A., 2000. "Whither nonlinear?," Journal of Economic Dynamics and Control, Elsevier, vol. 24(5-7), pages 663-678, June.
    18. Anders Johansen & Olivier Ledoit & Didier Sornette, 2000. "Crashes As Critical Points," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 3(02), pages 219-255.
    19. Aydin Cecen, A. & Erkal, Cahit, 1996. "Distinguishing between stochastic and deterministic behavior in foreign exchange rate returns: Further evidence," Economics Letters, Elsevier, vol. 51(3), pages 323-329, June.
    20. A. Johansen & D. Sornette, 1998. "Stock market crashes are outliers," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 1(2), pages 141-143, January.
    21. John R. Graham, 1999. "Herding among Investment Newsletters: Theory and Evidence," Journal of Finance, American Finance Association, vol. 54(1), pages 237-268, February.
    22. Mansilla, R., 2001. "Algorithmic complexity of real financial markets," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 301(1), pages 483-492.
    23. Wei-Xing Zhou & Didier Sornette, 2002. "Statistical Significance Of Periodicity And Log-Periodicity With Heavy-Tailed Correlated Noise," International Journal of Modern Physics C (IJMPC), World Scientific Publishing Co. Pte. Ltd., vol. 13(02), pages 137-169.
    24. Zhou, Wei-Xing & Sornette, Didier, 2003. "Evidence of a worldwide stock market log-periodic anti-bubble since mid-2000," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 330(3), pages 543-583.
    25. Johansen, Anders, 2003. "Characterization of large price variations in financial markets," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 324(1), pages 157-166.
    26. Blanchard, Olivier Jean, 1979. "Speculative bubbles, crashes and rational expectations," Economics Letters, Elsevier, vol. 3(4), pages 387-389.
    27. R. Mansilla, 2001. "Algorithmic Complexity in Real Financial Markets," Papers cond-mat/0104472, arXiv.org.
    28. Scharfstein, David S & Stein, Jeremy C, 1990. "Herd Behavior and Investment," American Economic Review, American Economic Association, vol. 80(3), pages 465-479, June.
    29. Lux, Thomas, 1995. "Herd Behaviour, Bubbles and Crashes," Economic Journal, Royal Economic Society, vol. 105(431), pages 881-896, July.
    30. William A. Brock & Cars H. Hommes, 1997. "A Rational Route to Randomness," Econometrica, Econometric Society, vol. 65(5), pages 1059-1096, September.
    31. Hsieh, David A, 1989. "Testing for Nonlinear Dependence in Daily Foreign Exchange Rates," The Journal of Business, University of Chicago Press, vol. 62(3), pages 339-368, July.
    32. D. Sornette & J. V. Andersen, 2001. "A Nonlinear Super-Exponential Rational Model of Speculative Financial Bubbles," Papers cond-mat/0104341, arXiv.org, revised Apr 2002.
    33. Graf v. Bothmer, Hans-Christian & Meister, Christian, 2003. "Predicting critical crashes? A new restriction for the free variables," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 320(C), pages 539-547.
    34. Cecen, A. Aydin & Erkal, Cahit, 1996. "Distinguishing between stochastic and deterministic behavior in high frequency foreign exchange rate returns: Can non-linear dynamics help forecasting?," International Journal of Forecasting, Elsevier, vol. 12(4), pages 465-473, December.
    35. Anders Johansen & Didier Sornette, 2001. "Bubbles And Anti-Bubbles In Latin-American, Asian And Western Stock Markets: An Empirical Study," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 4(06), pages 853-920.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lin, L. & Ren, R.E. & Sornette, D., 2014. "The volatility-confined LPPL model: A consistent model of ‘explosive’ financial bubbles with mean-reverting residuals," International Review of Financial Analysis, Elsevier, vol. 33(C), pages 210-225.
    2. Zhou, Wei-Xing & Sornette, Didier, 2009. "A case study of speculative financial bubbles in the South African stock market 2003–2006," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 388(6), pages 869-880.
    3. Sornette, Didier & Woodard, Ryan & Yan, Wanfeng & Zhou, Wei-Xing, 2013. "Clarifications to questions and criticisms on the Johansen–Ledoit–Sornette financial bubble model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(19), pages 4417-4428.
    4. Damian Smug & Peter Ashwin & Didier Sornette, 2018. "Predicting financial market crashes using ghost singularities," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-20, March.
    5. Zhang, Qunzhi & Sornette, Didier & Balcilar, Mehmet & Gupta, Rangan & Ozdemir, Zeynel Abidin & Yetkiner, Hakan, 2016. "LPPLS bubble indicators over two centuries of the S&P 500 index," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 458(C), pages 126-139.
    6. Zhou, Wei-Xing & Sornette, Didier, 2003. "Evidence of a worldwide stock market log-periodic anti-bubble since mid-2000," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 330(3), pages 543-583.
    7. Wei-Xing Zhou & Didier Sornette, 2003. "Nonparametric Analyses Of Log-Periodic Precursors To Financial Crashes," International Journal of Modern Physics C (IJMPC), World Scientific Publishing Co. Pte. Ltd., vol. 14(08), pages 1107-1125.
    8. Leonidas Sandoval Junior & Italo De Paula Franca, 2011. "Shocks in financial markets, price expectation, and damped harmonic oscillators," Papers 1103.1992, arXiv.org, revised Sep 2011.
    9. Sornette, Didier & Zhou, Wei-Xing, 2006. "Importance of positive feedbacks and overconfidence in a self-fulfilling Ising model of financial markets," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 370(2), pages 704-726.
    10. Song, Ruiqiang & Shu, Min & Zhu, Wei, 2022. "The 2020 global stock market crash: Endogenous or exogenous?," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 585(C).
    11. Zhou, Wei-Xing & Sornette, Didier, 2004. "Antibubble and prediction of China's stock market and real-estate," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 337(1), pages 243-268.
    12. Ruiqiang Song & Min Shu & Wei Zhu, 2021. "The 2020 Global Stock Market Crash: Endogenous or Exogenous?," Papers 2101.00327, arXiv.org.
    13. D. Sornette & R. Woodard, "undated". "Financial Bubbles, Real Estate bubbles, Derivative Bubbles, and the Financial and Economic Crisis," Working Papers CCSS-09-003, ETH Zurich, Chair of Systems Design.
    14. Shu, Min & Zhu, Wei, 2020. "Detection of Chinese stock market bubbles with LPPLS confidence indicator," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 557(C).
    15. Wosnitza, Jan Henrik & Leker, Jens, 2014. "Can log-periodic power law structures arise from random fluctuations?," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 401(C), pages 228-250.
    16. Brée, David S. & Joseph, Nathan Lael, 2013. "Testing for financial crashes using the Log Periodic Power Law model," International Review of Financial Analysis, Elsevier, vol. 30(C), pages 287-297.
    17. Sornette, Didier & Zhou, Wei-Xing, 2004. "Evidence of fueling of the 2000 new economy bubble by foreign capital inflow: implications for the future of the US economy and its stock market," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 332(C), pages 412-440.
    18. Min Shu & Ruiqiang Song & Wei Zhu, 2021. "The 'COVID' Crash of the 2020 U.S. Stock Market," Papers 2101.03625, arXiv.org.
    19. Shu, Min & Song, Ruiqiang & Zhu, Wei, 2021. "The ‘COVID’ crash of the 2020 U.S. Stock market," The North American Journal of Economics and Finance, Elsevier, vol. 58(C).
    20. Li Lin & Didier Sornette, 2009. "Diagnostics of Rational Expectation Financial Bubbles with Stochastic Mean-Reverting Termination Times," Papers 0911.1921, arXiv.org.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:cond-mat/0304601. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.