IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v609y2023ics0378437122008974.html
   My bibliography  Save this article

A note on a priori forecasting and simplicity bias in time series

Author

Listed:
  • Dingle, Kamaludin
  • Kamal, Rafiq
  • Hamzi, Boumediene

Abstract

To what extent can we forecast a time series without fitting to historical data? Can universal patterns of probability help in this task? Deep relations between pattern Kolmogorov complexity and pattern probability have recently been used to make a priori probability predictions in a variety of systems in physics, biology and engineering. Here we study simplicity bias (SB) – an exponential upper bound decay in pattern probability with increasing complexity – in discretised time series extracted from the World Bank Open Data collection. We predict upper bounds on the probability of discretised series patterns, without fitting to trends in the data. Thus we perform a kind of ‘forecasting without training data’, predicting time series shape patterns a priori, but not the actual numerical value of the series. Additionally we make predictions about which of two discretised series is more likely with accuracy of ∼80%, much higher than a 50% baseline rate, just by using the complexity of each series. These results point to a promising perspective on practical time series forecasting and integration with machine learning methods.

Suggested Citation

  • Dingle, Kamaludin & Kamal, Rafiq & Hamzi, Boumediene, 2023. "A note on a priori forecasting and simplicity bias in time series," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 609(C).
  • Handle: RePEc:eee:phsmap:v:609:y:2023:i:c:s0378437122008974
    DOI: 10.1016/j.physa.2022.128339
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437122008974
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2022.128339?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hector Zenil & Jean‐Paul Delahaye, 2011. "An Algorithmic Information Theoretic Approach To The Behaviour Of Financial Markets," Journal of Economic Surveys, Wiley Blackwell, vol. 25(3), pages 431-463, July.
    2. Bialek, William & Nemenman, Ilya & Tishby, Naftali, 2001. "Complexity through nonextensivity," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 302(1), pages 89-99.
    3. Jean-Paul Delahaye & Hector Zenil, 2011. "An algorithmic information-theoretic approach to the behaviour of financial markets," Post-Print hal-00825528, HAL.
    4. Jean-Paul Delahaye & Hector Zenil, 2012. "Numerical Evaluation of Algorithmic Complexity for Short Strings: A Glance into the Innermost Structure of Randomness," Post-Print hal-00825530, HAL.
    5. Torres, M.E. & Gamero, L.G., 2000. "Relative complexity changes in time series using information measures," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 286(3), pages 457-473.
    6. Fernando Soler-Toscano & Hector Zenil & Jean-Paul Delahaye & Nicolas Gauvrit, 2014. "Calculating Kolmogorov Complexity from the Output Frequency Distributions of Small Turing Machines," PLOS ONE, Public Library of Science, vol. 9(5), pages 1-18, May.
    7. Kamaludin Dingle & Chico Q. Camargo & Ard A. Louis, 2018. "Input–output maps are strongly biased towards simple outputs," Nature Communications, Nature, vol. 9(1), pages 1-7, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fernando Soler-Toscano & Hector Zenil, 2017. "A Computable Measure of Algorithmic Probability by Finite Approximations with an Application to Integer Sequences," Complexity, Hindawi, vol. 2017, pages 1-10, December.
    2. Brandouy, Olivier & Delahaye, Jean-Paul & Ma, Lin & Zenil, Hector, 2014. "Algorithmic complexity of financial motions," Research in International Business and Finance, Elsevier, vol. 30(C), pages 336-347.
    3. Daniel Wilson-Nunn & Hector Zenil, 2014. "On the Complexity and Behaviour of Cryptocurrencies Compared to Other Markets," Papers 1411.1924, arXiv.org.
    4. Olivier Brandouy & Jean-Paul Delahaye & Lin Ma, 2015. "Estimating the Algorithmic Complexity of Stock Markets," Papers 1504.04296, arXiv.org.
    5. Philip Z. Maymin, 2012. "A New Kind of Finance," Papers 1210.1588, arXiv.org.
    6. Maxwell Murialdo & Arturo Cifuentes, 2022. "Quantifying Value with Effective Complexity," Journal of Interdisciplinary Economics, , vol. 34(1), pages 69-85, January.
    7. Mikołaj Morzy & Tomasz Kajdanowicz & Przemysław Kazienko, 2017. "On Measuring the Complexity of Networks: Kolmogorov Complexity versus Entropy," Complexity, Hindawi, vol. 2017, pages 1-12, November.
    8. Lovallo, Michele & Lapenna, Vincenzo & Telesca, Luciano, 2005. "Transition matrix analysis of earthquake magnitude sequences," Chaos, Solitons & Fractals, Elsevier, vol. 24(1), pages 33-43.
    9. Łukasz Dębowski, 2014. "On Hidden Markov Processes with Infinite Excess Entropy," Journal of Theoretical Probability, Springer, vol. 27(2), pages 539-551, June.
    10. Torres, H.M. & Gurlekian, J.A. & Rufiner, H.L. & Torres, M.E., 2006. "Self-organizing map clustering based on continuous multiresolution entropy," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 361(1), pages 337-354.
    11. Zenil, Hector & Soler-Toscano, Fernando & Dingle, Kamaludin & Louis, Ard A., 2014. "Correlation of automorphism group size and topological properties with program-size complexity evaluations of graphs and complex networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 404(C), pages 341-358.
    12. Zozor, S. & Ravier, P. & Buttelli, O., 2005. "On Lempel–Ziv complexity for multidimensional data analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 345(1), pages 285-302.
    13. Ferman Hasan, 2021. "Contribution of eye-tracking to the study on perception of the complexity," Technium Social Sciences Journal, Technium Science, vol. 20(1), pages 612-626, June.
    14. Huaylla, Claudia A. & Kuperman, Marcelo N. & Garibaldi, Lucas A., 2024. "Comparison of two statistical measures of complexity applied to ecological bipartite networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 642(C).
    15. Fernando Soler-Toscano & Hector Zenil & Jean-Paul Delahaye & Nicolas Gauvrit, 2014. "Calculating Kolmogorov Complexity from the Output Frequency Distributions of Small Turing Machines," PLOS ONE, Public Library of Science, vol. 9(5), pages 1-18, May.
    16. Kukacka, Jiri & Kristoufek, Ladislav, 2021. "Does parameterization affect the complexity of agent-based models?," Journal of Economic Behavior & Organization, Elsevier, vol. 192(C), pages 324-356.
    17. Bahamonde, Adolfo D. & Cornejo, Pablo & Sepúlveda, Héctor H., 2023. "Laminar to turbulent transition in terms of information theory," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 629(C).
    18. Ghosh, Abhik, 2023. "Optimal guessing under nonextensive framework and associated moment bounds," Statistics & Probability Letters, Elsevier, vol. 197(C).
    19. Sivadasan, S. & Efstathiou, J. & Calinescu, A. & Huatuco, L. Huaccho, 2006. "Advances on measuring the operational complexity of supplier-customer systems," European Journal of Operational Research, Elsevier, vol. 171(1), pages 208-226, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:609:y:2023:i:c:s0378437122008974. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.