IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0252394.html
   My bibliography  Save this article

The evaluation of COVID-19 prediction precision with a Lyapunov-like exponent

Author

Listed:
  • Jiří Mazurek

Abstract

In the field of machine learning, building models and measuring their performance are two equally important tasks. Currently, measures of precision of regression models’ predictions are usually based on the notion of mean error, where by error we mean a deviation of a prediction from an observation. However, these mean based measures of models’ performance have two drawbacks. Firstly, they ignore the length of the prediction, which is crucial when dealing with chaotic systems, where a small deviation at the beginning grows exponentially with time. Secondly, these measures are not suitable in situations where a prediction is made for a specific point in time (e.g. a date), since they average all errors from the start of the prediction to its end. Therefore, the aim of this paper is to propose a new measure of models’ prediction precision, a divergence exponent, based on the notion of the Lyapunov exponent which overcomes the aforementioned drawbacks. The proposed approach enables the measuring and comparison of models’ prediction precision for time series with unequal length and a given target date in the framework of chaotic phenomena. Application of the divergence exponent to the evaluation of models’ accuracy is demonstrated by two examples and then a set of selected predictions of COVID-19 spread from other studies is evaluated to show its potential.

Suggested Citation

  • Jiří Mazurek, 2021. "The evaluation of COVID-19 prediction precision with a Lyapunov-like exponent," PLOS ONE, Public Library of Science, vol. 16(5), pages 1-9, May.
    • Handle: RePEc:plo:pone00:0252394
    DOI: 10.1371/journal.pone.0252394
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0252394
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0252394&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0252394?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Michał Wieczorek & Jakub Siłka & Dawid Połap & Marcin Woźniak & Robertas Damaševičius, 2020. "Real-time neural network based predictor for cov19 virus spread," PLOS ONE, Public Library of Science, vol. 15(12), pages 1-18, December.
    2. Cleo Anastassopoulou & Lucia Russo & Athanasios Tsakris & Constantinos Siettos, 2020. "Data-based analysis, modelling and forecasting of the COVID-19 outbreak," PLOS ONE, Public Library of Science, vol. 15(3), pages 1-21, March.
    3. Zeroual, Abdelhafid & Harrou, Fouzi & Dairi, Abdelkader & Sun, Ying, 2020. "Deep learning methods for forecasting COVID-19 time-Series data: A Comparative study," Chaos, Solitons & Fractals, Elsevier, vol. 140(C).
    4. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Huang, Chiou-Jye & Shen, Yamin & Kuo, Ping-Huan & Chen, Yung-Hsiang, 2022. "Novel spatiotemporal feature extraction parallel deep neural network for forecasting confirmed cases of coronavirus disease 2019," Socio-Economic Planning Sciences, Elsevier, vol. 80(C).
    2. Gregory L Watson & Di Xiong & Lu Zhang & Joseph A Zoller & John Shamshoian & Phillip Sundin & Teresa Bufford & Anne W Rimoin & Marc A Suchard & Christina M Ramirez, 2021. "Pandemic velocity: Forecasting COVID-19 in the US with a machine learning & Bayesian time series compartmental model," PLOS Computational Biology, Public Library of Science, vol. 17(3), pages 1-20, March.
    3. Waychal, Nachiketas & Laha, Arnab Kumar & Sinha, Ankur, 2022. "Customized forecasting with Adaptive Ensemble Generator," IIMA Working Papers WP 2022-06-04, Indian Institute of Management Ahmedabad, Research and Publication Department.
    4. repec:prg:jnlcfu:v:2022:y:2022:i:1:id:572 is not listed on IDEAS
    5. Chang, Andrew C. & Hanson, Tyler J., 2016. "The accuracy of forecasts prepared for the Federal Open Market Committee," Journal of Economics and Business, Elsevier, vol. 83(C), pages 23-43.
    6. Ling Tang & Chengyuan Zhang & Tingfei Li & Ling Li, 2021. "A novel BEMD-based method for forecasting tourist volume with search engine data," Tourism Economics, , vol. 27(5), pages 1015-1038, August.
    7. Hewamalage, Hansika & Bergmeir, Christoph & Bandara, Kasun, 2021. "Recurrent Neural Networks for Time Series Forecasting: Current status and future directions," International Journal of Forecasting, Elsevier, vol. 37(1), pages 388-427.
    8. Michael Vössing & Niklas Kühl & Matteo Lind & Gerhard Satzger, 2022. "Designing Transparency for Effective Human-AI Collaboration," Information Systems Frontiers, Springer, vol. 24(3), pages 877-895, June.
    9. Frank, Johannes, 2023. "Forecasting realized volatility in turbulent times using temporal fusion transformers," FAU Discussion Papers in Economics 03/2023, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    10. Kourentzes, Nikolaos & Petropoulos, Fotios & Trapero, Juan R., 2014. "Improving forecasting by estimating time series structural components across multiple frequencies," International Journal of Forecasting, Elsevier, vol. 30(2), pages 291-302.
    11. Jeon, Yunho & Seong, Sihyeon, 2022. "Robust recurrent network model for intermittent time-series forecasting," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1415-1425.
    12. Snyder, Ralph D. & Ord, J. Keith & Koehler, Anne B. & McLaren, Keith R. & Beaumont, Adrian N., 2017. "Forecasting compositional time series: A state space approach," International Journal of Forecasting, Elsevier, vol. 33(2), pages 502-512.
    13. Paulo Júlio & Pedro M. Esperança, 2012. "Evaluating the forecast quality of GDP components: An application to G7," GEE Papers 0047, Gabinete de Estratégia e Estudos, Ministério da Economia, revised Apr 2012.
    14. Rivera, Nilza & Guzmán, Juan Ignacio & Jara, José Joaquín & Lagos, Gustavo, 2021. "Evaluation of econometric models of secondary refined copper supply," Resources Policy, Elsevier, vol. 73(C).
    15. Cameron Roach & Rob Hyndman & Souhaib Ben Taieb, 2021. "Non‐linear mixed‐effects models for time series forecasting of smart meter demand," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(6), pages 1118-1130, September.
    16. Massimo Guidolin & Manuela Pedio, 2019. "Forecasting and Trading Monetary Policy Effects on the Riskless Yield Curve with Regime Switching Nelson†Siegel Models," Working Papers 639, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    17. Alysha M De Livera, 2010. "Automatic forecasting with a modified exponential smoothing state space framework," Monash Econometrics and Business Statistics Working Papers 10/10, Monash University, Department of Econometrics and Business Statistics.
    18. Philippe St-Aubin & Bruno Agard, 2022. "Precision and Reliability of Forecasts Performance Metrics," Forecasting, MDPI, vol. 4(4), pages 1-22, October.
    19. Masum, Mohammad & Masud, M.A. & Adnan, Muhaiminul Islam & Shahriar, Hossain & Kim, Sangil, 2022. "Comparative study of a mathematical epidemic model, statistical modeling, and deep learning for COVID-19 forecasting and management," Socio-Economic Planning Sciences, Elsevier, vol. 80(C).
    20. Nikitopoulos, Christina Sklibosios & Thomas, Alice Carole & Wang, Jianxin, 2023. "The economic impact of daily volatility persistence on energy markets," Journal of Commodity Markets, Elsevier, vol. 30(C).
    21. repec:cup:judgdm:v:14:y:2019:i:4:p:395-411 is not listed on IDEAS
    22. I. Yu. Zolotova & V. V. Dvorkin, 2017. "Short-term forecasting of prices for the Russian wholesale electricity market based on neural networks," Studies on Russian Economic Development, Springer, vol. 28(6), pages 608-615, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0252394. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.