IDEAS home Printed from https://ideas.repec.org/a/eee/matcom/v197y2022icp358-376.html
   My bibliography  Save this article

Modelling and forecasting based on recursive incomplete pseudoinverse matrices

Author

Listed:
  • Filelis - Papadopoulos, Christos K.
  • Kyziropoulos, Panagiotis E.
  • Morrison, John P.
  • O‘Reilly, Philip

Abstract

Time series modelling has a wide spectrum of applications in several fields including engineering and finance. Most traditional modelling techniques rely on assumptions related to the input data and manual pre-processing, based on user observations, rendering them unsuitable for analysing time-series with varying characteristics automatically, while more general modelling techniques usually require increased computational work for application and tuning. Recently, a general modelling framework based on a recursive Schur complement technique, that utilizes an adaptively determined set of basis functions, has been proposed. Herewith, a novel modified approach based on recursive incomplete pseudoinverse matrices in conjunction with preconditioned iterative methods for large datasets, is proposed. This sparse approach greatly reduces storage requirements and the recursive nature of the procedure avoids recomputation of the preconditioner after addition of a new basis function. Moreover, update of the coefficients for a different window of data and predefined basis functions can be performed utilizing the incomplete pseudoinverse matrix as preconditioner. The case of sinusoidal basis functions is presented along with a novel adaptive frequency estimation technique. The stability of the resulting model is discussed with respect to the choice of basis functions. The case of basis derived from machine learning techniques is also discussed. Numerical results are given depicting the applicability, generality and effectiveness of the proposed technique. Comparative results with other methods show forecasting RMSE improvement between 7% to 80%, for the majority of the chosen time series.

Suggested Citation

  • Filelis - Papadopoulos, Christos K. & Kyziropoulos, Panagiotis E. & Morrison, John P. & O‘Reilly, Philip, 2022. "Modelling and forecasting based on recursive incomplete pseudoinverse matrices," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 197(C), pages 358-376.
  • Handle: RePEc:eee:matcom:v:197:y:2022:i:c:p:358-376
    DOI: 10.1016/j.matcom.2022.02.020
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378475422000738
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.matcom.2022.02.020?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Peter R. Winters, 1960. "Forecasting Sales by Exponentially Weighted Moving Averages," Management Science, INFORMS, vol. 6(3), pages 324-342, April.
    2. [Reference to Proietti], Tommaso, 2000. "Comparing seasonal components for structural time series models," International Journal of Forecasting, Elsevier, vol. 16(2), pages 247-260.
    3. Jan G. De Gooijer & Rob J. Hyndman, 2005. "25 Years of IIF Time Series Forecasting: A Selective Review," Monash Econometrics and Business Statistics Working Papers 12/05, Monash University, Department of Econometrics and Business Statistics.
    4. Pagan, Adrian, 1996. "The econometrics of financial markets," Journal of Empirical Finance, Elsevier, vol. 3(1), pages 15-102, May.
    5. De Gooijer, Jan G. & Kumar, Kuldeep, 1992. "Some recent developments in non-linear time series modelling, testing, and forecasting," International Journal of Forecasting, Elsevier, vol. 8(2), pages 135-156, October.
    6. Holt, Charles C., 2004. "Author's retrospective on 'Forecasting seasonals and trends by exponentially weighted moving averages'," International Journal of Forecasting, Elsevier, vol. 20(1), pages 11-13.
    7. Awartani, Basel M.A. & Corradi, Valentina, 2005. "Predicting the volatility of the S&P-500 stock index via GARCH models: the role of asymmetries," International Journal of Forecasting, Elsevier, vol. 21(1), pages 167-183.
    8. Taylor, James W., 2003. "Exponential smoothing with a damped multiplicative trend," International Journal of Forecasting, Elsevier, vol. 19(4), pages 715-725.
    9. Tashman, Leonard J., 2000. "Out-of-sample tests of forecasting accuracy: an analysis and review," International Journal of Forecasting, Elsevier, vol. 16(4), pages 437-450.
    10. Holt, Charles C., 2004. "Forecasting seasonals and trends by exponentially weighted moving averages," International Journal of Forecasting, Elsevier, vol. 20(1), pages 5-10.
    11. Makridakis, Spyros & Hibon, Michele, 1991. "Exponential smoothing: The effect of initial values and loss functions on post-sample forecasting accuracy," International Journal of Forecasting, Elsevier, vol. 7(3), pages 317-330, November.
    12. Poskitt, D. S. & Tremayne, A. R., 1986. "The selection and use of linear and bilinear time series models," International Journal of Forecasting, Elsevier, vol. 2(1), pages 101-114.
    13. Jônatas Belotti & Hugo Siqueira & Lilian Araujo & Sérgio L. Stevan & Paulo S.G. de Mattos Neto & Manoel H. N. Marinho & João Fausto L. de Oliveira & Fábio Usberti & Marcos de Almeida Leone Filho & Att, 2020. "Neural-Based Ensembles and Unorganized Machines to Predict Streamflow Series from Hydroelectric Plants," Energies, MDPI, vol. 13(18), pages 1-22, September.
    14. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    15. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jan G. De Gooijer & Rob J. Hyndman, 2005. "25 Years of IIF Time Series Forecasting: A Selective Review," Monash Econometrics and Business Statistics Working Papers 12/05, Monash University, Department of Econometrics and Business Statistics.
    2. De Gooijer, Jan G. & Hyndman, Rob J., 2006. "25 years of time series forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 443-473.
    3. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    4. Gardner, Everette Jr., 2006. "Exponential smoothing: The state of the art--Part II," International Journal of Forecasting, Elsevier, vol. 22(4), pages 637-666.
    5. Zhen Zeng & Rachneet Kaur & Suchetha Siddagangappa & Saba Rahimi & Tucker Balch & Manuela Veloso, 2023. "Financial Time Series Forecasting using CNN and Transformer," Papers 2304.04912, arXiv.org.
    6. Dalton Garcia Borges de Souza & Erivelton Antonio dos Santos & Francisco Tarcísio Alves Júnior & Mariá Cristina Vasconcelos Nascimento, 2021. "On Comparing Cross-Validated Forecasting Models with a Novel Fuzzy-TOPSIS Metric: A COVID-19 Case Study," Sustainability, MDPI, vol. 13(24), pages 1-25, December.
    7. Theodosiou, Marina, 2011. "Forecasting monthly and quarterly time series using STL decomposition," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1178-1195, October.
    8. Trond Husby & Hans Visser, 2021. "Short- to medium-run forecasting of mobility with dynamic linear models," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 45(28), pages 871-902.
    9. Oscar Trull & Juan Carlos García-Díaz & Alicia Troncoso, 2020. "Initialization Methods for Multiple Seasonal Holt–Winters Forecasting Models," Mathematics, MDPI, vol. 8(2), pages 1-16, February.
    10. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2022. "Forecasting natural gas consumption using Bagging and modified regularization techniques," Energy Economics, Elsevier, vol. 106(C).
    11. Fieger, Peter & Rice, John, 2016. "Modelling Chinese Inbound Tourism Arrivals into Christchurch," MPRA Paper 75468, University Library of Munich, Germany.
    12. Kanungo, Rama Prasad, 2021. "Uncertainty of M&As under asymmetric estimation," Journal of Business Research, Elsevier, vol. 122(C), pages 774-793.
    13. Albrecht, Tobias & Rausch, Theresa Maria & Derra, Nicholas Daniel, 2021. "Call me maybe: Methods and practical implementation of artificial intelligence in call center arrivals’ forecasting," Journal of Business Research, Elsevier, vol. 123(C), pages 267-278.
    14. Sprangers, Olivier & Schelter, Sebastian & de Rijke, Maarten, 2023. "Parameter-efficient deep probabilistic forecasting," International Journal of Forecasting, Elsevier, vol. 39(1), pages 332-345.
    15. Kosuke Kawakami & Hirokazu Kobayashi & Kazuhide Nakata, 2021. "Seasonal Inventory Management Model for Raw Materials in Steel Industry," Interfaces, INFORMS, vol. 51(4), pages 312-324, July.
    16. Andrea Kolková & Petr Rozehnal, 2022. "Hybrid demand forecasting models: pre-pandemic and pandemic use studies," Equilibrium. Quarterly Journal of Economics and Economic Policy, Institute of Economic Research, vol. 17(3), pages 699-725, September.
    17. Feng Xu & Mohamad Sepehri & Jian Hua & Sergey Ivanov & Julius N. Anyu, 2018. "Time-Series Forecasting Models for Gasoline Prices in China," International Journal of Economics and Finance, Canadian Center of Science and Education, vol. 10(12), pages 1-43, December.
    18. Theresa Maria Rausch & Tobias Albrecht & Daniel Baier, 2022. "Beyond the beaten paths of forecasting call center arrivals: on the use of dynamic harmonic regression with predictor variables," Journal of Business Economics, Springer, vol. 92(4), pages 675-706, May.
    19. Veiga, Claudimar Pereira da & Veiga, Cássia Rita Pereira da & Puchalski, Weslly & Coelho, Leandro dos Santos & Tortato, Ubiratã, 2016. "Demand forecasting based on natural computing approaches applied to the foodstuff retail segment," Journal of Retailing and Consumer Services, Elsevier, vol. 31(C), pages 174-181.
    20. Hill, Arthur V. & Zhang, Weiyong & Burch, Gerald F., 2015. "Forecasting the forecastability quotient for inventory management," International Journal of Forecasting, Elsevier, vol. 31(3), pages 651-663.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:matcom:v:197:y:2022:i:c:p:358-376. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/mathematics-and-computers-in-simulation/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.