IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v12y2024i21p3320-d1504802.html
   My bibliography  Save this article

TVGeAN: Tensor Visibility Graph-Enhanced Attention Network for Versatile Multivariant Time Series Learning Tasks

Author

Listed:
  • Mohammed Baz

    (Department of Computer Engineering, College of Computers and Information Technology, Taif University, Taif 21944, Saudi Arabia)

Abstract

This paper introduces Tensor Visibility Graph-enhanced Attention Networks (TVGeAN), a novel graph autoencoder model specifically designed for MTS learning tasks. The underlying approach of TVGeAN is to combine the power of complex networks in representing time series as graphs with the strengths of Graph Neural Networks (GNNs) in learning from graph data. TVGeAN consists of two new main components: TVG which extend the capabilities of visibility graph algorithms in representing MTSs by converting them into weighted temporal graphs where both the nodes and the edges are tensors. Each node in the TVG represents the MTS observations at a particular time, while the weights of the edges are defined based on the visibility angle algorithm. The second main component of the proposed model is GeAN, a novel graph attention mechanism developed to seamlessly integrate the temporal interactions represented in the nodes and edges of the graphs into the core learning process. GeAN achieves this by using the outer product to quantify the pairwise interactions of nodes and edges at a fine-grained level and a bilinear model to effectively distil the knowledge interwoven in these representations. From an architectural point of view, TVGeAN builds on the autoencoder approach complemented by sparse and variational learning units. The sparse learning unit is used to promote inductive learning in TVGeAN, and the variational learning unit is used to endow TVGeAN with generative capabilities. The performance of the TVGeAN model is extensively evaluated against four widely cited MTS benchmarks for both supervised and unsupervised learning tasks. The results of these evaluations show the high performance of TVGeAN for various MTS learning tasks. In particular, TVGeAN can achieve an average root mean square error of 6.8 for the C-MPASS dataset (i.e., regression learning tasks) and a precision close to one for the SMD, MSL, and SMAP datasets (i.e., anomaly detection learning tasks), which are better results than most published works.

Suggested Citation

  • Mohammed Baz, 2024. "TVGeAN: Tensor Visibility Graph-Enhanced Attention Network for Versatile Multivariant Time Series Learning Tasks," Mathematics, MDPI, vol. 12(21), pages 1-33, October.
  • Handle: RePEc:gam:jmathe:v:12:y:2024:i:21:p:3320-:d:1504802
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/12/21/3320/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/12/21/3320/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ana Lazcano & Pedro Javier Herrera & Manuel Monge, 2023. "A Combined Model Based on Recurrent Neural Networks and Graph Convolutional Networks for Financial Time Series Forecasting," Mathematics, MDPI, vol. 11(1), pages 1-21, January.
    2. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178.
    3. Yang, Yue & Yang, Huijie, 2008. "Complex network-based time series analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 387(5), pages 1381-1386.
    4. Markku Lanne & Henri Nyberg, 2016. "Generalized Forecast Error Variance Decomposition for Linear and Nonlinear Multivariate Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 78(4), pages 595-603, August.
    5. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mario Figueiredo & Yuri F. Saporito, 2023. "Forecasting the term structure of commodities future prices using machine learning," Digital Finance, Springer, vol. 5(1), pages 57-90, March.
    2. Victor Bystrov, 2018. "Measuring the Natural Rates of Interest in Germany and Italy," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 10(4), pages 333-353, December.
    3. Yukai Yang & Luc Bauwens, 2018. "State-Space Models on the Stiefel Manifold with a New Approach to Nonlinear Filtering," Econometrics, MDPI, vol. 6(4), pages 1-22, December.
    4. Fernández-Macho, Javier, 2008. "Spectral estimation of a structural thin-plate smoothing model," Computational Statistics & Data Analysis, Elsevier, vol. 53(1), pages 189-195, September.
    5. Drew Creal & Siem Jan Koopman & Eric Zivot, 2008. "The Effect of the Great Moderation on the U.S. Business Cycle in a Time-varying Multivariate Trend-cycle Model," Tinbergen Institute Discussion Papers 08-069/4, Tinbergen Institute.
    6. Avanzi, Benjamin & Taylor, Greg & Vu, Phuong Anh & Wong, Bernard, 2020. "A multivariate evolutionary generalised linear model framework with adaptive estimation for claims reserving," Insurance: Mathematics and Economics, Elsevier, vol. 93(C), pages 50-71.
    7. Sudhamayee, K. & Krishna, M. Gopal & Manimaran, P., 2023. "Simplicial network analysis on EEG signals," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 630(C).
    8. François R. Velde, 2009. "Chronicle of a Deflation Unforetold," Journal of Political Economy, University of Chicago Press, vol. 117(4), pages 591-634, August.
    9. Chen, Peimin & Wu, Chunchi, 2014. "Default prediction with dynamic sectoral and macroeconomic frailties," Journal of Banking & Finance, Elsevier, vol. 40(C), pages 211-226.
    10. repec:zbw:bofitp:2019_008 is not listed on IDEAS
    11. Yue Zhao & Difang Wan, 2018. "Institutional high frequency trading and price discovery: Evidence from an emerging commodity futures market," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 38(2), pages 243-270, February.
    12. Wen Xu, 2016. "Estimation of Dynamic Panel Data Models with Stochastic Volatility Using Particle Filters," Econometrics, MDPI, vol. 4(4), pages 1-13, October.
    13. Pierre Mabille, 2019. "Aggregate Precautionary Savings Motives," 2019 Meeting Papers 344, Society for Economic Dynamics.
    14. Scott Brave & R. Andrew Butters & Alejandro Justiniano, 2016. "Forecasting Economic Activity with Mixed Frequency Bayesian VARs," Working Paper Series WP-2016-5, Federal Reserve Bank of Chicago.
    15. Labib Shami & Teddy Lazebnik, 2024. "Implementing Machine Learning Methods in Estimating the Size of the Non-observed Economy," Computational Economics, Springer;Society for Computational Economics, vol. 63(4), pages 1459-1476, April.
    16. repec:spo:wpmain:info:hdl:2441/1904 is not listed on IDEAS
    17. Hári, Norbert & De Waegenaere, Anja & Melenberg, Bertrand & Nijman, Theo E., 2008. "Estimating the term structure of mortality," Insurance: Mathematics and Economics, Elsevier, vol. 42(2), pages 492-504, April.
    18. Brave, Scott A. & Gascon, Charles & Kluender, William & Walstrum, Thomas, 2021. "Predicting benchmarked US state employment data in real time," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1261-1275.
    19. Alejandro Rodriguez & Esther Ruiz, 2009. "Bootstrap prediction intervals in state–space models," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(2), pages 167-178, March.
    20. Parrini, Alessandro, 2013. "Importance Sampling for Portfolio Credit Risk in Factor Copula Models," MPRA Paper 103745, University Library of Munich, Germany.
    21. Jean-Luc Gaffard, 2014. "Crise de la théorie et crise de la politique économique. Des modèles d'équilibre général stochastique aux modèles de dynamique hors de l'équilibre," Revue économique, Presses de Sciences-Po, vol. 65(1), pages 71-96.
    22. Salman Huseynov, 2021. "Long and short memory in dynamic term structure models," CREATES Research Papers 2021-15, Department of Economics and Business Economics, Aarhus University.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2024:i:21:p:3320-:d:1504802. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.