IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v17y2024i7p1625-d1365892.html
   My bibliography  Save this article

Data-Driven Techniques for Short-Term Electricity Price Forecasting through Novel Deep Learning Approaches with Attention Mechanisms

Author

Listed:
  • Vasileios Laitsos

    (Department of Electrical and Computer Engineering, University of Thessaly, 383 34 Volos, Greece)

  • Georgios Vontzos

    (Department of Electrical and Computer Engineering, University of Thessaly, 383 34 Volos, Greece)

  • Dimitrios Bargiotas

    (Department of Electrical and Computer Engineering, University of Thessaly, 383 34 Volos, Greece)

  • Aspassia Daskalopulu

    (Department of Electrical and Computer Engineering, University of Thessaly, 383 34 Volos, Greece)

  • Lefteri H. Tsoukalas

    (Center for Intelligent Energy Systems (CiENS), School of Nuclear Engineering, Purdue University, West Lafayette, IN 47906, USA)

Abstract

The electricity market is constantly evolving, being driven by factors such as market liberalization, the increasing use of renewable energy sources (RESs), and various economic and political influences. These dynamics make it challenging to predict wholesale electricity prices. Accurate short-term forecasting is crucial to maintaining system balance and addressing anomalies such as negative prices and deviations from predictions. This paper investigates short-term electricity price forecasting using historical time series data and employs advanced deep learning algorithms. First, four deep learning models are implemented and proposed, which are a convolutional neural network (CNN) with an integrated attention mechanism, a hybrid CNN followed by a gated recurrent unit model (CNN-GRU) with an attention mechanism, and two ensemble learning models, which are a soft voting ensemble and a stacking ensemble model. Also, the optimized version of a transformer model, the Multi-Head Attention model, is introduced. Finally, the perceptron model is used as a benchmark for comparison. Our results show excellent prediction accuracy, particularly in the hybrid CNN-GRU model with attention, thereby achieving a mean absolute percentage error (MAPE) of 6.333%. The soft voting ensemble model and the Multi-Head Attention model also performed well, with MAPEs of 6.125% and 6.889%, respectively. These findings are significant, as previous studies have not shown high performance with transformer models and attention mechanisms. The presented results offer promising insights for future research in this field.

Suggested Citation

  • Vasileios Laitsos & Georgios Vontzos & Dimitrios Bargiotas & Aspassia Daskalopulu & Lefteri H. Tsoukalas, 2024. "Data-Driven Techniques for Short-Term Electricity Price Forecasting through Novel Deep Learning Approaches with Attention Mechanisms," Energies, MDPI, vol. 17(7), pages 1-27, March.
  • Handle: RePEc:gam:jeners:v:17:y:2024:i:7:p:1625-:d:1365892
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/17/7/1625/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/17/7/1625/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Brusaferri, Alessandro & Matteucci, Matteo & Portolani, Pietro & Vitali, Andrea, 2019. "Bayesian deep learning based method for probabilistic forecast of day-ahead electricity prices," Applied Energy, Elsevier, vol. 250(C), pages 1158-1175.
    2. Beltrán, Sergio & Castro, Alain & Irizar, Ion & Naveran, Gorka & Yeregui, Imanol, 2022. "Framework for collaborative intelligence in forecasting day-ahead electricity price," Applied Energy, Elsevier, vol. 306(PA).
    3. Athanasios Ioannis Arvanitidis & Dimitrios Bargiotas & Dimitrios Kontogiannis & Athanasios Fevgas & Miltiadis Alamaniotis, 2022. "Optimized Data-Driven Models for Short-Term Electricity Price Forecasting Based on Signal Decomposition and Clustering Techniques," Energies, MDPI, vol. 15(21), pages 1-24, October.
    4. Laiqing Yan & Zutai Yan & Zhenwen Li & Ning Ma & Ran Li & Jian Qin, 2023. "Electricity Market Price Prediction Based on Quadratic Hybrid Decomposition and THPO Algorithm," Energies, MDPI, vol. 16(13), pages 1-18, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Seyed Mohammad Sharifhosseini & Taher Niknam & Mohammad Hossein Taabodi & Habib Asadi Aghajari & Ehsan Sheybani & Giti Javidi & Motahareh Pourbehzadi, 2024. "Investigating Intelligent Forecasting and Optimization in Electrical Power Systems: A Comprehensive Review of Techniques and Applications," Energies, MDPI, vol. 17(21), pages 1-35, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ghimire, Sujan & Deo, Ravinesh C. & Casillas-Pérez, David & Salcedo-Sanz, Sancho, 2024. "Two-step deep learning framework with error compensation technique for short-term, half-hourly electricity price forecasting," Applied Energy, Elsevier, vol. 353(PA).
    2. Gao, Yuan & Miyata, Shohei & Akashi, Yasunori, 2022. "Interpretable deep learning models for hourly solar radiation prediction based on graph neural network and attention," Applied Energy, Elsevier, vol. 321(C).
    3. Zhao, Yincheng & Zhang, Guozhou & Hu, Weihao & Huang, Qi & Chen, Zhe & Blaabjerg, Frede, 2023. "Meta-learning based voltage control strategy for emergency faults of active distribution networks," Applied Energy, Elsevier, vol. 349(C).
    4. Karol Pilot & Alicja Ganczarek-Gamrot & Krzysztof Kania, 2024. "Dealing with Anomalies in Day-Ahead Market Prediction Using Machine Learning Hybrid Model," Energies, MDPI, vol. 17(17), pages 1-20, September.
    5. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    6. Wang, Ran & Lu, Shilei & Feng, Wei, 2020. "A novel improved model for building energy consumption prediction based on model integration," Applied Energy, Elsevier, vol. 262(C).
    7. Sabarathinam Srinivasan & Suresh Kumarasamy & Zacharias E. Andreadakis & Pedro G. Lind, 2023. "Artificial Intelligence and Mathematical Models of Power Grids Driven by Renewable Energy Sources: A Survey," Energies, MDPI, vol. 16(14), pages 1-56, July.
    8. Yin, Linfei & Qiu, Yao, 2022. "Long-term price guidance mechanism of flexible energy service providers based on stochastic differential methods," Energy, Elsevier, vol. 238(PB).
    9. Ethem Çanakoğlu & Esra Adıyeke, 2020. "Comparison of Electricity Spot Price Modelling and Risk Management Applications," Energies, MDPI, vol. 13(18), pages 1-22, September.
    10. Jun Dong & Xihao Dou & Aruhan Bao & Yaoyu Zhang & Dongran Liu, 2022. "Day-Ahead Spot Market Price Forecast Based on a Hybrid Extreme Learning Machine Technique: A Case Study in China," Sustainability, MDPI, vol. 14(13), pages 1-24, June.
    11. Kaiyan Wang & Haodong Du & Rong Jia & Hongtao Jia, 2022. "Performance Comparison of Bayesian Deep Learning Model and Traditional Bayesian Neural Network in Short-Term PV Interval Prediction," Sustainability, MDPI, vol. 14(19), pages 1-27, October.
    12. Nie, Ying & Li, Ping & Wang, Jianzhou & Zhang, Lifang, 2024. "A novel multivariate electrical price bi-forecasting system based on deep learning, a multi-input multi-output structure and an operator combination mechanism," Applied Energy, Elsevier, vol. 366(C).
    13. Kılıç Depren, Serpil & Kartal, Mustafa Tevfik & Ertuğrul, Hasan Murat & Depren, Özer, 2022. "The role of data frequency and method selection in electricity price estimation: Comparative evidence from Turkey in pre-pandemic and pandemic periods," Renewable Energy, Elsevier, vol. 186(C), pages 217-225.
    14. Wagner, Andreas & Ramentol, Enislay & Schirra, Florian & Michaeli, Hendrik, 2022. "Short- and long-term forecasting of electricity prices using embedding of calendar information in neural networks," Journal of Commodity Markets, Elsevier, vol. 28(C).
    15. Richter, Lucas & Lehna, Malte & Marchand, Sophie & Scholz, Christoph & Dreher, Alexander & Klaiber, Stefan & Lenk, Steve, 2022. "Artificial Intelligence for Electricity Supply Chain automation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 163(C).
    16. Sheybanivaziri, Samaneh & Le Dréau, Jérôme & Kazmi, Hussain, 2024. "Forecasting price spikes in day-ahead electricity markets: techniques, challenges, and the road ahead," Discussion Papers 2024/1, Norwegian School of Economics, Department of Business and Management Science.
    17. Venkatraj, V. & Dixit, M.K., 2022. "Challenges in implementing data-driven approaches for building life cycle energy assessment: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    18. Marcelle Caroline Thimotheo de Brito & Amaro O. Pereira Junior & Mario Veiga Ferraz Pereira & Julio César Cahuano Simba & Sergio Granville, 2022. "Competitive Behavior of Hydroelectric Power Plants under Uncertainty in Spot Market," Energies, MDPI, vol. 15(19), pages 1-22, October.
    19. Chen, Xiaoyang & Du, Yang & Lim, Enggee & Fang, Lurui & Yan, Ke, 2022. "Towards the applicability of solar nowcasting: A practice on predictive PV power ramp-rate control," Renewable Energy, Elsevier, vol. 195(C), pages 147-166.
    20. Sergio Cantillo-Luna & Ricardo Moreno-Chuquen & Jesus Lopez-Sotelo & David Celeita, 2023. "An Intra-Day Electricity Price Forecasting Based on a Probabilistic Transformer Neural Network Architecture," Energies, MDPI, vol. 16(19), pages 1-24, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:17:y:2024:i:7:p:1625-:d:1365892. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.