IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i17p7613-d1469932.html
   My bibliography  Save this article

Short-Term Load Forecasting for Regional Smart Energy Systems Based on Two-Stage Feature Extraction and Hybrid Inverted Transformer

Author

Listed:
  • Zhewei Huang

    (School of Electrical and Electronic Engineering, Huazhong University of Science and Technology, Wuhan 430074, China
    These authors contributed to the work equally and should be regarded as co-first authors.)

  • Yawen Yi

    (School of Electrical and Electronic Engineering, Huazhong University of Science and Technology, Wuhan 430074, China
    These authors contributed to the work equally and should be regarded as co-first authors.)

Abstract

Accurate short-term load forecasting is critical for enhancing the reliability and stability of regional smart energy systems. However, the inherent challenges posed by the substantial fluctuations and volatility in electricity load patterns necessitate the development of advanced forecasting techniques. In this study, a novel short-term load forecasting approach based on a two-stage feature extraction process and a hybrid inverted Transformer model is proposed. Initially, the Prophet method is employed to extract essential features such as trends, seasonality and holiday patterns from the original load dataset. Subsequently, variational mode decomposition (VMD) optimized by the IVY algorithm is utilized to extract significant periodic features from the residual component obtained by Prophet. The extracted features from both stages are then integrated to construct a comprehensive data matrix. This matrix is then inputted into a hybrid deep learning model that combines an inverted Transformer (iTransformer), temporal convolutional networks (TCNs) and a multilayer perceptron (MLP) for accurate short-term load forecasting. A thorough evaluation of the proposed method is conducted through four sets of comparative experiments using data collected from the Elia grid in Belgium. Experimental results illustrate the superior performance of the proposed approach, demonstrating high forecasting accuracy and robustness, highlighting its potential in ensuring the stable operation of regional smart energy systems.

Suggested Citation

  • Zhewei Huang & Yawen Yi, 2024. "Short-Term Load Forecasting for Regional Smart Energy Systems Based on Two-Stage Feature Extraction and Hybrid Inverted Transformer," Sustainability, MDPI, vol. 16(17), pages 1-25, September.
  • Handle: RePEc:gam:jsusta:v:16:y:2024:i:17:p:7613-:d:1469932
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/17/7613/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/16/17/7613/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Morais, Lucas Barros Scianni & Aquila, Giancarlo & de Faria, Victor Augusto Durães & Lima, Luana Medeiros Marangon & Lima, José Wanderley Marangon & de Queiroz, Anderson Rodrigo, 2023. "Short-term load forecasting using neural networks and global climate models: An application to a large-scale electrical power system," Applied Energy, Elsevier, vol. 348(C).
    2. Xiaoshuang Huang & Yinbao Zhang & Jianzhong Liu & Xinjia Zhang & Sicong Liu, 2023. "A Short-Term Wind Power Forecasting Model Based on 3D Convolutional Neural Network–Gated Recurrent Unit," Sustainability, MDPI, vol. 15(19), pages 1-13, September.
    3. Stefano Frizzo Stefenon & Laio Oriel Seman & Viviana Cocco Mariani & Leandro dos Santos Coelho, 2023. "Aggregating Prophet and Seasonal Trend Decomposition for Time Series Forecasting of Italian Electricity Spot Prices," Energies, MDPI, vol. 16(3), pages 1-18, January.
    4. Li, Ke & Mu, Yuchen & Yang, Fan & Wang, Haiyang & Yan, Yi & Zhang, Chenghui, 2023. "A novel short-term multi-energy load forecasting method for integrated energy system based on feature separation-fusion technology and improved CNN," Applied Energy, Elsevier, vol. 351(C).
    5. Sean J. Taylor & Benjamin Letham, 2018. "Forecasting at Scale," The American Statistician, Taylor & Francis Journals, vol. 72(1), pages 37-45, January.
    6. González Grandón, T. & Schwenzer, J. & Steens, T. & Breuing, J., 2024. "Electricity demand forecasting with hybrid classical statistical and machine learning algorithms: Case study of Ukraine," Applied Energy, Elsevier, vol. 355(C).
    7. Xiao, Wenjing & Mo, Li & Xu, Zhanxing & Liu, Chang & Zhang, Yongchuan, 2024. "A hybrid electric load forecasting model based on decomposition considering fisher information," Applied Energy, Elsevier, vol. 364(C).
    8. Yan Hong & Ding Wang & Jingming Su & Maowei Ren & Wanqiu Xu & Yuhao Wei & Zhen Yang, 2023. "Short-Term Power Load Forecasting in Three Stages Based on CEEMDAN-TGA Model," Sustainability, MDPI, vol. 15(14), pages 1-28, July.
    9. Wang, Chuang & Zhao, Haishen & Liu, Yang & Fan, Guojin, 2024. "Minute-level ultra-short-term power load forecasting based on time series data features," Applied Energy, Elsevier, vol. 372(C).
    10. Wei, Nan & Yin, Chuang & Yin, Lihua & Tan, Jingyi & Liu, Jinyuan & Wang, Shouxi & Qiao, Weibiao & Zeng, Fanhua, 2024. "Short-term load forecasting based on WM algorithm and transfer learning model," Applied Energy, Elsevier, vol. 353(PA).
    11. Liu, Shan & Yan, Jie & Yan, Yamin & Zhang, Haoran & Zhang, Jing & Liu, Yongqian & Han, Shuang, 2024. "Joint operation of mobile battery, power system, and transportation system for improving the renewable energy penetration rate," Applied Energy, Elsevier, vol. 357(C).
    12. Jingming Su & Xuguang Han & Yan Hong, 2023. "Short Term Power Load Forecasting Based on PSVMD-CGA Model," Sustainability, MDPI, vol. 15(4), pages 1-23, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Winita Sulandari & Yudho Yudhanto & Sri Subanti & Crisma Devika Setiawan & Riskhia Hapsari & Paulo Canas Rodrigues, 2023. "Comparing the Simple to Complex Automatic Methods with the Ensemble Approach in Forecasting Electrical Time Series Data," Energies, MDPI, vol. 16(22), pages 1-16, November.
    2. Aleksandr N. Grekov & Elena V. Vyshkvarkova & Aleksandr S. Mavrin, 2024. "Forecasting and Anomaly Detection in BEWS: Comparative Study of Theta, Croston, and Prophet Algorithms," Forecasting, MDPI, vol. 6(2), pages 1-14, May.
    3. Zhigang Liu & Jin Wang & Tao Tao & Ziyun Zhang & Siyi Chen & Yang Yi & Shuang Han & Yongqian Liu, 2023. "Wave Power Prediction Based on Seasonal and Trend Decomposition Using Locally Weighted Scatterplot Smoothing and Dual-Channel Seq2Seq Model," Energies, MDPI, vol. 16(22), pages 1-17, November.
    4. Jorge-Eusebio Velasco-López & Ramón-Alberto Carrasco & Jesús Serrano-Guerrero & Francisco Chiclana, 2024. "Profiling Social Sentiment in Times of Health Emergencies with Information from Social Networks and Official Statistics," Mathematics, MDPI, vol. 12(6), pages 1-23, March.
    5. Fadaki, Masih & Asadikia, Atie, 2024. "Augmenting Monte Carlo Tree Search for managing service level agreements," International Journal of Production Economics, Elsevier, vol. 271(C).
    6. Michael Vössing & Niklas Kühl & Matteo Lind & Gerhard Satzger, 2022. "Designing Transparency for Effective Human-AI Collaboration," Information Systems Frontiers, Springer, vol. 24(3), pages 877-895, June.
    7. Maghsoodi, Abtin Ijadi, 2023. "Cryptocurrency portfolio allocation using a novel hybrid and predictive big data decision support system," Omega, Elsevier, vol. 115(C).
    8. Miroslav Navratil & Andrea Kolkova, 2019. "Decomposition and Forecasting Time Series in the Business Economy Using Prophet Forecasting Model," Central European Business Review, Prague University of Economics and Business, vol. 2019(4), pages 26-39.
    9. Fadi Kahwash & Basel Barakat & Ahmad Taha & Qammer H. Abbasi & Muhammad Ali Imran, 2021. "Optimising Electrical Power Supply Sustainability Using a Grid-Connected Hybrid Renewable Energy System—An NHS Hospital Case Study," Energies, MDPI, vol. 14(21), pages 1-23, October.
    10. Lorenzo Menculini & Andrea Marini & Massimiliano Proietti & Alberto Garinei & Alessio Bozza & Cecilia Moretti & Marcello Marconi, 2021. "Comparing Prophet and Deep Learning to ARIMA in Forecasting Wholesale Food Prices," Forecasting, MDPI, vol. 3(3), pages 1-19, September.
    11. Romero-Fiances, Irene & Livera, Andreas & Theristis, Marios & Makrides, George & Stein, Joshua S. & Nofuentes, Gustavo & de la Casa, Juan & Georghiou, George E., 2022. "Impact of duration and missing data on the long-term photovoltaic degradation rate estimation," Renewable Energy, Elsevier, vol. 181(C), pages 738-748.
    12. Ashish Shrestha & Bishal Ghimire & Francisco Gonzalez-Longatt, 2021. "A Bayesian Model to Forecast the Time Series Kinetic Energy Data for a Power System," Energies, MDPI, vol. 14(11), pages 1-15, June.
    13. Nik Dawson & Sacha Molitorisz & Marian-Andrei Rizoiu & Peter Fray, 2020. "Layoffs, Inequity and COVID-19: A Longitudinal Study of the Journalism Jobs Crisis in Australia from 2012 to 2020," Papers 2008.12459, arXiv.org, revised Feb 2021.
    14. Luyao Zhang & Fan Zhang, 2023. "Understand Waiting Time in Transaction Fee Mechanism: An Interdisciplinary Perspective," Papers 2305.02552, arXiv.org.
    15. Qinghe Zhao & Xinyi Liu & Junlong Fang, 2023. "Extreme Gradient Boosting Model for Day-Ahead STLF in National Level Power System: Estonia Case Study," Energies, MDPI, vol. 16(24), pages 1-29, December.
    16. Md Jamal Ahmed Shohan & Md Omar Faruque & Simon Y. Foo, 2022. "Forecasting of Electric Load Using a Hybrid LSTM-Neural Prophet Model," Energies, MDPI, vol. 15(6), pages 1-18, March.
    17. Ángel Cuevas & Ramiro Ledo & Enrique M. Quilis, 2021. "Seasonal adjustment of the Spanish sales daily data," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 12(4), pages 687-708, December.
    18. Sprangers, Olivier & Schelter, Sebastian & de Rijke, Maarten, 2023. "Parameter-efficient deep probabilistic forecasting," International Journal of Forecasting, Elsevier, vol. 39(1), pages 332-345.
    19. Odin Foldvik Eikeland & Filippo Maria Bianchi & Harry Apostoleris & Morten Hansen & Yu-Cheng Chiou & Matteo Chiesa, 2021. "Predicting Energy Demand in Semi-Remote Arctic Locations," Energies, MDPI, vol. 14(4), pages 1-17, February.
    20. Jayesh Thaker & Robert Höller, 2022. "A Comparative Study of Time Series Forecasting of Solar Energy Based on Irradiance Classification," Energies, MDPI, vol. 15(8), pages 1-26, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:17:p:7613-:d:1469932. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.