IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i6p2878-d1102690.html
   My bibliography  Save this article

A Short-Term Load Forecasting Model Based on Crisscross Grey Wolf Optimizer and Dual-Stage Attention Mechanism

Author

Listed:
  • Renxi Gong

    (School of Electrical Engineering, Guangxi University, Nanning 530004, China
    School of Traffic &Transportation, Nanning University, Nanning 530200, China)

  • Xianglong Li

    (School of Electrical Engineering, Guangxi University, Nanning 530004, China)

Abstract

Accurate short-term load forecasting is of great significance to the safe and stable operation of power systems and the development of the power market. Most existing studies apply deep learning models to make predictions considering only one feature or temporal relationship in load time series. Therefore, to obtain an accurate and reliable prediction result, a hybrid prediction model combining a dual-stage attention mechanism (DA), crisscross grey wolf optimizer (CS-GWO) and bidirectional gated recurrent unit (BiGRU) is proposed in this paper. DA is introduced on the input side of the model to improve the sensitivity of the model to key features and information at key time points simultaneously. CS-GWO is formed by combining the horizontal and vertical crossover operators, to enhance the global search ability and the diversity of the population of GWO. Meanwhile, BiGRU is optimized by CS-GWO to accelerate the convergence of the model. Finally, a collected load dataset, four evaluation metrics and parametric and non-parametric testing manners are used to evaluate the proposed CS-GWO-DA-BiGRU short-term load prediction model. The experimental results show that the RMSE, MAE and SMAPE are reduced respectively by 3.86%, 1.37% and 0.30% of those of the second-best performing CSO-DA-BiGRU model, which demonstrates that the proposed model can better fit the load data and achieve better prediction results.

Suggested Citation

  • Renxi Gong & Xianglong Li, 2023. "A Short-Term Load Forecasting Model Based on Crisscross Grey Wolf Optimizer and Dual-Stage Attention Mechanism," Energies, MDPI, vol. 16(6), pages 1-24, March.
    • Handle: RePEc:gam:jeners:v:16:y:2023:i:6:p:2878-:d:1102690
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/6/2878/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/16/6/2878/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dongxiao Niu & Shuyu Dai, 2017. "A Short-Term Load Forecasting Model with a Modified Particle Swarm Optimization Algorithm and Least Squares Support Vector Machine Based on the Denoising Method of Empirical Mode Decomposition and Gre," Energies, MDPI, vol. 10(3), pages 1-20, March.
    2. Yu, Feng & Xu, Xiaozhong, 2014. "A short-term load forecasting model of natural gas based on optimized genetic algorithm and improved BP neural network," Applied Energy, Elsevier, vol. 134(C), pages 102-113.
    3. Hashim, Fatma A. & Houssein, Essam H. & Hussain, Kashif & Mabrouk, Mai S. & Al-Atabany, Walid, 2022. "Honey Badger Algorithm: New metaheuristic algorithm for solving optimization problems," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 192(C), pages 84-110.
    4. Niu, Zhewen & Yu, Zeyuan & Tang, Wenhu & Wu, Qinghua & Reformat, Marek, 2020. "Wind power forecasting using attention-based gated recurrent unit network," Energy, Elsevier, vol. 196(C).
    5. Li, Song & Goel, Lalit & Wang, Peng, 2016. "An ensemble approach for short-term load forecasting by extreme learning machine," Applied Energy, Elsevier, vol. 170(C), pages 22-29.
    6. Fazlipour, Zahra & Mashhour, Elaheh & Joorabian, Mahmood, 2022. "A deep model for short-term load forecasting applying a stacked autoencoder based on LSTM supported by a multi-stage attention mechanism," Applied Energy, Elsevier, vol. 327(C).
    7. Salah Bouktif & Ali Fiaz & Ali Ouni & Mohamed Adel Serhani, 2018. "Optimal Deep Learning LSTM Model for Electric Load Forecasting using Feature Selection and Genetic Algorithm: Comparison with Machine Learning Approaches †," Energies, MDPI, vol. 11(7), pages 1-20, June.
    8. Seon Hyeog Kim & Gyul Lee & Gu-Young Kwon & Do-In Kim & Yong-June Shin, 2018. "Deep Learning Based on Multi-Decomposition for Short-Term Load Forecasting," Energies, MDPI, vol. 11(12), pages 1-17, December.
    9. Meng, Anbo & Chen, Shun & Ou, Zuhong & Ding, Weifeng & Zhou, Huaming & Fan, Jingmin & Yin, Hao, 2022. "A hybrid deep learning architecture for wind power prediction based on bi-attention mechanism and crisscross optimization," Energy, Elsevier, vol. 238(PB).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Umme Mumtahina & Sanath Alahakoon & Peter Wolfs, 2024. "Hyperparameter Tuning of Load-Forecasting Models Using Metaheuristic Optimization Algorithms—A Systematic Review," Mathematics, MDPI, vol. 12(21), pages 1-51, October.
    2. Yang Feng & Xiaonan Hu & Songsong Hou & Yan Guo, 2025. "A Novel BiGRU-Attention Model for Predicting Corn Market Prices Based on Multi-Feature Fusion and Grey Wolf Optimization," Agriculture, MDPI, vol. 15(5), pages 1-25, February.
    3. Peng, Daogang & Liu, Yu & Wang, Danhao & Zhao, Huirong & Qu, Bogang, 2024. "Multi-energy load forecasting for integrated energy system based on sequence decomposition fusion and factors correlation analysis," Energy, Elsevier, vol. 308(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wei Sun & Chongchong Zhang, 2018. "A Hybrid BA-ELM Model Based on Factor Analysis and Similar-Day Approach for Short-Term Load Forecasting," Energies, MDPI, vol. 11(5), pages 1-18, May.
    2. Yuqi Dong & Xuejiao Ma & Chenchen Ma & Jianzhou Wang, 2016. "Research and Application of a Hybrid Forecasting Model Based on Data Decomposition for Electrical Load Forecasting," Energies, MDPI, vol. 9(12), pages 1-30, December.
    3. He, Feifei & Zhou, Jianzhong & Feng, Zhong-kai & Liu, Guangbiao & Yang, Yuqi, 2019. "A hybrid short-term load forecasting model based on variational mode decomposition and long short-term memory networks considering relevant factors with Bayesian optimization algorithm," Applied Energy, Elsevier, vol. 237(C), pages 103-116.
    4. Wu, Zhuochun & Zhao, Xiaochen & Ma, Yuqing & Zhao, Xinyan, 2019. "A hybrid model based on modified multi-objective cuckoo search algorithm for short-term load forecasting," Applied Energy, Elsevier, vol. 237(C), pages 896-909.
    5. Meng, Anbo & Chen, Shu & Ou, Zuhong & Xiao, Jianhua & Zhang, Jianfeng & Chen, Shun & Zhang, Zheng & Liang, Ruduo & Zhang, Zhan & Xian, Zikang & Wang, Chenen & Yin, Hao & Yan, Baiping, 2022. "A novel few-shot learning approach for wind power prediction applying secondary evolutionary generative adversarial network," Energy, Elsevier, vol. 261(PA).
    6. Heng, Jiani & Wang, Jianzhou & Xiao, Liye & Lu, Haiyan, 2017. "Research and application of a combined model based on frequent pattern growth algorithm and multi-objective optimization for solar radiation forecasting," Applied Energy, Elsevier, vol. 208(C), pages 845-866.
    7. Wu, Qiang & Zheng, Hongling & Guo, Xiaozhu & Liu, Guangqiang, 2022. "Promoting wind energy for sustainable development by precise wind speed prediction based on graph neural networks," Renewable Energy, Elsevier, vol. 199(C), pages 977-992.
    8. Zhang, Guoqiang & Guo, Jifeng, 2020. "A novel ensemble method for hourly residential electricity consumption forecasting by imaging time series," Energy, Elsevier, vol. 203(C).
    9. Ma, Zhengjing & Mei, Gang, 2022. "A hybrid attention-based deep learning approach for wind power prediction," Applied Energy, Elsevier, vol. 323(C).
    10. Zaki Masood & Rahma Gantassi & Ardiansyah & Yonghoon Choi, 2022. "A Multi-Step Time-Series Clustering-Based Seq2Seq LSTM Learning for a Single Household Electricity Load Forecasting," Energies, MDPI, vol. 15(7), pages 1-11, April.
    11. Zhang, Ziyuan & Wang, Jianzhou & Wei, Danxiang & Luo, Tianrui & Xia, Yurui, 2023. "A novel ensemble system for short-term wind speed forecasting based on Two-stage Attention-Based Recurrent Neural Network," Renewable Energy, Elsevier, vol. 204(C), pages 11-23.
    12. Luca Massidda & Marino Marrocu, 2017. "Decoupling Weather Influence from User Habits for an Optimal Electric Load Forecast System," Energies, MDPI, vol. 10(12), pages 1-16, December.
    13. Lin Lin & Lin Xue & Zhiqiang Hu & Nantian Huang, 2018. "Modular Predictor for Day-Ahead Load Forecasting and Feature Selection for Different Hours," Energies, MDPI, vol. 11(7), pages 1-30, July.
    14. Xiao, Liye & Shao, Wei & Liang, Tulu & Wang, Chen, 2016. "A combined model based on multiple seasonal patterns and modified firefly algorithm for electrical load forecasting," Applied Energy, Elsevier, vol. 167(C), pages 135-153.
    15. Bingjie Jin & Guihua Zeng & Zhilin Lu & Hongqiao Peng & Shuxin Luo & Xinhe Yang & Haojun Zhu & Mingbo Liu, 2022. "Hybrid LSTM–BPNN-to-BPNN Model Considering Multi-Source Information for Forecasting Medium- and Long-Term Electricity Peak Load," Energies, MDPI, vol. 15(20), pages 1-20, October.
    16. Sumit Saroha & Marta Zurek-Mortka & Jerzy Ryszard Szymanski & Vineet Shekher & Pardeep Singla, 2021. "Forecasting of Market Clearing Volume Using Wavelet Packet-Based Neural Networks with Tracking Signals," Energies, MDPI, vol. 14(19), pages 1-21, September.
    17. Ding, Song & Tao, Zui & Zhang, Huahan & Li, Yao, 2022. "Forecasting nuclear energy consumption in China and America: An optimized structure-adaptative grey model," Energy, Elsevier, vol. 239(PA).
    18. Suriyan Jomthanachai & Wai Peng Wong & Khai Wah Khaw, 2024. "An Application of Machine Learning to Logistics Performance Prediction: An Economics Attribute-Based of Collective Instance," Computational Economics, Springer;Society for Computational Economics, vol. 63(2), pages 741-792, February.
    19. Li, Hui & Nie, Weige & Duan, Huiming, 2024. "A Haavelmo grey model based on economic growth and its application to energy industry investments," Chaos, Solitons & Fractals, Elsevier, vol. 181(C).
    20. Ping-Huan Kuo & Chiou-Jye Huang, 2018. "A Green Energy Application in Energy Management Systems by an Artificial Intelligence-Based Solar Radiation Forecasting Model," Energies, MDPI, vol. 11(4), pages 1-15, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:6:p:2878-:d:1102690. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.