IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v14y2021i21p7378-d672923.html
   My bibliography  Save this article

Stacking Ensemble Methodology Using Deep Learning and ARIMA Models for Short-Term Load Forecasting

Author

Listed:
  • Pedro M. R. Bento

    (Department of Electromechanical Engineering, Faculty of Engineering, University of Beira Interior, 6201-001 Covilhã, Portugal
    IT-Instituto de Telecomunicações, 6201-001 Covilhã, Portugal)

  • Jose A. N. Pombo

    (Department of Electromechanical Engineering, Faculty of Engineering, University of Beira Interior, 6201-001 Covilhã, Portugal)

  • Maria R. A. Calado

    (Department of Electromechanical Engineering, Faculty of Engineering, University of Beira Interior, 6201-001 Covilhã, Portugal
    IT-Instituto de Telecomunicações, 6201-001 Covilhã, Portugal)

  • Silvio J. P. S. Mariano

    (Department of Electromechanical Engineering, Faculty of Engineering, University of Beira Interior, 6201-001 Covilhã, Portugal
    IT-Instituto de Telecomunicações, 6201-001 Covilhã, Portugal)

Abstract

Short-Term Load Forecasting is critical for reliable power system operation, and the search for enhanced methodologies has been a constant field of investigation, particularly in an increasingly competitive environment where the market operator and its participants need to better inform their decisions. Hence, it is important to continue advancing in terms of forecasting accuracy and consistency. This paper presents a new deep learning-based ensemble methodology for 24 h ahead load forecasting, where an automatic framework is proposed to select the best Box-Jenkins models (ARIMA Forecasters), from a wide-range of combinations. The method is distinct in its parameters but more importantly in considering different batches of historical (training) data, thus benefiting from prediction models focused on recent and longer load trends. Afterwards, these accurate predictions, mainly the linear components of the load time-series, are fed to the ensemble Deep Forward Neural Network. This flexible type of network architecture not only functions as a combiner but also receives additional historical and auxiliary data to further its generalization capabilities. Numerical testing using New England market data validated the proposed ensemble approach with diverse base forecasters, achieving promising results in comparison with other state-of-the-art methods.

Suggested Citation

  • Pedro M. R. Bento & Jose A. N. Pombo & Maria R. A. Calado & Silvio J. P. S. Mariano, 2021. "Stacking Ensemble Methodology Using Deep Learning and ARIMA Models for Short-Term Load Forecasting," Energies, MDPI, vol. 14(21), pages 1-21, November.
    • Handle: RePEc:gam:jeners:v:14:y:2021:i:21:p:7378-:d:672923
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/14/21/7378/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/14/21/7378/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jihoon Moon & Yongsung Kim & Minjae Son & Eenjun Hwang, 2018. "Hybrid Short-Term Load Forecasting Scheme Using Random Forest and Multilayer Perceptron," Energies, MDPI, vol. 11(12), pages 1-20, November.
    2. Prado, Francisco & Minutolo, Marcel C. & Kristjanpoller, Werner, 2020. "Forecasting based on an ensemble Autoregressive Moving Average - Adaptive neuro - Fuzzy inference system – Neural network - Genetic Algorithm Framework," Energy, Elsevier, vol. 197(C).
    3. Oreshkin, Boris N. & Dudek, Grzegorz & Pełka, Paweł & Turkina, Ekaterina, 2021. "N-BEATS neural network for mid-term electricity load forecasting," Applied Energy, Elsevier, vol. 293(C).
    4. Yuhong Xie & Yuzuru Ueda & Masakazu Sugiyama, 2021. "A Two-Stage Short-Term Load Forecasting Method Using Long Short-Term Memory and Multilayer Perceptron," Energies, MDPI, vol. 14(18), pages 1-17, September.
    5. Massaoudi, Mohamed & Refaat, Shady S. & Chihi, Ines & Trabelsi, Mohamed & Oueslati, Fakhreddine S. & Abu-Rub, Haitham, 2021. "A novel stacked generalization ensemble-based hybrid LGBM-XGB-MLP model for Short-Term Load Forecasting," Energy, Elsevier, vol. 214(C).
    6. Shree Krishna Acharya & Young-Min Wi & Jaehee Lee, 2019. "Short-Term Load Forecasting for a Single Household Based on Convolution Neural Networks Using Data Augmentation," Energies, MDPI, vol. 12(18), pages 1-19, September.
    7. Janusz Sowinski, 2021. "The Impact of the Selection of Exogenous Variables in the ANFIS Model on the Results of the Daily Load Forecast in the Power Company," Energies, MDPI, vol. 14(2), pages 1-18, January.
    8. Yu Jin & Honggang Guo & Jianzhou Wang & Aiyi Song, 2020. "A Hybrid System Based on LSTM for Short-Term Power Load Forecasting," Energies, MDPI, vol. 13(23), pages 1-32, November.
    9. Tuukka Salmi & Jussi Kiljander & Daniel Pakkala, 2020. "Stacked Boosters Network Architecture for Short-Term Load Forecasting in Buildings," Energies, MDPI, vol. 13(9), pages 1-15, May.
    10. Chan-Uk Yeom & Keun-Chang Kwak, 2017. "Short-Term Electricity-Load Forecasting Using a TSK-Based Extreme Learning Machine with Knowledge Representation," Energies, MDPI, vol. 10(10), pages 1-18, October.
    11. Rial A. Rajagukguk & Raden A. A. Ramadhan & Hyun-Jin Lee, 2020. "A Review on Deep Learning Models for Forecasting Time Series Data of Solar Irradiance and Photovoltaic Power," Energies, MDPI, vol. 13(24), pages 1-23, December.
    12. Rob J. Hyndman & Andrey V. Kostenko, 2007. "Minimum Sample Size requirements for Seasonal Forecasting Models," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 6, pages 12-15, Spring.
    13. Yamin Shen & Yuxuan Ma & Simin Deng & Chiou-Jye Huang & Ping-Huan Kuo, 2021. "An Ensemble Model based on Deep Learning and Data Preprocessing for Short-Term Electrical Load Forecasting," Sustainability, MDPI, vol. 13(4), pages 1-21, February.
    14. Amevi Acakpovi & Alfred Tettey Ternor & Nana Yaw Asabere & Patrick Adjei & Abdul-Shakud Iddrisu, 2020. "Time Series Prediction of Electricity Demand Using Adaptive Neuro-Fuzzy Inference Systems," Mathematical Problems in Engineering, Hindawi, vol. 2020, pages 1-14, August.
    15. Mansoor, Muhammad & Grimaccia, Francesco & Leva, Sonia & Mussetta, Marco, 2021. "Comparison of echo state network and feed-forward neural networks in electrical load forecasting for demand response programs," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 184(C), pages 282-293.
    16. Tomasz Ciechulski & Stanisław Osowski, 2021. "High Precision LSTM Model for Short-Time Load Forecasting in Power Systems," Energies, MDPI, vol. 14(11), pages 1-15, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Feras Alasali & Khaled Nusair & Lina Alhmoud & Eyad Zarour, 2021. "Impact of the COVID-19 Pandemic on Electricity Demand and Load Forecasting," Sustainability, MDPI, vol. 13(3), pages 1-22, January.
    2. Md Jamal Ahmed Shohan & Md Omar Faruque & Simon Y. Foo, 2022. "Forecasting of Electric Load Using a Hybrid LSTM-Neural Prophet Model," Energies, MDPI, vol. 15(6), pages 1-18, March.
    3. Janusz Sowinski, 2021. "The Impact of the Selection of Exogenous Variables in the ANFIS Model on the Results of the Daily Load Forecast in the Power Company," Energies, MDPI, vol. 14(2), pages 1-18, January.
    4. Ahmad, Tanveer & Zhang, Dongdong & Huang, Chao, 2021. "Methodological framework for short-and medium-term energy, solar and wind power forecasting with stochastic-based machine learning approach to monetary and energy policy applications," Energy, Elsevier, vol. 231(C).
    5. Stanislaw Osowski & Robert Szmurlo & Krzysztof Siwek & Tomasz Ciechulski, 2022. "Neural Approaches to Short-Time Load Forecasting in Power Systems—A Comparative Study," Energies, MDPI, vol. 15(9), pages 1-21, April.
    6. He, Yaoyao & Cao, Chaojin & Wang, Shuo & Fu, Hong, 2022. "Nonparametric probabilistic load forecasting based on quantile combination in electrical power systems," Applied Energy, Elsevier, vol. 322(C).
    7. Grzegorz Dudek, 2021. "Short-Term Load Forecasting Using Neural Networks with Pattern Similarity-Based Error Weights," Energies, MDPI, vol. 14(11), pages 1-18, May.
    8. Miguel A. Jaramillo-Morán & Daniel Fernández-Martínez & Agustín García-García & Diego Carmona-Fernández, 2021. "Improving Artificial Intelligence Forecasting Models Performance with Data Preprocessing: European Union Allowance Prices Case Study," Energies, MDPI, vol. 14(23), pages 1-23, November.
    9. Hasnain Iftikhar & Josue E. Turpo-Chaparro & Paulo Canas Rodrigues & Javier Linkolk López-Gonzales, 2023. "Day-Ahead Electricity Demand Forecasting Using a Novel Decomposition Combination Method," Energies, MDPI, vol. 16(18), pages 1-22, September.
    10. Wei Sun & Chongchong Zhang, 2018. "A Hybrid BA-ELM Model Based on Factor Analysis and Similar-Day Approach for Short-Term Load Forecasting," Energies, MDPI, vol. 11(5), pages 1-18, May.
    11. Liu Lu & Wei Wei, 2023. "Influence of Public Sports Services on Residents’ Mental Health at Communities Level: New Insights from China," IJERPH, MDPI, vol. 20(2), pages 1-14, January.
    12. Monika Zimmermann & Florian Ziel, 2024. "Efficient mid-term forecasting of hourly electricity load using generalized additive models," Papers 2405.17070, arXiv.org.
    13. Li, Guanzheng & Li, Bin & Li, Chao & Wang, Shuai, 2023. "State-of-health rapid estimation for lithium-ion battery based on an interpretable stacking ensemble model with short-term voltage profiles," Energy, Elsevier, vol. 263(PE).
    14. Wen-Ze Wu & Chong Liu & Wanli Xie & Mark Goh & Tao Zhang, 2023. "Predictive analysis of the industrial water-waste-energy system using an optimised grey approach: A case study in China," Energy & Environment, , vol. 34(5), pages 1639-1656, August.
    15. Verdone, Alessio & Scardapane, Simone & Panella, Massimo, 2024. "Explainable Spatio-Temporal Graph Neural Networks for multi-site photovoltaic energy production," Applied Energy, Elsevier, vol. 353(PB).
    16. Jihoon Moon & Junhong Kim & Pilsung Kang & Eenjun Hwang, 2020. "Solving the Cold-Start Problem in Short-Term Load Forecasting Using Tree-Based Methods," Energies, MDPI, vol. 13(4), pages 1-37, February.
    17. Saima Akhtar & Sulman Shahzad & Asad Zaheer & Hafiz Sami Ullah & Heybet Kilic & Radomir Gono & Michał Jasiński & Zbigniew Leonowicz, 2023. "Short-Term Load Forecasting Models: A Review of Challenges, Progress, and the Road Ahead," Energies, MDPI, vol. 16(10), pages 1-29, May.
    18. Mohamed Massaoudi & Ines Chihi & Lilia Sidhom & Mohamed Trabelsi & Shady S. Refaat & Fakhreddine S. Oueslati, 2021. "Enhanced Random Forest Model for Robust Short-Term Photovoltaic Power Forecasting Using Weather Measurements," Energies, MDPI, vol. 14(13), pages 1-20, July.
    19. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    20. Cen, Xiao & Chen, Zengliang & Chen, Haifeng & Ding, Chen & Ding, Bo & Li, Fei & Lou, Fangwei & Zhu, Zhenyu & Zhang, Hongyu & Hong, Bingyuan, 2024. "User repurchase behavior prediction for integrated energy supply stations based on the user profiling method," Energy, Elsevier, vol. 286(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:14:y:2021:i:21:p:7378-:d:672923. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.