IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v374y2024ics0306261924014508.html
   My bibliography  Save this article

Future energy insights: Time-series and deep learning models for city load forecasting

Author

Listed:
  • Maleki, Neda
  • Lundström, Oxana
  • Musaddiq, Arslan
  • Jeansson, John
  • Olsson, Tobias
  • Ahlgren, Fredrik

Abstract

Most of the utility meters in Sweden are now integrated with Internet of Things (IoT) technology. This modern approach significantly enhances our understanding of energy consumption patterns and empowers consumers with detailed insights into their power usage. Additionally, it provides energy companies and grid owners with critical data to facilitate future energy production planning. However, having data at our disposal is only half the battle won. The method employed to forecast energy consumption is equally important due to the complex interplay between long-term trends, seasonal fluctuations, and other unpredictable factors. To optimally utilize this data, we analyzed several robust time-series forecasting models: Random Forest, XGBoost, SARIMAX, FB Prophet, and a Convolutional Neural Network (CNN). Each of these models was chosen for its unique strengths in capturing long-term trends and short-term variations, making them appropriate candidates for predicting power consumption. We showcase the models’ performance on the energy consumption data from commercial property owners in 2021 and evaluate their performance based on key performance metrics such as mean squared error (MSE), root mean squared error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE), Relative Root Mean Square Error (RRMSE), Coefficient of determination (R2), and Standard Deviation (SD). Our results demonstrate that while FB Prophet, with its ability to effectively factor in external parameters such as price and temperature, fared well in predicting aggregated consumption, it was effectively outperformed by the CNN classifier. The CNN model demonstrated exceptional prediction capabilities and flexibility in adding additional features to the model. For example, the CNN model with the highest accuracy showed the lowest MSE compared to Random Forest, XGBoost, SARIMAX, and FB Prophet with reductions of 75.70%, 69.48%, 49.45%, and 30.62%, respectively. Additionally, the CNN model showed superior R2 values, indicating a better fit to the data. Specifically, the R2 value for the CNN model was 0.93% on the training set and 0.60% on the testing set, outperforming the other models in terms of explained variance. We also utilized AutoML to analyze a 4-year dataset (2021–2023) to showcase the generalizability of the models. Using AutoML, the R2 value increased from 47% to 83% with an expanded dataset, indicating that other models will also achieve better results. From a qualitative perspective, contrary to the prevailing notion that deep learning models demand substantial resources, our experience revealed that training a CNN model did not pose significantly greater challenges than traditional models. This reinforces the untapped potential of deep learning in time-series forecasting, highlighting that complex problems like electricity consumption forecasts may benefit from advanced solutions like CNN.

Suggested Citation

  • Maleki, Neda & Lundström, Oxana & Musaddiq, Arslan & Jeansson, John & Olsson, Tobias & Ahlgren, Fredrik, 2024. "Future energy insights: Time-series and deep learning models for city load forecasting," Applied Energy, Elsevier, vol. 374(C).
  • Handle: RePEc:eee:appene:v:374:y:2024:i:c:s0306261924014508
    DOI: 10.1016/j.apenergy.2024.124067
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924014508
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2024.124067?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Muhammad Shahzad Nazir & Fahad Alturise & Sami Alshmrany & Hafiz. M. J Nazir & Muhammad Bilal & Ahmad N. Abdalla & P. Sanjeevikumar & Ziad M. Ali, 2020. "Wind Generation Forecasting Methods and Proliferation of Artificial Neural Network: A Review of Five Years Research Trend," Sustainability, MDPI, vol. 12(9), pages 1-27, May.
    2. Li, Ao & Xiao, Fu & Zhang, Chong & Fan, Cheng, 2021. "Attention-based interpretable neural network for building cooling load prediction," Applied Energy, Elsevier, vol. 299(C).
    3. Moradkhani, Mohammad Amin & Hosseini, Seyyed Hossein & Song, Mengjie & Teimoori, Khalil, 2024. "Comprehensive data-driven methods for estimating the thermal conductivity of biodiesels and their blends with alcohols and fossil diesels," Renewable Energy, Elsevier, vol. 221(C).
    4. Dong-Jin Bae & Bo-Sung Kwon & Kyung-Bin Song, 2021. "XGBoost-Based Day-Ahead Load Forecasting Algorithm Considering Behind-the-Meter Solar PV Generation," Energies, MDPI, vol. 15(1), pages 1-16, December.
    5. Zhang, Qiang & Tian, Zhe & Ma, Zhijun & Li, Genyan & Lu, Yakai & Niu, Jide, 2020. "Development of the heating load prediction model for the residential building of district heating based on model calibration," Energy, Elsevier, vol. 205(C).
    6. Kim, Tae-Young & Cho, Sung-Bae, 2019. "Predicting residential energy consumption using CNN-LSTM neural networks," Energy, Elsevier, vol. 182(C), pages 72-81.
    7. Sean J. Taylor & Benjamin Letham, 2018. "Forecasting at Scale," The American Statistician, Taylor & Francis Journals, vol. 72(1), pages 37-45, January.
    8. Cai, Mengmeng & Pipattanasomporn, Manisa & Rahman, Saifur, 2019. "Day-ahead building-level load forecasts using deep learning vs. traditional time-series techniques," Applied Energy, Elsevier, vol. 236(C), pages 1078-1088.
    9. Zhang, Liang & Wen, Jin & Li, Yanfei & Chen, Jianli & Ye, Yunyang & Fu, Yangyang & Livingood, William, 2021. "A review of machine learning in building load prediction," Applied Energy, Elsevier, vol. 285(C).
    10. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tang, Lingfeng & Xie, Haipeng & Wang, Xiaoyang & Bie, Zhaohong, 2023. "Privacy-preserving knowledge sharing for few-shot building energy prediction: A federated learning approach," Applied Energy, Elsevier, vol. 337(C).
    2. Guo, Yanhua & Wang, Ningbo & Shao, Shuangquan & Huang, Congqi & Zhang, Zhentao & Li, Xiaoqiong & Wang, Youdong, 2024. "A review on hybrid physics and data-driven modeling methods applied in air source heat pump systems for energy efficiency improvement," Renewable and Sustainable Energy Reviews, Elsevier, vol. 204(C).
    3. Yong Zhou & Lingyu Wang & Junhao Qian, 2022. "Application of Combined Models Based on Empirical Mode Decomposition, Deep Learning, and Autoregressive Integrated Moving Average Model for Short-Term Heating Load Predictions," Sustainability, MDPI, vol. 14(12), pages 1-20, June.
    4. Hyunsoo Kim & Jiseok Jeong & Changwan Kim, 2022. "Daily Peak-Electricity-Demand Forecasting Based on Residual Long Short-Term Network," Mathematics, MDPI, vol. 10(23), pages 1-17, November.
    5. Zhang, Yunfei & Zhou, Zhihua & Liu, Junwei & Yuan, Jianjuan, 2022. "Data augmentation for improving heating load prediction of heating substation based on TimeGAN," Energy, Elsevier, vol. 260(C).
    6. Liang, Xinbin & Zhu, Xu & Chen, Kang & Chen, Siliang & Jin, Xinqiao & Du, Zhimin, 2023. "Endowing data-driven models with rejection ability: Out-of-distribution detection and confidence estimation for black-box models of building energy systems," Energy, Elsevier, vol. 263(PC).
    7. Byung-Ki Jeon & Eui-Jong Kim, 2021. "LSTM-Based Model Predictive Control for Optimal Temperature Set-Point Planning," Sustainability, MDPI, vol. 13(2), pages 1-14, January.
    8. Jonas Sievers & Thomas Blank, 2023. "A Systematic Literature Review on Data-Driven Residential and Industrial Energy Management Systems," Energies, MDPI, vol. 16(4), pages 1-21, February.
    9. Hadjout, D. & Torres, J.F. & Troncoso, A. & Sebaa, A. & Martínez-Álvarez, F., 2022. "Electricity consumption forecasting based on ensemble deep learning with application to the Algerian market," Energy, Elsevier, vol. 243(C).
    10. Chongchong Xu & Zhicheng Liao & Chaojie Li & Xiaojun Zhou & Renyou Xie, 2022. "Review on Interpretable Machine Learning in Smart Grid," Energies, MDPI, vol. 15(12), pages 1-31, June.
    11. Heydari, Azim & Majidi Nezhad, Meysam & Pirshayan, Elmira & Astiaso Garcia, Davide & Keynia, Farshid & De Santoli, Livio, 2020. "Short-term electricity price and load forecasting in isolated power grids based on composite neural network and gravitational search optimization algorithm," Applied Energy, Elsevier, vol. 277(C).
    12. Stefano Frizzo Stefenon & Laio Oriel Seman & Viviana Cocco Mariani & Leandro dos Santos Coelho, 2023. "Aggregating Prophet and Seasonal Trend Decomposition for Time Series Forecasting of Italian Electricity Spot Prices," Energies, MDPI, vol. 16(3), pages 1-18, January.
    13. Liu, Che & Li, Fan & Zhang, Chenghui & Sun, Bo & Zhang, Guanguan, 2023. "A day-ahead prediction method for high-resolution electricity consumption in residential units," Energy, Elsevier, vol. 265(C).
    14. Li, Guannan & Li, Fan & Ahmad, Tanveer & Liu, Jiangyan & Li, Tao & Fang, Xi & Wu, Yubei, 2022. "Performance evaluation of sequence-to-sequence-Attention model for short-term multi-step ahead building energy predictions," Energy, Elsevier, vol. 259(C).
    15. Jason Runge & Radu Zmeureanu, 2021. "A Review of Deep Learning Techniques for Forecasting Energy Use in Buildings," Energies, MDPI, vol. 14(3), pages 1-26, January.
    16. Elsisi, Mahmoud & Amer, Mohammed & Dababat, Alya’ & Su, Chun-Lien, 2023. "A comprehensive review of machine learning and IoT solutions for demand side energy management, conservation, and resilient operation," Energy, Elsevier, vol. 281(C).
    17. Sekhar, Charan & Dahiya, Ratna, 2023. "Robust framework based on hybrid deep learning approach for short term load forecasting of building electricity demand," Energy, Elsevier, vol. 268(C).
    18. Zang, Haixiang & Xu, Ruiqi & Cheng, Lilin & Ding, Tao & Liu, Ling & Wei, Zhinong & Sun, Guoqiang, 2021. "Residential load forecasting based on LSTM fusing self-attention mechanism with pooling," Energy, Elsevier, vol. 229(C).
    19. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    20. Zhang, Xu & Sun, Yongjun & Gao, Dian-ce & Zou, Wenke & Fu, Jianping & Ma, Xiaowen, 2022. "Similarity-based grouping method for evaluation and optimization of dataset structure in machine-learning based short-term building cooling load prediction without measurable occupancy information," Applied Energy, Elsevier, vol. 327(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:374:y:2024:i:c:s0306261924014508. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.