IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v330y2023ipas0306261922015367.html
   My bibliography  Save this article

A real-time electrical load forecasting and unsupervised anomaly detection framework

Author

Listed:
  • Wang, Xinlin
  • Yao, Zhihao
  • Papaefthymiou, Marios

Abstract

We propose a unified machine learning (ML) framework for simultaneously performing electrical load forecasting and unsupervised anomaly detection in real time. For load forecasting, we introduce a training data generator (TDG) and a look-back optimizer (LBO) to enhance the performance of a baseline ML-driven prediction approach. The proposed TDG selects a subset of the entire historical dataset of power consumption to derive a relatively small training dataset that is used for forecasting using ML. It is designed to operate on raw meter data, without requiring any input data conditioning or additional information (e.g., weather, building occupancy), thus providing a data-efficient training approach. The proposed LBO optimizes prediction performance by tracking the accuracy of prior forecasts and automatically adjusting the framework to improve prediction outcomes. For the problem of anomaly detection, the proposed framework is unsupervised and determines abnormality by comparing fluctuations in the current load with power consumption changes in the training dataset. Therefore, in addition to not requiring any data-labeling, it circumvents the problem of imbalanced classes associated with ML-based anomaly detection methods. The proposed framework is evaluated using a real-world power consumption dataset from a large US-based university campus with considerable power usage complexity. Twelve different evaluation metrics are used to comprehensively assess the effectiveness of our approach. Our evaluation results show that compared with alternative methods, the proposed framework consistently achieves superior outcomes with regard to both load forecasting and anomaly detection, representing a promising approach to electrical load forecasting and anomaly detection in practice.

Suggested Citation

  • Wang, Xinlin & Yao, Zhihao & Papaefthymiou, Marios, 2023. "A real-time electrical load forecasting and unsupervised anomaly detection framework," Applied Energy, Elsevier, vol. 330(PA).
  • Handle: RePEc:eee:appene:v:330:y:2023:i:pa:s0306261922015367
    DOI: 10.1016/j.apenergy.2022.120279
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261922015367
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2022.120279?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhang, Wenjie & Quan, Hao & Srinivasan, Dipti, 2018. "Parallel and reliable probabilistic load forecasting via quantile regression forest and quantile determination," Energy, Elsevier, vol. 160(C), pages 810-819.
    2. Hu, Jianming & Luo, Qingxi & Tang, Jingwei & Heng, Jiani & Deng, Yuwen, 2022. "Conformalized temporal convolutional quantile regression networks for wind power interval forecasting," Energy, Elsevier, vol. 248(C).
    3. Li, Ao & Xiao, Fu & Zhang, Chong & Fan, Cheng, 2021. "Attention-based interpretable neural network for building cooling load prediction," Applied Energy, Elsevier, vol. 299(C).
    4. Wang, Xinlin & Flores, Robert & Brouwer, Jack & Papaefthymiou, Marios, 2022. "Real-time detection of electrical load anomalies through hyperdimensional computing," Energy, Elsevier, vol. 261(PA).
    5. Fan, Cheng & Xiao, Fu & Zhao, Yang, 2017. "A short-term building cooling load prediction method using deep learning algorithms," Applied Energy, Elsevier, vol. 195(C), pages 222-233.
    6. Xue-Bo Jin & Wei-Zhen Zheng & Jian-Lei Kong & Xiao-Yi Wang & Yu-Ting Bai & Ting-Li Su & Seng Lin, 2021. "Deep-Learning Forecasting Method for Electric Power Load via Attention-Based Encoder-Decoder with Bayesian Optimization," Energies, MDPI, vol. 14(6), pages 1-18, March.
    7. Davut Solyali, 2020. "A Comparative Analysis of Machine Learning Approaches for Short-/Long-Term Electricity Load Forecasting in Cyprus," Sustainability, MDPI, vol. 12(9), pages 1-34, April.
    8. Wang, Xinlin & Ahn, Sung-Hoon, 2020. "Real-time prediction and anomaly detection of electrical load in a residential community," Applied Energy, Elsevier, vol. 259(C).
    9. Wang, Fu-Kwun & Amogne, Zemenu Endalamaw & Chou, Jia-Hong & Tseng, Cheng, 2022. "Online remaining useful life prediction of lithium-ion batteries using bidirectional long short-term memory with attention mechanism," Energy, Elsevier, vol. 254(PB).
    10. Fan, Cheng & Xiao, Fu & Zhao, Yang & Wang, Jiayuan, 2018. "Analytical investigation of autoencoder-based methods for unsupervised anomaly detection in building energy data," Applied Energy, Elsevier, vol. 211(C), pages 1123-1135.
    11. Wang, Xinlin & Wang, Hao & Ahn, Sung-Hoon, 2021. "Demand-side management for off-grid solar-powered microgrids: A case study of rural electrification in Tanzania," Energy, Elsevier, vol. 224(C).
    12. Massaoudi, Mohamed & Refaat, Shady S. & Chihi, Ines & Trabelsi, Mohamed & Oueslati, Fakhreddine S. & Abu-Rub, Haitham, 2021. "A novel stacked generalization ensemble-based hybrid LGBM-XGB-MLP model for Short-Term Load Forecasting," Energy, Elsevier, vol. 214(C).
    13. Sabri Boughorbel & Fethi Jarray & Mohammed El-Anbari, 2017. "Optimal classifier for imbalanced data using Matthews Correlation Coefficient metric," PLOS ONE, Public Library of Science, vol. 12(6), pages 1-17, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sicheng Wan & Yibo Wang & Youshuang Zhang & Beibei Zhu & Huakun Huang & Jia Liu, 2024. "Fusion of Hierarchical Optimization Models for Accurate Power Load Prediction," Sustainability, MDPI, vol. 16(16), pages 1-23, August.
    2. Aydin Zaboli & Swetha Rani Kasimalla & Kuchan Park & Younggi Hong & Junho Hong, 2024. "A Comprehensive Review of Behind-the-Meter Distributed Energy Resources Load Forecasting: Models, Challenges, and Emerging Technologies," Energies, MDPI, vol. 17(11), pages 1-27, May.
    3. Li, Ke & Mu, Yuchen & Yang, Fan & Wang, Haiyang & Yan, Yi & Zhang, Chenghui, 2024. "Joint forecasting of source-load-price for integrated energy system based on multi-task learning and hybrid attention mechanism," Applied Energy, Elsevier, vol. 360(C).
    4. Stracqualursi, Erika & Rosato, Antonello & Di Lorenzo, Gianfranco & Panella, Massimo & Araneo, Rodolfo, 2023. "Systematic review of energy theft practices and autonomous detection through artificial intelligence methods," Renewable and Sustainable Energy Reviews, Elsevier, vol. 184(C).
    5. Saima Akhtar & Sulman Shahzad & Asad Zaheer & Hafiz Sami Ullah & Heybet Kilic & Radomir Gono & Michał Jasiński & Zbigniew Leonowicz, 2023. "Short-Term Load Forecasting Models: A Review of Challenges, Progress, and the Road Ahead," Energies, MDPI, vol. 16(10), pages 1-29, May.
    6. Tulin Guzel & Hakan Cinar & Mehmet Nabi Cenet & Kamil Doruk Oguz & Ahmet Yucekaya & Mustafa Hekimoglu, 2023. "A Framework to Forecast Electricity Consumption of Meters using Automated Ranking and Data Preprocessing," International Journal of Energy Economics and Policy, Econjournals, vol. 13(5), pages 179-193, September.
    7. Eren, Yavuz & Küçükdemiral, İbrahim, 2024. "A comprehensive review on deep learning approaches for short-term load forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Xinlin & Flores, Robert & Brouwer, Jack & Papaefthymiou, Marios, 2022. "Real-time detection of electrical load anomalies through hyperdimensional computing," Energy, Elsevier, vol. 261(PA).
    2. Hernandez-Matheus, Alejandro & Löschenbrand, Markus & Berg, Kjersti & Fuchs, Ida & Aragüés-Peñalba, Mònica & Bullich-Massagué, Eduard & Sumper, Andreas, 2022. "A systematic review of machine learning techniques related to local energy communities," Renewable and Sustainable Energy Reviews, Elsevier, vol. 170(C).
    3. Zhang, Dongxue & Wang, Shuai & Liang, Yuqiu & Du, Zhiyuan, 2023. "A novel combined model for probabilistic load forecasting based on deep learning and improved optimizer," Energy, Elsevier, vol. 264(C).
    4. Himeur, Yassine & Ghanem, Khalida & Alsalemi, Abdullah & Bensaali, Faycal & Amira, Abbes, 2021. "Artificial intelligence based anomaly detection of energy consumption in buildings: A review, current trends and new perspectives," Applied Energy, Elsevier, vol. 287(C).
    5. Kong, Jun & Jiang, Wen & Tian, Qing & Jiang, Min & Liu, Tianshan, 2023. "Anomaly detection based on joint spatio-temporal learning for building electricity consumption," Applied Energy, Elsevier, vol. 334(C).
    6. Huang, Tian-en & Guo, Qinglai & Sun, Hongbin & Tan, Chin-Woo & Hu, Tianyu, 2019. "A deep spatial-temporal data-driven approach considering microclimates for power system security assessment," Applied Energy, Elsevier, vol. 237(C), pages 36-48.
    7. Li, Guannan & Li, Fan & Ahmad, Tanveer & Liu, Jiangyan & Li, Tao & Fang, Xi & Wu, Yubei, 2022. "Performance evaluation of sequence-to-sequence-Attention model for short-term multi-step ahead building energy predictions," Energy, Elsevier, vol. 259(C).
    8. Fan, Cheng & Wang, Jiayuan & Gang, Wenjie & Li, Shenghan, 2019. "Assessment of deep recurrent neural network-based strategies for short-term building energy predictions," Applied Energy, Elsevier, vol. 236(C), pages 700-710.
    9. Yan, Xiuying & Ji, Xingxing & Meng, Qinglong & Sun, Hang & Lei, Yu, 2024. "A hybrid prediction model of improved bidirectional long short-term memory network for cooling load based on PCANet and attention mechanism," Energy, Elsevier, vol. 292(C).
    10. Jia, Lizhi & Liu, Junjie & Chong, Adrian & Dai, Xilei, 2022. "Deep learning and physics-based modeling for the optimization of ice-based thermal energy systems in cooling plants," Applied Energy, Elsevier, vol. 322(C).
    11. Fan, Cheng & Sun, Yongjun & Zhao, Yang & Song, Mengjie & Wang, Jiayuan, 2019. "Deep learning-based feature engineering methods for improved building energy prediction," Applied Energy, Elsevier, vol. 240(C), pages 35-45.
    12. Liu, Yiren & Zhao, Xiangyu & Qin, S. Joe, 2024. "Dynamically engineered multi-modal feature learning for predictions of office building cooling loads," Applied Energy, Elsevier, vol. 355(C).
    13. Liang, Xinbin & Zhu, Xu & Chen, Kang & Chen, Siliang & Jin, Xinqiao & Du, Zhimin, 2023. "Endowing data-driven models with rejection ability: Out-of-distribution detection and confidence estimation for black-box models of building energy systems," Energy, Elsevier, vol. 263(PC).
    14. Fan, Cheng & Chen, Ruikun & Mo, Jinhan & Liao, Longhui, 2024. "Personalized federated learning for cross-building energy knowledge sharing: Cost-effective strategies and model architectures," Applied Energy, Elsevier, vol. 362(C).
    15. Hany Habbak & Mohamed Mahmoud & Khaled Metwally & Mostafa M. Fouda & Mohamed I. Ibrahem, 2023. "Load Forecasting Techniques and Their Applications in Smart Grids," Energies, MDPI, vol. 16(3), pages 1-33, February.
    16. Wang, Zeyu & Liu, Jian & Zhang, Yuanxin & Yuan, Hongping & Zhang, Ruixue & Srinivasan, Ravi S., 2021. "Practical issues in implementing machine-learning models for building energy efficiency: Moving beyond obstacles," Renewable and Sustainable Energy Reviews, Elsevier, vol. 143(C).
    17. Chen, Zhiwen & Deng, Qiao & Ren, Hao & Zhao, Zhengrun & Peng, Tao & Yang, Chunhua & Gui, Weihua, 2022. "A new energy consumption prediction method for chillers based on GraphSAGE by combining empirical knowledge and operating data," Applied Energy, Elsevier, vol. 310(C).
    18. Xing, Zhuoqun & Pan, Yiqun & Yang, Yiting & Yuan, Xiaolei & Liang, Yumin & Huang, Zhizhong, 2024. "Transfer learning integrating similarity analysis for short-term and long-term building energy consumption prediction," Applied Energy, Elsevier, vol. 365(C).
    19. Yu, Min & Niu, Dongxiao & Zhao, Jinqiu & Li, Mingyu & Sun, Lijie & Yu, Xiaoyu, 2023. "Building cooling load forecasting of IES considering spatiotemporal coupling based on hybrid deep learning model," Applied Energy, Elsevier, vol. 349(C).
    20. Nadia Jahanafroozi & Saman Shokrpour & Fatemeh Nejati & Omrane Benjeddou & Mohammad Worya Khordehbinan & Afshin Marani & Moncef L. Nehdi, 2022. "New Heuristic Methods for Sustainable Energy Performance Analysis of HVAC Systems," Sustainability, MDPI, vol. 14(21), pages 1-14, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:330:y:2023:i:pa:s0306261922015367. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.