IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v366y2024ics0306261924006974.html
   My bibliography  Save this article

Innovative framework for accurate and transparent forecasting of energy consumption: A fusion of feature selection and interpretable machine learning

Author

Listed:
  • Eskandari, Hamidreza
  • Saadatmand, Hassan
  • Ramzan, Muhammad
  • Mousapour, Mobina

Abstract

The study presents a novel framework integrating feature selection (FS) and machine learning (ML) techniques to forecast inland national energy consumption (EC) in the United Kingdom across all energy sources. This innovative framework strategically combines three FS approaches with five interpretable ML models using Shapley Additive Explanations (SHAP), with the dual goal of enhancing accuracy and transparency in EC predictions. By meticulously selecting the most pertinent features from diverse features—including meteorological conditions, socioeconomic parameters, and historical consumption patterns of different primary fuels—the proposed framework enhances the robustness of the forecasting model. This is achieved through benchmarking three FS approaches: ensemble filter, wrapper, and a hybrid ensemble filter-wrapper. In addition, we introduce a novel ensemble filter FS, synthesizing outcomes from multiple base FS methods to make well-informed decisions about feature retention. Experimental results underscore the efficacy of integrating both wrapper and ensemble filter-wrapper FS approaches with interpretable ML models, ensuring the forecasting process remains comprehensible and interpretable while utilizing a manageable number of features (four to eight). In addition, experimental results indicate that different feature subsets are usually selected for each combined FS approach and ML model. This study not only demonstrates the framework's capability to provide accurate forecasts but also establishes it as a valuable tool for policymakers and energy analysts.

Suggested Citation

  • Eskandari, Hamidreza & Saadatmand, Hassan & Ramzan, Muhammad & Mousapour, Mobina, 2024. "Innovative framework for accurate and transparent forecasting of energy consumption: A fusion of feature selection and interpretable machine learning," Applied Energy, Elsevier, vol. 366(C).
  • Handle: RePEc:eee:appene:v:366:y:2024:i:c:s0306261924006974
    DOI: 10.1016/j.apenergy.2024.123314
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924006974
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2024.123314?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pao, Hsiao-Tien & Fu, Hsin-Chia & Tseng, Cheng-Lung, 2012. "Forecasting of CO2 emissions, energy consumption and economic growth in China using an improved grey model," Energy, Elsevier, vol. 40(1), pages 400-409.
    2. Zhou, Quan & Li, Yanfei & Zhao, Dezong & Li, Ji & Williams, Huw & Xu, Hongming & Yan, Fuwu, 2022. "Transferable representation modelling for real-time energy management of the plug-in hybrid vehicle based on k-fold fuzzy learning and Gaussian process regression," Applied Energy, Elsevier, vol. 305(C).
    3. Sharifzadeh, Mahdi & Sikinioti-Lock, Alexandra & Shah, Nilay, 2019. "Machine-learning methods for integrated renewable power generation: A comparative study of artificial neural networks, support vector regression, and Gaussian Process Regression," Renewable and Sustainable Energy Reviews, Elsevier, vol. 108(C), pages 513-538.
    4. Lv, Sheng-Xiang & Wang, Lin, 2023. "Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model," Energy, Elsevier, vol. 263(PE).
    5. Mustafa Saglam & Catalina Spataru & Omer Ali Karaman, 2023. "Forecasting Electricity Demand in Turkey Using Optimization and Machine Learning Algorithms," Energies, MDPI, vol. 16(11), pages 1-23, June.
    6. Centofanti, Fabio & Fontana, Matteo & Lepore, Antonio & Vantini, Simone, 2022. "Smooth LASSO estimator for the Function-on-Function linear regression model," Computational Statistics & Data Analysis, Elsevier, vol. 176(C).
    7. Rao, Congjun & Zhang, Yue & Wen, Jianghui & Xiao, Xinping & Goh, Mark, 2023. "Energy demand forecasting in China: A support vector regression-compositional data second exponential smoothing model," Energy, Elsevier, vol. 263(PC).
    8. Atems, Bebonchu & Mette, Jehu & Lin, Guoyu & Madraki, Golshan, 2023. "Estimating and forecasting the impact of nonrenewable energy prices on US renewable energy consumption," Energy Policy, Elsevier, vol. 173(C).
    9. Wen, Yifan & Wu, Ruoxi & Zhou, Zihang & Zhang, Shaojun & Yang, Shengge & Wallington, Timothy J. & Shen, Wei & Tan, Qinwen & Deng, Ye & Wu, Ye, 2022. "A data-driven method of traffic emissions mapping with land use random forest models," Applied Energy, Elsevier, vol. 305(C).
    10. Kamani, D. & Ardehali, M.M., 2023. "Long-term forecast of electrical energy consumption with considerations for solar and wind energy sources," Energy, Elsevier, vol. 268(C).
    11. van Zyl, Corne & Ye, Xianming & Naidoo, Raj, 2024. "Harnessing eXplainable artificial intelligence for feature selection in time series energy forecasting: A comparative analysis of Grad-CAM and SHAP," Applied Energy, Elsevier, vol. 353(PA).
    12. Maaouane, Mohamed & Zouggar, Smail & Krajačić, Goran & Zahboune, Hassan, 2021. "Modelling industry energy demand using multiple linear regression analysis based on consumed quantity of goods," Energy, Elsevier, vol. 225(C).
    13. Aras, Serkan & Hanifi Van, M., 2022. "An interpretable forecasting framework for energy consumption and CO2 emissions," Applied Energy, Elsevier, vol. 328(C).
    14. Sahraei, Mohammad Ali & Çodur, Merve Kayaci, 2022. "Prediction of transportation energy demand by novel hybrid meta-heuristic ANN," Energy, Elsevier, vol. 249(C).
    15. Hoxha, Julian & Çodur, Muhammed Yasin & Mustafaraj, Enea & Kanj, Hassan & El Masri, Ali, 2023. "Prediction of transportation energy demand in Türkiye using stacking ensemble models: Methodology and comparative analysis," Applied Energy, Elsevier, vol. 350(C).
    16. Li, Zheng & Zhou, Bo & Hensher, David A., 2022. "Forecasting automobile gasoline demand in Australia using machine learning-based regression," Energy, Elsevier, vol. 239(PD).
    17. Emami Javanmard, M. & Tang, Y. & Wang, Z. & Tontiwachwuthikul, P., 2023. "Forecast energy demand, CO2 emissions and energy resource impacts for the transportation sector," Applied Energy, Elsevier, vol. 338(C).
    18. Qiao, Qingyao & Eskandari, Hamidreza & Saadatmand, Hassan & Sahraei, Mohammad Ali, 2024. "An interpretable multi-stage forecasting framework for energy consumption and CO2 emissions for the transportation sector," Energy, Elsevier, vol. 286(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qiao, Qingyao & Eskandari, Hamidreza & Saadatmand, Hassan & Sahraei, Mohammad Ali, 2024. "An interpretable multi-stage forecasting framework for energy consumption and CO2 emissions for the transportation sector," Energy, Elsevier, vol. 286(C).
    2. Ahmat Khazali Acyl & Flavian Emmanuel Sapnken & Aubin Kinfack Jeutsa & Jean Marie Stevy Sama & Marcel Rodrigue Ewodo-Amougou & Jean Gaston Tamba, 2024. "Forecasting Petroleum Products Consumption in the Chadian Road Transport Sector using Optimised Grey Models," International Journal of Energy Economics and Policy, Econjournals, vol. 14(1), pages 603-611, January.
    3. Emami Javanmard, M. & Tang, Y. & Wang, Z. & Tontiwachwuthikul, P., 2023. "Forecast energy demand, CO2 emissions and energy resource impacts for the transportation sector," Applied Energy, Elsevier, vol. 338(C).
    4. Mustafa Saglam & Catalina Spataru & Omer Ali Karaman, 2023. "Forecasting Electricity Demand in Turkey Using Optimization and Machine Learning Algorithms," Energies, MDPI, vol. 16(11), pages 1-23, June.
    5. Yifei Chen & Zhihan Fu, 2023. "Multi-Step Ahead Forecasting of the Energy Consumed by the Residential and Commercial Sectors in the United States Based on a Hybrid CNN-BiLSTM Model," Sustainability, MDPI, vol. 15(3), pages 1-21, January.
    6. Pin Li & Jinsuo Zhang, 2019. "Is China’s Energy Supply Sustainable? New Research Model Based on the Exponential Smoothing and GM(1,1) Methods," Energies, MDPI, vol. 12(2), pages 1-30, January.
    7. Wang, Weida & Chen, Yincong & Yang, Chao & Li, Ying & Xu, Bin & Xiang, Changle, 2022. "An enhanced hypotrochoid spiral optimization algorithm based intertwined optimal sizing and control strategy of a hybrid electric air-ground vehicle," Energy, Elsevier, vol. 257(C).
    8. Shahbeig, Hossein & Nosrati, Mohsen, 2020. "Pyrolysis of municipal sewage sludge for bioenergy production: Thermo-kinetic studies, evolved gas analysis, and techno-socio-economic assessment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 119(C).
    9. Liu, Jianmiao & Li, Junyi & Chen, Yong & Lian, Song & Zeng, Jiaqi & Geng, Maosi & Zheng, Sijing & Dong, Yinan & He, Yan & Huang, Pei & Zhao, Zhijian & Yan, Xiaoyu & Hu, Qinru & Wang, Lei & Yang, Di & , 2023. "Multi-scale urban passenger transportation CO2 emission calculation platform for smart mobility management," Applied Energy, Elsevier, vol. 331(C).
    10. Wuyue An & Lin Wang & Dongfeng Zhang, 2023. "Comprehensive commodity price forecasting framework using text mining methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1865-1888, November.
    11. Zhang, Xiaohong & Wu, Liqian & Zhang, Rong & Deng, Shihuai & Zhang, Yanzong & Wu, Jun & Li, Yuanwei & Lin, Lili & Li, Li & Wang, Yinjun & Wang, Lilin, 2013. "Evaluating the relationships among economic growth, energy consumption, air emissions and air environmental protection investment in China," Renewable and Sustainable Energy Reviews, Elsevier, vol. 18(C), pages 259-270.
    12. Yuan, Chaoqing & Liu, Sifeng & Fang, Zhigeng, 2016. "Comparison of China's primary energy consumption forecasting by using ARIMA (the autoregressive integrated moving average) model and GM(1,1) model," Energy, Elsevier, vol. 100(C), pages 384-390.
    13. Qin Fei & Rajah Rasiah & Leow Jia Shen, 2014. "The Clean Energy-Growth Nexus with CO2 Emissions and Technological Innovation in Norway and New Zealand," Energy & Environment, , vol. 25(8), pages 1323-1344, December.
    14. Lee, Chien-Chiang & Hussain, Jafar & Mu, Xian, 2024. "Renewable energy and carbon-neutral gaming: A holistic approach to sustainable electricity," Energy, Elsevier, vol. 297(C).
    15. Yang, Ting & Yang, Zhenning & Li, Fei & Wang, Hengyu, 2024. "A short-term wind power forecasting method based on multivariate signal decomposition and variable selection," Applied Energy, Elsevier, vol. 360(C).
    16. Pata, Ugur Korkut & Caglar, Abdullah Emre, 2021. "Investigating the EKC hypothesis with renewable energy consumption, human capital, globalization and trade openness for China: Evidence from augmented ARDL approach with a structural break," Energy, Elsevier, vol. 216(C).
    17. Kaiyuan Zheng & Ying Zhang, 2023. "Prediction and Urban Adaptivity Evaluation Model Based on Carbon Emissions: A Case Study of Six Coastal City Clusters in China," Sustainability, MDPI, vol. 15(4), pages 1-19, February.
    18. Stefenon, Stefano Frizzo & Seman, Laio Oriel & Aquino, Luiza Scapinello & Coelho, Leandro dos Santos, 2023. "Wavelet-Seq2Seq-LSTM with attention for time series forecasting of level of dams in hydroelectric power plants," Energy, Elsevier, vol. 274(C).
    19. Nebiyu Kedir & Phuong H. D. Nguyen & Citlaly Pérez & Pedro Ponce & Aminah Robinson Fayek, 2023. "Systematic Literature Review on Fuzzy Hybrid Methods in Photovoltaic Solar Energy: Opportunities, Challenges, and Guidance for Implementation," Energies, MDPI, vol. 16(9), pages 1-38, April.
    20. Qichang Xie & Yingkun Yan & Xu Wang, 2023. "Assessing the role of foreign direct investment in environmental sustainability: a spatial semiparametric panel approach," Economic Change and Restructuring, Springer, vol. 56(2), pages 1263-1295, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:366:y:2024:i:c:s0306261924006974. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.