IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v278y2023ipbs0360544223014160.html
   My bibliography  Save this article

A clustering-based feature enhancement method for short-term natural gas consumption forecasting

Author

Listed:
  • Liu, Jinyuan
  • Wang, Shouxi
  • Wei, Nan
  • Qiao, Weibiao
  • Li, Ze
  • Zeng, Fanhua

Abstract

Natural gas consumption forecasting is crucial for planning and operating of sustainable energy systems. The accuracy of consumption forecasting is significantly affected by the quality of the collected features. Previous feature clustering methods, such as K-means and Gaussian mixed model (GMM), ignore the interference of factors with weak correlation on the clustering effect and thus fail to extract key information from the collected features. This paper proposes a novel feature enhancement method, namely, Gaussian correlation mixed clustering (GCMC), to extract fluctuation patterns from the highest correlation factors and divides the original sequence into multiple clusters to enhance the feature quality while reducing the complex fluctuation. Among them, correlation coefficient analysis, GMM, Bayesian information criterion and an improved information evaluation method are combined to cluster the selected highest correlation feature based on fluctuation patterns and evaluate the enhancement effect of feature quality. Then, each of the divided clusters is regarded as an independent dataset of the long short-term memory (LSTM) model for parallel forecasting and the results are restored to the structure of original sequence. In our experiments, we design four real-life datasets with different complexities. The results reveal that the proposed method outperforms GMM in terms of information entropy and accuracy. The information entropy for evaluating feature quality is improved by 6.13–9.66%. In comparison with other classic forecasting models, the mean absolute range normalized error (MARNE) of GCMC-LSTM for Karditsa, Thessaloniki, Oinofyta and Salfa Anthoussa are 6.06%, 4.62%, 14.18% and 15.30%, respectively, which presents the best performance and robustness. Especially for datasets with high complexity, by introducing GCMC, the MARNE is improved by 32.72% in Oinofyta.

Suggested Citation

  • Liu, Jinyuan & Wang, Shouxi & Wei, Nan & Qiao, Weibiao & Li, Ze & Zeng, Fanhua, 2023. "A clustering-based feature enhancement method for short-term natural gas consumption forecasting," Energy, Elsevier, vol. 278(PB).
    • Handle: RePEc:eee:energy:v:278:y:2023:i:pb:s0360544223014160
    DOI: 10.1016/j.energy.2023.128022
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544223014160
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2023.128022?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yun Bai & Zhenzhong Sun & Bo Zeng & Jianyu Long & Lin Li & José Valente Oliveira & Chuan Li, 2019. "A comparison of dimension reduction techniques for support vector machine modeling of multi-parameter manufacturing quality prediction," Journal of Intelligent Manufacturing, Springer, vol. 30(5), pages 2245-2256, June.
    2. Kaytez, Fazil, 2020. "A hybrid approach based on autoregressive integrated moving average and least-square support vector machine for long-term forecasting of net electricity consumption," Energy, Elsevier, vol. 197(C).
    3. Salah Bouktif & Ali Fiaz & Ali Ouni & Mohamed Adel Serhani, 2018. "Optimal Deep Learning LSTM Model for Electric Load Forecasting using Feature Selection and Genetic Algorithm: Comparison with Machine Learning Approaches †," Energies, MDPI, vol. 11(7), pages 1-20, June.
    4. Fan, Cheng & Sun, Yongjun & Zhao, Yang & Song, Mengjie & Wang, Jiayuan, 2019. "Deep learning-based feature engineering methods for improved building energy prediction," Applied Energy, Elsevier, vol. 240(C), pages 35-45.
    5. Wei, Nan & Yin, Lihua & Li, Chao & Wang, Wei & Qiao, Weibiao & Li, Changjun & Zeng, Fanhua & Fu, Lingdi, 2022. "Short-term load forecasting using detrend singular spectrum fluctuation analysis," Energy, Elsevier, vol. 256(C).
    6. Wei, Nan & Yin, Lihua & Li, Chao & Liu, Jinyuan & Li, Changjun & Huang, Yuanyuan & Zeng, Fanhua, 2022. "Data complexity of daily natural gas consumption: Measurement and impact on forecasting performance," Energy, Elsevier, vol. 238(PC).
    7. Guo, Zixi & Zhao, Jinzhou & You, Zhenjiang & Li, Yongming & Zhang, Shu & Chen, Yiyu, 2021. "Prediction of coalbed methane production based on deep learning," Energy, Elsevier, vol. 230(C).
    8. Liang, Yi & Niu, Dongxiao & Hong, Wei-Chiang, 2019. "Short term load forecasting based on feature extraction and improved general regression neural network model," Energy, Elsevier, vol. 166(C), pages 653-663.
    9. Jun Peng & Zhiyong Zheng & Xiaoyong Zhang & Kunyuan Deng & Kai Gao & Heng Li & Bin Chen & Yingze Yang & Zhiwu Huang, 2020. "A Data-Driven Method with Feature Enhancement and Adaptive Optimization for Lithium-Ion Battery Remaining Useful Life Prediction," Energies, MDPI, vol. 13(3), pages 1-20, February.
    10. Wei, Nan & Yin, Lihua & Li, Chao & Li, Changjun & Chan, Christine & Zeng, Fanhua, 2021. "Forecasting the daily natural gas consumption with an accurate white-box model," Energy, Elsevier, vol. 232(C).
    11. Wei, Nan & Li, Changjun & Peng, Xiaolong & Li, Yang & Zeng, Fanhua, 2019. "Daily natural gas consumption forecasting via the application of a novel hybrid model," Applied Energy, Elsevier, vol. 250(C), pages 358-368.
    12. Svoboda, Radek & Kotik, Vojtech & Platos, Jan, 2021. "Short-term natural gas consumption forecasting from long-term data collection," Energy, Elsevier, vol. 218(C).
    13. Jinyuan Liu & Shouxi Wang & Nan Wei & Yi Yang & Yihao Lv & Xu Wang & Fanhua Zeng, 2023. "An Enhancement Method Based on Long Short-Term Memory Neural Network for Short-Term Natural Gas Consumption Forecasting," Energies, MDPI, vol. 16(3), pages 1-14, January.
    14. Nan Wei & Changjun Li & Jiehao Duan & Jinyuan Liu & Fanhua Zeng, 2019. "Daily Natural Gas Load Forecasting Based on a Hybrid Deep Learning Model," Energies, MDPI, vol. 12(2), pages 1-15, January.
    15. Chen, Hao, 2022. "Cluster-based ensemble learning for wind power modeling from meteorological wind data," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).
    16. Laib, Oussama & Khadir, Mohamed Tarek & Mihaylova, Lyudmila, 2019. "Toward efficient energy systems based on natural gas consumption prediction with LSTM Recurrent Neural Networks," Energy, Elsevier, vol. 177(C), pages 530-542.
    17. Luo, X.J. & Oyedele, Lukumon O. & Ajayi, Anuoluwapo O. & Akinade, Olugbenga O. & Owolabi, Hakeem A. & Ahmed, Ashraf, 2020. "Feature extraction and genetic algorithm enhanced adaptive deep neural network for energy consumption prediction in buildings," Renewable and Sustainable Energy Reviews, Elsevier, vol. 131(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tang, Zhenhao & Sui, Mengxuan & Wang, Xu & Xue, Wenyuan & Yang, Yuan & Wang, Zhi & Ouyang, Tinghui, 2024. "Theory-guided deep neural network for boiler 3-D NOx concentration distribution prediction," Energy, Elsevier, vol. 299(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jason Runge & Radu Zmeureanu, 2021. "A Review of Deep Learning Techniques for Forecasting Energy Use in Buildings," Energies, MDPI, vol. 14(3), pages 1-26, January.
    2. Jinyuan Liu & Shouxi Wang & Nan Wei & Yi Yang & Yihao Lv & Xu Wang & Fanhua Zeng, 2023. "An Enhancement Method Based on Long Short-Term Memory Neural Network for Short-Term Natural Gas Consumption Forecasting," Energies, MDPI, vol. 16(3), pages 1-14, January.
    3. Wei, Nan & Yin, Lihua & Li, Chao & Wang, Wei & Qiao, Weibiao & Li, Changjun & Zeng, Fanhua & Fu, Lingdi, 2022. "Short-term load forecasting using detrend singular spectrum fluctuation analysis," Energy, Elsevier, vol. 256(C).
    4. Andreea Valeria Vesa & Tudor Cioara & Ionut Anghel & Marcel Antal & Claudia Pop & Bogdan Iancu & Ioan Salomie & Vasile Teodor Dadarlat, 2020. "Energy Flexibility Prediction for Data Center Engagement in Demand Response Programs," Sustainability, MDPI, vol. 12(4), pages 1-23, February.
    5. Zang, Haixiang & Xu, Ruiqi & Cheng, Lilin & Ding, Tao & Liu, Ling & Wei, Zhinong & Sun, Guoqiang, 2021. "Residential load forecasting based on LSTM fusing self-attention mechanism with pooling," Energy, Elsevier, vol. 229(C).
    6. Fang, Yu & Jia, Chunhong & Wang, Xin & Min, Fan, 2024. "A fusion gas load prediction model with three-way residual error amendment," Energy, Elsevier, vol. 294(C).
    7. Saima Akhtar & Sulman Shahzad & Asad Zaheer & Hafiz Sami Ullah & Heybet Kilic & Radomir Gono & Michał Jasiński & Zbigniew Leonowicz, 2023. "Short-Term Load Forecasting Models: A Review of Challenges, Progress, and the Road Ahead," Energies, MDPI, vol. 16(10), pages 1-29, May.
    8. Du, Jian & Zheng, Jianqin & Liang, Yongtu & Lu, Xinyi & Klemeš, Jiří Jaromír & Varbanov, Petar Sabev & Shahzad, Khurram & Rashid, Muhammad Imtiaz & Ali, Arshid Mahmood & Liao, Qi & Wang, Bohong, 2022. "A hybrid deep learning framework for predicting daily natural gas consumption," Energy, Elsevier, vol. 257(C).
    9. Rundong Gong & Xiukun Wang & Lei Li & Kaikai Li & Ran An & Chenggang Xian, 2022. "Lattice Boltzmann Modeling of Spontaneous Imbibition in Variable-Diameter Capillaries," Energies, MDPI, vol. 15(12), pages 1-19, June.
    10. Wei, Nan & Yin, Chuang & Yin, Lihua & Tan, Jingyi & Liu, Jinyuan & Wang, Shouxi & Qiao, Weibiao & Zeng, Fanhua, 2024. "Short-term load forecasting based on WM algorithm and transfer learning model," Applied Energy, Elsevier, vol. 353(PA).
    11. Qiao, Weibiao & Liu, Wei & Liu, Enbin, 2021. "A combination model based on wavelet transform for predicting the difference between monthly natural gas production and consumption of U.S," Energy, Elsevier, vol. 235(C).
    12. Somu, Nivethitha & M R, Gauthama Raman & Ramamritham, Krithi, 2020. "A hybrid model for building energy consumption forecasting using long short term memory networks," Applied Energy, Elsevier, vol. 261(C).
    13. Shahzad Aslam & Nasir Ayub & Umer Farooq & Muhammad Junaid Alvi & Fahad R. Albogamy & Gul Rukh & Syed Irtaza Haider & Ahmad Taher Azar & Rasool Bukhsh, 2021. "Towards Electric Price and Load Forecasting Using CNN-Based Ensembler in Smart Grid," Sustainability, MDPI, vol. 13(22), pages 1-28, November.
    14. Ding, Jia & Zhao, Yuxuan & Jin, Junyang, 2023. "Forecasting natural gas consumption with multiple seasonal patterns," Applied Energy, Elsevier, vol. 337(C).
    15. João Vitor Leme & Wallace Casaca & Marilaine Colnago & Maurício Araújo Dias, 2020. "Towards Assessing the Electricity Demand in Brazil: Data-Driven Analysis and Ensemble Learning Models," Energies, MDPI, vol. 13(6), pages 1-20, March.
    16. Chuang Yin & Nan Wei & Jinghang Wu & Chuhong Ruan & Xi Luo & Fanhua Zeng, 2024. "An Empirical Mode Decomposition-Based Hybrid Model for Sub-Hourly Load Forecasting," Energies, MDPI, vol. 17(2), pages 1-17, January.
    17. Salam, Abdulwahed & El Hibaoui, Abdelaaziz, 2021. "Energy consumption prediction model with deep inception residual network inspiration and LSTM," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 190(C), pages 97-109.
    18. Yang, Zhaoming & Liu, Zhe & Zhou, Jing & Song, Chaofan & Xiang, Qi & He, Qian & Hu, Jingjing & Faber, Michael H. & Zio, Enrico & Li, Zhenlin & Su, Huai & Zhang, Jinjun, 2023. "A graph neural network (GNN) method for assigning gas calorific values to natural gas pipeline networks," Energy, Elsevier, vol. 278(C).
    19. Wei, Nan & Yin, Lihua & Li, Chao & Li, Changjun & Chan, Christine & Zeng, Fanhua, 2021. "Forecasting the daily natural gas consumption with an accurate white-box model," Energy, Elsevier, vol. 232(C).
    20. Zeng, Huibin & Shao, Bilin & Dai, Hongbin & Yan, Yichuan & Tian, Ning, 2023. "Prediction of fluctuation loads based on GARCH family-CatBoost-CNNLSTM," Energy, Elsevier, vol. 263(PE).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:278:y:2023:i:pb:s0360544223014160. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.