IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v298y2024ics0360544224011381.html
   My bibliography  Save this article

A compound framework for short-term gas load forecasting combining time-enhanced perception transformer and two-stage feature extraction

Author

Listed:
  • Lin, Zijie
  • Xie, Linbo
  • Zhang, Siyuan

Abstract

The development of accurate and reliable gas load forecasting models is critical to residential safety and gas company economics. However, since the seq2seq neural network conveys information by sequentially updating the hidden states, when processing gas load data, the information needs to be passed several times before it can affect the prediction results at subsequent time steps. This can lead to a lack of ability of the model to capture long-term dependencies. To address the above issues, we propose a novel compound framework. Time-enhanced perception transformer (TEPT) in the framework achieves parallel computation of historical data and stronger location awareness through convolutional self-attention and improved attention scores. This results in better capture of local patterns and long-term dependencies in gas loads. In addition, the framework proposes two-stage feature extraction (TSFE) for decomposing the important parts of the original information and extracting more refined features based on them. We constructed a real gas load data set from Wuxi, China to verify the effectiveness. The results show that MAE, MAPE, and RMSE of the proposed method are 3.45, 1.07%, and 4.68, which provide higher accuracy compared to other prediction methods.

Suggested Citation

  • Lin, Zijie & Xie, Linbo & Zhang, Siyuan, 2024. "A compound framework for short-term gas load forecasting combining time-enhanced perception transformer and two-stage feature extraction," Energy, Elsevier, vol. 298(C).
    • Handle: RePEc:eee:energy:v:298:y:2024:i:c:s0360544224011381
    DOI: 10.1016/j.energy.2024.131365
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224011381
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2024.131365?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yu, Feng & Xu, Xiaozhong, 2014. "A short-term load forecasting model of natural gas based on optimized genetic algorithm and improved BP neural network," Applied Energy, Elsevier, vol. 134(C), pages 102-113.
    2. Wen, Kai & Lu, Yangfan & Lu, Meitong & Zhang, Wenwei & Zhu, Ming & Qiao, Dan & Meng, Fanpeng & Zhang, Jing & Gong, Jing & Hong, Bingyuan, 2022. "Multi-period optimal infrastructure planning of natural gas pipeline network system integrating flowrate allocation," Energy, Elsevier, vol. 257(C).
    3. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    4. Hong, Bingyuan & Qiao, Dan & Li, Yichen & Sun, Xiaoqing & Yang, Baolong & Li, Li & Gong, Jing & Wen, Kai, 2023. "Supply-demand balance of natural gas pipeline network integrating hydraulic and thermal characteristics, energy conservation and carbon reduction," Energy, Elsevier, vol. 283(C).
    5. Li, Fengyun & Zheng, Haofeng & Li, Xingmei & Yang, Fei, 2021. "Day-ahead city natural gas load forecasting based on decomposition-fusion technique and diversified ensemble learning model," Applied Energy, Elsevier, vol. 303(C).
    6. Kartal, Mustafa Tevfik & Pata, Ugur Korkut & Kılıç Depren, Serpil & Depren, Özer, 2023. "Effects of possible changes in natural gas, nuclear, and coal energy consumption on CO2 emissions: Evidence from France under Russia’s gas supply cuts by dynamic ARDL simulations approach," Applied Energy, Elsevier, vol. 339(C).
    7. Izadyar, Nima & Ghadamian, Hossein & Ong, Hwai Chyuan & moghadam, Zeinab & Tong, Chong Wen & Shamshirband, Shahaboddin, 2015. "Appraisal of the support vector machine to forecast residential heating demand for the District Heating System based on the monthly overall natural gas consumption," Energy, Elsevier, vol. 93(P2), pages 1558-1567.
    8. Zeng, Huibin & Shao, Bilin & Dai, Hongbin & Yan, Yichuan & Tian, Ning, 2023. "Prediction of fluctuation loads based on GARCH family-CatBoost-CNNLSTM," Energy, Elsevier, vol. 263(PE).
    9. Tong, Jianfeng & Liu, Zhenxing & Zhang, Yong & Zheng, Xiujuan & Jin, Junyang, 2023. "Improved multi-gate mixture-of-experts framework for multi-step prediction of gas load," Energy, Elsevier, vol. 282(C).
    10. Fu, Wenlong & Fu, Yuchen & Li, Bailing & Zhang, Hairong & Zhang, Xuanrui & Liu, Jiarui, 2023. "A compound framework incorporating improved outlier detection and correction, VMD, weight-based stacked generalization with enhanced DESMA for multi-step short-term wind speed forecasting," Applied Energy, Elsevier, vol. 348(C).
    11. Zeng, Huibin & Shao, Bilin & Dai, Hongbin & Yan, Yichuan & Tian, Ning, 2023. "Natural gas demand response strategy considering user satisfaction and load volatility under dynamic pricing," Energy, Elsevier, vol. 277(C).
    12. Zhu, L. & Li, M.S. & Wu, Q.H. & Jiang, L., 2015. "Short-term natural gas demand prediction based on support vector regression with false neighbours filtered," Energy, Elsevier, vol. 80(C), pages 428-436.
    13. Federico Scarpa & Vincenzo Bianco, 2017. "Assessing the Quality of Natural Gas Consumption Forecasting: An Application to the Italian Residential Sector," Energies, MDPI, vol. 10(11), pages 1-13, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tong, Jianfeng & Liu, Zhenxing & Zhang, Yong & Zheng, Xiujuan & Jin, Junyang, 2023. "Improved multi-gate mixture-of-experts framework for multi-step prediction of gas load," Energy, Elsevier, vol. 282(C).
    2. Deng, Yanqiao & Ma, Xin & Zhang, Peng & Cai, Yubin, 2022. "Multi-step ahead forecasting of daily urban gas load in Chengdu using a Tanimoto kernel-based NAR model and Whale optimization," Energy, Elsevier, vol. 260(C).
    3. Beyca, Omer Faruk & Ervural, Beyzanur Cayir & Tatoglu, Ekrem & Ozuyar, Pinar Gokcin & Zaim, Selim, 2019. "Using machine learning tools for forecasting natural gas consumption in the province of Istanbul," Energy Economics, Elsevier, vol. 80(C), pages 937-949.
    4. Mustafa Akpinar & Nejat Yumusak, 2016. "Year Ahead Demand Forecast of City Natural Gas Using Seasonal Time Series Methods," Energies, MDPI, vol. 9(9), pages 1-17, September.
    5. Lu, Hongfang & Ma, Xin & Azimi, Mohammadamin, 2020. "US natural gas consumption prediction using an improved kernel-based nonlinear extension of the Arps decline model," Energy, Elsevier, vol. 194(C).
    6. Konstantinos Papageorgiou & Elpiniki I. Papageorgiou & Katarzyna Poczeta & Dionysis Bochtis & George Stamoulis, 2020. "Forecasting of Day-Ahead Natural Gas Consumption Demand in Greece Using Adaptive Neuro-Fuzzy Inference System," Energies, MDPI, vol. 13(9), pages 1-32, May.
    7. Wei, Nan & Li, Changjun & Peng, Xiaolong & Li, Yang & Zeng, Fanhua, 2019. "Daily natural gas consumption forecasting via the application of a novel hybrid model," Applied Energy, Elsevier, vol. 250(C), pages 358-368.
    8. Yifei Chen & Zhihan Fu, 2023. "Multi-Step Ahead Forecasting of the Energy Consumed by the Residential and Commercial Sectors in the United States Based on a Hybrid CNN-BiLSTM Model," Sustainability, MDPI, vol. 15(3), pages 1-21, January.
    9. Ravnik, J. & Hriberšek, M., 2019. "A method for natural gas forecasting and preliminary allocation based on unique standard natural gas consumption profiles," Energy, Elsevier, vol. 180(C), pages 149-162.
    10. Wei-Chiang Hong & Guo-Feng Fan, 2019. "Hybrid Empirical Mode Decomposition with Support Vector Regression Model for Short Term Load Forecasting," Energies, MDPI, vol. 12(6), pages 1-16, March.
    11. Su, Huai & Zio, Enrico & Zhang, Jinjun & Xu, Mingjing & Li, Xueyi & Zhang, Zongjie, 2019. "A hybrid hourly natural gas demand forecasting method based on the integration of wavelet transform and enhanced Deep-RNN model," Energy, Elsevier, vol. 178(C), pages 585-597.
    12. Chen, Ying & Koch, Thorsten & Zakiyeva, Nazgul & Zhu, Bangzhu, 2020. "Modeling and forecasting the dynamics of the natural gas transmission network in Germany with the demand and supply balance constraint," Applied Energy, Elsevier, vol. 278(C).
    13. Du, Jian & Zheng, Jianqin & Liang, Yongtu & Lu, Xinyi & Klemeš, Jiří Jaromír & Varbanov, Petar Sabev & Shahzad, Khurram & Rashid, Muhammad Imtiaz & Ali, Arshid Mahmood & Liao, Qi & Wang, Bohong, 2022. "A hybrid deep learning framework for predicting daily natural gas consumption," Energy, Elsevier, vol. 257(C).
    14. Tomasz Cieślik & Piotr Narloch & Adam Szurlej & Krzysztof Kogut, 2022. "Indirect Impact of the COVID-19 Pandemic on Natural Gas Consumption by Commercial Consumers in a Selected City in Poland," Energies, MDPI, vol. 15(4), pages 1-18, February.
    15. Reza Hafezi & Amir Naser Akhavan & Mazdak Zamani & Saeed Pakseresht & Shahaboddin Shamshirband, 2019. "Developing a Data Mining Based Model to Extract Predictor Factors in Energy Systems: Application of Global Natural Gas Demand," Energies, MDPI, vol. 12(21), pages 1-22, October.
    16. Yuanyuan Zhou & Min Zhou & Qing Xia & Wei-Chiang Hong, 2019. "Construction of EMD-SVR-QGA Model for Electricity Consumption: Case of University Dormitory," Mathematics, MDPI, vol. 7(12), pages 1-23, December.
    17. Song, Jiancai & Zhang, Liyi & Jiang, Qingling & Ma, Yunpeng & Zhang, Xinxin & Xue, Guixiang & Shen, Xingliang & Wu, Xiangdong, 2022. "Estimate the daily consumption of natural gas in district heating system based on a hybrid seasonal decomposition and temporal convolutional network model," Applied Energy, Elsevier, vol. 309(C).
    18. Wei, Nan & Yin, Lihua & Li, Chao & Liu, Jinyuan & Li, Changjun & Huang, Yuanyuan & Zeng, Fanhua, 2022. "Data complexity of daily natural gas consumption: Measurement and impact on forecasting performance," Energy, Elsevier, vol. 238(PC).
    19. Nan Wei & Changjun Li & Jiehao Duan & Jinyuan Liu & Fanhua Zeng, 2019. "Daily Natural Gas Load Forecasting Based on a Hybrid Deep Learning Model," Energies, MDPI, vol. 12(2), pages 1-15, January.
    20. Jean Gaston Tamba & Salom Ndjakomo Essiane & Emmanuel Flavian Sapnken & Francis Djanna Koffi & Jean Luc Nsouand l & Bozidar Soldo & Donatien Njomo, 2018. "Forecasting Natural Gas: A Literature Survey," International Journal of Energy Economics and Policy, Econjournals, vol. 8(3), pages 216-249.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:298:y:2024:i:c:s0360544224011381. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.