IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v278y2020ics0306261920311053.html
   My bibliography  Save this article

Modeling and forecasting the dynamics of the natural gas transmission network in Germany with the demand and supply balance constraint

Author

Listed:
  • Chen, Ying
  • Koch, Thorsten
  • Zakiyeva, Nazgul
  • Zhu, Bangzhu

Abstract

We develop a novel large-scale Network Autoregressive model with balance Constraint (NAC) to predict hour-ahead gas flows in the gas transmission network, where the total in- and out-flows of the network are balanced over time. By integrating recent advances in optimization and statistical modeling, the NAC model can provide an accurate hour-ahead forecast of the gas flow at all of the distribution points in the network. By detecting the influential nodes of the dynamic network, taking into account that demand and supply have to be balanced, the forecast can be used to compute an optimized schedule and resource allocation. We demonstrate an application of our model in forecasting hour-ahead gas in- and out-flows at 128 nodes in the German high-pressure natural gas transmission network over a time frame of 22 months. It dramatically improves the out-of-sample forecast accuracy with the average root mean squared error reduced from 1.116 to 0.725 (35% change) and the mean squared forecast error reduced from 36.389 to 11.914 (67% change). The NAC model successfully also improves the demand and supply balance, with the average deviation dropping from 7.590 to 2.391. Moreover, we identify three permanently influential nodes in the gas transmission network, and we also capture the dynamic changes in the network with 42 influential nodes on average and 17 influential nodes in summer months.

Suggested Citation

  • Chen, Ying & Koch, Thorsten & Zakiyeva, Nazgul & Zhu, Bangzhu, 2020. "Modeling and forecasting the dynamics of the natural gas transmission network in Germany with the demand and supply balance constraint," Applied Energy, Elsevier, vol. 278(C).
    • Handle: RePEc:eee:appene:v:278:y:2020:i:c:s0306261920311053
    DOI: 10.1016/j.apenergy.2020.115597
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261920311053
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2020.115597?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Szoplik, Jolanta, 2015. "Forecasting of natural gas consumption with artificial neural networks," Energy, Elsevier, vol. 85(C), pages 208-220.
    2. Rodrigo Lopez Farias & Vicenç Puig & Hector Rodriguez Rangel & Juan J. Flores, 2018. "Multi-Model Prediction for Demand Forecast in Water Distribution Networks," Energies, MDPI, vol. 11(3), pages 1-21, March.
    3. Zhu, Bangzhu & Ye, Shunxin & Jiang, Minxing & Wang, Ping & Wu, Zhanchi & Xie, Rui & Chevallier, Julien & Wei, Yi-Ming, 2019. "Achieving the carbon intensity target of China: A least squares support vector machine with mixture kernel function approach," Applied Energy, Elsevier, vol. 233, pages 196-207.
    4. Ghimire, Sujan & Deo, Ravinesh C. & Raj, Nawin & Mi, Jianchun, 2019. "Deep solar radiation forecasting with convolutional neural network and long short-term memory network algorithms," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    5. Potočnik, Primož & Soldo, Božidar & Šimunović, Goran & Šarić, Tomislav & Jeromen, Andrej & Govekar, Edvard, 2014. "Comparison of static and adaptive models for short-term residential natural gas forecasting in Croatia," Applied Energy, Elsevier, vol. 129(C), pages 94-103.
    6. Yu, Weichao & Wen, Kai & Min, Yuan & He, Lei & Huang, Weihe & Gong, Jing, 2018. "A methodology to quantify the gas supply capacity of natural gas transmission pipeline system using reliability theory," Reliability Engineering and System Safety, Elsevier, vol. 175(C), pages 128-141.
    7. Ravnik, J. & Hriberšek, M., 2019. "A method for natural gas forecasting and preliminary allocation based on unique standard natural gas consumption profiles," Energy, Elsevier, vol. 180(C), pages 149-162.
    8. Nicholson, William B. & Matteson, David S. & Bien, Jacob, 2017. "VARX-L: Structured regularization for large vector autoregressions with exogenous variables," International Journal of Forecasting, Elsevier, vol. 33(3), pages 627-651.
    9. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    10. Canale, Antonio & Vantini, Simone, 2016. "Constrained functional time series: Applications to the Italian gas market," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1340-1351.
    11. Liu, Zhenkun & Jiang, Ping & Zhang, Lifang & Niu, Xinsong, 2020. "A combined forecasting model for time series: Application to short-term wind speed forecasting," Applied Energy, Elsevier, vol. 259(C).
    12. Yu, Weichao & Gong, Jing & Song, Shangfei & Huang, Weihe & Li, Yichen & Zhang, Jie & Hong, Bingyuan & Zhang, Ye & Wen, Kai & Duan, Xu, 2019. "Gas supply reliability analysis of a natural gas pipeline system considering the effects of underground gas storages," Applied Energy, Elsevier, vol. 252(C), pages 1-1.
    13. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    14. Yu, Feng & Xu, Xiaozhong, 2014. "A short-term load forecasting model of natural gas based on optimized genetic algorithm and improved BP neural network," Applied Energy, Elsevier, vol. 134(C), pages 102-113.
    15. Zeng, Bo & Li, Chuan, 2016. "Forecasting the natural gas demand in China using a self-adapting intelligent grey model," Energy, Elsevier, vol. 112(C), pages 810-825.
    16. Wadud, Zia & Dey, Himadri S. & Kabir, Md. Ashfanoor & Khan, Shahidul I., 2011. "Modeling and forecasting natural gas demand in Bangladesh," Energy Policy, Elsevier, vol. 39(11), pages 7372-7380.
    17. Chen, Ying & Xu, Xiuqin & Koch, Thorsten, 2020. "Day-ahead high-resolution forecasting of natural gas demand and supply in Germany with a hybrid model," Applied Energy, Elsevier, vol. 262(C).
    18. Shine, P. & Scully, T. & Upton, J. & Murphy, M.D., 2019. "Annual electricity consumption prediction and future expansion analysis on dairy farms using a support vector machine," Applied Energy, Elsevier, vol. 250(C), pages 1110-1119.
    19. Konstantinos Papageorgiou & Elpiniki I. Papageorgiou & Katarzyna Poczeta & Dionysis Bochtis & George Stamoulis, 2020. "Forecasting of Day-Ahead Natural Gas Consumption Demand in Greece Using Adaptive Neuro-Fuzzy Inference System," Energies, MDPI, vol. 13(9), pages 1-32, May.
    20. Zhu, L. & Li, M.S. & Wu, Q.H. & Jiang, L., 2015. "Short-term natural gas demand prediction based on support vector regression with false neighbours filtered," Energy, Elsevier, vol. 80(C), pages 428-436.
    21. Su, Huai & Zio, Enrico & Zhang, Jinjun & Li, Xueyi, 2018. "A systematic framework of vulnerability analysis of a natural gas pipeline network," Reliability Engineering and System Safety, Elsevier, vol. 175(C), pages 79-91.
    22. Mustafa Akpinar & Nejat Yumusak, 2016. "Year Ahead Demand Forecast of City Natural Gas Using Seasonal Time Series Methods," Energies, MDPI, vol. 9(9), pages 1-17, September.
    23. Zhou, Yang & Zhang, Shuaishuai & Wu, Libo & Tian, Yingjie, 2019. "Predicting sectoral electricity consumption based on complex network analysis," Applied Energy, Elsevier, vol. 255(C).
    24. Yanming Li & Bin Nan & Ji Zhu, 2015. "Multivariate sparse group lasso for the multivariate multiple linear regression with an arbitrary group structure," Biometrics, The International Biometric Society, vol. 71(2), pages 354-363, June.
    25. Karadede, Yusuf & Ozdemir, Gultekin & Aydemir, Erdal, 2017. "Breeder hybrid algorithm approach for natural gas demand forecasting model," Energy, Elsevier, vol. 141(C), pages 1269-1284.
    26. Song, Song & Bickel, Peter J., 2011. "Large vector auto regressions," SFB 649 Discussion Papers 2011-048, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    27. Ying Chen & Bo Li, 2017. "An Adaptive Functional Autoregressive Forecast Model to Predict Electricity Price Curves," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(3), pages 371-388, July.
    28. Chen, Ying & Chua, Wee Song & Koch, Thorsten, 2018. "Forecasting day-ahead high-resolution natural-gas demand and supply in Germany," Applied Energy, Elsevier, vol. 228(C), pages 1091-1110.
    29. Hsu, Nan-Jung & Hung, Hung-Lin & Chang, Ya-Mei, 2008. "Subset selection for vector autoregressive processes using Lasso," Computational Statistics & Data Analysis, Elsevier, vol. 52(7), pages 3645-3657, March.
    30. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    31. Wei, Nan & Li, Changjun & Peng, Xiaolong & Li, Yang & Zeng, Fanhua, 2019. "Daily natural gas consumption forecasting via the application of a novel hybrid model," Applied Energy, Elsevier, vol. 250(C), pages 358-368.
    32. Soldo, Božidar, 2012. "Forecasting natural gas consumption," Applied Energy, Elsevier, vol. 92(C), pages 26-37.
    33. Brendan O’Donoghue & Eric Chu & Neal Parikh & Stephen Boyd, 2016. "Conic Optimization via Operator Splitting and Homogeneous Self-Dual Embedding," Journal of Optimization Theory and Applications, Springer, vol. 169(3), pages 1042-1068, June.
    34. Ahmadian Behrooz, Hesam & Boozarjomehry, R. Bozorgmehry, 2017. "Dynamic optimization of natural gas networks under customer demand uncertainties," Energy, Elsevier, vol. 134(C), pages 968-983.
    35. Obringer, Renee & Mukherjee, Sayanti & Nateghi, Roshanak, 2020. "Evaluating the climate sensitivity of coupled electricity-natural gas demand using a multivariate framework," Applied Energy, Elsevier, vol. 262(C).
    36. Ming Yuan & Yi Lin, 2006. "Model selection and estimation in regression with grouped variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 49-67, February.
    37. Potocnik, Primoz & Thaler, Marko & Govekar, Edvard & Grabec, Igor & Poredos, Alojz, 2007. "Forecasting risks of natural gas consumption in Slovenia," Energy Policy, Elsevier, vol. 35(8), pages 4271-4282, August.
    38. Chiang, Nai-Yuan & Zavala, Victor M., 2016. "Large-scale optimal control of interconnected natural gas and electrical transmission systems," Applied Energy, Elsevier, vol. 168(C), pages 226-235.
    39. Panapakidis, Ioannis P. & Dagoumas, Athanasios S., 2017. "Day-ahead natural gas demand forecasting based on the combination of wavelet transform and ANFIS/genetic algorithm/neural network model," Energy, Elsevier, vol. 118(C), pages 231-245.
    40. Liang, Yingzong & Hui, Chi Wai, 2018. "Convexification for natural gas transmission networks optimization," Energy, Elsevier, vol. 158(C), pages 1001-1016.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Piao Wang & Shahid Hussain Gurmani & Zhifu Tao & Jinpei Liu & Huayou Chen, 2024. "Interval time series forecasting: A systematic literature review," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(2), pages 249-285, March.
    2. Wei, Nan & Yin, Lihua & Li, Chao & Li, Changjun & Chan, Christine & Zeng, Fanhua, 2021. "Forecasting the daily natural gas consumption with an accurate white-box model," Energy, Elsevier, vol. 232(C).
    3. Lai, Wei-Ting & Chen, Ray-Bing & Chen, Ying & Koch, Thorsten, 2022. "Variational Bayesian inference for network autoregression models," Computational Statistics & Data Analysis, Elsevier, vol. 169(C).
    4. Montuori, Lina & Alcázar-Ortega, Manuel & Álvarez-Bel, Carlos, 2021. "Methodology for the evaluation of demand response strategies for the management of natural gas systems," Energy, Elsevier, vol. 234(C).
    5. Xu, Xiuqin & Chen, Ying & Goude, Yannig & Yao, Qiwei, 2021. "Day-ahead probabilistic forecasting for French half-hourly electricity loads and quantiles for curve-to-curve regression," Applied Energy, Elsevier, vol. 301(C).
    6. Fang, Guochang & Chen, Gang & Yang, Kun & Yin, Weijun & Tian, Lixin, 2024. "How does green fiscal expenditure promote green total factor energy efficiency? — Evidence from Chinese 254 cities," Applied Energy, Elsevier, vol. 353(PA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Beyca, Omer Faruk & Ervural, Beyzanur Cayir & Tatoglu, Ekrem & Ozuyar, Pinar Gokcin & Zaim, Selim, 2019. "Using machine learning tools for forecasting natural gas consumption in the province of Istanbul," Energy Economics, Elsevier, vol. 80(C), pages 937-949.
    2. Ravnik, J. & Hriberšek, M., 2019. "A method for natural gas forecasting and preliminary allocation based on unique standard natural gas consumption profiles," Energy, Elsevier, vol. 180(C), pages 149-162.
    3. Chen, Ying & Xu, Xiuqin & Koch, Thorsten, 2020. "Day-ahead high-resolution forecasting of natural gas demand and supply in Germany with a hybrid model," Applied Energy, Elsevier, vol. 262(C).
    4. Lu, Hongfang & Ma, Xin & Azimi, Mohammadamin, 2020. "US natural gas consumption prediction using an improved kernel-based nonlinear extension of the Arps decline model," Energy, Elsevier, vol. 194(C).
    5. Song, Jiancai & Zhang, Liyi & Jiang, Qingling & Ma, Yunpeng & Zhang, Xinxin & Xue, Guixiang & Shen, Xingliang & Wu, Xiangdong, 2022. "Estimate the daily consumption of natural gas in district heating system based on a hybrid seasonal decomposition and temporal convolutional network model," Applied Energy, Elsevier, vol. 309(C).
    6. Wei, Nan & Yin, Lihua & Li, Chao & Liu, Jinyuan & Li, Changjun & Huang, Yuanyuan & Zeng, Fanhua, 2022. "Data complexity of daily natural gas consumption: Measurement and impact on forecasting performance," Energy, Elsevier, vol. 238(PC).
    7. Yukseltan, Ergun & Yucekaya, Ahmet & Bilge, Ayse Humeyra & Agca Aktunc, Esra, 2021. "Forecasting models for daily natural gas consumption considering periodic variations and demand segregation," Socio-Economic Planning Sciences, Elsevier, vol. 74(C).
    8. Jean Gaston Tamba & Salom Ndjakomo Essiane & Emmanuel Flavian Sapnken & Francis Djanna Koffi & Jean Luc Nsouand l & Bozidar Soldo & Donatien Njomo, 2018. "Forecasting Natural Gas: A Literature Survey," International Journal of Energy Economics and Policy, Econjournals, vol. 8(3), pages 216-249.
    9. Guo-Feng Fan & An Wang & Wei-Chiang Hong, 2018. "Combining Grey Model and Self-Adapting Intelligent Grey Model with Genetic Algorithm and Annual Share Changes in Natural Gas Demand Forecasting," Energies, MDPI, vol. 11(7), pages 1-21, June.
    10. Ergun Yukseltan & Ahmet Yucekaya & Ayse Humeyra Bilge & Esra Agca Aktunc, 2020. "Forecasting Models for Daily Natural Gas Consumption Considering Periodic Variations and Demand Segregation," Papers 2003.13385, arXiv.org.
    11. Su, Huai & Zio, Enrico & Zhang, Jinjun & Xu, Mingjing & Li, Xueyi & Zhang, Zongjie, 2019. "A hybrid hourly natural gas demand forecasting method based on the integration of wavelet transform and enhanced Deep-RNN model," Energy, Elsevier, vol. 178(C), pages 585-597.
    12. Qiao, Weibiao & Liu, Wei & Liu, Enbin, 2021. "A combination model based on wavelet transform for predicting the difference between monthly natural gas production and consumption of U.S," Energy, Elsevier, vol. 235(C).
    13. Konstantinos Papageorgiou & Elpiniki I. Papageorgiou & Katarzyna Poczeta & Dionysis Bochtis & George Stamoulis, 2020. "Forecasting of Day-Ahead Natural Gas Consumption Demand in Greece Using Adaptive Neuro-Fuzzy Inference System," Energies, MDPI, vol. 13(9), pages 1-32, May.
    14. Sen, Doruk & Günay, M. Erdem & Tunç, K.M. Murat, 2019. "Forecasting annual natural gas consumption using socio-economic indicators for making future policies," Energy, Elsevier, vol. 173(C), pages 1106-1118.
    15. Laib, Oussama & Khadir, Mohamed Tarek & Mihaylova, Lyudmila, 2019. "Toward efficient energy systems based on natural gas consumption prediction with LSTM Recurrent Neural Networks," Energy, Elsevier, vol. 177(C), pages 530-542.
    16. Deng, Yanqiao & Ma, Xin & Zhang, Peng & Cai, Yubin, 2022. "Multi-step ahead forecasting of daily urban gas load in Chengdu using a Tanimoto kernel-based NAR model and Whale optimization," Energy, Elsevier, vol. 260(C).
    17. Wei, Nan & Yin, Lihua & Li, Chao & Li, Changjun & Chan, Christine & Zeng, Fanhua, 2021. "Forecasting the daily natural gas consumption with an accurate white-box model," Energy, Elsevier, vol. 232(C).
    18. Wei, Nan & Li, Changjun & Peng, Xiaolong & Li, Yang & Zeng, Fanhua, 2019. "Daily natural gas consumption forecasting via the application of a novel hybrid model," Applied Energy, Elsevier, vol. 250(C), pages 358-368.
    19. Szoplik, Jolanta, 2015. "Forecasting of natural gas consumption with artificial neural networks," Energy, Elsevier, vol. 85(C), pages 208-220.
    20. Mustafa Akpinar & Nejat Yumusak, 2016. "Year Ahead Demand Forecast of City Natural Gas Using Seasonal Time Series Methods," Energies, MDPI, vol. 9(9), pages 1-17, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:278:y:2020:i:c:s0306261920311053. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.