IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v322y2023i2d10.1007_s10479-021-04089-x.html
   My bibliography  Save this article

Sparse regression modeling for short- and long‐term natural gas demand prediction

Author

Listed:
  • Ayşe Özmen

    (METU)

Abstract

The multivariate adaptive regression splines (MARS) model is a flexible non-parametric sparse regression algorithm and provides an excellent promise to data fitting through nonlinear basis functions. During the last decades, it is employed in many fields of control design, finance, technology, and science. It can be regarded as an extension of linear models that automatically model interactions and nonlinearities. The least absolute shrinkage and selection operator (LASSO) analysis is a variable selection and shrinkage method to linear regression models. It proposes to construct the subset of explanatory variables which minimizes estimation error to a quantitative dependent variable. LASSO is applied to choose the variables and perform the regularization to improve the interpretability and robustness of the model. In this paper, we examine MARS and LASSO to generate natural gas demand forecasts of residential users for the distribution system operators who need both short- and long-term forecasts. We also compare the performance of MARS and LASSO with a simple multiple-linear regression (LR) commonly used in practice. Our analysis reveals that MARS outperforms LASSO and LR in both the average measures and in the worst-case analysis. For 1 day-ahead forecast, MARS provides a MAPE of around 4.8% while the same figure under LASSO and LR reaches 8.3 and 8.5% respectively. However, as the forecasting horizon increases, we observe that the performance of these proposed methods gets worse and for 1 year-ahead forecast, the MAPE values for MARS, LASSO, and LR are 13.4%, 24.8% and 26.3% respectively.

Suggested Citation

  • Ayşe Özmen, 2023. "Sparse regression modeling for short- and long‐term natural gas demand prediction," Annals of Operations Research, Springer, vol. 322(2), pages 921-946, March.
  • Handle: RePEc:spr:annopr:v:322:y:2023:i:2:d:10.1007_s10479-021-04089-x
    DOI: 10.1007/s10479-021-04089-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-021-04089-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10479-021-04089-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "Understanding intraday electricity markets: Variable selection and very short-term price forecasting using LASSO," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1533-1547.
    2. Vondrácek, Jirí & Pelikán, Emil & Konár, Ondrej & Cermáková, Jana & Eben, Krystof & Malý, Marek & Brabec, Marek, 2008. "A statistical model for the estimation of natural gas consumption," Applied Energy, Elsevier, vol. 85(5), pages 362-370, May.
    3. Sarak, H & Satman, A, 2003. "The degree-day method to estimate the residential heating natural gas consumption in Turkey: a case study," Energy, Elsevier, vol. 28(9), pages 929-939.
    4. Thaler, Marko & Grabec, Igor & Poredoš, Alojz, 2005. "Prediction of energy consumption and risk of excess demand in a distribution system," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 355(1), pages 46-53.
    5. Sen, Doruk & Günay, M. Erdem & Tunç, K.M. Murat, 2019. "Forecasting annual natural gas consumption using socio-economic indicators for making future policies," Energy, Elsevier, vol. 173(C), pages 1106-1118.
    6. Zhang, Yaojie & Ma, Feng & Wang, Yudong, 2019. "Forecasting crude oil prices with a large set of predictors: Can LASSO select powerful predictors?," Journal of Empirical Finance, Elsevier, vol. 54(C), pages 97-117.
    7. Pilla, Venkata L. & Rosenberger, Jay M. & Chen, Victoria & Engsuwan, Narakorn & Siddappa, Sheela, 2012. "A multivariate adaptive regression splines cutting plane approach for solving a two-stage stochastic programming fleet assignment model," European Journal of Operational Research, Elsevier, vol. 216(1), pages 162-171.
    8. Sailor, David J. & Muñoz, J.Ricardo, 1997. "Sensitivity of electricity and natural gas consumption to climate in the U.S.A.—Methodology and results for eight states," Energy, Elsevier, vol. 22(10), pages 987-998.
    9. Brabec, Marek & Konár, Ondrej & Pelikán, Emil & Malý, Marek, 2008. "A nonlinear mixed effects model for the prediction of natural gas consumption by individual customers," International Journal of Forecasting, Elsevier, vol. 24(4), pages 659-678.
    10. Liu, Lon-Mu & Lin, Maw-Wen, 1991. "Forecasting residential consumption of natural gas using monthly and quarterly time series," International Journal of Forecasting, Elsevier, vol. 7(1), pages 3-16, May.
    11. Lee, Tian-Shyug & Chiu, Chih-Chou & Chou, Yu-Chao & Lu, Chi-Jie, 2006. "Mining the customer credit using classification and regression tree and multivariate adaptive regression splines," Computational Statistics & Data Analysis, Elsevier, vol. 50(4), pages 1113-1130, February.
    12. Hribar, Rok & Potočnik, Primož & Šilc, Jurij & Papa, Gregor, 2019. "A comparison of models for forecasting the residential natural gas demand of an urban area," Energy, Elsevier, vol. 167(C), pages 511-522.
    13. Pakize Taylan & Gerhard-Wilhelm Weber & Fatma Yerlikaya Özkurt, 2010. "A new approach to multivariate adaptive regression splines by using Tikhonov regularization and continuous optimization," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 18(2), pages 377-395, December.
    14. Karadede, Yusuf & Ozdemir, Gultekin & Aydemir, Erdal, 2017. "Breeder hybrid algorithm approach for natural gas demand forecasting model," Energy, Elsevier, vol. 141(C), pages 1269-1284.
    15. Sermpinis, Georgios & Tsoukas, Serafeim & Zhang, Ping, 2018. "Modelling market implied ratings using LASSO variable selection techniques," Journal of Empirical Finance, Elsevier, vol. 48(C), pages 19-35.
    16. Özmen, Ayşe & Yılmaz, Yavuz & Weber, Gerhard-Wilhelm, 2018. "Natural gas consumption forecast with MARS and CMARS models for residential users," Energy Economics, Elsevier, vol. 70(C), pages 357-381.
    17. Beyca, Omer Faruk & Ervural, Beyzanur Cayir & Tatoglu, Ekrem & Ozuyar, Pinar Gokcin & Zaim, Selim, 2019. "Using machine learning tools for forecasting natural gas consumption in the province of Istanbul," Energy Economics, Elsevier, vol. 80(C), pages 937-949.
    18. Soldo, Božidar, 2012. "Forecasting natural gas consumption," Applied Energy, Elsevier, vol. 92(C), pages 26-37.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jean Gaston Tamba & Salom Ndjakomo Essiane & Emmanuel Flavian Sapnken & Francis Djanna Koffi & Jean Luc Nsouand l & Bozidar Soldo & Donatien Njomo, 2018. "Forecasting Natural Gas: A Literature Survey," International Journal of Energy Economics and Policy, Econjournals, vol. 8(3), pages 216-249.
    2. Özmen, Ayşe & Yılmaz, Yavuz & Weber, Gerhard-Wilhelm, 2018. "Natural gas consumption forecast with MARS and CMARS models for residential users," Energy Economics, Elsevier, vol. 70(C), pages 357-381.
    3. Soldo, Božidar, 2012. "Forecasting natural gas consumption," Applied Energy, Elsevier, vol. 92(C), pages 26-37.
    4. Ravnik, J. & Hriberšek, M., 2019. "A method for natural gas forecasting and preliminary allocation based on unique standard natural gas consumption profiles," Energy, Elsevier, vol. 180(C), pages 149-162.
    5. Qiao, Weibiao & Liu, Wei & Liu, Enbin, 2021. "A combination model based on wavelet transform for predicting the difference between monthly natural gas production and consumption of U.S," Energy, Elsevier, vol. 235(C).
    6. Lu, Hongfang & Ma, Xin & Azimi, Mohammadamin, 2020. "US natural gas consumption prediction using an improved kernel-based nonlinear extension of the Arps decline model," Energy, Elsevier, vol. 194(C).
    7. Tomasz Cieślik & Piotr Narloch & Adam Szurlej & Krzysztof Kogut, 2022. "Indirect Impact of the COVID-19 Pandemic on Natural Gas Consumption by Commercial Consumers in a Selected City in Poland," Energies, MDPI, vol. 15(4), pages 1-18, February.
    8. Szoplik, Jolanta, 2015. "Forecasting of natural gas consumption with artificial neural networks," Energy, Elsevier, vol. 85(C), pages 208-220.
    9. Potočnik, Primož & Soldo, Božidar & Šimunović, Goran & Šarić, Tomislav & Jeromen, Andrej & Govekar, Edvard, 2014. "Comparison of static and adaptive models for short-term residential natural gas forecasting in Croatia," Applied Energy, Elsevier, vol. 129(C), pages 94-103.
    10. Wei, Nan & Yin, Lihua & Li, Chao & Li, Changjun & Chan, Christine & Zeng, Fanhua, 2021. "Forecasting the daily natural gas consumption with an accurate white-box model," Energy, Elsevier, vol. 232(C).
    11. Beyca, Omer Faruk & Ervural, Beyzanur Cayir & Tatoglu, Ekrem & Ozuyar, Pinar Gokcin & Zaim, Selim, 2019. "Using machine learning tools for forecasting natural gas consumption in the province of Istanbul," Energy Economics, Elsevier, vol. 80(C), pages 937-949.
    12. Palanisamy Manigandan & MD Shabbir Alam & Majed Alharthi & Uzma Khan & Kuppusamy Alagirisamy & Duraisamy Pachiyappan & Abdul Rehman, 2021. "Forecasting Natural Gas Production and Consumption in United States-Evidence from SARIMA and SARIMAX Models," Energies, MDPI, vol. 14(19), pages 1-17, September.
    13. Spoladore, Alessandro & Borelli, Davide & Devia, Francesco & Mora, Flavio & Schenone, Corrado, 2016. "Model for forecasting residential heat demand based on natural gas consumption and energy performance indicators," Applied Energy, Elsevier, vol. 182(C), pages 488-499.
    14. Lu, Fei & Ma, Feng & Li, Pan & Huang, Dengshi, 2022. "Natural gas volatility predictability in a data-rich world," International Review of Financial Analysis, Elsevier, vol. 83(C).
    15. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2022. "Forecasting natural gas consumption using Bagging and modified regularization techniques," Energy Economics, Elsevier, vol. 106(C).
    16. Li, Wei & Lu, Can, 2019. "The multiple effectiveness of state natural gas consumption constraint policies for achieving sustainable development targets in China," Applied Energy, Elsevier, vol. 235(C), pages 685-698.
    17. Ahmet Goncu & Mehmet Oguz Karahan & Tolga Umut Kuzubas, 2019. "Forecasting Daily Residential Natural Gas Consumption: A Dynamic Temperature Modelling Approach," Bogazici Journal, Review of Social, Economic and Administrative Studies, Bogazici University, Department of Economics, vol. 33(1), pages 1-22.
    18. Wei, Nan & Yin, Lihua & Li, Chao & Liu, Jinyuan & Li, Changjun & Huang, Yuanyuan & Zeng, Fanhua, 2022. "Data complexity of daily natural gas consumption: Measurement and impact on forecasting performance," Energy, Elsevier, vol. 238(PC).
    19. Ding, Lili & Zhao, Zhongchao & Wang, Lei, 2022. "Probability density forecasts for natural gas demand in China: Do mixed-frequency dynamic factors matter?," Applied Energy, Elsevier, vol. 312(C).
    20. Serli Kiremitciyan & Ahmet Goncu & Tolga Umut Kuzubas, 2014. "A Comparison of Stochastic Models of Natural Gas Consumption," Working Papers 2014/10, Bogazici University, Department of Economics.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:322:y:2023:i:2:d:10.1007_s10479-021-04089-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.