IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v300y2021ics0306261921007947.html
   My bibliography  Save this article

Forecasting residential electricity consumption using a hybrid machine learning model with online search data

Author

Listed:
  • Gao, Feng
  • Chi, Hong
  • Shao, Xueyan

Abstract

Accurate forecasting of residential electricity consumption plays an important role in formulating energy plans and ensuring the safety of power system operations. In order to improve forecasting accuracy, we propose a novel hybrid model with online search data for residential electricity consumption forecasting. Two main steps are involved: (1) Time difference correlation analysis, cointegration test, and Granger causality test are employed to investigate the relationship between online search data and residential electricity consumption. Qualified search keywords are selected to serve as predictors. (2) An extreme learning machine model optimized by Jaya algorithm, together with the selected search keywords from the first step, is proposed to predict residential electricity consumption. Furthermore, monthly residential electricity consumption data from China are used to validate the effectiveness of the proposed model. The experimental results show that the incorporation of online search data into the model can significantly improve forecasting accuracy. After incorporating online search data, improvement rates of all the forecasting models exceed 10%. In addition, the proposed model has the best forecasting performance compared with seasonal autoregressive integrated moving average (SARIMA(X)), support vector regression (SVR), back propagation neural network (BPNN) and extreme learning model (ELM). Root mean squared error (RMSE), mean absolute percentage error (MAPE), and mean absolute error (MAE) of the proposed model with online search data decrease by 34%-51.2%, 43.03%-53.92%, and 41.35%-54.85% relative to other benchmark models, respectively.

Suggested Citation

  • Gao, Feng & Chi, Hong & Shao, Xueyan, 2021. "Forecasting residential electricity consumption using a hybrid machine learning model with online search data," Applied Energy, Elsevier, vol. 300(C).
    • Handle: RePEc:eee:appene:v:300:y:2021:i:c:s0306261921007947
    DOI: 10.1016/j.apenergy.2021.117393
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261921007947
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2021.117393?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bessec, Marie & Fouquau, Julien, 2008. "The non-linear link between electricity consumption and temperature in Europe: A threshold panel approach," Energy Economics, Elsevier, vol. 30(5), pages 2705-2721, September.
    2. Alberini, Anna & Gans, Will & Velez-Lopez, Daniel, 2011. "Residential Consumption of Gas and Electricity in the U.S.: The Role of Prices and Income," Sustainable Development Papers 99637, Fondazione Eni Enrico Mattei (FEEM).
    3. Isil Erel & Léa H Stern & Chenhao Tan & Michael S Weisbach, 2021. "Selecting Directors Using Machine Learning," NBER Chapters, in: Big Data: Long-Term Implications for Financial Markets and Firms, pages 3226-3264, National Bureau of Economic Research, Inc.
    4. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    5. Salisu, Afees A. & Ogbonna, Ahamuefula E. & Adewuyi, Adeolu, 2020. "Google trends and the predictability of precious metals," Resources Policy, Elsevier, vol. 65(C).
    6. Liwen Ling & Dabin Zhang & Shanying Chen & Amin W. Mugera, 2020. "Can online search data improve the forecast accuracy of pork price in China?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(4), pages 671-686, July.
    7. Xiao, Jin & Li, Yuxi & Xie, Ling & Liu, Dunhu & Huang, Jing, 2018. "A hybrid model based on selective ensemble for energy consumption forecasting in China," Energy, Elsevier, vol. 159(C), pages 534-546.
    8. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    9. Cheung, Yin-Wong & Lai, Kon S, 1995. "Lag Order and Critical Values of a Modified Dickey-Fuller Test," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 57(3), pages 411-419, August.
    10. Dagher, Leila & Bird, Lori & Heeter, Jenny, 2017. "Residential green power demand in the United States," Renewable Energy, Elsevier, vol. 114(PB), pages 1062-1068.
    11. Jiang, Weiheng & Wu, Xiaogang & Gong, Yi & Yu, Wanxin & Zhong, Xinhui, 2020. "Holt–Winters smoothing enhanced by fruit fly optimization algorithm to forecast monthly electricity consumption," Energy, Elsevier, vol. 193(C).
    12. Guefano, Serge & Tamba, Jean Gaston & Azong, Tchitile Emmanuel Wilfried & Monkam, Louis, 2021. "Forecast of electricity consumption in the Cameroonian residential sector by Grey and vector autoregressive models," Energy, Elsevier, vol. 214(C).
    13. Li, Hengyun & Hu, Mingming & Li, Gang, 2020. "Forecasting tourism demand with multisource big data," Annals of Tourism Research, Elsevier, vol. 83(C).
    14. Alberini, Anna & Gans, Will & Velez-Lopez, Daniel, 2011. "Residential consumption of gas and electricity in the U.S.: The role of prices and income," Energy Economics, Elsevier, vol. 33(5), pages 870-881, September.
    15. Shen, Meng & Lu, Yujie & Wei, Kua Harn & Cui, Qingbin, 2020. "Prediction of household electricity consumption and effectiveness of concerted intervention strategies based on occupant behaviour and personality traits," Renewable and Sustainable Energy Reviews, Elsevier, vol. 127(C).
    16. Li, Jingjing & Tang, Ling & Wang, Shouyang, 2020. "Forecasting crude oil price with multilingual search engine data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 551(C).
    17. Hekkenberg, M. & Benders, R.M.J. & Moll, H.C. & Schoot Uiterkamp, A.J.M., 2009. "Indications for a changing electricity demand pattern: The temperature dependence of electricity demand in the Netherlands," Energy Policy, Elsevier, vol. 37(4), pages 1542-1551, April.
    18. Cao, Guohua & Wu, Lijuan, 2016. "Support vector regression with fruit fly optimization algorithm for seasonal electricity consumption forecasting," Energy, Elsevier, vol. 115(P1), pages 734-745.
    19. Dikaios Tserkezos, E., 1992. "Forecasting residential electricity consumption in Greece using monthly and quarterly data," Energy Economics, Elsevier, vol. 14(3), pages 226-232, July.
    20. Xu, Hua & Wang, Minggang & Jiang, Shumin & Yang, Weiguo, 2020. "Carbon price forecasting with complex network and extreme learning machine," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 545(C).
    21. Zhu, L. & Li, M.S. & Wu, Q.H. & Jiang, L., 2015. "Short-term natural gas demand prediction based on support vector regression with false neighbours filtered," Energy, Elsevier, vol. 80(C), pages 428-436.
    22. Wang, Jianjun & Li, Li & Niu, Dongxiao & Tan, Zhongfu, 2012. "An annual load forecasting model based on support vector regression with differential evolution algorithm," Applied Energy, Elsevier, vol. 94(C), pages 65-70.
    23. Cheung, Yin-Wong & Lai, Kon S, 1995. "Lag Order and Critical Values of the Augmented Dickey-Fuller Test," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 277-280, July.
    24. Liu, Che & Sun, Bo & Zhang, Chenghui & Li, Fan, 2020. "A hybrid prediction model for residential electricity consumption using holt-winters and extreme learning machine," Applied Energy, Elsevier, vol. 275(C).
    25. Yu, Lean & Zhao, Yaqing & Tang, Ling & Yang, Zebin, 2019. "Online big data-driven oil consumption forecasting with Google trends," International Journal of Forecasting, Elsevier, vol. 35(1), pages 213-223.
    26. Lu, Quanying & Li, Yuze & Chai, Jian & Wang, Shouyang, 2020. "Crude oil price analysis and forecasting: A perspective of “new triangle”," Energy Economics, Elsevier, vol. 87(C).
    27. Ferbar Tratar, Liljana & Strmčnik, Ervin, 2016. "The comparison of Holt–Winters method and Multiple regression method: A case study," Energy, Elsevier, vol. 109(C), pages 266-276.
    28. Xiong, Xin & Hu, Xi & Guo, Huan, 2021. "A hybrid optimized grey seasonal variation index model improved by whale optimization algorithm for forecasting the residential electricity consumption," Energy, Elsevier, vol. 234(C).
    29. de Oliveira, Erick Meira & Cyrino Oliveira, Fernando Luiz, 2018. "Forecasting mid-long term electric energy consumption through bagging ARIMA and exponential smoothing methods," Energy, Elsevier, vol. 144(C), pages 776-788.
    30. Guo, Zhifeng & Zhou, Kaile & Zhang, Chi & Lu, Xinhui & Chen, Wen & Yang, Shanlin, 2018. "Residential electricity consumption behavior: Influencing factors, related theories and intervention strategies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 399-412.
    31. Sun, Wei & Zhang, Chongchong, 2018. "Analysis and forecasting of the carbon price using multi—resolution singular value decomposition and extreme learning machine optimized by adaptive whale optimization algorithm," Applied Energy, Elsevier, vol. 231(C), pages 1354-1371.
    32. Zhang, Guoqiang & Guo, Jifeng, 2020. "A novel ensemble method for hourly residential electricity consumption forecasting by imaging time series," Energy, Elsevier, vol. 203(C).
    33. repec:dau:papers:123456789/8180 is not listed on IDEAS
    34. Wang, Lin & Hu, Huanling & Ai, Xue-Yi & Liu, Hua, 2018. "Effective electricity energy consumption forecasting using echo state network improved by differential evolution algorithm," Energy, Elsevier, vol. 153(C), pages 801-815.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xu, Jiayi & Zhang, Xiao-Bing & Liu, Yang, 2024. "Asymmetric search behavior for gasoline prices: Evidence from the Chinese gasoline market," International Review of Economics & Finance, Elsevier, vol. 89(PB), pages 699-712.
    2. Pesantez, Jorge E. & Li, Binbin & Lee, Christopher & Zhao, Zhizhen & Butala, Mark & Stillwell, Ashlynn S., 2023. "A Comparison Study of Predictive Models for Electricity Demand in a Diverse Urban Environment," Energy, Elsevier, vol. 283(C).
    3. Ren, Fukang & Wei, Ziqing & Zhai, Xiaoqiang, 2022. "A review on the integration and optimization of distributed energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 162(C).
    4. Hamza Mubarak & Mohammad J. Sanjari & Sascha Stegen & Abdallah Abdellatif, 2023. "Improved Active and Reactive Energy Forecasting Using a Stacking Ensemble Approach: Steel Industry Case Study," Energies, MDPI, vol. 16(21), pages 1-32, October.
    5. Gao, Tian & Niu, Dongxiao & Ji, Zhengsen & Sun, Lijie, 2022. "Mid-term electricity demand forecasting using improved variational mode decomposition and extreme learning machine optimized by sparrow search algorithm," Energy, Elsevier, vol. 261(PB).
    6. Sheng, Yujie & Zeng, Hongtai & Guo, Qinglai & Yu, Yang & Li, Qiang, 2023. "Impact of customer portrait information superiority on competitive pricing of EV fast-charging stations," Applied Energy, Elsevier, vol. 348(C).
    7. Wang, Jianzhou & Xing, Qianyi & Zeng, Bo & Zhao, Weigang, 2022. "An ensemble forecasting system for short-term power load based on multi-objective optimizer and fuzzy granulation," Applied Energy, Elsevier, vol. 327(C).
    8. Liangfeng Zou & Yuanyuan Zha & Yuqing Diao & Chi Tang & Wenquan Gu & Dongguo Shao, 2023. "Coupling the Causal Inference and Informer Networks for Short-term Forecasting in Irrigation Water Usage," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 37(1), pages 427-449, January.
    9. Jiang, Hongyan & Cheng, Feng & Wu, Cong & Fang, Dianjun & Zeng, Yuhai, 2024. "A multi-period-sequential-index combination method for short-term prediction of small sample data," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    10. Du, Pei & Guo, Ju'e & Sun, Shaolong & Wang, Shouyang & Wu, Jing, 2022. "A novel two-stage seasonal grey model for residential electricity consumption forecasting," Energy, Elsevier, vol. 258(C).
    11. Houben, Nikolaus & Cosic, Armin & Stadler, Michael & Mansoor, Muhammad & Zellinger, Michael & Auer, Hans & Ajanovic, Amela & Haas, Reinhard, 2023. "Optimal dispatch of a multi-energy system microgrid under uncertainty: A renewable energy community in Austria," Applied Energy, Elsevier, vol. 337(C).
    12. Saâdaoui, Foued & Ben Jabeur, Sami, 2023. "Analyzing the influence of geopolitical risks on European power prices using a multiresolution causal neural network," Energy Economics, Elsevier, vol. 124(C).
    13. Changping Li & Xiaohui Wang & Longchen Duan & Bo Lei, 2022. "Study on a Discharge Circuit Prediction Model of High-Voltage Electro-Pulse Boring Based on Bayesian Fusion," Energies, MDPI, vol. 15(10), pages 1-12, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Du, Pei & Guo, Ju'e & Sun, Shaolong & Wang, Shouyang & Wu, Jing, 2022. "A novel two-stage seasonal grey model for residential electricity consumption forecasting," Energy, Elsevier, vol. 258(C).
    2. Tang, Tao & Jiang, Weiheng & Zhang, Hui & Nie, Jiangtian & Xiong, Zehui & Wu, Xiaogang & Feng, Wenjiang, 2022. "GM(1,1) based improved seasonal index model for monthly electricity consumption forecasting," Energy, Elsevier, vol. 252(C).
    3. Park, Sungjun & Kim, Jinsoo, 2018. "The effect of interest in renewable energy on US household electricity consumption: An analysis using Google Trends data," Renewable Energy, Elsevier, vol. 127(C), pages 1004-1010.
    4. Jiang, Hongyan & Cheng, Feng & Wu, Cong & Fang, Dianjun & Zeng, Yuhai, 2024. "A multi-period-sequential-index combination method for short-term prediction of small sample data," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    5. Gong, Xue & Ye, Xin & Zhang, Weiguo & Zhang, Yue, 2023. "Predicting energy futures high-frequency volatility using technical indicators: The role of interaction," Energy Economics, Elsevier, vol. 119(C).
    6. Hu, Huanling & Wang, Lin & Peng, Lu & Zeng, Yu-Rong, 2020. "Effective energy consumption forecasting using enhanced bagged echo state network," Energy, Elsevier, vol. 193(C).
    7. Xue Gong & Weiguo Zhang & Weijun Xu & Zhe Li, 2022. "Uncertainty index and stock volatility prediction: evidence from international markets," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-44, December.
    8. Desiderio Romero-Jordán & Pablo del Río & Cristina Peñasco, 2014. "Household electricity demand in Spanish regions. Public policy implications," Working Papers 2014/24, Institut d'Economia de Barcelona (IEB).
    9. Amber, K.P. & Ahmad, R. & Aslam, M.W. & Kousar, A. & Usman, M. & Khan, M.S., 2018. "Intelligent techniques for forecasting electricity consumption of buildings," Energy, Elsevier, vol. 157(C), pages 886-893.
    10. Desiderio Romero-Jordán & Pablo del Río & Cristina Peñasco, 2014. "Household electricity demand in Spanish regions. Public policy implications," Working Papers 2014/24, Institut d'Economia de Barcelona (IEB).
    11. Zhang, Meng & Guo, Huan & Sun, Ming & Liu, Sifeng & Forrest, Jeffrey, 2022. "A novel flexible grey multivariable model and its application in forecasting energy consumption in China," Energy, Elsevier, vol. 239(PE).
    12. Chabouni, Naima & Belarbi, Yacine & Benhassine, Wassim, 2020. "Electricity load dynamics, temperature and seasonality Nexus in Algeria," Energy, Elsevier, vol. 200(C).
    13. Liu, Che & Li, Fan & Zhang, Chenghui & Sun, Bo & Zhang, Guanguan, 2023. "A day-ahead prediction method for high-resolution electricity consumption in residential units," Energy, Elsevier, vol. 265(C).
    14. Hanauer, Matthias X. & Kononova, Marina & Rapp, Marc Steffen, 2022. "Boosting agnostic fundamental analysis: Using machine learning to identify mispricing in European stock markets," Finance Research Letters, Elsevier, vol. 48(C).
    15. Li, Jieyi & Qian, Shuangyue & Li, Ling & Guo, Yuanxuan & Wu, Jun & Tang, Ling, 2024. "A novel secondary decomposition method for forecasting crude oil price with twitter sentiment," Energy, Elsevier, vol. 290(C).
    16. Hoang, Daniel & Wiegratz, Kevin, 2022. "Machine learning methods in finance: Recent applications and prospects," Working Paper Series in Economics 158, Karlsruhe Institute of Technology (KIT), Department of Economics and Management.
    17. Li, Ang & Liu, Mark & Sheather, Simon, 2023. "Predicting stock splits using ensemble machine learning and SMOTE oversampling," Pacific-Basin Finance Journal, Elsevier, vol. 78(C).
    18. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    19. Gao, Tian & Niu, Dongxiao & Ji, Zhengsen & Sun, Lijie, 2022. "Mid-term electricity demand forecasting using improved variational mode decomposition and extreme learning machine optimized by sparrow search algorithm," Energy, Elsevier, vol. 261(PB).
    20. Michalski, Lachlan & Low, Rand Kwong Yew, 2024. "Determinants of corporate credit ratings: Does ESG matter?," International Review of Financial Analysis, Elsevier, vol. 94(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:300:y:2021:i:c:s0306261921007947. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.