IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v300y2021ics0306261921007947.html
   My bibliography  Save this article

Forecasting residential electricity consumption using a hybrid machine learning model with online search data

Author

Listed:
  • Gao, Feng
  • Chi, Hong
  • Shao, Xueyan

Abstract

Accurate forecasting of residential electricity consumption plays an important role in formulating energy plans and ensuring the safety of power system operations. In order to improve forecasting accuracy, we propose a novel hybrid model with online search data for residential electricity consumption forecasting. Two main steps are involved: (1) Time difference correlation analysis, cointegration test, and Granger causality test are employed to investigate the relationship between online search data and residential electricity consumption. Qualified search keywords are selected to serve as predictors. (2) An extreme learning machine model optimized by Jaya algorithm, together with the selected search keywords from the first step, is proposed to predict residential electricity consumption. Furthermore, monthly residential electricity consumption data from China are used to validate the effectiveness of the proposed model. The experimental results show that the incorporation of online search data into the model can significantly improve forecasting accuracy. After incorporating online search data, improvement rates of all the forecasting models exceed 10%. In addition, the proposed model has the best forecasting performance compared with seasonal autoregressive integrated moving average (SARIMA(X)), support vector regression (SVR), back propagation neural network (BPNN) and extreme learning model (ELM). Root mean squared error (RMSE), mean absolute percentage error (MAPE), and mean absolute error (MAE) of the proposed model with online search data decrease by 34%-51.2%, 43.03%-53.92%, and 41.35%-54.85% relative to other benchmark models, respectively.

Suggested Citation

  • Gao, Feng & Chi, Hong & Shao, Xueyan, 2021. "Forecasting residential electricity consumption using a hybrid machine learning model with online search data," Applied Energy, Elsevier, vol. 300(C).
    • Handle: RePEc:eee:appene:v:300:y:2021:i:c:s0306261921007947
    DOI: 10.1016/j.apenergy.2021.117393
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261921007947
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2021.117393?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Isil Erel & Léa H Stern & Chenhao Tan & Michael S Weisbach, 2021. "Selecting Directors Using Machine Learning," NBER Chapters, in: Big Data: Long-Term Implications for Financial Markets and Firms, pages 3226-3264, National Bureau of Economic Research, Inc.
    2. Salisu, Afees A. & Ogbonna, Ahamuefula E. & Adewuyi, Adeolu, 2020. "Google trends and the predictability of precious metals," Resources Policy, Elsevier, vol. 65(C).
    3. Cheung, Yin-Wong & Lai, Kon S, 1995. "Lag Order and Critical Values of a Modified Dickey-Fuller Test," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 57(3), pages 411-419, August.
    4. Guefano, Serge & Tamba, Jean Gaston & Azong, Tchitile Emmanuel Wilfried & Monkam, Louis, 2021. "Forecast of electricity consumption in the Cameroonian residential sector by Grey and vector autoregressive models," Energy, Elsevier, vol. 214(C).
    5. Li, Hengyun & Hu, Mingming & Li, Gang, 2020. "Forecasting tourism demand with multisource big data," Annals of Tourism Research, Elsevier, vol. 83(C).
    6. Alberini, Anna & Gans, Will & Velez-Lopez, Daniel, 2011. "Residential consumption of gas and electricity in the U.S.: The role of prices and income," Energy Economics, Elsevier, vol. 33(5), pages 870-881, September.
    7. Bessec, Marie & Fouquau, Julien, 2008. "The non-linear link between electricity consumption and temperature in Europe: A threshold panel approach," Energy Economics, Elsevier, vol. 30(5), pages 2705-2721, September.
    8. Dikaios Tserkezos, E., 1992. "Forecasting residential electricity consumption in Greece using monthly and quarterly data," Energy Economics, Elsevier, vol. 14(3), pages 226-232, July.
    9. Cheung, Yin-Wong & Lai, Kon S, 1995. "Lag Order and Critical Values of the Augmented Dickey-Fuller Test," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 277-280, July.
    10. Guo, Zhifeng & Zhou, Kaile & Zhang, Chi & Lu, Xinhui & Chen, Wen & Yang, Shanlin, 2018. "Residential electricity consumption behavior: Influencing factors, related theories and intervention strategies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 399-412.
    11. Zhang, Guoqiang & Guo, Jifeng, 2020. "A novel ensemble method for hourly residential electricity consumption forecasting by imaging time series," Energy, Elsevier, vol. 203(C).
    12. repec:dau:papers:123456789/8180 is not listed on IDEAS
    13. Alberini, Anna & Gans, Will & Velez-Lopez, Daniel, 2011. "Residential Consumption of Gas and Electricity in the U.S.: The Role of Prices and Income," Sustainable Development Papers 99637, Fondazione Eni Enrico Mattei (FEEM).
    14. Xiao, Jin & Li, Yuxi & Xie, Ling & Liu, Dunhu & Huang, Jing, 2018. "A hybrid model based on selective ensemble for energy consumption forecasting in China," Energy, Elsevier, vol. 159(C), pages 534-546.
    15. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    16. Jiang, Weiheng & Wu, Xiaogang & Gong, Yi & Yu, Wanxin & Zhong, Xinhui, 2020. "Holt–Winters smoothing enhanced by fruit fly optimization algorithm to forecast monthly electricity consumption," Energy, Elsevier, vol. 193(C).
    17. Shen, Meng & Lu, Yujie & Wei, Kua Harn & Cui, Qingbin, 2020. "Prediction of household electricity consumption and effectiveness of concerted intervention strategies based on occupant behaviour and personality traits," Renewable and Sustainable Energy Reviews, Elsevier, vol. 127(C).
    18. Ferbar Tratar, Liljana & Strmčnik, Ervin, 2016. "The comparison of Holt–Winters method and Multiple regression method: A case study," Energy, Elsevier, vol. 109(C), pages 266-276.
    19. Xiong, Xin & Hu, Xi & Guo, Huan, 2021. "A hybrid optimized grey seasonal variation index model improved by whale optimization algorithm for forecasting the residential electricity consumption," Energy, Elsevier, vol. 234(C).
    20. Dagher, Leila & Bird, Lori & Heeter, Jenny, 2017. "Residential green power demand in the United States," Renewable Energy, Elsevier, vol. 114(PB), pages 1062-1068.
    21. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    22. Cao, Guohua & Wu, Lijuan, 2016. "Support vector regression with fruit fly optimization algorithm for seasonal electricity consumption forecasting," Energy, Elsevier, vol. 115(P1), pages 734-745.
    23. Zhu, L. & Li, M.S. & Wu, Q.H. & Jiang, L., 2015. "Short-term natural gas demand prediction based on support vector regression with false neighbours filtered," Energy, Elsevier, vol. 80(C), pages 428-436.
    24. Wang, Jianjun & Li, Li & Niu, Dongxiao & Tan, Zhongfu, 2012. "An annual load forecasting model based on support vector regression with differential evolution algorithm," Applied Energy, Elsevier, vol. 94(C), pages 65-70.
    25. Yu, Lean & Zhao, Yaqing & Tang, Ling & Yang, Zebin, 2019. "Online big data-driven oil consumption forecasting with Google trends," International Journal of Forecasting, Elsevier, vol. 35(1), pages 213-223.
    26. Sun, Wei & Zhang, Chongchong, 2018. "Analysis and forecasting of the carbon price using multi—resolution singular value decomposition and extreme learning machine optimized by adaptive whale optimization algorithm," Applied Energy, Elsevier, vol. 231(C), pages 1354-1371.
    27. Liwen Ling & Dabin Zhang & Shanying Chen & Amin W. Mugera, 2020. "Can online search data improve the forecast accuracy of pork price in China?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(4), pages 671-686, July.
    28. Li, Jingjing & Tang, Ling & Wang, Shouyang, 2020. "Forecasting crude oil price with multilingual search engine data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 551(C).
    29. Hekkenberg, M. & Benders, R.M.J. & Moll, H.C. & Schoot Uiterkamp, A.J.M., 2009. "Indications for a changing electricity demand pattern: The temperature dependence of electricity demand in the Netherlands," Energy Policy, Elsevier, vol. 37(4), pages 1542-1551, April.
    30. Xu, Hua & Wang, Minggang & Jiang, Shumin & Yang, Weiguo, 2020. "Carbon price forecasting with complex network and extreme learning machine," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 545(C).
    31. Liu, Che & Sun, Bo & Zhang, Chenghui & Li, Fan, 2020. "A hybrid prediction model for residential electricity consumption using holt-winters and extreme learning machine," Applied Energy, Elsevier, vol. 275(C).
    32. Lu, Quanying & Li, Yuze & Chai, Jian & Wang, Shouyang, 2020. "Crude oil price analysis and forecasting: A perspective of “new triangle”," Energy Economics, Elsevier, vol. 87(C).
    33. de Oliveira, Erick Meira & Cyrino Oliveira, Fernando Luiz, 2018. "Forecasting mid-long term electric energy consumption through bagging ARIMA and exponential smoothing methods," Energy, Elsevier, vol. 144(C), pages 776-788.
    34. Wang, Lin & Hu, Huanling & Ai, Xue-Yi & Liu, Hua, 2018. "Effective electricity energy consumption forecasting using echo state network improved by differential evolution algorithm," Energy, Elsevier, vol. 153(C), pages 801-815.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xu, Jiayi & Zhang, Xiao-Bing & Liu, Yang, 2024. "Asymmetric search behavior for gasoline prices: Evidence from the Chinese gasoline market," International Review of Economics & Finance, Elsevier, vol. 89(PB), pages 699-712.
    2. Liangfeng Zou & Yuanyuan Zha & Yuqing Diao & Chi Tang & Wenquan Gu & Dongguo Shao, 2023. "Coupling the Causal Inference and Informer Networks for Short-term Forecasting in Irrigation Water Usage," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 37(1), pages 427-449, January.
    3. Jiang, Hongyan & Cheng, Feng & Wu, Cong & Fang, Dianjun & Zeng, Yuhai, 2024. "A multi-period-sequential-index combination method for short-term prediction of small sample data," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    4. Saâdaoui, Foued & Ben Jabeur, Sami, 2023. "Analyzing the influence of geopolitical risks on European power prices using a multiresolution causal neural network," Energy Economics, Elsevier, vol. 124(C).
    5. Changping Li & Xiaohui Wang & Longchen Duan & Bo Lei, 2022. "Study on a Discharge Circuit Prediction Model of High-Voltage Electro-Pulse Boring Based on Bayesian Fusion," Energies, MDPI, vol. 15(10), pages 1-12, May.
    6. Pesantez, Jorge E. & Li, Binbin & Lee, Christopher & Zhao, Zhizhen & Butala, Mark & Stillwell, Ashlynn S., 2023. "A Comparison Study of Predictive Models for Electricity Demand in a Diverse Urban Environment," Energy, Elsevier, vol. 283(C).
    7. Atif Maqbool Khan & Artur Wyrwa, 2024. "A Survey of Quantitative Techniques in Electricity Consumption—A Global Perspective," Energies, MDPI, vol. 17(19), pages 1-38, September.
    8. Ren, Fukang & Wei, Ziqing & Zhai, Xiaoqiang, 2022. "A review on the integration and optimization of distributed energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 162(C).
    9. Hamza Mubarak & Mohammad J. Sanjari & Sascha Stegen & Abdallah Abdellatif, 2023. "Improved Active and Reactive Energy Forecasting Using a Stacking Ensemble Approach: Steel Industry Case Study," Energies, MDPI, vol. 16(21), pages 1-32, October.
    10. Gao, Tian & Niu, Dongxiao & Ji, Zhengsen & Sun, Lijie, 2022. "Mid-term electricity demand forecasting using improved variational mode decomposition and extreme learning machine optimized by sparrow search algorithm," Energy, Elsevier, vol. 261(PB).
    11. Sheng, Yujie & Zeng, Hongtai & Guo, Qinglai & Yu, Yang & Li, Qiang, 2023. "Impact of customer portrait information superiority on competitive pricing of EV fast-charging stations," Applied Energy, Elsevier, vol. 348(C).
    12. Wang, Jianzhou & Xing, Qianyi & Zeng, Bo & Zhao, Weigang, 2022. "An ensemble forecasting system for short-term power load based on multi-objective optimizer and fuzzy granulation," Applied Energy, Elsevier, vol. 327(C).
    13. Du, Pei & Guo, Ju'e & Sun, Shaolong & Wang, Shouyang & Wu, Jing, 2022. "A novel two-stage seasonal grey model for residential electricity consumption forecasting," Energy, Elsevier, vol. 258(C).
    14. Houben, Nikolaus & Cosic, Armin & Stadler, Michael & Mansoor, Muhammad & Zellinger, Michael & Auer, Hans & Ajanovic, Amela & Haas, Reinhard, 2023. "Optimal dispatch of a multi-energy system microgrid under uncertainty: A renewable energy community in Austria," Applied Energy, Elsevier, vol. 337(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Du, Pei & Guo, Ju'e & Sun, Shaolong & Wang, Shouyang & Wu, Jing, 2022. "A novel two-stage seasonal grey model for residential electricity consumption forecasting," Energy, Elsevier, vol. 258(C).
    2. Tang, Tao & Jiang, Weiheng & Zhang, Hui & Nie, Jiangtian & Xiong, Zehui & Wu, Xiaogang & Feng, Wenjiang, 2022. "GM(1,1) based improved seasonal index model for monthly electricity consumption forecasting," Energy, Elsevier, vol. 252(C).
    3. Park, Sungjun & Kim, Jinsoo, 2018. "The effect of interest in renewable energy on US household electricity consumption: An analysis using Google Trends data," Renewable Energy, Elsevier, vol. 127(C), pages 1004-1010.
    4. Jiang, Hongyan & Cheng, Feng & Wu, Cong & Fang, Dianjun & Zeng, Yuhai, 2024. "A multi-period-sequential-index combination method for short-term prediction of small sample data," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    5. Gong, Xue & Ye, Xin & Zhang, Weiguo & Zhang, Yue, 2023. "Predicting energy futures high-frequency volatility using technical indicators: The role of interaction," Energy Economics, Elsevier, vol. 119(C).
    6. Desiderio Romero-Jordán & Pablo del Río & Cristina Peñasco, 2014. "Household electricity demand in Spanish regions. Public policy implications," Working Papers 2014/24, Institut d'Economia de Barcelona (IEB).
    7. Hu, Huanling & Wang, Lin & Peng, Lu & Zeng, Yu-Rong, 2020. "Effective energy consumption forecasting using enhanced bagged echo state network," Energy, Elsevier, vol. 193(C).
    8. Amber, K.P. & Ahmad, R. & Aslam, M.W. & Kousar, A. & Usman, M. & Khan, M.S., 2018. "Intelligent techniques for forecasting electricity consumption of buildings," Energy, Elsevier, vol. 157(C), pages 886-893.
    9. Xue Gong & Weiguo Zhang & Weijun Xu & Zhe Li, 2022. "Uncertainty index and stock volatility prediction: evidence from international markets," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-44, December.
    10. Desiderio Romero-Jordán & Pablo del Río & Cristina Peñasco, 2014. "Household electricity demand in Spanish regions. Public policy implications," Working Papers 2014/24, Institut d'Economia de Barcelona (IEB).
    11. Michalski, Lachlan & Low, Rand Kwong Yew, 2024. "Determinants of corporate credit ratings: Does ESG matter?," International Review of Financial Analysis, Elsevier, vol. 94(C).
    12. Zhang, Meng & Guo, Huan & Sun, Ming & Liu, Sifeng & Forrest, Jeffrey, 2022. "A novel flexible grey multivariable model and its application in forecasting energy consumption in China," Energy, Elsevier, vol. 239(PE).
    13. Chabouni, Naima & Belarbi, Yacine & Benhassine, Wassim, 2020. "Electricity load dynamics, temperature and seasonality Nexus in Algeria," Energy, Elsevier, vol. 200(C).
    14. Hu, Huanling & Wang, Lin & Lv, Sheng-Xiang, 2020. "Forecasting energy consumption and wind power generation using deep echo state network," Renewable Energy, Elsevier, vol. 154(C), pages 598-613.
    15. Colak, Gonul & Fu, Mengchuan & Hasan, Iftekhar, 2022. "On modeling IPO failure risk," Economic Modelling, Elsevier, vol. 109(C).
    16. Paul Geertsema & Helen Lu, 2023. "Relative Valuation with Machine Learning," Journal of Accounting Research, Wiley Blackwell, vol. 61(1), pages 329-376, March.
    17. Amini, Shahram & Elmore, Ryan & Öztekin, Özde & Strauss, Jack, 2021. "Can machines learn capital structure dynamics?," Journal of Corporate Finance, Elsevier, vol. 70(C).
    18. Liu, Che & Li, Fan & Zhang, Chenghui & Sun, Bo & Zhang, Guanguan, 2023. "A day-ahead prediction method for high-resolution electricity consumption in residential units," Energy, Elsevier, vol. 265(C).
    19. Xiong, Xin & Hu, Xi & Guo, Huan, 2021. "A hybrid optimized grey seasonal variation index model improved by whale optimization algorithm for forecasting the residential electricity consumption," Energy, Elsevier, vol. 234(C).
    20. Jiang, Weiheng & Wu, Xiaogang & Gong, Yi & Yu, Wanxin & Zhong, Xinhui, 2020. "Holt–Winters smoothing enhanced by fruit fly optimization algorithm to forecast monthly electricity consumption," Energy, Elsevier, vol. 193(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:300:y:2021:i:c:s0306261921007947. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.