IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i13p5099-d1184903.html
   My bibliography  Save this article

A Reinforcement Learning Approach for Ensemble Machine Learning Models in Peak Electricity Forecasting

Author

Listed:
  • Warut Pannakkong

    (School of Manufacturing Systems and Mechanical Engineering, Sirindhorn International Institute of Technology, Pathum Thani 12120, Thailand)

  • Vu Thanh Vinh

    (School of Manufacturing Systems and Mechanical Engineering, Sirindhorn International Institute of Technology, Pathum Thani 12120, Thailand)

  • Nguyen Ngoc Minh Tuyen

    (School of Manufacturing Systems and Mechanical Engineering, Sirindhorn International Institute of Technology, Pathum Thani 12120, Thailand)

  • Jirachai Buddhakulsomsiri

    (School of Manufacturing Systems and Mechanical Engineering, Sirindhorn International Institute of Technology, Pathum Thani 12120, Thailand)

Abstract

Electricity peak load forecasting plays an important role in electricity generation capacity planning to ensure reliable power supplies. To achieve high forecast accuracy, multiple machine learning models have been implemented to forecast the monthly peak load in Thailand over the past few years, yielding promising results. One approach to further improve forecast accuracy is to effectively select the most accurate forecast value for each period from among the forecast values generated by these models. This article presents a novel reinforcement learning approach using the double deep Q-network (Double DQN), which acts as a model selector from a pool of available models. The monthly electricity peak load data of Thailand from 2004 to 2017 are used to demonstrate the effectiveness of the proposed method. A hyperparameter tuning methodology using a fractional factorial design is implemented to significantly reduce the number of required experimental runs. The results indicate that the proposed selection model using Double DQN outperforms all tested individual machine learning models in terms of mean square error.

Suggested Citation

  • Warut Pannakkong & Vu Thanh Vinh & Nguyen Ngoc Minh Tuyen & Jirachai Buddhakulsomsiri, 2023. "A Reinforcement Learning Approach for Ensemble Machine Learning Models in Peak Electricity Forecasting," Energies, MDPI, vol. 16(13), pages 1-20, July.
  • Handle: RePEc:gam:jeners:v:16:y:2023:i:13:p:5099-:d:1184903
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/13/5099/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/16/13/5099/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fumo, Nelson & Rafe Biswas, M.A., 2015. "Regression analysis for prediction of residential energy consumption," Renewable and Sustainable Energy Reviews, Elsevier, vol. 47(C), pages 332-343.
    2. Perera, A.T.D. & Wickramasinghe, P.U. & Nik, Vahid M. & Scartezzini, Jean-Louis, 2020. "Introducing reinforcement learning to the energy system design process," Applied Energy, Elsevier, vol. 262(C).
    3. Saxena, Harshit & Aponte, Omar & McConky, Katie T., 2019. "A hybrid machine learning model for forecasting a billing period’s peak electric load days," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1288-1303.
    4. Liu, Hui & Yu, Chengqing & Wu, Haiping & Duan, Zhu & Yan, Guangxi, 2020. "A new hybrid ensemble deep reinforcement learning model for wind speed short term forecasting," Energy, Elsevier, vol. 202(C).
    5. Rallapalli, Srinivasa Rao & Ghosh, Sajal, 2012. "Forecasting monthly peak demand of electricity in India—A critique," Energy Policy, Elsevier, vol. 45(C), pages 516-520.
    6. Sheffrin, Anjali & Yoshimura, Henry & LaPlante, David & Neenan, Bernard, 2008. "Harnessing the Power of Demand," The Electricity Journal, Elsevier, vol. 21(2), pages 39-50, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shao, Zhen & Chao, Fu & Yang, Shan-Lin & Zhou, Kai-Le, 2017. "A review of the decomposition methodology for extracting and identifying the fluctuation characteristics in electricity demand forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 75(C), pages 123-136.
    2. Kim, Sunwoo & Choi, Yechan & Park, Joungho & Adams, Derrick & Heo, Seongmin & Lee, Jay H., 2024. "Multi-period, multi-timescale stochastic optimization model for simultaneous capacity investment and energy management decisions for hybrid Micro-Grids with green hydrogen production under uncertainty," Renewable and Sustainable Energy Reviews, Elsevier, vol. 190(PA).
    3. Chen, Han & Huang, Ye & Shen, Huizhong & Chen, Yilin & Ru, Muye & Chen, Yuanchen & Lin, Nan & Su, Shu & Zhuo, Shaojie & Zhong, Qirui & Wang, Xilong & Liu, Junfeng & Li, Bengang & Tao, Shu, 2016. "Modeling temporal variations in global residential energy consumption and pollutant emissions," Applied Energy, Elsevier, vol. 184(C), pages 820-829.
    4. Wang, Zhengchao & Perera, A.T.D., 2020. "Integrated platform to design robust energy internet," Applied Energy, Elsevier, vol. 269(C).
    5. Mardones, Cristian, 2021. "Ex-post evaluation and cost-benefit analysis of a heater replacement program implemented in southern Chile," Energy, Elsevier, vol. 227(C).
    6. Liu, Che & Sun, Bo & Zhang, Chenghui & Li, Fan, 2020. "A hybrid prediction model for residential electricity consumption using holt-winters and extreme learning machine," Applied Energy, Elsevier, vol. 275(C).
    7. Liang, Tao & Zhao, Qing & Lv, Qingzhao & Sun, Hexu, 2021. "A novel wind speed prediction strategy based on Bi-LSTM, MOOFADA and transfer learning for centralized control centers," Energy, Elsevier, vol. 230(C).
    8. Anna Kipping & Erik Trømborg, 2017. "Modeling Aggregate Hourly Energy Consumption in a Regional Building Stock," Energies, MDPI, vol. 11(1), pages 1-20, December.
    9. Liu, Hui & Duan, Zhu & Chen, Chao, 2020. "Wind speed big data forecasting using time-variant multi-resolution ensemble model with clustering auto-encoder," Applied Energy, Elsevier, vol. 280(C).
    10. Bingjie Jin & Guihua Zeng & Zhilin Lu & Hongqiao Peng & Shuxin Luo & Xinhe Yang & Haojun Zhu & Mingbo Liu, 2022. "Hybrid LSTM–BPNN-to-BPNN Model Considering Multi-Source Information for Forecasting Medium- and Long-Term Electricity Peak Load," Energies, MDPI, vol. 15(20), pages 1-20, October.
    11. Acikgoz, Hakan & Budak, Umit & Korkmaz, Deniz & Yildiz, Ceyhun, 2021. "WSFNet: An efficient wind speed forecasting model using channel attention-based densely connected convolutional neural network," Energy, Elsevier, vol. 233(C).
    12. Gholami, M. & Barbaresi, A. & Torreggiani, D. & Tassinari, P., 2020. "Upscaling of spatial energy planning, phases, methods, and techniques: A systematic review through meta-analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 132(C).
    13. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    14. Zhang, Lifang & Wang, Jianzhou & Niu, Xinsong & Liu, Zhenkun, 2021. "Ensemble wind speed forecasting with multi-objective Archimedes optimization algorithm and sub-model selection," Applied Energy, Elsevier, vol. 301(C).
    15. Rafael de Arce & Ramón Mahía, 2019. "Drivers of Electricity Poverty in Spanish Dwellings: A Quantile Regression Approach," Energies, MDPI, vol. 12(11), pages 1-18, May.
    16. Chou, Jui-Sheng & Tran, Duc-Son, 2018. "Forecasting energy consumption time series using machine learning techniques based on usage patterns of residential householders," Energy, Elsevier, vol. 165(PB), pages 709-726.
    17. Qu, Zhijian & Xu, Juan & Wang, Zixiao & Chi, Rui & Liu, Hanxin, 2021. "Prediction of electricity generation from a combined cycle power plant based on a stacking ensemble and its hyperparameter optimization with a grid-search method," Energy, Elsevier, vol. 227(C).
    18. Pesantez, Jorge E. & Li, Binbin & Lee, Christopher & Zhao, Zhizhen & Butala, Mark & Stillwell, Ashlynn S., 2023. "A Comparison Study of Predictive Models for Electricity Demand in a Diverse Urban Environment," Energy, Elsevier, vol. 283(C).
    19. Zeng, Sheng & Su, Bin & Zhang, Minglong & Gao, Yuan & Liu, Jun & Luo, Song & Tao, Qingmei, 2021. "Analysis and forecast of China's energy consumption structure," Energy Policy, Elsevier, vol. 159(C).
    20. Mastrucci, Alessio & Marvuglia, Antonino & Leopold, Ulrich & Benetto, Enrico, 2017. "Life Cycle Assessment of building stocks from urban to transnational scales: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 74(C), pages 316-332.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:13:p:5099-:d:1184903. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.