IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v352y2023ics0306261923013533.html
   My bibliography  Save this article

Event-driven forecasting of wholesale electricity price and frequency regulation price using machine learning algorithms

Author

Listed:
  • Sai, Wei
  • Pan, Zehua
  • Liu, Siyu
  • Jiao, Zhenjun
  • Zhong, Zheng
  • Miao, Bin
  • Chan, Siew Hwa

Abstract

The wholesale electricity market is composed of real-time market and procurement. Since the fully liberalization of the energy market in Singapore in 2018, competition among the market participants has become intensive. Therefore, the forecast of the electricity price, including both Uniform Singapore Energy Price (USEP) and regulation price (REG), is essential for market participants to trade at the best possible price. This study proposes an event-driven forecast model to provide a real-time automatical price forecast of the wholesale electricity price using the cutting-edge regression tree ensembled algorithm, XGBoost. The model is triggered every half of an hour by the dispatch of the latest electricity price, which will be also used as the input together with other necessary training data from the historical price database. The training is finished within 1–2 min and the model makes the predictions on prices of the next 6 h. A better prediction has been demonstrated benchmarked to the forecast provided commercially by Energy Market Company. The forecast model only takes commercially available data as the input and is embedded with messaging broker, enabling online collaboration of different modules. The model is readily implemented, and thus can serve as an effective supplementary tool in virtual power plant operation with a higher renewable energy penetration in the future.

Suggested Citation

  • Sai, Wei & Pan, Zehua & Liu, Siyu & Jiao, Zhenjun & Zhong, Zheng & Miao, Bin & Chan, Siew Hwa, 2023. "Event-driven forecasting of wholesale electricity price and frequency regulation price using machine learning algorithms," Applied Energy, Elsevier, vol. 352(C).
    • Handle: RePEc:eee:appene:v:352:y:2023:i:c:s0306261923013533
    DOI: 10.1016/j.apenergy.2023.121989
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261923013533
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2023.121989?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Faheem Jan & Ismail Shah & Sajid Ali, 2022. "Short-Term Electricity Prices Forecasting Using Functional Time Series Analysis," Energies, MDPI, vol. 15(9), pages 1-15, May.
    2. Yildirim, Zekeriya & Arifli, Arif, 2021. "Oil price shocks, exchange rate and macroeconomic fluctuations in a small oil-exporting economy," Energy, Elsevier, vol. 219(C).
    3. van der Stelt, Sander & AlSkaif, Tarek & van Sark, Wilfried, 2018. "Techno-economic analysis of household and community energy storage for residential prosumers with smart appliances," Applied Energy, Elsevier, vol. 209(C), pages 266-276.
    4. Hasankhani, Arezoo & Hakimi, Seyed Mehdi, 2021. "Stochastic energy management of smart microgrid with intermittent renewable energy resources in electricity market," Energy, Elsevier, vol. 219(C).
    5. Pusceddu, Elian & Zakeri, Behnam & Castagneto Gissey, Giorgio, 2021. "Synergies between energy arbitrage and fast frequency response for battery energy storage systems," Applied Energy, Elsevier, vol. 283(C).
    6. Fabra, Natalia & Motta, Massimo & Peitz, Martin, 2022. "Learning from electricity markets: How to design a resilience strategy," Energy Policy, Elsevier, vol. 168(C).
    7. Frew, Bethany & Brinkman, Greg & Denholm, Paul & Narwade, Vinayak & Stephen, Gord & Bloom, Aaron & Lau, Jessica, 2021. "Impact of operating reserve rules on electricity prices with high penetrations of renewable energy," Energy Policy, Elsevier, vol. 156(C).
    8. Rafal Weron, 2014. "A review of electricity price forecasting: The past, the present and the future," HSC Research Reports HSC/14/02, Hugo Steinhaus Center, Wroclaw University of Technology.
    9. Cao, K.H. & Qi, H.S. & Tsai, C.H. & Woo, C.K. & Zarnikau, J., 2021. "Energy trading efficiency in the US Midcontinent electricity markets," Applied Energy, Elsevier, vol. 302(C).
    10. Hu, Yu & Armada, Miguel & Jesús Sánchez, María, 2022. "Potential utilization of battery energy storage systems (BESS) in the major European electricity markets," Applied Energy, Elsevier, vol. 322(C).
    11. Atems, Bebonchu & Mette, Jehu & Lin, Guoyu & Madraki, Golshan, 2023. "Estimating and forecasting the impact of nonrenewable energy prices on US renewable energy consumption," Energy Policy, Elsevier, vol. 173(C).
    12. Ismail Shah & Faheem Jan & Sajid Ali & Tahir Mehmood, 2022. "Functional Data Approach for Short-Term Electricity Demand Forecasting," Mathematical Problems in Engineering, Hindawi, vol. 2022, pages 1-14, June.
    13. Harrold, Daniel J.B. & Cao, Jun & Fan, Zhong, 2022. "Data-driven battery operation for energy arbitrage using rainbow deep reinforcement learning," Energy, Elsevier, vol. 238(PC).
    14. Mallapragada, Dharik S. & Sepulveda, Nestor A. & Jenkins, Jesse D., 2020. "Long-run system value of battery energy storage in future grids with increasing wind and solar generation," Applied Energy, Elsevier, vol. 275(C).
    15. Yu Hu & Miguel Armada & Maria Jesus Sanchez, 2021. "Potential utilization of Battery Energy Storage Systems (BESS) in the major European electricity markets," Papers 2112.09816, arXiv.org, revised Jun 2022.
    16. Panapakidis, Ioannis P. & Dagoumas, Athanasios S., 2016. "Day-ahead electricity price forecasting via the application of artificial neural network based models," Applied Energy, Elsevier, vol. 172(C), pages 132-151.
    17. Mayer, Klaus & Trück, Stefan, 2018. "Electricity markets around the world," Journal of Commodity Markets, Elsevier, vol. 9(C), pages 77-100.
    18. Wang, Qi & Zhang, Chunyu & Ding, Yi & Xydis, George & Wang, Jianhui & Østergaard, Jacob, 2015. "Review of real-time electricity markets for integrating Distributed Energy Resources and Demand Response," Applied Energy, Elsevier, vol. 138(C), pages 695-706.
    19. Pan, Zehua & Shen, Jian & Wang, Jingyi & Xu, Xinhai & Chan, Wei Ping & Liu, Siyu & Zhou, Yexin & Yan, Zilin & Jiao, Zhenjun & Lim, Teik-Thye & Zhong, Zheng, 2022. "Thermodynamic analyses of a standalone diesel-fueled distributed power generation system based on solid oxide fuel cells," Applied Energy, Elsevier, vol. 308(C).
    20. Nikpour, Ahmad & Nateghi, Abolfazl & Shafie-khah, Miadreza & Catalão, João P.S., 2021. "Day-ahead optimal bidding of microgrids considering uncertainties of price and renewable energy resources," Energy, Elsevier, vol. 227(C).
    21. Wen, Jun & Zhao, Xin-Xin & Chang, Chun-Ping, 2021. "The impact of extreme events on energy price risk," Energy Economics, Elsevier, vol. 99(C).
    22. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    23. Olabi, A.G. & Onumaegbu, C. & Wilberforce, Tabbi & Ramadan, Mohamad & Abdelkareem, Mohammad Ali & Al – Alami, Abdul Hai, 2021. "Critical review of energy storage systems," Energy, Elsevier, vol. 214(C).
    24. Hermans, Mathias & Bruninx, Kenneth & Delarue, Erik, 2020. "Impact of generator start-up lead times on short-term scheduling with high shares of renewables," Applied Energy, Elsevier, vol. 268(C).
    25. Sergey Voronin & Jarmo Partanen, 2013. "Price Forecasting in the Day-Ahead Energy Market by an Iterative Method with Separate Normal Price and Price Spike Frameworks," Energies, MDPI, vol. 6(11), pages 1-24, November.
    26. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    27. Tschora, Léonard & Pierre, Erwan & Plantevit, Marc & Robardet, Céline, 2022. "Electricity price forecasting on the day-ahead market using machine learning," Applied Energy, Elsevier, vol. 313(C).
    28. Nikolaidis, Pavlos & Poullikkas, Andreas, 2021. "A novel cluster-based spinning reserve dynamic model for wind and PV power reinforcement," Energy, Elsevier, vol. 234(C).
    29. Stawska, Anna & Romero, Natalia & de Weerdt, Mathijs & Verzijlbergh, Remco, 2021. "Demand response: For congestion management or for grid balancing?," Energy Policy, Elsevier, vol. 148(PA).
    30. Koolen, Derck & Huisman, Ronald & Ketter, Wolfgang, 2022. "Decision strategies in sequential power markets with renewable energy," Energy Policy, Elsevier, vol. 167(C).
    31. Koltsaklis, Nikolaos E. & Dagoumas, Athanasios S., 2018. "Incorporating unit commitment aspects to the European electricity markets algorithm: An optimization model for the joint clearing of energy and reserve markets," Applied Energy, Elsevier, vol. 231(C), pages 235-258.
    32. Chen, Lingen & Yang, Bo & Feng, Huijun & Ge, Yanlin & Xia, Shaojun, 2020. "Performance optimization of an open simple-cycle gas turbine combined cooling, heating and power plant driven by basic oxygen furnace gas in China's steelmaking plants," Energy, Elsevier, vol. 203(C).
    33. Léonard Tschora & Erwan Pierre & Marc Plantevit & Céline Robardet, 2022. "Electricity price forecasting on the day-ahead market using machine learning," Post-Print hal-03621974, HAL.
    34. Agrawal, Rahul Kumar & Muchahary, Frankle & Tripathi, Madan Mohan, 2019. "Ensemble of relevance vector machines and boosted trees for electricity price forecasting," Applied Energy, Elsevier, vol. 250(C), pages 540-548.
    35. Khojasteh, Meysam & Faria, Pedro & Vale, Zita, 2022. "A robust model for aggregated bidding of energy storages and wind resources in the joint energy and reserve markets," Energy, Elsevier, vol. 238(PB).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nie, Ying & Li, Ping & Wang, Jianzhou & Zhang, Lifang, 2024. "A novel multivariate electrical price bi-forecasting system based on deep learning, a multi-input multi-output structure and an operator combination mechanism," Applied Energy, Elsevier, vol. 366(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chai, Shanglei & Li, Qiang & Abedin, Mohammad Zoynul & Lucey, Brian M., 2024. "Forecasting electricity prices from the state-of-the-art modeling technology and the price determinant perspectives," Research in International Business and Finance, Elsevier, vol. 67(PA).
    2. Loizidis, Stylianos & Kyprianou, Andreas & Georghiou, George E., 2024. "Electricity market price forecasting using ELM and Bootstrap analysis: A case study of the German and Finnish Day-Ahead markets," Applied Energy, Elsevier, vol. 363(C).
    3. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    4. Elmore, Clay T. & Dowling, Alexander W., 2021. "Learning spatiotemporal dynamics in wholesale energy markets with dynamic mode decomposition," Energy, Elsevier, vol. 232(C).
    5. Daniel Manfre Jaimes & Manuel Zamudio López & Hamidreza Zareipour & Mike Quashie, 2023. "A Hybrid Model for Multi-Day-Ahead Electricity Price Forecasting considering Price Spikes," Forecasting, MDPI, vol. 5(3), pages 1-23, July.
    6. Madadkhani, Shiva & Ikonnikova, Svetlana, 2024. "Toward high-resolution projection of electricity prices: A machine learning approach to quantifying the effects of high fuel and CO2 prices," Energy Economics, Elsevier, vol. 129(C).
    7. Halužan, Marko & Verbič, Miroslav & Zorić, Jelena, 2020. "Performance of alternative electricity price forecasting methods: Findings from the Greek and Hungarian power exchanges," Applied Energy, Elsevier, vol. 277(C).
    8. Li, Wei & Becker, Denis Mike, 2021. "Day-ahead electricity price prediction applying hybrid models of LSTM-based deep learning methods and feature selection algorithms under consideration of market coupling," Energy, Elsevier, vol. 237(C).
    9. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    10. Billé, Anna Gloria & Gianfreda, Angelica & Del Grosso, Filippo & Ravazzolo, Francesco, 2023. "Forecasting electricity prices with expert, linear, and nonlinear models," International Journal of Forecasting, Elsevier, vol. 39(2), pages 570-586.
    11. Bartosz Uniejewski, 2024. "Regularization for electricity price forecasting," Papers 2404.03968, arXiv.org.
    12. Karol Pilot & Alicja Ganczarek-Gamrot & Krzysztof Kania, 2024. "Dealing with Anomalies in Day-Ahead Market Prediction Using Machine Learning Hybrid Model," Energies, MDPI, vol. 17(17), pages 1-20, September.
    13. Bhatia, Kushagra & Mittal, Rajat & Varanasi, Jyothi & Tripathi, M.M., 2021. "An ensemble approach for electricity price forecasting in markets with renewable energy resources," Utilities Policy, Elsevier, vol. 70(C).
    14. Hasnain Iftikhar & Josue E. Turpo-Chaparro & Paulo Canas Rodrigues & Javier Linkolk López-Gonzales, 2023. "Forecasting Day-Ahead Electricity Prices for the Italian Electricity Market Using a New Decomposition—Combination Technique," Energies, MDPI, vol. 16(18), pages 1-23, September.
    15. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "Understanding intraday electricity markets: Variable selection and very short-term price forecasting using LASSO," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1533-1547.
    16. Ehsani, Behdad & Pineau, Pierre-Olivier & Charlin, Laurent, 2024. "Price forecasting in the Ontario electricity market via TriConvGRU hybrid model: Univariate vs. multivariate frameworks," Applied Energy, Elsevier, vol. 359(C).
    17. Gabrielli, Paolo & Wüthrich, Moritz & Blume, Steffen & Sansavini, Giovanni, 2022. "Data-driven modeling for long-term electricity price forecasting," Energy, Elsevier, vol. 244(PB).
    18. Nametala, Ciniro Aparecido Leite & Faria, Wandry Rodrigues & Lage, Guilherme Guimarães & Pereira, Benvindo Rodrigues, 2023. "Analysis of hourly price granularity implementation in the Brazilian deregulated electricity contracting environment," Utilities Policy, Elsevier, vol. 81(C).
    19. Sheybanivaziri, Samaneh & Le Dréau, Jérôme & Kazmi, Hussain, 2024. "Forecasting price spikes in day-ahead electricity markets: techniques, challenges, and the road ahead," Discussion Papers 2024/1, Norwegian School of Economics, Department of Business and Management Science.
    20. Kahvecioğlu, Gökçe & Morton, David P. & Wagner, Michael J., 2022. "Dispatch optimization of a concentrating solar power system under uncertain solar irradiance and energy prices," Applied Energy, Elsevier, vol. 326(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:352:y:2023:i:c:s0306261923013533. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.