IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v17y2024i17p4436-d1471177.html
   My bibliography  Save this article

Dealing with Anomalies in Day-Ahead Market Prediction Using Machine Learning Hybrid Model

Author

Listed:
  • Karol Pilot

    (Independent Researcher, 40-287 Katowice, Poland)

  • Alicja Ganczarek-Gamrot

    (Faculty of Informatics and Communication, University of Economics in Katowice, 40-287 Katowice, Poland)

  • Krzysztof Kania

    (Faculty of Informatics and Communication, University of Economics in Katowice, 40-287 Katowice, Poland)

Abstract

Forecasting the electricity market, even in the short term, is a difficult task, due to the nature of this commodity, the lack of storage capacity, and the multiplicity and volatility of factors that influence its price. The sensitivity of the market results in the appearance of anomalies in the market, during which forecasting models often break down. The aim of this paper is to present the possibility of using hybrid machine learning models to forecast the price of electricity, especially when such events occur. It includes the automatic detection of anomalies using three different switch types and two independent forecasting models, one for use during periods of stable markets and the other during periods of anomalies. The results of empirical tests conducted on data from the Polish energy market showed that the proposed solution improves the overall quality of prediction compared to using each model separately and significantly improves the quality of prediction during anomaly periods.

Suggested Citation

  • Karol Pilot & Alicja Ganczarek-Gamrot & Krzysztof Kania, 2024. "Dealing with Anomalies in Day-Ahead Market Prediction Using Machine Learning Hybrid Model," Energies, MDPI, vol. 17(17), pages 1-20, September.
    • Handle: RePEc:gam:jeners:v:17:y:2024:i:17:p:4436-:d:1471177
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/17/17/4436/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/17/17/4436/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gianfreda, Angelica & Ravazzolo, Francesco & Rossini, Luca, 2020. "Comparing the forecasting performances of linear models for electricity prices with high RES penetration," International Journal of Forecasting, Elsevier, vol. 36(3), pages 974-986.
    2. Koopman, Siem Jan & Ooms, Marius & Carnero, M. Angeles, 2007. "Periodic Seasonal Reg-ARFIMAGARCH Models for Daily Electricity Spot Prices," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 16-27, March.
    3. Zhang, Jinliang & Tan, Zhongfu & Wei, Yiming, 2020. "An adaptive hybrid model for short term electricity price forecasting," Applied Energy, Elsevier, vol. 258(C).
    4. Beltrán, Sergio & Castro, Alain & Irizar, Ion & Naveran, Gorka & Yeregui, Imanol, 2022. "Framework for collaborative intelligence in forecasting day-ahead electricity price," Applied Energy, Elsevier, vol. 306(PA).
    5. Maciejowska, Katarzyna & Nitka, Weronika & Weron, Tomasz, 2021. "Enhancing load, wind and solar generation for day-ahead forecasting of electricity prices," Energy Economics, Elsevier, vol. 99(C).
    6. Borovkova, Svetlana & Schmeck, Maren Diane, 2017. "Electricity price modeling with stochastic time change," Energy Economics, Elsevier, vol. 63(C), pages 51-65.
    7. Gulay, Emrah & Duru, Okan, 2020. "Hybrid modeling in the predictive analytics of energy systems and prices," Applied Energy, Elsevier, vol. 268(C).
    8. Kanamura, Takashi & Ohashi, Kazuhiko, 2007. "A structural model for electricity prices with spikes: Measurement of spike risk and optimal policies for hydropower plant operation," Energy Economics, Elsevier, vol. 29(5), pages 1010-1032, September.
    9. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    10. Thilo Meyer-Brandis & Peter Tankov, 2008. "Multi-Factor Jump-Diffusion Models Of Electricity Prices," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 11(05), pages 503-528.
    11. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    12. Hamilton, James D., 1990. "Analysis of time series subject to changes in regime," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 39-70.
    13. Kostrzewski, Maciej & Kostrzewska, Jadwiga, 2019. "Probabilistic electricity price forecasting with Bayesian stochastic volatility models," Energy Economics, Elsevier, vol. 80(C), pages 610-620.
    14. Kim, Sungil & Kim, Heeyoung, 2016. "A new metric of absolute percentage error for intermittent demand forecasts," International Journal of Forecasting, Elsevier, vol. 32(3), pages 669-679.
    15. Janczura, Joanna & Weron, Rafal, 2010. "An empirical comparison of alternate regime-switching models for electricity spot prices," Energy Economics, Elsevier, vol. 32(5), pages 1059-1073, September.
    16. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    17. Agnello, Luca & Castro, Vítor & Hammoudeh, Shawkat & Sousa, Ricardo M., 2020. "Global factors, uncertainty, weather conditions and energy prices: On the drivers of the duration of commodity price cycle phases," Energy Economics, Elsevier, vol. 90(C).
    18. Rafal Weron, 2006. "Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach," HSC Books, Hugo Steinhaus Center, Wroclaw University of Science and Technology, number hsbook0601, December.
    19. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    20. Lago, Jesus & De Ridder, Fjo & De Schutter, Bart, 2018. "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, Elsevier, vol. 221(C), pages 386-405.
    21. Douglas M. Hawkins, 1980. "Critical Values for Identifying Outliers," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 29(1), pages 95-96, March.
    22. Tschora, Léonard & Pierre, Erwan & Plantevit, Marc & Robardet, Céline, 2022. "Electricity price forecasting on the day-ahead market using machine learning," Applied Energy, Elsevier, vol. 313(C).
    23. Léonard Tschora & Erwan Pierre & Marc Plantevit & Céline Robardet, 2022. "Electricity price forecasting on the day-ahead market using machine learning," Post-Print hal-03621974, HAL.
    24. repec:qut:auncer:2012_5 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chai, Shanglei & Li, Qiang & Abedin, Mohammad Zoynul & Lucey, Brian M., 2024. "Forecasting electricity prices from the state-of-the-art modeling technology and the price determinant perspectives," Research in International Business and Finance, Elsevier, vol. 67(PA).
    2. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    3. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Science and Technology.
    4. He Jiang & Yao Dong & Jianzhou Wang, 2024. "Electricity price forecasting using quantile regression averaging with nonconvex regularization," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(6), pages 1859-1879, September.
    5. Madadkhani, Shiva & Ikonnikova, Svetlana, 2024. "Toward high-resolution projection of electricity prices: A machine learning approach to quantifying the effects of high fuel and CO2 prices," Energy Economics, Elsevier, vol. 129(C).
    6. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    7. Lehna, Malte & Scheller, Fabian & Herwartz, Helmut, 2022. "Forecasting day-ahead electricity prices: A comparison of time series and neural network models taking external regressors into account," Energy Economics, Elsevier, vol. 106(C).
    8. Billé, Anna Gloria & Gianfreda, Angelica & Del Grosso, Filippo & Ravazzolo, Francesco, 2023. "Forecasting electricity prices with expert, linear, and nonlinear models," International Journal of Forecasting, Elsevier, vol. 39(2), pages 570-586.
    9. Daniel Manfre Jaimes & Manuel Zamudio López & Hamidreza Zareipour & Mike Quashie, 2023. "A Hybrid Model for Multi-Day-Ahead Electricity Price Forecasting considering Price Spikes," Forecasting, MDPI, vol. 5(3), pages 1-23, July.
    10. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    11. Hilger, Hannes & Witthaut, Dirk & Dahmen, Manuel & Rydin Gorjão, Leonardo & Trebbien, Julius & Cramer, Eike, 2024. "Multivariate scenario generation of day-ahead electricity prices using normalizing flows," Applied Energy, Elsevier, vol. 367(C).
    12. Ehsani, Behdad & Pineau, Pierre-Olivier & Charlin, Laurent, 2024. "Price forecasting in the Ontario electricity market via TriConvGRU hybrid model: Univariate vs. multivariate frameworks," Applied Energy, Elsevier, vol. 359(C).
    13. Grothe, Oliver & Kächele, Fabian & Krüger, Fabian, 2023. "From point forecasts to multivariate probabilistic forecasts: The Schaake shuffle for day-ahead electricity price forecasting," Energy Economics, Elsevier, vol. 120(C).
    14. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    15. Mira Watermeyer & Thomas Mobius & Oliver Grothe & Felix Musgens, 2023. "A hybrid model for day-ahead electricity price forecasting: Combining fundamental and stochastic modelling," Papers 2304.09336, arXiv.org.
    16. Hakan Acaroğlu & Fausto Pedro García Márquez, 2021. "Comprehensive Review on Electricity Market Price and Load Forecasting Based on Wind Energy," Energies, MDPI, vol. 14(22), pages 1-23, November.
    17. Olivares, Kin G. & Challu, Cristian & Marcjasz, Grzegorz & Weron, Rafał & Dubrawski, Artur, 2023. "Neural basis expansion analysis with exogenous variables: Forecasting electricity prices with NBEATSx," International Journal of Forecasting, Elsevier, vol. 39(2), pages 884-900.
    18. Yang, Yifan & Guo, Ju’e & Li, Yi & Zhou, Jiandong, 2024. "Forecasting day-ahead electricity prices with spatial dependence," International Journal of Forecasting, Elsevier, vol. 40(3), pages 1255-1270.
    19. Deniz Kenan Kılıç & Peter Nielsen & Amila Thibbotuwawa, 2024. "Intraday Electricity Price Forecasting via LSTM and Trading Strategy for the Power Market: A Case Study of the West Denmark DK1 Grid Region," Energies, MDPI, vol. 17(12), pages 1-15, June.
    20. Huang, Siwan & Shi, Jianheng & Wang, Baoyue & An, Na & Li, Li & Hou, Xuebing & Wang, Chunsen & Zhang, Xiandong & Wang, Kai & Li, Huilin & Zhang, Sui & Zhong, Ming, 2024. "A hybrid framework for day-ahead electricity spot-price forecasting: A case study in China," Applied Energy, Elsevier, vol. 373(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:17:y:2024:i:17:p:4436-:d:1471177. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.