IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v306y2022ipas0306261921013398.html
   My bibliography  Save this article

Framework for collaborative intelligence in forecasting day-ahead electricity price

Author

Listed:
  • Beltrán, Sergio
  • Castro, Alain
  • Irizar, Ion
  • Naveran, Gorka
  • Yeregui, Imanol

Abstract

Electricity price forecasting in wholesale markets is an essential asset for deciding bidding strategies and operational schedules. The decision making process is limited if no understanding is given on how and why such electricity price points have been forecast. The present article proposes a novel framework that promotes human–machine collaboration in forecasting day-ahead electricity price in wholesale markets. The framework is based on a new model architecture that uses a plethora of statistical and machine learning models, a wide range of exogenous features, a combination of several time series decomposition methods and a collection of time series characteristics based on signal processing and time series analysis methods. The model architecture is supported by open-source automated machine learning platforms that provide a baseline reference used for comparison purposes. The objective of the framework is not only to provide forecasts, but to promote a human-in-the-loop approach by providing a data story based on a collection of model-agnostic methods aimed at interpreting the mechanisms and behavior of the new model architecture and its predictions. The framework has been applied to the Spanish wholesale market. The forecasting results show good accuracy on mean absolute error (1.859, 95% HDI [0.575, 3.924] EUR(MWh)−1) and mean absolute scaled error (0.378, 95% HDI [0.091, 0.934]). Moreover, the framework demonstrates its human-centric capabilities by providing graphical and numeric explanations that augments understanding on the model and its electricity price point forecasts.

Suggested Citation

  • Beltrán, Sergio & Castro, Alain & Irizar, Ion & Naveran, Gorka & Yeregui, Imanol, 2022. "Framework for collaborative intelligence in forecasting day-ahead electricity price," Applied Energy, Elsevier, vol. 306(PA).
  • Handle: RePEc:eee:appene:v:306:y:2022:i:pa:s0306261921013398
    DOI: 10.1016/j.apenergy.2021.118049
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261921013398
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2021.118049?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Milstein, Irena & Tishler, Asher, 2015. "Can price volatility enhance market power? The case of renewable technologies in competitive electricity markets," Resource and Energy Economics, Elsevier, vol. 41(C), pages 70-90.
    2. Umut Ugurlu & Oktay Tas & Aycan Kaya & Ilkay Oksuz, 2018. "The Financial Effect of the Electricity Price Forecasts’ Inaccuracy on a Hydro-Based Generation Company," Energies, MDPI, vol. 11(8), pages 1-19, August.
    3. Green, Richard & Vasilakos, Nicholas, 2010. "Market behaviour with large amounts of intermittent generation," Energy Policy, Elsevier, vol. 38(7), pages 3211-3220, July.
    4. Kenneth Wallis, 2011. "Combining forecasts - forty years later," Applied Financial Economics, Taylor & Francis Journals, vol. 21(1-2), pages 33-41.
    5. Brancucci Martinez-Anido, Carlo & Brinkman, Greg & Hodge, Bri-Mathias, 2016. "The impact of wind power on electricity prices," Renewable Energy, Elsevier, vol. 94(C), pages 474-487.
    6. Knittel, Christopher R. & Roberts, Michael R., 2005. "An empirical examination of restructured electricity prices," Energy Economics, Elsevier, vol. 27(5), pages 791-817, September.
    7. Javier Contreras, 2017. "Forecasting Models of Electricity Prices," Energies, MDPI, vol. 10(2), pages 1-2, January.
    8. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    9. Hibon, Michele & Evgeniou, Theodoros, 2005. "To combine or not to combine: selecting among forecasts and their combinations," International Journal of Forecasting, Elsevier, vol. 21(1), pages 15-24.
    10. Bhatia, Kushagra & Mittal, Rajat & Varanasi, Jyothi & Tripathi, M.M., 2021. "An ensemble approach for electricity price forecasting in markets with renewable energy resources," Utilities Policy, Elsevier, vol. 70(C).
    11. Janczura, Joanna & Trück, Stefan & Weron, Rafał & Wolff, Rodney C., 2013. "Identifying spikes and seasonal components in electricity spot price data: A guide to robust modeling," Energy Economics, Elsevier, vol. 38(C), pages 96-110.
    12. Hsiao, Cheng & Wan, Shui Ki, 2014. "Is there an optimal forecast combination?," Journal of Econometrics, Elsevier, vol. 178(P2), pages 294-309.
    13. Franses, Philip Hans, 2016. "A note on the Mean Absolute Scaled Error," International Journal of Forecasting, Elsevier, vol. 32(1), pages 20-22.
    14. Ketterer, Janina C., 2014. "The impact of wind power generation on the electricity price in Germany," Energy Economics, Elsevier, vol. 44(C), pages 270-280.
    15. Severin Borenstein & James Bushnell, 2015. "The US Electricity Industry After 20 Years of Restructuring," Annual Review of Economics, Annual Reviews, vol. 7(1), pages 437-463, August.
    16. Ghoddusi, Hamed & Creamer, Germán G. & Rafizadeh, Nima, 2019. "Machine learning in energy economics and finance: A review," Energy Economics, Elsevier, vol. 81(C), pages 709-727.
    17. Stan Lipovetsky & Michael Conklin, 2001. "Analysis of regression in game theory approach," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 17(4), pages 319-330, October.
    18. Fang-Fang Li & Zhi-Yu Wang & Xiao Zhao & En Xie & Jun Qiu, 2019. "Decomposition-ANN Methods for Long-Term Discharge Prediction Based on Fisher’s Ordered Clustering with MESA," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 33(9), pages 3095-3110, July.
    19. Aiolfi, Marco & Timmermann, Allan, 2006. "Persistence in forecasting performance and conditional combination strategies," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 31-53.
    20. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    21. Rafal Weron, 2006. "Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach," HSC Books, Hugo Steinhaus Center, Wroclaw University of Technology, number hsbook0601, December.
    22. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    23. Afanasyev, Dmitriy O. & Fedorova, Elena A., 2019. "On the impact of outlier filtering on the electricity price forecasting accuracy," Applied Energy, Elsevier, vol. 236(C), pages 196-210.
    24. Croonenbroeck, Carsten & Hüttel, Silke, 2017. "Quantifying the economic efficiency impact of inaccurate renewable energy price forecasts," Energy, Elsevier, vol. 134(C), pages 767-774.
    25. Nowotarski, Jakub & Raviv, Eran & Trück, Stefan & Weron, Rafał, 2014. "An empirical comparison of alternative schemes for combining electricity spot price forecasts," Energy Economics, Elsevier, vol. 46(C), pages 395-412.
    26. Qin, Quande & Xie, Kangqiang & He, Huangda & Li, Li & Chu, Xianghua & Wei, Yi-Ming & Wu, Teresa, 2019. "An effective and robust decomposition-ensemble energy price forecasting paradigm with local linear prediction," Energy Economics, Elsevier, vol. 83(C), pages 402-414.
    27. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    28. Yang, Zhang & Ce, Li & Lian, Li, 2017. "Electricity price forecasting by a hybrid model, combining wavelet transform, ARMA and kernel-based extreme learning machine methods," Applied Energy, Elsevier, vol. 190(C), pages 291-305.
    29. Agrawal, Rahul Kumar & Muchahary, Frankle & Tripathi, Madan Mohan, 2019. "Ensemble of relevance vector machines and boosted trees for electricity price forecasting," Applied Energy, Elsevier, vol. 250(C), pages 540-548.
    30. Matheus Henrique Dal Molin Ribeiro & Stéfano Frizzo Stefenon & José Donizetti de Lima & Ademir Nied & Viviana Cocco Mariani & Leandro dos Santos Coelho, 2020. "Electricity Price Forecasting Based on Self-Adaptive Decomposition and Heterogeneous Ensemble Learning," Energies, MDPI, vol. 13(19), pages 1-22, October.
    31. Fraunholz, Christoph & Kraft, Emil & Keles, Dogan & Fichtner, Wolf, 2021. "Advanced price forecasting in agent-based electricity market simulation," Applied Energy, Elsevier, vol. 290(C).
    32. Lago, Jesus & De Ridder, Fjo & Vrancx, Peter & De Schutter, Bart, 2018. "Forecasting day-ahead electricity prices in Europe: The importance of considering market integration," Applied Energy, Elsevier, vol. 211(C), pages 890-903.
    33. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anne Carolina Rodrigues Klaar & Stefano Frizzo Stefenon & Laio Oriel Seman & Viviana Cocco Mariani & Leandro dos Santos Coelho, 2023. "Structure Optimization of Ensemble Learning Methods and Seasonal Decomposition Approaches to Energy Price Forecasting in Latin America: A Case Study about Mexico," Energies, MDPI, vol. 16(7), pages 1-17, March.
    2. Vasileios Laitsos & Georgios Vontzos & Dimitrios Bargiotas & Aspassia Daskalopulu & Lefteri H. Tsoukalas, 2024. "Data-Driven Techniques for Short-Term Electricity Price Forecasting through Novel Deep Learning Approaches with Attention Mechanisms," Energies, MDPI, vol. 17(7), pages 1-27, March.
    3. Harri Aaltonen & Seppo Sierla & Ville Kyrki & Mahdi Pourakbari-Kasmaei & Valeriy Vyatkin, 2022. "Bidding a Battery on Electricity Markets and Minimizing Battery Aging Costs: A Reinforcement Learning Approach," Energies, MDPI, vol. 15(14), pages 1-19, July.
    4. Karol Pilot & Alicja Ganczarek-Gamrot & Krzysztof Kania, 2024. "Dealing with Anomalies in Day-Ahead Market Prediction Using Machine Learning Hybrid Model," Energies, MDPI, vol. 17(17), pages 1-20, September.
    5. Yin, Linfei & Qiu, Yao, 2022. "Neural network dynamic differential control for long-term price guidance mechanism of flexible energy service providers," Energy, Elsevier, vol. 255(C).
    6. Marcelle Caroline Thimotheo de Brito & Amaro O. Pereira Junior & Mario Veiga Ferraz Pereira & Julio César Cahuano Simba & Sergio Granville, 2022. "Competitive Behavior of Hydroelectric Power Plants under Uncertainty in Spot Market," Energies, MDPI, vol. 15(19), pages 1-22, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    2. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    3. Hakan Acaroğlu & Fausto Pedro García Márquez, 2021. "Comprehensive Review on Electricity Market Price and Load Forecasting Based on Wind Energy," Energies, MDPI, vol. 14(22), pages 1-23, November.
    4. Kadir Özen & Dilem Yıldırım, 2021. "Application of Bagging in Day-Ahead Electricity Price Forecasting and Factor Augmentation," ERC Working Papers 2101, ERC - Economic Research Center, Middle East Technical University, revised Apr 2021.
    5. Lago, Jesus & De Ridder, Fjo & De Schutter, Bart, 2018. "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, Elsevier, vol. 221(C), pages 386-405.
    6. Arkadiusz Jędrzejewski & Grzegorz Marcjasz & Rafał Weron, 2021. "Importance of the Long-Term Seasonal Component in Day-Ahead Electricity Price Forecasting Revisited: Parameter-Rich Models Estimated via the LASSO," Energies, MDPI, vol. 14(11), pages 1-17, June.
    7. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    8. Billé, Anna Gloria & Gianfreda, Angelica & Del Grosso, Filippo & Ravazzolo, Francesco, 2023. "Forecasting electricity prices with expert, linear, and nonlinear models," International Journal of Forecasting, Elsevier, vol. 39(2), pages 570-586.
    9. Afanasyev, Dmitriy O. & Fedorova, Elena A., 2019. "On the impact of outlier filtering on the electricity price forecasting accuracy," Applied Energy, Elsevier, vol. 236(C), pages 196-210.
    10. Avci, Ezgi & Ketter, Wolfgang & van Heck, Eric, 2018. "Managing electricity price modeling risk via ensemble forecasting: The case of Turkey," Energy Policy, Elsevier, vol. 123(C), pages 390-403.
    11. Gianfreda, Angelica & Ravazzolo, Francesco & Rossini, Luca, 2020. "Comparing the forecasting performances of linear models for electricity prices with high RES penetration," International Journal of Forecasting, Elsevier, vol. 36(3), pages 974-986.
    12. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting: Part II — Probabilistic forecasting," Energy Economics, Elsevier, vol. 79(C), pages 171-182.
    13. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    14. Katarzyna Maciejowska & Bartosz Uniejewski & Tomasz Serafin, 2020. "PCA Forecast Averaging—Predicting Day-Ahead and Intraday Electricity Prices," Energies, MDPI, vol. 13(14), pages 1-19, July.
    15. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    16. Olivares, Kin G. & Challu, Cristian & Marcjasz, Grzegorz & Weron, Rafał & Dubrawski, Artur, 2023. "Neural basis expansion analysis with exogenous variables: Forecasting electricity prices with NBEATSx," International Journal of Forecasting, Elsevier, vol. 39(2), pages 884-900.
    17. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2020. "Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 466-479.
    18. Štefan Bojnec & Alan Križaj, 2021. "Electricity Markets during the Liberalization: The Case of a European Union Country," Energies, MDPI, vol. 14(14), pages 1-21, July.
    19. Özen, Kadir & Yıldırım, Dilem, 2021. "Application of bagging in day-ahead electricity price forecasting and factor augmentation," Energy Economics, Elsevier, vol. 103(C).
    20. Grzegorz Marcjasz & Bartosz Uniejewski & Rafal Weron, 2017. "Importance of the long-term seasonal component in day-ahead electricity price forecasting revisited: Neural network models," HSC Research Reports HSC/17/03, Hugo Steinhaus Center, Wroclaw University of Technology.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:306:y:2022:i:pa:s0306261921013398. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.