IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v299y2021ics0306261921006632.html
   My bibliography  Save this article

Real-time electricity price forecasting of wind farms with deep neural network transfer learning and hybrid datasets

Author

Listed:
  • Yang, Haolin
  • Schell, Kristen R.

Abstract

The ability to forecast real-time electricity price for wind power is key to the operation of energy markets and hedging price risks. Recent research suggests new deep neural network (DNN) architectures can capture temporal dependencies in historical price data, along with the ability to automatically extract important features of the dataset. However, most existing price prediction DNN representations still utilize basic architecture designs and either no pre-training, or simple training approaches. This work studies both the effect of transfer learning on three network representations and different source domains, as well as the mechanism of transfer learning. It is shown that transfer learning improves accuracy across all network representations. The best performance is obtained with a GRU-based architecture, termed GRU-TL, that has been pre-trained from a hybrid dataset of all wind farms in the same subzone. This model outperforms all statistical and deep learning benchmarks by an average of 6.7% in the mean absolute percent error (MAPE) metric. The underlying mechanism of transfer learning enables the pre-trained DNN representation to learn the features of the target dataset more accurately.

Suggested Citation

  • Yang, Haolin & Schell, Kristen R., 2021. "Real-time electricity price forecasting of wind farms with deep neural network transfer learning and hybrid datasets," Applied Energy, Elsevier, vol. 299(C).
  • Handle: RePEc:eee:appene:v:299:y:2021:i:c:s0306261921006632
    DOI: 10.1016/j.apenergy.2021.117242
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261921006632
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2021.117242?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Brusaferri, Alessandro & Matteucci, Matteo & Portolani, Pietro & Vitali, Andrea, 2019. "Bayesian deep learning based method for probabilistic forecast of day-ahead electricity prices," Applied Energy, Elsevier, vol. 250(C), pages 1158-1175.
    2. Chang, Zihan & Zhang, Yang & Chen, Wenbo, 2019. "Electricity price prediction based on hybrid model of adam optimized LSTM neural network and wavelet transform," Energy, Elsevier, vol. 187(C).
    3. Panapakidis, Ioannis P. & Dagoumas, Athanasios S., 2016. "Day-ahead electricity price forecasting via the application of artificial neural network based models," Applied Energy, Elsevier, vol. 172(C), pages 132-151.
    4. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    5. Lin, Whei-Min & Gow, Hong-Jey & Tsai, Ming-Tang, 2010. "An enhanced radial basis function network for short-term electricity price forecasting," Applied Energy, Elsevier, vol. 87(10), pages 3226-3234, October.
    6. Lago, Jesus & De Ridder, Fjo & Vrancx, Peter & De Schutter, Bart, 2018. "Forecasting day-ahead electricity prices in Europe: The importance of considering market integration," Applied Energy, Elsevier, vol. 211(C), pages 890-903.
    7. Yang, Wendong & Wang, Jianzhou & Niu, Tong & Du, Pei, 2019. "A hybrid forecasting system based on a dual decomposition strategy and multi-objective optimization for electricity price forecasting," Applied Energy, Elsevier, vol. 235(C), pages 1205-1225.
    8. Tim Hill & Marcus O'Connor & William Remus, 1996. "Neural Network Models for Time Series Forecasts," Management Science, INFORMS, vol. 42(7), pages 1082-1092, July.
    9. Halužan, Marko & Verbič, Miroslav & Zorić, Jelena, 2020. "Performance of alternative electricity price forecasting methods: Findings from the Greek and Hungarian power exchanges," Applied Energy, Elsevier, vol. 277(C).
    10. Wang, Deyun & Luo, Hongyuan & Grunder, Olivier & Lin, Yanbing & Guo, Haixiang, 2017. "Multi-step ahead electricity price forecasting using a hybrid model based on two-layer decomposition technique and BP neural network optimized by firefly algorithm," Applied Energy, Elsevier, vol. 190(C), pages 390-407.
    11. Crespo Cuaresma, Jesús & Hlouskova, Jaroslava & Kossmeier, Stephan & Obersteiner, Michael, 2004. "Forecasting electricity spot-prices using linear univariate time-series models," Applied Energy, Elsevier, vol. 77(1), pages 87-106, January.
    12. Timo Teräsvirta & Chien‐Fu Lin & Clive W. J. Granger, 1993. "Power Of The Neural Network Linearity Test," Journal of Time Series Analysis, Wiley Blackwell, vol. 14(2), pages 209-220, March.
    13. Lago, Jesus & De Ridder, Fjo & De Schutter, Bart, 2018. "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, Elsevier, vol. 221(C), pages 386-405.
    14. Kumar, Sandeep & Muhuri, Pranab K., 2019. "A novel GDP prediction technique based on transfer learning using CO2 emission dataset," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    15. Qiao, Weibiao & Yang, Zhe, 2020. "Forecast the electricity price of U.S. using a wavelet transform-based hybrid model," Energy, Elsevier, vol. 193(C).
    16. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    17. Fan, Cheng & Sun, Yongjun & Xiao, Fu & Ma, Jie & Lee, Dasheng & Wang, Jiayuan & Tseng, Yen Chieh, 2020. "Statistical investigations of transfer learning-based methodology for short-term building energy predictions," Applied Energy, Elsevier, vol. 262(C).
    18. Shen, Sheng & Sadoughi, Mohammadkazem & Li, Meng & Wang, Zhengdao & Hu, Chao, 2020. "Deep convolutional neural networks with ensemble learning and transfer learning for capacity estimation of lithium-ion batteries," Applied Energy, Elsevier, vol. 260(C).
    19. Luo, Shuman & Weng, Yang, 2019. "A two-stage supervised learning approach for electricity price forecasting by leveraging different data sources," Applied Energy, Elsevier, vol. 242(C), pages 1497-1512.
    20. Yang, Zhang & Ce, Li & Lian, Li, 2017. "Electricity price forecasting by a hybrid model, combining wavelet transform, ARMA and kernel-based extreme learning machine methods," Applied Energy, Elsevier, vol. 190(C), pages 291-305.
    21. Agrawal, Rahul Kumar & Muchahary, Frankle & Tripathi, Madan Mohan, 2019. "Ensemble of relevance vector machines and boosted trees for electricity price forecasting," Applied Energy, Elsevier, vol. 250(C), pages 540-548.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liang, Xing-Yu & Zhang, Bo & Zhang, Chun-Lu, 2024. "Physics-informed deep residual neural network for finned-tube evaporator performance prediction," Energy, Elsevier, vol. 302(C).
    2. Meng, Anbo & Wang, Peng & Zhai, Guangsong & Zeng, Cong & Chen, Shun & Yang, Xiaoyi & Yin, Hao, 2022. "Electricity price forecasting with high penetration of renewable energy using attention-based LSTM network trained by crisscross optimization," Energy, Elsevier, vol. 254(PA).
    3. Faramarz Saghi & Mustafa Jahangoshai Rezaee, 2023. "Integrating Wavelet Decomposition and Fuzzy Transformation for Improving the Accuracy of Forecasting Crude Oil Price," Computational Economics, Springer;Society for Computational Economics, vol. 61(2), pages 559-591, February.
    4. Yin, Linfei & Qiu, Yao, 2022. "Neural network dynamic differential control for long-term price guidance mechanism of flexible energy service providers," Energy, Elsevier, vol. 255(C).
    5. Yangrui Zhang & Peng Tao & Xiangming Wu & Chenguang Yang & Guang Han & Hui Zhou & Yinlong Hu, 2022. "Hourly Electricity Price Prediction for Electricity Market with High Proportion of Wind and Solar Power," Energies, MDPI, vol. 15(4), pages 1-13, February.
    6. Neeraj Kumar & Madan Mohan Tripathi & Saket Gupta & Majed A. Alotaibi & Hasmat Malik & Asyraf Afthanorhan, 2023. "Study of Potential Impact of Wind Energy on Electricity Price Using Regression Techniques," Sustainability, MDPI, vol. 15(19), pages 1-17, October.
    7. Bartosz Uniejewski, 2023. "Smoothing Quantile Regression Averaging: A new approach to probabilistic forecasting of electricity prices," Papers 2302.00411, arXiv.org, revised Nov 2024.
    8. Haokun Su & Xiangang Peng & Hanyu Liu & Huan Quan & Kaitong Wu & Zhiwen Chen, 2022. "Multi-Step-Ahead Electricity Price Forecasting Based on Temporal Graph Convolutional Network," Mathematics, MDPI, vol. 10(14), pages 1-16, July.
    9. Chai, Shanglei & Li, Qiang & Abedin, Mohammad Zoynul & Lucey, Brian M., 2024. "Forecasting electricity prices from the state-of-the-art modeling technology and the price determinant perspectives," Research in International Business and Finance, Elsevier, vol. 67(PA).
    10. Hakan Acaroğlu & Fausto Pedro García Márquez, 2021. "Comprehensive Review on Electricity Market Price and Load Forecasting Based on Wind Energy," Energies, MDPI, vol. 14(22), pages 1-23, November.
    11. Juan D. Velásquez & Lorena Cadavid & Carlos J. Franco, 2023. "Intelligence Techniques in Sustainable Energy: Analysis of a Decade of Advances," Energies, MDPI, vol. 16(19), pages 1-45, October.
    12. Liu, Ling & Wang, Jujie & Li, Jianping & Wei, Lu, 2023. "Monthly wind distribution prediction based on nonparametric estimation and modified differential evolution optimization algorithm," Renewable Energy, Elsevier, vol. 217(C).
    13. Wang, Kang & Wang, Haixin & Yang, Zihao & Feng, Jiawei & Li, Yanzhen & Yang, Junyou & Chen, Zhe, 2023. "A transfer learning method for electric vehicles charging strategy based on deep reinforcement learning," Applied Energy, Elsevier, vol. 343(C).
    14. Xue, Wenyuan & Lu, Yichen & Wang, Zhi & Cao, Shengxian & Sui, Mengxuan & Yang, Yuan & Li, Jiyuan & Xie, Yubin, 2024. "Reconstructing near-water-wall temperature in coal-fired boilers using improved transfer learning and hidden layer configuration optimization," Energy, Elsevier, vol. 294(C).
    15. Ghimire, Sujan & Deo, Ravinesh C. & Casillas-Pérez, David & Salcedo-Sanz, Sancho, 2024. "Two-step deep learning framework with error compensation technique for short-term, half-hourly electricity price forecasting," Applied Energy, Elsevier, vol. 353(PA).
    16. Li, Kangping & Li, Zhenghui & Huang, Chunyi & Ai, Qian, 2024. "Online transfer learning-based residential demand response potential forecasting for load aggregator," Applied Energy, Elsevier, vol. 358(C).
    17. Pedro Leal & Rui Castro & Fernando Lopes, 2023. "Influence of Increasing Renewable Power Penetration on the Long-Term Iberian Electricity Market Prices," Energies, MDPI, vol. 16(3), pages 1-19, January.
    18. Liu, Ling & Wang, Jujie & Li, Jianping & Wei, Lu, 2023. "An online transfer learning model for wind turbine power prediction based on spatial feature construction and system-wide update," Applied Energy, Elsevier, vol. 340(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chai, Shanglei & Li, Qiang & Abedin, Mohammad Zoynul & Lucey, Brian M., 2024. "Forecasting electricity prices from the state-of-the-art modeling technology and the price determinant perspectives," Research in International Business and Finance, Elsevier, vol. 67(PA).
    2. Jasiński, Tomasz, 2020. "Use of new variables based on air temperature for forecasting day-ahead spot electricity prices using deep neural networks: A new approach," Energy, Elsevier, vol. 213(C).
    3. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    4. Ghimire, Sujan & Deo, Ravinesh C. & Casillas-Pérez, David & Salcedo-Sanz, Sancho, 2024. "Two-step deep learning framework with error compensation technique for short-term, half-hourly electricity price forecasting," Applied Energy, Elsevier, vol. 353(PA).
    5. Elmore, Clay T. & Dowling, Alexander W., 2021. "Learning spatiotemporal dynamics in wholesale energy markets with dynamic mode decomposition," Energy, Elsevier, vol. 232(C).
    6. Yang, Haolin & Schell, Kristen R., 2022. "GHTnet: Tri-Branch deep learning network for real-time electricity price forecasting," Energy, Elsevier, vol. 238(PC).
    7. Heydari, Azim & Majidi Nezhad, Meysam & Pirshayan, Elmira & Astiaso Garcia, Davide & Keynia, Farshid & De Santoli, Livio, 2020. "Short-term electricity price and load forecasting in isolated power grids based on composite neural network and gravitational search optimization algorithm," Applied Energy, Elsevier, vol. 277(C).
    8. Qiao, Weibiao & Yang, Zhe, 2020. "Forecast the electricity price of U.S. using a wavelet transform-based hybrid model," Energy, Elsevier, vol. 193(C).
    9. Halužan, Marko & Verbič, Miroslav & Zorić, Jelena, 2020. "Performance of alternative electricity price forecasting methods: Findings from the Greek and Hungarian power exchanges," Applied Energy, Elsevier, vol. 277(C).
    10. Lago, Jesus & De Ridder, Fjo & De Schutter, Bart, 2018. "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, Elsevier, vol. 221(C), pages 386-405.
    11. Díaz, Guzmán & Coto, José & Gómez-Aleixandre, Javier, 2019. "Prediction and explanation of the formation of the Spanish day-ahead electricity price through machine learning regression," Applied Energy, Elsevier, vol. 239(C), pages 610-625.
    12. Nie, Ying & Li, Ping & Wang, Jianzhou & Zhang, Lifang, 2024. "A novel multivariate electrical price bi-forecasting system based on deep learning, a multi-input multi-output structure and an operator combination mechanism," Applied Energy, Elsevier, vol. 366(C).
    13. Loizidis, Stylianos & Kyprianou, Andreas & Georghiou, George E., 2024. "Electricity market price forecasting using ELM and Bootstrap analysis: A case study of the German and Finnish Day-Ahead markets," Applied Energy, Elsevier, vol. 363(C).
    14. Lu, Renzhi & Bai, Ruichang & Huang, Yuan & Li, Yuting & Jiang, Junhui & Ding, Yuemin, 2021. "Data-driven real-time price-based demand response for industrial facilities energy management," Applied Energy, Elsevier, vol. 283(C).
    15. Brusaferri, Alessandro & Matteucci, Matteo & Portolani, Pietro & Vitali, Andrea, 2019. "Bayesian deep learning based method for probabilistic forecast of day-ahead electricity prices," Applied Energy, Elsevier, vol. 250(C), pages 1158-1175.
    16. Lago, Jesus & De Ridder, Fjo & Vrancx, Peter & De Schutter, Bart, 2018. "Forecasting day-ahead electricity prices in Europe: The importance of considering market integration," Applied Energy, Elsevier, vol. 211(C), pages 890-903.
    17. Liu, Luyao & Bai, Feifei & Su, Chenyu & Ma, Cuiping & Yan, Ruifeng & Li, Hailong & Sun, Qie & Wennersten, Ronald, 2022. "Forecasting the occurrence of extreme electricity prices using a multivariate logistic regression model," Energy, Elsevier, vol. 247(C).
    18. Palacio, Sebastián M., 2020. "Predicting collusive patterns in a liberalized electricity market with mandatory auctions of forward contracts," Energy Policy, Elsevier, vol. 139(C).
    19. Umut Ugurlu & Ilkay Oksuz & Oktay Tas, 2018. "Electricity Price Forecasting Using Recurrent Neural Networks," Energies, MDPI, vol. 11(5), pages 1-23, May.
    20. Tschora, Léonard & Pierre, Erwan & Plantevit, Marc & Robardet, Céline, 2022. "Electricity price forecasting on the day-ahead market using machine learning," Applied Energy, Elsevier, vol. 313(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:299:y:2021:i:c:s0306261921006632. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.