IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v294y2021ics0306261921004438.html
   My bibliography  Save this article

DeepComp: Deep reinforcement learning based renewable energy error compensable forecasting

Author

Listed:
  • Jeong, Jaeik
  • Kim, Hongseok

Abstract

Recently, renewable energy is rapidly integrated into the power grid to prevent climate change, and accurate forecasting of renewable generation becomes critical for reliable power system operation. However, existing forecasting algorithms only focused on reducing forecasting errors without considering error compensability by using a large-scale battery. In this paper, we propose a novel strategy called error compensable forecasting. We switch the objective of forecasting from reducing errors to making errors compensable by leveraging a battery, which in turn reduces the dispatched error, the difference between forecasted value and dispatched value. The challenging part of the proposed objective lies in that the stored energy at current time is affected by the previous forecasting result. In this regard, we propose a deep reinforcement learning based error compensable forecasting framework, called DeepComp, having forecasting in the loop of control. This makes an action as a continuous forecasted value, which requires a continuous action space. We leverage proximal policy optimization, which is simple to implement with outstanding performance for continuous control. Extensive experiments with solar and wind power generations show that DeepComp outperforms the conventional forecasting methods by up to 90% and achieves accurate forecasting, e.g., 0.58–1.22% of the mean absolute percentage error.

Suggested Citation

  • Jeong, Jaeik & Kim, Hongseok, 2021. "DeepComp: Deep reinforcement learning based renewable energy error compensable forecasting," Applied Energy, Elsevier, vol. 294(C).
  • Handle: RePEc:eee:appene:v:294:y:2021:i:c:s0306261921004438
    DOI: 10.1016/j.apenergy.2021.116970
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261921004438
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2021.116970?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yohwan Choi & Hongseok Kim, 2016. "Optimal Scheduling of Energy Storage System for Self-Sustainable Base Station Operation Considering Battery Wear-Out Cost," Energies, MDPI, vol. 9(6), pages 1-19, June.
    2. Li, Pengtao & Zhou, Kaile & Lu, Xinhui & Yang, Shanlin, 2020. "A hybrid deep learning model for short-term PV power forecasting," Applied Energy, Elsevier, vol. 259(C).
    3. Hua, Haochen & Qin, Yuchao & Hao, Chuantong & Cao, Junwei, 2019. "Optimal energy management strategies for energy Internet via deep reinforcement learning approach," Applied Energy, Elsevier, vol. 239(C), pages 598-609.
    4. Zheng, Jianqin & Zhang, Haoran & Dai, Yuanhao & Wang, Bohong & Zheng, Taicheng & Liao, Qi & Liang, Yongtu & Zhang, Fengwei & Song, Xuan, 2020. "Time series prediction for output of multi-region solar power plants," Applied Energy, Elsevier, vol. 257(C).
    5. Meka, Rajitha & Alaeddini, Adel & Bhaganagar, Kiran, 2021. "A robust deep learning framework for short-term wind power forecast of a full-scale wind farm using atmospheric variables," Energy, Elsevier, vol. 221(C).
    6. Das, Utpal Kumar & Tey, Kok Soon & Seyedmahmoudian, Mehdi & Mekhilef, Saad & Idris, Moh Yamani Idna & Van Deventer, Willem & Horan, Bend & Stojcevski, Alex, 2018. "Forecasting of photovoltaic power generation and model optimization: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 912-928.
    7. Mashlakov, Aleksei & Kuronen, Toni & Lensu, Lasse & Kaarna, Arto & Honkapuro, Samuli, 2021. "Assessing the performance of deep learning models for multivariate probabilistic energy forecasting," Applied Energy, Elsevier, vol. 285(C).
    8. Jae Ho Kim & Warren B. Powell, 2011. "Optimal Energy Commitments with Storage and Intermittent Supply," Operations Research, INFORMS, vol. 59(6), pages 1347-1360, December.
    9. Wang, Jianzhou & Song, Yiliao & Liu, Feng & Hou, Ru, 2016. "Analysis and application of forecasting models in wind power integration: A review of multi-step-ahead wind speed forecasting models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 60(C), pages 960-981.
    10. Jaeik Jeong & Hongseok Kim, 2019. "Multi-Site Photovoltaic Forecasting Exploiting Space-Time Convolutional Neural Network," Energies, MDPI, vol. 12(23), pages 1-14, November.
    11. Kuk Yeol Bae & Han Seung Jang & Bang Chul Jung & Dan Keun Sung, 2019. "Effect of Prediction Error of Machine Learning Schemes on Photovoltaic Power Trading Based on Energy Storage Systems," Energies, MDPI, vol. 12(7), pages 1-20, April.
    12. Han, Sekyung & Han, Soohee & Aki, Hirohisa, 2014. "A practical battery wear model for electric vehicle charging applications," Applied Energy, Elsevier, vol. 113(C), pages 1100-1108.
    13. David Silver & Julian Schrittwieser & Karen Simonyan & Ioannis Antonoglou & Aja Huang & Arthur Guez & Thomas Hubert & Lucas Baker & Matthew Lai & Adrian Bolton & Yutian Chen & Timothy Lillicrap & Fan , 2017. "Mastering the game of Go without human knowledge," Nature, Nature, vol. 550(7676), pages 354-359, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hassani, Hossein & Razavi-Far, Roozbeh & Saif, Mehrdad, 2022. "Real-time out-of-step prediction control to prevent emerging blackouts in power systems: A reinforcement learning approach," Applied Energy, Elsevier, vol. 314(C).
    2. Soleimanzade, Mohammad Amin & Kumar, Amit & Sadrzadeh, Mohtada, 2022. "Novel data-driven energy management of a hybrid photovoltaic-reverse osmosis desalination system using deep reinforcement learning," Applied Energy, Elsevier, vol. 317(C).
    3. Dimitrios Vamvakas & Panagiotis Michailidis & Christos Korkas & Elias Kosmatopoulos, 2023. "Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications," Energies, MDPI, vol. 16(14), pages 1-38, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hongchao Zhang & Tengteng Zhu, 2022. "Stacking Model for Photovoltaic-Power-Generation Prediction," Sustainability, MDPI, vol. 14(9), pages 1-16, May.
    2. Tang, Yugui & Yang, Kuo & Zhang, Shujing & Zhang, Zhen, 2022. "Photovoltaic power forecasting: A hybrid deep learning model incorporating transfer learning strategy," Renewable and Sustainable Energy Reviews, Elsevier, vol. 162(C).
    3. Zhen, Hao & Niu, Dongxiao & Wang, Keke & Shi, Yucheng & Ji, Zhengsen & Xu, Xiaomin, 2021. "Photovoltaic power forecasting based on GA improved Bi-LSTM in microgrid without meteorological information," Energy, Elsevier, vol. 231(C).
    4. Benedikt Finnah, 2022. "Optimal bidding functions for renewable energies in sequential electricity markets," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 44(1), pages 1-27, March.
    5. Wang, Xiaoyang & Sun, Yunlin & Luo, Duo & Peng, Jinqing, 2022. "Comparative study of machine learning approaches for predicting short-term photovoltaic power output based on weather type classification," Energy, Elsevier, vol. 240(C).
    6. Akhter, Muhammad Naveed & Mekhilef, Saad & Mokhlis, Hazlie & Ali, Raza & Usama, Muhammad & Muhammad, Munir Azam & Khairuddin, Anis Salwa Mohd, 2022. "A hybrid deep learning method for an hour ahead power output forecasting of three different photovoltaic systems," Applied Energy, Elsevier, vol. 307(C).
    7. Victor Hugo Wentz & Joylan Nunes Maciel & Jorge Javier Gimenez Ledesma & Oswaldo Hideo Ando Junior, 2022. "Solar Irradiance Forecasting to Short-Term PV Power: Accuracy Comparison of ANN and LSTM Models," Energies, MDPI, vol. 15(7), pages 1-23, March.
    8. Seung Chan Jo & Young Gyu Jin & Yong Tae Yoon & Ho Chan Kim, 2021. "Methods for Integrating Extraterrestrial Radiation into Neural Network Models for Day-Ahead PV Generation Forecasting," Energies, MDPI, vol. 14(9), pages 1-18, May.
    9. Limouni, Tariq & Yaagoubi, Reda & Bouziane, Khalid & Guissi, Khalid & Baali, El Houssain, 2023. "Accurate one step and multistep forecasting of very short-term PV power using LSTM-TCN model," Renewable Energy, Elsevier, vol. 205(C), pages 1010-1024.
    10. Xu, Fang Yuan & Tang, Rui Xin & Xu, Si Bin & Fan, Yi Liang & Zhou, Ya & Zhang, Hao Tian, 2021. "Neural network-based photovoltaic generation capacity prediction system with benefit-oriented modification," Energy, Elsevier, vol. 223(C).
    11. Martina Radicioni & Valentina Lucaferri & Francesco De Lia & Antonino Laudani & Roberto Lo Presti & Gabriele Maria Lozito & Francesco Riganti Fulginei & Riccardo Schioppo & Mario Tucci, 2021. "Power Forecasting of a Photovoltaic Plant Located in ENEA Casaccia Research Center," Energies, MDPI, vol. 14(3), pages 1-22, January.
    12. Perera, A.T.D. & Kamalaruban, Parameswaran, 2021. "Applications of reinforcement learning in energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 137(C).
    13. Sarmas, Elissaios & Spiliotis, Evangelos & Stamatopoulos, Efstathios & Marinakis, Vangelis & Doukas, Haris, 2023. "Short-term photovoltaic power forecasting using meta-learning and numerical weather prediction independent Long Short-Term Memory models," Renewable Energy, Elsevier, vol. 216(C).
    14. Xiangshu Lei, 2024. "A Photovoltaic Prediction Model with Integrated Attention Mechanism," Mathematics, MDPI, vol. 12(13), pages 1-16, July.
    15. Gupta, Priya & Singh, Rhythm, 2023. "Combining a deep learning model with multivariate empirical mode decomposition for hourly global horizontal irradiance forecasting," Renewable Energy, Elsevier, vol. 206(C), pages 908-927.
    16. Jimyung Kang & Jooseung Lee & Soonwoo Lee, 2023. "Data-Driven Minute-Ahead Forecast of PV Generation with Adjacent PV Sector Information," Energies, MDPI, vol. 16(13), pages 1-16, June.
    17. Wang, Jianzhou & Zhou, Yilin & Li, Zhiwu, 2022. "Hour-ahead photovoltaic generation forecasting method based on machine learning and multi objective optimization algorithm," Applied Energy, Elsevier, vol. 312(C).
    18. du Plessis, A.A. & Strauss, J.M. & Rix, A.J., 2021. "Short-term solar power forecasting: Investigating the ability of deep learning models to capture low-level utility-scale Photovoltaic system behaviour," Applied Energy, Elsevier, vol. 285(C).
    19. Fjelkestam Frederiksen, Cornelia A. & Cai, Zuansi, 2022. "Novel machine learning approach for solar photovoltaic energy output forecast using extra-terrestrial solar irradiance," Applied Energy, Elsevier, vol. 306(PB).
    20. Touzani, Samir & Prakash, Anand Krishnan & Wang, Zhe & Agarwal, Shreya & Pritoni, Marco & Kiran, Mariam & Brown, Richard & Granderson, Jessica, 2021. "Controlling distributed energy resources via deep reinforcement learning for load flexibility and energy efficiency," Applied Energy, Elsevier, vol. 304(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:294:y:2021:i:c:s0306261921004438. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.