IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v263y2023ipcs0360544222026329.html
   My bibliography  Save this article

Differential attention net: Multi-directed differential attention based hybrid deep learning model for solar power forecasting

Author

Listed:
  • Rai, Amit
  • Shrivastava, Ashish
  • Jana, Kartick C.

Abstract

Solar power plants provide a clean alternative to conventional thermal power plants. However, solar plant dependency on environmental factors threatens existing energy grids in terms of power quality and management. So, accurate solar power prediction is indispensable for designing and managing solar power plants. This work introduces a novel multi-directed differential attention-based differential attention net for accurate solar power prediction. The proposed model in the first step utilizes the feature of convolution neural network (CNN) and bidirectional long-short memory (BiLSTM) based hybrid deep learning model in parallel branches to extract the local dependencies in the latent space. However, long-term temporal dependencies in this time-series problem deteriorate prediction performance. So, an attention-based deep learning model is applied in the parallel branches to tap the long-term dependencies. Moreover, Bayesian optimization is used to fine-tune the hyperparameter of the proposed model, as it provides better results with the gaussian backend process. The proposed model is tested on two different datasets, one is real-time solar plant dataset located in the Australian desert, and other one is from Delhi, India. The proposed net is compared with other hybrid deep learning models (e.g., comprising of the recurrent neural network, gated recurrent unit, and LSTM). And the findings of the work confirms the effectiveness of the proposed model.

Suggested Citation

  • Rai, Amit & Shrivastava, Ashish & Jana, Kartick C., 2023. "Differential attention net: Multi-directed differential attention based hybrid deep learning model for solar power forecasting," Energy, Elsevier, vol. 263(PC).
  • Handle: RePEc:eee:energy:v:263:y:2023:i:pc:s0360544222026329
    DOI: 10.1016/j.energy.2022.125746
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544222026329
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2022.125746?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ahmed, R. & Sreeram, V. & Mishra, Y. & Arif, M.D., 2020. "A review and evaluation of the state-of-the-art in PV solar power forecasting: Techniques and optimization," Renewable and Sustainable Energy Reviews, Elsevier, vol. 124(C).
    2. Sharifzadeh, Mahdi & Sikinioti-Lock, Alexandra & Shah, Nilay, 2019. "Machine-learning methods for integrated renewable power generation: A comparative study of artificial neural networks, support vector regression, and Gaussian Process Regression," Renewable and Sustainable Energy Reviews, Elsevier, vol. 108(C), pages 513-538.
    3. Das, Utpal Kumar & Tey, Kok Soon & Seyedmahmoudian, Mehdi & Mekhilef, Saad & Idris, Moh Yamani Idna & Van Deventer, Willem & Horan, Bend & Stojcevski, Alex, 2018. "Forecasting of photovoltaic power generation and model optimization: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 912-928.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Zeng, Jianwu & Qiao, Wei, 2013. "Short-term solar power prediction using a support vector machine," Renewable Energy, Elsevier, vol. 52(C), pages 118-127.
    6. Massaoudi, Mohamed & Refaat, Shady S. & Chihi, Ines & Trabelsi, Mohamed & Oueslati, Fakhreddine S. & Abu-Rub, Haitham, 2021. "A novel stacked generalization ensemble-based hybrid LGBM-XGB-MLP model for Short-Term Load Forecasting," Energy, Elsevier, vol. 214(C).
    7. Yin, Wansi & Han, Yutong & Zhou, Hai & Ma, Ming & Li, Li & Zhu, Honglu, 2020. "A novel non-iterative correction method for short-term photovoltaic power forecasting," Renewable Energy, Elsevier, vol. 159(C), pages 23-32.
    8. Kumari, Pratima & Toshniwal, Durga, 2021. "Long short term memory–convolutional neural network based deep hybrid approach for solar irradiance forecasting," Applied Energy, Elsevier, vol. 295(C).
    9. Ruijin Zhu & Weilin Guo & Xuejiao Gong, 2019. "Short-Term Photovoltaic Power Output Prediction Based on k -Fold Cross-Validation and an Ensemble Model," Energies, MDPI, vol. 12(7), pages 1-15, March.
    10. Despotovic, Milan & Nedic, Vladimir & Despotovic, Danijela & Cvetanovic, Slobodan, 2015. "Review and statistical analysis of different global solar radiation sunshine models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 52(C), pages 1869-1880.
    11. Yang, Zhongshan & Wang, Jian, 2018. "A hybrid forecasting approach applied in wind speed forecasting based on a data processing strategy and an optimized artificial intelligence algorithm," Energy, Elsevier, vol. 160(C), pages 87-100.
    12. VanDeventer, William & Jamei, Elmira & Thirunavukkarasu, Gokul Sidarth & Seyedmahmoudian, Mehdi & Soon, Tey Kok & Horan, Ben & Mekhilef, Saad & Stojcevski, Alex, 2019. "Short-term PV power forecasting using hybrid GASVM technique," Renewable Energy, Elsevier, vol. 140(C), pages 367-379.
    13. Yang, Zhongshan & Wang, Jian, 2018. "A combination forecasting approach applied in multistep wind speed forecasting based on a data processing strategy and an optimized artificial intelligence algorithm," Applied Energy, Elsevier, vol. 230(C), pages 1108-1125.
    14. Nam, SeungBeom & Hur, Jin, 2019. "A hybrid spatio-temporal forecasting of solar generating resources for grid integration," Energy, Elsevier, vol. 177(C), pages 503-510.
    15. Mellit, A. & Pavan, A. Massi & Lughi, V., 2021. "Deep learning neural networks for short-term photovoltaic power forecasting," Renewable Energy, Elsevier, vol. 172(C), pages 276-288.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liu, Jingxuan & Zang, Haixiang & Zhang, Fengchun & Cheng, Lilin & Ding, Tao & Wei, Zhinong & Sun, Guoqiang, 2023. "A hybrid meteorological data simulation framework based on time-series generative adversarial network for global daily solar radiation estimation," Renewable Energy, Elsevier, vol. 219(P1).
    2. Zang, Haixiang & Chen, Dianhao & Liu, Jingxuan & Cheng, Lilin & Sun, Guoqiang & Wei, Zhinong, 2024. "Improving ultra-short-term photovoltaic power forecasting using a novel sky-image-based framework considering spatial-temporal feature interaction," Energy, Elsevier, vol. 293(C).
    3. Isaac Gallardo & Daniel Amor & Álvaro Gutiérrez, 2023. "Recent Trends in Real-Time Photovoltaic Prediction Systems," Energies, MDPI, vol. 16(15), pages 1-17, July.
    4. Dao, Fang & Zeng, Yun & Qian, Jing, 2024. "Fault diagnosis of hydro-turbine via the incorporation of bayesian algorithm optimized CNN-LSTM neural network," Energy, Elsevier, vol. 290(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sarmas, Elissaios & Spiliotis, Evangelos & Stamatopoulos, Efstathios & Marinakis, Vangelis & Doukas, Haris, 2023. "Short-term photovoltaic power forecasting using meta-learning and numerical weather prediction independent Long Short-Term Memory models," Renewable Energy, Elsevier, vol. 216(C).
    2. Yin, Linfei & Cao, Xinghui & Liu, Dongduan, 2023. "Weighted fully-connected regression networks for one-day-ahead hourly photovoltaic power forecasting," Applied Energy, Elsevier, vol. 332(C).
    3. Tang, Yugui & Yang, Kuo & Zhang, Shujing & Zhang, Zhen, 2022. "Photovoltaic power forecasting: A hybrid deep learning model incorporating transfer learning strategy," Renewable and Sustainable Energy Reviews, Elsevier, vol. 162(C).
    4. Kim, Jimin & Obregon, Josue & Park, Hoonseok & Jung, Jae-Yoon, 2024. "Multi-step photovoltaic power forecasting using transformer and recurrent neural networks," Renewable and Sustainable Energy Reviews, Elsevier, vol. 200(C).
    5. Saima Akhtar & Sulman Shahzad & Asad Zaheer & Hafiz Sami Ullah & Heybet Kilic & Radomir Gono & Michał Jasiński & Zbigniew Leonowicz, 2023. "Short-Term Load Forecasting Models: A Review of Challenges, Progress, and the Road Ahead," Energies, MDPI, vol. 16(10), pages 1-29, May.
    6. Zheng, Lingwei & Su, Ran & Sun, Xinyu & Guo, Siqi, 2023. "Historical PV-output characteristic extraction based weather-type classification strategy and its forecasting method for the day-ahead prediction of PV output," Energy, Elsevier, vol. 271(C).
    7. Gupta, Priya & Singh, Rhythm, 2023. "Combining simple and less time complex ML models with multivariate empirical mode decomposition to obtain accurate GHI forecast," Energy, Elsevier, vol. 263(PC).
    8. Ifaei, Pouya & Nazari-Heris, Morteza & Tayerani Charmchi, Amir Saman & Asadi, Somayeh & Yoo, ChangKyoo, 2023. "Sustainable energies and machine learning: An organized review of recent applications and challenges," Energy, Elsevier, vol. 266(C).
    9. Xu, Fang Yuan & Tang, Rui Xin & Xu, Si Bin & Fan, Yi Liang & Zhou, Ya & Zhang, Hao Tian, 2021. "Neural network-based photovoltaic generation capacity prediction system with benefit-oriented modification," Energy, Elsevier, vol. 223(C).
    10. Nguyen, Thi Ngoc & Müsgens, Felix, 2022. "What drives the accuracy of PV output forecasts?," Applied Energy, Elsevier, vol. 323(C).
    11. Putri Nor Liyana Mohamad Radzi & Muhammad Naveed Akhter & Saad Mekhilef & Noraisyah Mohamed Shah, 2023. "Review on the Application of Photovoltaic Forecasting Using Machine Learning for Very Short- to Long-Term Forecasting," Sustainability, MDPI, vol. 15(4), pages 1-21, February.
    12. Lima, Marcello Anderson F.B. & Carvalho, Paulo C.M. & Fernández-Ramírez, Luis M. & Braga, Arthur P.S., 2020. "Improving solar forecasting using Deep Learning and Portfolio Theory integration," Energy, Elsevier, vol. 195(C).
    13. Cao, Yisheng & Liu, Gang & Luo, Donghua & Bavirisetti, Durga Prasad & Xiao, Gang, 2023. "Multi-timescale photovoltaic power forecasting using an improved Stacking ensemble algorithm based LSTM-Informer model," Energy, Elsevier, vol. 283(C).
    14. Linh Bui Duy & Ninh Nguyen Quang & Binh Doan Van & Eleonora Riva Sanseverino & Quynh Tran Thi Tu & Hang Le Thi Thuy & Sang Le Quang & Thinh Le Cong & Huyen Cu Thi Thanh, 2024. "Refining Long Short-Term Memory Neural Network Input Parameters for Enhanced Solar Power Forecasting," Energies, MDPI, vol. 17(16), pages 1-22, August.
    15. Paletta, Quentin & Hu, Anthony & Arbod, Guillaume & Lasenby, Joan, 2022. "ECLIPSE: Envisioning CLoud Induced Perturbations in Solar Energy," Applied Energy, Elsevier, vol. 326(C).
    16. Hu, Zehuan & Gao, Yuan & Ji, Siyu & Mae, Masayuki & Imaizumi, Taiji, 2024. "Improved multistep ahead photovoltaic power prediction model based on LSTM and self-attention with weather forecast data," Applied Energy, Elsevier, vol. 359(C).
    17. Huang, Xiaoqiao & Li, Qiong & Tai, Yonghang & Chen, Zaiqing & Zhang, Jun & Shi, Junsheng & Gao, Bixuan & Liu, Wuming, 2021. "Hybrid deep neural model for hourly solar irradiance forecasting," Renewable Energy, Elsevier, vol. 171(C), pages 1041-1060.
    18. Wang, Jianzhou & Zhou, Yilin & Li, Zhiwu, 2022. "Hour-ahead photovoltaic generation forecasting method based on machine learning and multi objective optimization algorithm," Applied Energy, Elsevier, vol. 312(C).
    19. Sabadus, Andreea & Blaga, Robert & Hategan, Sergiu-Mihai & Calinoiu, Delia & Paulescu, Eugenia & Mares, Oana & Boata, Remus & Stefu, Nicoleta & Paulescu, Marius & Badescu, Viorel, 2024. "A cross-sectional survey of deterministic PV power forecasting: Progress and limitations in current approaches," Renewable Energy, Elsevier, vol. 226(C).
    20. Ahmed, R. & Sreeram, V. & Mishra, Y. & Arif, M.D., 2020. "A review and evaluation of the state-of-the-art in PV solar power forecasting: Techniques and optimization," Renewable and Sustainable Energy Reviews, Elsevier, vol. 124(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:263:y:2023:i:pc:s0360544222026329. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.