IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v369y2024ics0306261924009243.html
   My bibliography  Save this article

Harnessing AI for solar energy: Emergence of transformer models

Author

Listed:
  • Hanif, M.F.
  • Mi, J.

Abstract

This review emphasizes the critical need for accurate integration of solar energy into power grids. It meticulously examines the advancements in transformer models for solar forecasting, representing a confluence of renewable energy research and cutting-edge machine learning. It evaluates the effectiveness of various transformer architectures, including single, hybrid, and specialized models, across different forecasting horizons, from short to medium term. This review unveils substantial improvements in forecasting accuracy and computational efficiency, highlighting the models' proficiency in handling complex and diverse solar data. A key contribution is the emphasis on the crucial role of hyperparameters in refining model performance, balancing precision against computational demands. Importantly, the research also identifies critical challenges, such as the significant computational resources required and the need for expansive, high-quality datasets, which limit the broader application of these models. In response, this review advocates for future research directions focused on standardizing model configurations, venturing into longer-term forecasting, and fostering innovations to enhance computational economy. These proposed pathways aim to surmount current challenges, steering the domain towards more accurate, adaptable, and sustainable solar forecasting solutions that can contribute to achieving global renewable energy and climate objectives. This review not only maps the present landscape of transformer models in solar energy forecasting but also charts a trajectory for future advancements. It serves as a pivotal guide for researchers and practitioners, delineating the current advancements and future directions in navigating the complexities of solar data interpretation and forecasting, thereby significantly contributing to the development of reliable and efficient renewable energy systems.

Suggested Citation

  • Hanif, M.F. & Mi, J., 2024. "Harnessing AI for solar energy: Emergence of transformer models," Applied Energy, Elsevier, vol. 369(C).
  • Handle: RePEc:eee:appene:v:369:y:2024:i:c:s0306261924009243
    DOI: 10.1016/j.apenergy.2024.123541
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924009243
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2024.123541?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Elham M. Al-Ali & Yassine Hajji & Yahia Said & Manel Hleili & Amal M. Alanzi & Ali H. Laatar & Mohamed Atri, 2023. "Solar Energy Production Forecasting Based on a Hybrid CNN-LSTM-Transformer Model," Mathematics, MDPI, vol. 11(3), pages 1-19, January.
    2. Lasse Espeholt & Shreya Agrawal & Casper Sønderby & Manoj Kumar & Jonathan Heek & Carla Bromberg & Cenk Gazen & Rob Carver & Marcin Andrychowicz & Jason Hickey & Aaron Bell & Nal Kalchbrenner, 2022. "Deep learning for twelve hour precipitation forecasts," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    3. Zaohui Kang & Jizhong Xue & Chun Sing Lai & Yu Wang & Haoliang Yuan & Fangyuan Xu, 2023. "Vision Transformer-Based Photovoltaic Prediction Model," Energies, MDPI, vol. 16(12), pages 1-14, June.
    4. A-Hyun Jung & Dong-Hyun Lee & Jin-Young Kim & Chang Ki Kim & Hyun-Goo Kim & Yung-Seop Lee, 2022. "Regional Photovoltaic Power Forecasting Using Vector Autoregression Model in South Korea," Energies, MDPI, vol. 15(21), pages 1-13, October.
    5. Prado, Francisco & Minutolo, Marcel C. & Kristjanpoller, Werner, 2020. "Forecasting based on an ensemble Autoregressive Moving Average - Adaptive neuro - Fuzzy inference system – Neural network - Genetic Algorithm Framework," Energy, Elsevier, vol. 197(C).
    6. Severiano, Carlos A. & Silva, Petrônio Cândido de Lima e & Weiss Cohen, Miri & Guimarães, Frederico Gadelha, 2021. "Evolving fuzzy time series for spatio-temporal forecasting in renewable energy systems," Renewable Energy, Elsevier, vol. 171(C), pages 764-783.
    7. Jumaboev Sherozbek & Jaewoo Park & Mohammad Shaheer Akhtar & O-Bong Yang, 2023. "Transformers-Based Encoder Model for Forecasting Hourly Power Output of Transparent Photovoltaic Module Systems," Energies, MDPI, vol. 16(3), pages 1-11, January.
    8. Sue Ellen Haupt & Tyler C. McCandless & Susan Dettling & Stefano Alessandrini & Jared A. Lee & Seth Linden & William Petzke & Thomas Brummet & Nhi Nguyen & Branko Kosović & Gerry Wiener & Tahani Hussa, 2020. "Combining Artificial Intelligence with Physics-Based Methods for Probabilistic Renewable Energy Forecasting," Energies, MDPI, vol. 13(8), pages 1-23, April.
    9. Jebli, Imane & Belouadha, Fatima-Zahra & Kabbaj, Mohammed Issam & Tilioua, Amine, 2021. "Prediction of solar energy guided by pearson correlation using machine learning," Energy, Elsevier, vol. 224(C).
    10. Liu, Jiarui & Fu, Yuchen, 2023. "Renewable energy forecasting: A self-supervised learning-based transformer variant," Energy, Elsevier, vol. 284(C).
    11. Gao, Bixuan & Huang, Xiaoqiao & Shi, Junsheng & Tai, Yonghang & Zhang, Jun, 2020. "Hourly forecasting of solar irradiance based on CEEMDAN and multi-strategy CNN-LSTM neural networks," Renewable Energy, Elsevier, vol. 162(C), pages 1665-1683.
    12. Ghimire, Sujan & Deo, Ravinesh C. & Raj, Nawin & Mi, Jianchun, 2019. "Deep solar radiation forecasting with convolutional neural network and long short-term memory network algorithms," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    13. Jiang, Ping & Nie, Ying & Wang, Jianzhou & Huang, Xiaojia, 2023. "Multivariable short-term electricity price forecasting using artificial intelligence and multi-input multi-output scheme," Energy Economics, Elsevier, vol. 117(C).
    14. Zhang, Gang & Yang, Dazhi & Galanis, George & Androulakis, Emmanouil, 2022. "Solar forecasting with hourly updated numerical weather prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 154(C).
    15. Seok-Jun Bu & Sung-Bae Cho, 2020. "Time Series Forecasting with Multi-Headed Attention-Based Deep Learning for Residential Energy Consumption," Energies, MDPI, vol. 13(18), pages 1-16, September.
    16. Zang, Haixiang & Liu, Ling & Sun, Li & Cheng, Lilin & Wei, Zhinong & Sun, Guoqiang, 2020. "Short-term global horizontal irradiance forecasting based on a hybrid CNN-LSTM model with spatiotemporal correlations," Renewable Energy, Elsevier, vol. 160(C), pages 26-41.
    17. Bastos, Bruno Quaresma & Cyrino Oliveira, Fernando Luiz & Milidiú, Ruy Luiz, 2021. "U-Convolutional model for spatio-temporal wind speed forecasting," International Journal of Forecasting, Elsevier, vol. 37(2), pages 949-970.
    18. Miguel López Santos & Xela García-Santiago & Fernando Echevarría Camarero & Gonzalo Blázquez Gil & Pablo Carrasco Ortega, 2022. "Application of Temporal Fusion Transformer for Day-Ahead PV Power Forecasting," Energies, MDPI, vol. 15(14), pages 1-22, July.
    19. Wang, Wei & Feng, Bin & Huang, Gang & Guo, Chuangxin & Liao, Wenlong & Chen, Zhe, 2023. "Conformal asymmetric multi-quantile generative transformer for day-ahead wind power interval prediction," Applied Energy, Elsevier, vol. 333(C).
    20. Zhang, Liwenbo & Wilson, Robin & Sumner, Mark & Wu, Yupeng, 2023. "Advanced multimodal fusion method for very short-term solar irradiance forecasting using sky images and meteorological data: A gate and transformer mechanism approach," Renewable Energy, Elsevier, vol. 216(C).
    21. Mirza, Adeel Feroz & Shu, Zhaokun & Usman, Muhammad & Mansoor, Majad & Ling, Qiang, 2024. "Quantile-transformed multi-attention residual framework (QT-MARF) for medium-term PV and wind power prediction," Renewable Energy, Elsevier, vol. 220(C).
    22. Natei Ermias Benti & Mesfin Diro Chaka & Addisu Gezahegn Semie, 2023. "Forecasting Renewable Energy Generation with Machine Learning and Deep Learning: Current Advances and Future Prospects," Sustainability, MDPI, vol. 15(9), pages 1-33, April.
    23. Kumari, Pratima & Toshniwal, Durga, 2021. "Long short term memory–convolutional neural network based deep hybrid approach for solar irradiance forecasting," Applied Energy, Elsevier, vol. 295(C).
    24. Zhuoyuan Lyu & Ying Shen & Yu Zhao & Tao Hu, 2023. "Solar Radiation Prediction Based on Conformer-GLaplace-SDAR Model," Sustainability, MDPI, vol. 15(20), pages 1-18, October.
    25. Liu, Yehong & Yin, Guosheng, 2020. "The Delaunay triangulation learner and its ensembles," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    26. Jiang, Chengcheng & Zhu, Qunzhi, 2023. "Evaluating the most significant input parameters for forecasting global solar radiation of different sequences based on Informer," Applied Energy, Elsevier, vol. 348(C).
    27. Anton Orlov & Jana Sillmann & Ilaria Vigo, 2020. "Author Correction: Better seasonal forecasts for the renewable energy industry," Nature Energy, Nature, vol. 5(3), pages 271-271, March.
    28. Elizabeth Michael, Neethu & Hasan, Shazia & Al-Durra, Ahmed & Mishra, Manohar, 2022. "Short-term solar irradiance forecasting based on a novel Bayesian optimized deep Long Short-Term Memory neural network," Applied Energy, Elsevier, vol. 324(C).
    29. Huang, Xiaoqiao & Li, Qiong & Tai, Yonghang & Chen, Zaiqing & Zhang, Jun & Shi, Junsheng & Gao, Bixuan & Liu, Wuming, 2021. "Hybrid deep neural model for hourly solar irradiance forecasting," Renewable Energy, Elsevier, vol. 171(C), pages 1041-1060.
    30. Fengyuan Tian & Xuexin Fan & Ruitian Wang & Haochen Qin & Yaxiang Fan & Albert Alexander Stonier, 2022. "A Power Forecasting Method for Ultra-Short-Term Photovoltaic Power Generation Using Transformer Model," Mathematical Problems in Engineering, Hindawi, vol. 2022, pages 1-15, October.
    31. Chen, Shanlin & Li, Chengxi & Xie, Yuying & Li, Mengying, 2023. "Global and direct solar irradiance estimation using deep learning and selected spectral satellite images," Applied Energy, Elsevier, vol. 352(C).
    32. Ahajjam, Mohamed Aymane & Bonilla Licea, Daniel & Ghogho, Mounir & Kobbane, Abdellatif, 2022. "Experimental investigation of variational mode decomposition and deep learning for short-term multi-horizon residential electric load forecasting," Applied Energy, Elsevier, vol. 326(C).
    33. Junhui Huang & Sakdirat Kaewunruen, 2023. "Forecasting Energy Consumption of a Public Building Using Transformer and Support Vector Regression," Energies, MDPI, vol. 16(2), pages 1-15, January.
    34. N. Yogambal Jayalakshmi & R. Shankar & Umashankar Subramaniam & I. Baranilingesan & Alagar Karthick & Balasubramaniam Stalin & Robbi Rahim & Aritra Ghosh, 2021. "Novel Multi-Time Scale Deep Learning Algorithm for Solar Irradiance Forecasting," Energies, MDPI, vol. 14(9), pages 1-23, April.
    35. Jian Zhu & Zhiyuan Zhao & Xiaoran Zheng & Zhao An & Qingwu Guo & Zhikai Li & Jianling Sun & Yuanjun Guo, 2023. "Time-Series Power Forecasting for Wind and Solar Energy Based on the SL-Transformer," Energies, MDPI, vol. 16(22), pages 1-15, November.
    36. Cao, Yisheng & Liu, Gang & Luo, Donghua & Bavirisetti, Durga Prasad & Xiao, Gang, 2023. "Multi-timescale photovoltaic power forecasting using an improved Stacking ensemble algorithm based LSTM-Informer model," Energy, Elsevier, vol. 283(C).
    37. Zendehboudi, Sohrab & Rezaei, Nima & Lohi, Ali, 2018. "Applications of hybrid models in chemical, petroleum, and energy systems: A systematic review," Applied Energy, Elsevier, vol. 228(C), pages 2539-2566.
    38. Hewamalage, Hansika & Bergmeir, Christoph & Bandara, Kasun, 2021. "Recurrent Neural Networks for Time Series Forecasting: Current status and future directions," International Journal of Forecasting, Elsevier, vol. 37(1), pages 388-427.
    39. Liu, Jingxuan & Zang, Haixiang & Cheng, Lilin & Ding, Tao & Wei, Zhinong & Sun, Guoqiang, 2023. "A Transformer-based multimodal-learning framework using sky images for ultra-short-term solar irradiance forecasting," Applied Energy, Elsevier, vol. 342(C).
    40. Anton Orlov & Jana Sillmann & Ilaria Vigo, 2020. "Better seasonal forecasts for the renewable energy industry," Nature Energy, Nature, vol. 5(2), pages 108-110, February.
    41. Si, Zhiyuan & Yang, Ming & Yu, Yixiao & Ding, Tingting, 2021. "Photovoltaic power forecast based on satellite images considering effects of solar position," Applied Energy, Elsevier, vol. 302(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xu, Shaozhen & Liu, Jun & Huang, Xiaoqiao & Li, Chengli & Chen, Zaiqing & Tai, Yonghang, 2024. "Minutely multi-step irradiance forecasting based on all-sky images using LSTM-InformerStack hybrid model with dual feature enhancement," Renewable Energy, Elsevier, vol. 224(C).
    2. Elizabeth Michael, Neethu & Hasan, Shazia & Al-Durra, Ahmed & Mishra, Manohar, 2022. "Short-term solar irradiance forecasting based on a novel Bayesian optimized deep Long Short-Term Memory neural network," Applied Energy, Elsevier, vol. 324(C).
    3. Jiang, Chengcheng & Zhu, Qunzhi, 2023. "Evaluating the most significant input parameters for forecasting global solar radiation of different sequences based on Informer," Applied Energy, Elsevier, vol. 348(C).
    4. Neethu Elizabeth Michael & Manohar Mishra & Shazia Hasan & Ahmed Al-Durra, 2022. "Short-Term Solar Power Predicting Model Based on Multi-Step CNN Stacked LSTM Technique," Energies, MDPI, vol. 15(6), pages 1-20, March.
    5. Sibtain, Muhammad & Li, Xianshan & Saleem, Snoober & Ain, Qurat-ul- & Shi, Qiang & Li, Fei & Saeed, Muhammad & Majeed, Fatima & Shah, Syed Shoaib Ahmed & Saeed, Muhammad Hammad, 2022. "Multifaceted irradiance prediction by exploiting hybrid decomposition-entropy-Spatiotemporal attention based Sequence2Sequence models," Renewable Energy, Elsevier, vol. 196(C), pages 648-682.
    6. Zhao, He & Huang, Xiaoqiao & Xiao, Zenan & Shi, Haoyuan & Li, Chengli & Tai, Yonghang, 2024. "Week-ahead hourly solar irradiation forecasting method based on ICEEMDAN and TimesNet networks," Renewable Energy, Elsevier, vol. 220(C).
    7. Liu, Jiarui & Fu, Yuchen, 2023. "Renewable energy forecasting: A self-supervised learning-based transformer variant," Energy, Elsevier, vol. 284(C).
    8. Acikgoz, Hakan, 2022. "A novel approach based on integration of convolutional neural networks and deep feature selection for short-term solar radiation forecasting," Applied Energy, Elsevier, vol. 305(C).
    9. Niu, Tong & Li, Jinkai & Wei, Wei & Yue, Hui, 2022. "A hybrid deep learning framework integrating feature selection and transfer learning for multi-step global horizontal irradiation forecasting," Applied Energy, Elsevier, vol. 326(C).
    10. Ding, Song & Cai, Zhijian & Qin, Xinghuan & Shen, Xingao, 2024. "Comparative assessment and policy analysis of forecasting quarterly renewable energy demand: Fresh evidence from an innovative seasonal approach with superior matching algorithms," Applied Energy, Elsevier, vol. 367(C).
    11. Nourani, Vahid & Sharghi, Elnaz & Behfar, Nazanin & Zhang, Yongqiang, 2022. "Multi-step-ahead solar irradiance modeling employing multi-frequency deep learning models and climatic data," Applied Energy, Elsevier, vol. 315(C).
    12. Vu, Ba Hau & Chung, Il-Yop, 2022. "Optimal generation scheduling and operating reserve management for PV generation using RNN-based forecasting models for stand-alone microgrids," Renewable Energy, Elsevier, vol. 195(C), pages 1137-1154.
    13. Putri Nor Liyana Mohamad Radzi & Muhammad Naveed Akhter & Saad Mekhilef & Noraisyah Mohamed Shah, 2023. "Review on the Application of Photovoltaic Forecasting Using Machine Learning for Very Short- to Long-Term Forecasting," Sustainability, MDPI, vol. 15(4), pages 1-21, February.
    14. Perera, Maneesha & De Hoog, Julian & Bandara, Kasun & Senanayake, Damith & Halgamuge, Saman, 2024. "Day-ahead regional solar power forecasting with hierarchical temporal convolutional neural networks using historical power generation and weather data," Applied Energy, Elsevier, vol. 361(C).
    15. Hoyos-Gómez, Laura S. & Ruiz-Muñoz, Jose F. & Ruiz-Mendoza, Belizza J., 2022. "Short-term forecasting of global solar irradiance in tropical environments with incomplete data," Applied Energy, Elsevier, vol. 307(C).
    16. Zheng, Jianqin & Du, Jian & Wang, Bohong & Klemeš, Jiří Jaromír & Liao, Qi & Liang, Yongtu, 2023. "A hybrid framework for forecasting power generation of multiple renewable energy sources," Renewable and Sustainable Energy Reviews, Elsevier, vol. 172(C).
    17. Gupta, Priya & Singh, Rhythm, 2023. "Combining a deep learning model with multivariate empirical mode decomposition for hourly global horizontal irradiance forecasting," Renewable Energy, Elsevier, vol. 206(C), pages 908-927.
    18. Amir A. Imam & Abdullah Abusorrah & Mustafa M. A. Seedahmed & Mousa Marzband, 2024. "Accurate Forecasting of Global Horizontal Irradiance in Saudi Arabia: A Comparative Study of Machine Learning Predictive Models and Feature Selection Techniques," Mathematics, MDPI, vol. 12(16), pages 1-25, August.
    19. Yin, Linfei & Cao, Xinghui & Liu, Dongduan, 2023. "Weighted fully-connected regression networks for one-day-ahead hourly photovoltaic power forecasting," Applied Energy, Elsevier, vol. 332(C).
    20. Wang, Yun & Song, Mengmeng & Yang, Dazhi, 2024. "Local-global feature-based spatio-temporal wind speed forecasting with a sparse and dynamic graph," Energy, Elsevier, vol. 289(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:369:y:2024:i:c:s0306261924009243. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.