IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v362y2024ics0306261924003891.html
   My bibliography  Save this article

Data-driven approach for day-ahead System Non-Synchronous Penetration forecasting: A comprehensive framework, model development and analysis

Author

Listed:
  • Cardo-Miota, Javier
  • Trivedi, Rohit
  • Patra, Sandipan
  • Khadem, Shafi
  • Bahloul, Mohamed

Abstract

This article presents a comprehensive, innovative, and data-driven approach for predicting System Non-Synchronous Penetration (SNSP) levels. It consists of iterative steps that involve data analytics and forecasting model development to overcome the challenges associated with forecasting, such as data mining or overfitting. The approach starts by defining the problem domain and identifying relevant features using the Pearson correlation method. The framework ensures that all forecasting models carry out data pre-processing uniformly. The hyperparameters, understood as adjustable external factors not learned during the training process that affect the performance and predictive ability of the forecasting model are optimized using the random search algorithm to enhance the models’ performance. The study compares the performance of classical models, such as Random Forest and Light Gradient Boosting, with advanced machine learning-based models, such as Feed-forward, Gate Recurrent Unit, Short-Term Long Memory, and Convolutional Neural Network. Data from the Irish power system is chosen as a case study. The results indicate that the Feed-forward model produces the lowest errors. It has a Mean Absolute Error of about 4.09, a Root Mean Squared Error of 5.37 and a Mean Absolute Percentage Error of 18.17% respectively. This systematic and practical approach can be applied to other regions with similar challenges. This study also highlights the potential of advanced machine learning-based models in improving SNSP forecasting accuracy. The approach is beneficial for network and market operators, and ancillary service providers in smart grid network operations, with a 15-minute resolution. It provides a promising direction for future research in this area.

Suggested Citation

  • Cardo-Miota, Javier & Trivedi, Rohit & Patra, Sandipan & Khadem, Shafi & Bahloul, Mohamed, 2024. "Data-driven approach for day-ahead System Non-Synchronous Penetration forecasting: A comprehensive framework, model development and analysis," Applied Energy, Elsevier, vol. 362(C).
  • Handle: RePEc:eee:appene:v:362:y:2024:i:c:s0306261924003891
    DOI: 10.1016/j.apenergy.2024.123006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924003891
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2024.123006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Assereto, Martina & Byrne, Julie, 2021. "No real option for solar in Ireland: A real option valuation of utility scale solar investment in Ireland," Renewable and Sustainable Energy Reviews, Elsevier, vol. 143(C).
    2. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    3. Mason, Karl & Duggan, Jim & Howley, Enda, 2018. "Forecasting energy demand, wind generation and carbon dioxide emissions in Ireland using evolutionary neural networks," Energy, Elsevier, vol. 155(C), pages 705-720.
    4. Newbery, David, 2017. "Tales of two islands – Lessons for EU energy policy from electricity market reforms in Britain and Ireland," Energy Policy, Elsevier, vol. 105(C), pages 597-607.
    5. Liu, Xiaolei & Lin, Zi & Feng, Ziming, 2021. "Short-term offshore wind speed forecast by seasonal ARIMA - A comparison against GRU and LSTM," Energy, Elsevier, vol. 227(C).
    6. Newbery, David, 2021. "National Energy and Climate Plans for the island of Ireland: wind curtailment, interconnectors and storage," Energy Policy, Elsevier, vol. 158(C).
    7. Vorushylo, Inna & Keatley, Patrick & Shah, Nikhilkumar & Green, Richard & Hewitt, Neil, 2018. "How heat pumps and thermal energy storage can be used to manage wind power: A study of Ireland," Energy, Elsevier, vol. 157(C), pages 539-549.
    8. Bahloul, Mohamed & Daoud, Mohamed & Khadem, Shafiuzzaman K., 2022. "A bottom-up approach for techno-economic analysis of battery energy storage system for Irish grid DS3 service provision," Energy, Elsevier, vol. 245(C).
    9. Al kez, Dlzar & Foley, Aoife M. & McIlwaine, Neil & Morrow, D. John & Hayes, Barry P. & Zehir, M. Alparslan & Mehigan, Laura & Papari, Behnaz & Edrington, Chris S. & Baran, Mesut, 2020. "A critical evaluation of grid stability and codes, energy storage and smart loads in power systems with wind generation," Energy, Elsevier, vol. 205(C).
    10. Higgins, P. & Foley, A.M. & Douglas, R. & Li, K., 2014. "Impact of offshore wind power forecast error in a carbon constraint electricity market," Energy, Elsevier, vol. 76(C), pages 187-197.
    11. Bahloul, Mohamed & Daoud, Mohamed & Khadem, Shafi K., 2024. "Optimal dispatch of battery energy storage for multi-service provision in a collocated PV power plant considering battery ageing," Energy, Elsevier, vol. 293(C).
    12. Drew, Daniel R. & Coker, Phil J. & Bloomfield, Hannah C. & Brayshaw, David J. & Barlow, Janet F. & Richards, Andrew, 2019. "Sunny windy sundays," Renewable Energy, Elsevier, vol. 138(C), pages 870-875.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhu, Xiaoxun & Liu, Ruizhang & Chen, Yao & Gao, Xiaoxia & Wang, Yu & Xu, Zixu, 2021. "Wind speed behaviors feather analysis and its utilization on wind speed prediction using 3D-CNN," Energy, Elsevier, vol. 236(C).
    2. Coker, Phil J. & Bloomfield, Hannah C. & Drew, Daniel R. & Brayshaw, David J., 2020. "Interannual weather variability and the challenges for Great Britain’s electricity market design," Renewable Energy, Elsevier, vol. 150(C), pages 509-522.
    3. Newbery, David M., 2023. "High renewable electricity penetration: Marginal curtailment and market failure under “subsidy-free” entry," Energy Economics, Elsevier, vol. 126(C).
    4. Shi, Changfeng & Zhi, Jiaqi & Yao, Xiao & Zhang, Hong & Yu, Yue & Zeng, Qingshun & Li, Luji & Zhang, Yuxi, 2023. "How can China achieve the 2030 carbon peak goal—a crossover analysis based on low-carbon economics and deep learning," Energy, Elsevier, vol. 269(C).
    5. Li, Min & Yang, Yi & He, Zhaoshuang & Guo, Xinbo & Zhang, Ruisheng & Huang, Bingqing, 2023. "A wind speed forecasting model based on multi-objective algorithm and interpretability learning," Energy, Elsevier, vol. 269(C).
    6. Labib Shami & Teddy Lazebnik, 2024. "Implementing Machine Learning Methods in Estimating the Size of the Non-observed Economy," Computational Economics, Springer;Society for Computational Economics, vol. 63(4), pages 1459-1476, April.
    7. Zhang, Yagang & Wang, Hui & Wang, Jingchao & Cheng, Xiaodan & Wang, Tong & Zhao, Zheng, 2024. "Ensemble optimization approach based on hybrid mode decomposition and intelligent technology for wind power prediction system," Energy, Elsevier, vol. 292(C).
    8. Todd E. Clark & Florian Huber & Gary Koop & Massimiliano Marcellino, 2022. "Forecasting US Inflation Using Bayesian Nonparametric Models," Papers 2202.13793, arXiv.org.
    9. James, Nick & Menzies, Max, 2022. "Global and regional changes in carbon dioxide emissions: 1970–2019," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 608(P1).
    10. Vassilis M. Charitopoulos & Mathilde Fajardy & Chi Kong Chyong & David M. Reiner, 2022. "The case of 100% electrification of domestic heat in Great Britain," Working Papers EPRG2206, Energy Policy Research Group, Cambridge Judge Business School, University of Cambridge.
    11. Tostes, Bernardo & Henriques, Sofia T. & Brockway, Paul E. & Heun, Matthew Kuperus & Domingos, Tiago & Sousa, Tânia, 2024. "On the right track? Energy use, carbon emissions, and intensities of world rail transportation, 1840–2020," Applied Energy, Elsevier, vol. 367(C).
    12. Rafiq Asghar & Francesco Riganti Fulginei & Hamid Wadood & Sarmad Saeed, 2023. "A Review of Load Frequency Control Schemes Deployed for Wind-Integrated Power Systems," Sustainability, MDPI, vol. 15(10), pages 1-29, May.
    13. Ding, Song & Cai, Zhijian & Qin, Xinghuan & Shen, Xingao, 2024. "Comparative assessment and policy analysis of forecasting quarterly renewable energy demand: Fresh evidence from an innovative seasonal approach with superior matching algorithms," Applied Energy, Elsevier, vol. 367(C).
    14. Khasanzoda, Nasrullo & Safaraliev, Murodbek & Zicmane, Inga & Beryozkina, Svetlana & Rahimov, Jamshed & Ahyoev, Javod, 2022. "Use of smart grid based wind resources in isolated power systems," Energy, Elsevier, vol. 253(C).
    15. Yi, Yuxin & Zhang, Liming & Du, Lei & Sun, Helin, 2024. "Cross-regional integration of renewable energy and corporate carbon emissions: Evidence from China's cross-regional surplus renewable energy spot trading pilot," Energy Economics, Elsevier, vol. 135(C).
    16. Lewis, Matt & McNaughton, James & Márquez-Dominguez, Concha & Todeschini, Grazia & Togneri, Michael & Masters, Ian & Allmark, Matthew & Stallard, Tim & Neill, Simon & Goward-Brown, Alice & Robins, Pet, 2019. "Power variability of tidal-stream energy and implications for electricity supply," Energy, Elsevier, vol. 183(C), pages 1061-1074.
    17. Todd E. Clark & Florian Huber & Gary Koop & Massimiliano Marcellino & Michael Pfarrhofer, 2023. "Tail Forecasting With Multivariate Bayesian Additive Regression Trees," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(3), pages 979-1022, August.
    18. Gohdes, Nicholas & Simshauser, Paul & Wilson, Clevo, 2022. "Renewable entry costs, project finance and the role of revenue quality in Australia's National Electricity Market," Energy Economics, Elsevier, vol. 114(C).
    19. Lee, Yoonjae & Ha, Byeongmin & Hwangbo, Soonho, 2022. "Generative model-based hybrid forecasting model for renewable electricity supply using long short-term memory networks: A case study of South Korea's energy transition policy," Renewable Energy, Elsevier, vol. 200(C), pages 69-87.
    20. Ye, Li & Yang, Deling & Dang, Yaoguo & Wang, Junjie, 2022. "An enhanced multivariable dynamic time-delay discrete grey forecasting model for predicting China's carbon emissions," Energy, Elsevier, vol. 249(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:362:y:2024:i:c:s0306261924003891. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.