IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v201y2022ip1p792-801.html
   My bibliography  Save this article

Optimal scheduling of a wind energy dominated distribution network via a deep reinforcement learning approach

Author

Listed:
  • Zhu, Jiaoyiling
  • Hu, Weihao
  • Xu, Xiao
  • Liu, Haoming
  • Pan, Li
  • Fan, Haoyang
  • Zhang, Zhenyuan
  • Chen, Zhe

Abstract

With the development of clean energy systems, large-scale renewable energy is being connected to the traditional distribution network, which also brings new challenges to the reliable and economic scheduling of the power grid. To address these challenges, this paper proposes an intelligent scheduling strategy for a wind energy dominated distribution network, which aims to reduce the fluctuation caused by the wind energy. First, the energy scheduling model and objective function of the distribution network system are established and the constraints of various types of components are considered. Then, deep reinforcement learning is introduced to realize real-time decision in distribution network to solve the problem of fluctuation caused by the uncertain wind power output. The energy scheduling method is developed into a Markov decision process based on deep deterministic policy gradient (DDPG) algorithm. Finally, the simulation is verified on the IEEE14 node system. The results verify that the proposed approach can effectively reduce power fluctuations in the distribution network. The superiority of the adopted DDPG algorithm is demonstrated by comparing with the deep Q network algorithm.

Suggested Citation

  • Zhu, Jiaoyiling & Hu, Weihao & Xu, Xiao & Liu, Haoming & Pan, Li & Fan, Haoyang & Zhang, Zhenyuan & Chen, Zhe, 2022. "Optimal scheduling of a wind energy dominated distribution network via a deep reinforcement learning approach," Renewable Energy, Elsevier, vol. 201(P1), pages 792-801.
  • Handle: RePEc:eee:renene:v:201:y:2022:i:p1:p:792-801
    DOI: 10.1016/j.renene.2022.10.094
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148122015968
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.renene.2022.10.094?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xu, Xiao & Hu, Weihao & Cao, Di & Huang, Qi & Chen, Cong & Chen, Zhe, 2020. "Optimized sizing of a standalone PV-wind-hydropower station with pumped-storage installation hybrid energy system," Renewable Energy, Elsevier, vol. 147(P1), pages 1418-1431.
    2. Hua, Haochen & Qin, Yuchao & Hao, Chuantong & Cao, Junwei, 2019. "Optimal energy management strategies for energy Internet via deep reinforcement learning approach," Applied Energy, Elsevier, vol. 239(C), pages 598-609.
    3. Azaza, Maher & Wallin, Fredrik, 2017. "Multi objective particle swarm optimization of hybrid micro-grid system: A case study in Sweden," Energy, Elsevier, vol. 123(C), pages 108-118.
    4. Templeton, J.D. & Hassani, F. & Ghoreishi-Madiseh, S.A., 2016. "Study of effective solar energy storage using a double pipe geothermal heat exchanger," Renewable Energy, Elsevier, vol. 86(C), pages 173-181.
    5. Moiseeva, Ekaterina & Wogrin, Sonja & Hesamzadeh, Mohammad Reza, 2017. "Generation flexibility in ramp rates: Strategic behavior and lessons for electricity market design," European Journal of Operational Research, Elsevier, vol. 261(2), pages 755-771.
    6. Malheiro, André & Castro, Pedro M. & Lima, Ricardo M. & Estanqueiro, Ana, 2015. "Integrated sizing and scheduling of wind/PV/diesel/battery isolated systems," Renewable Energy, Elsevier, vol. 83(C), pages 646-657.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhou, Yanting & Ma, Zhongjing & Shi, Xingyu & Zou, Suli, 2024. "Multi-agent optimal scheduling for integrated energy system considering the global carbon emission constraint," Energy, Elsevier, vol. 288(C).
    2. Rekha Guchhait & Biswajit Sarkar, 2023. "Increasing Growth of Renewable Energy: A State of Art," Energies, MDPI, vol. 16(6), pages 1-29, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rahmat Khezri & Amin Mahmoudi & Hirohisa Aki & S. M. Muyeen, 2021. "Optimal Planning of Remote Area Electricity Supply Systems: Comprehensive Review, Recent Developments and Future Scopes," Energies, MDPI, vol. 14(18), pages 1-29, September.
    2. Xu, Xiao & Hu, Weihao & Du, Yuefang & Liu, Wen & Liu, Zhou & Huang, Qi & Chen, Zhe, 2020. "Robust chance-constrained gas management for a standalone gas supply system based on wind energy," Energy, Elsevier, vol. 212(C).
    3. Qi, Yunying & Xu, Xiao & Liu, Youbo & Pan, Li & Liu, Junyong & Hu, Weihao, 2024. "Intelligent energy management for an on-grid hydrogen refueling station based on dueling double deep Q network algorithm with NoisyNet," Renewable Energy, Elsevier, vol. 222(C).
    4. Zhao, Yi-Bo & Dong, Xiao-Jian & Shen, Jia-Ni & He, Yi-Jun, 2024. "Simultaneous sizing and scheduling optimization for PV-wind-battery hybrid systems with a modified battery lifetime model: A high-resolution analysis in China," Applied Energy, Elsevier, vol. 360(C).
    5. Adefarati, T. & Bansal, R.C. & Bettayeb, M. & Naidoo, R., 2022. "Technical, economic, and environmental assessment of the distribution power system with the application of renewable energy technologies," Renewable Energy, Elsevier, vol. 199(C), pages 278-297.
    6. Islam, M.S. & Das, Barun K. & Das, Pronob & Rahaman, Md Habibur, 2021. "Techno-economic optimization of a zero emission energy system for a coastal community in Newfoundland, Canada," Energy, Elsevier, vol. 220(C).
    7. Jiaxin Lu & Weijun Wang & Yingchao Zhang & Song Cheng, 2017. "Multi-Objective Optimal Design of Stand-Alone Hybrid Energy System Using Entropy Weight Method Based on HOMER," Energies, MDPI, vol. 10(10), pages 1-17, October.
    8. Avilés A., Camilo & Oliva H., Sebastian & Watts, David, 2019. "Single-dwelling and community renewable microgrids: Optimal sizing and energy management for new business models," Applied Energy, Elsevier, vol. 254(C).
    9. Bhatt, Ankit & Sharma, M.P. & Saini, R.P., 2016. "Feasibility and sensitivity analysis of an off-grid micro hydro–photovoltaic–biomass and biogas–diesel–battery hybrid energy system for a remote area in Uttarakhand state, India," Renewable and Sustainable Energy Reviews, Elsevier, vol. 61(C), pages 53-69.
    10. Ahmad Alzahrani & Senthil Kumar Ramu & Gunapriya Devarajan & Indragandhi Vairavasundaram & Subramaniyaswamy Vairavasundaram, 2022. "A Review on Hydrogen-Based Hybrid Microgrid System: Topologies for Hydrogen Energy Storage, Integration, and Energy Management with Solar and Wind Energy," Energies, MDPI, vol. 15(21), pages 1-32, October.
    11. Skroufouta, S. & Baltas, E., 2021. "Investigation of hybrid renewable energy system (HRES) for covering energy and water needs on the Island of Karpathos in Aegean Sea," Renewable Energy, Elsevier, vol. 173(C), pages 141-150.
    12. Xu, Xiao & Hu, Weihao & Cao, Di & Liu, Wen & Huang, Qi & Hu, Yanting & Chen, Zhe, 2021. "Enhanced design of an offgrid PV-battery-methanation hybrid energy system for power/gas supply," Renewable Energy, Elsevier, vol. 167(C), pages 440-456.
    13. Nian, Yong-Le & Cheng, Wen-Long, 2018. "Insights into geothermal utilization of abandoned oil and gas wells," Renewable and Sustainable Energy Reviews, Elsevier, vol. 87(C), pages 44-60.
    14. Calise, Francesco & Cappiello, Francesco Liberato & Dentice d’Accadia, Massimo & Vicidomini, Maria, 2020. "Dynamic modelling and thermoeconomic analysis of micro wind turbines and building integrated photovoltaic panels," Renewable Energy, Elsevier, vol. 160(C), pages 633-652.
    15. Abdullah Al-Shereiqi & Amer Al-Hinai & Mohammed Albadi & Rashid Al-Abri, 2021. "Optimal Sizing of Hybrid Wind-Solar Power Systems to Suppress Output Fluctuation," Energies, MDPI, vol. 14(17), pages 1-16, August.
    16. Zhang, Yijie & Ma, Tao & Elia Campana, Pietro & Yamaguchi, Yohei & Dai, Yanjun, 2020. "A techno-economic sizing method for grid-connected household photovoltaic battery systems," Applied Energy, Elsevier, vol. 269(C).
    17. Ahmad, Tanveer & Chen, Huanxin, 2019. "Deep learning for multi-scale smart energy forecasting," Energy, Elsevier, vol. 175(C), pages 98-112.
    18. Jicheng Liu & Fangqiu Xu & Shuaishuai Lin & Hua Cai & Suli Yan, 2018. "A Multi-Agent-Based Optimization Model for Microgrid Operation Using Dynamic Guiding Chaotic Search Particle Swarm Optimization," Energies, MDPI, vol. 11(12), pages 1-22, November.
    19. Yang, Jingze & Chi, Hetian & Cheng, Mohan & Dong, Mingqi & Li, Siwu & Yao, Hong, 2023. "Performance analysis of hydrogen supply using curtailed power from a solar-wind-storage power system," Renewable Energy, Elsevier, vol. 212(C), pages 1005-1019.
    20. Bedoić, Robert & Dorotić, Hrvoje & Schneider, Daniel Rolph & Čuček, Lidija & Ćosić, Boris & Pukšec, Tomislav & Duić, Neven, 2021. "Synergy between feedstock gate fee and power-to-gas: An energy and economic analysis of renewable methane production in a biogas plant," Renewable Energy, Elsevier, vol. 173(C), pages 12-23.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:201:y:2022:i:p1:p:792-801. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.