IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v377y2025ipds0306261924021561.html
   My bibliography  Save this article

Decomposition prediction fractional-order active disturbance rejection control deep Q network for generation control of integrated energy systems

Author

Listed:
  • Lu, Quan
  • Huang, Wenxuan
  • Yin, Linfei

Abstract

The number of distributed renewable energy sources of integrated energy systems (IESs) are increasing. The volatility of renewable energy exacerbates active power imbalances and increase frequency deviations in power systems. This work proposes a decomposition prediction fractional-order active disturbance rejection control deep Q network (DPFOADRCDQN) to control each generator of IESs more accurately and to reduce systemic frequency fluctuation. According to the fluctuation size of frequency deviation, the sub-signal obtained after the prediction of the modal decomposition of frequency deviation is classified into big fluctuating signals and small fluctuating signals; fractional-order active disturbance rejection control (FOADRC) controls small fluctuating signals; deep Q network (DQN) controls big fluctuating signals. Frequency deviation signals in complex power systems with a large percentage of renewable energy have higher smoothness after modal decomposition, FOADRC can efficiently follow the small fluctuating signals, and DQN can learn the rich data features in the big fluctuating signals and give precise control commands. The DPFOADRCDQN, proportional-integral-derivative, Q-learning, fuzzy control, and the previous state-of-the-art reinforcement learning are simulated in IESs where the renewable energy generators output is 0 %, 20 %, 40 %, 65 %, and 80 % of all generators output, the results show the average frequency deviation, total generation cost, and carbon emission cost are at least 42.7 %, 0.92 %, and 0.93 % smaller than the comparison algorithm, respectively.

Suggested Citation

  • Lu, Quan & Huang, Wenxuan & Yin, Linfei, 2025. "Decomposition prediction fractional-order active disturbance rejection control deep Q network for generation control of integrated energy systems," Applied Energy, Elsevier, vol. 377(PD).
    • Handle: RePEc:eee:appene:v:377:y:2025:i:pd:s0306261924021561
    DOI: 10.1016/j.apenergy.2024.124773
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924021561
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2024.124773?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xiong, Houbo & Zhou, Yue & Guo, Chuangxin & Ding, Yi & Luo, Fengji, 2023. "Multi-stage risk-based assessment for wind energy accommodation capability: A robust and non-anticipative method," Applied Energy, Elsevier, vol. 350(C).
    2. Qiu, Dawei & Dong, Zihang & Zhang, Xi & Wang, Yi & Strbac, Goran, 2022. "Safe reinforcement learning for real-time automatic control in a smart energy-hub," Applied Energy, Elsevier, vol. 309(C).
    3. Ding, Yunfei & Chen, Zijun & Zhang, Hongwei & Wang, Xin & Guo, Ying, 2022. "A short-term wind power prediction model based on CEEMD and WOA-KELM," Renewable Energy, Elsevier, vol. 189(C), pages 188-198.
    4. Han, Kunlun & Yang, Kai & Yin, Linfei, 2022. "Lightweight actor-critic generative adversarial networks for real-time smart generation control of microgrids," Applied Energy, Elsevier, vol. 317(C).
    5. Yin, Linfei & Gao, Qi & Zhao, Lulin & Wang, Tao, 2020. "Expandable deep learning for real-time economic generation dispatch and control of three-state energies based future smart grids," Energy, Elsevier, vol. 191(C).
    6. Bazdar, Elaheh & Sameti, Mohammad & Nasiri, Fuzhan & Haghighat, Fariborz, 2022. "Compressed air energy storage in integrated energy systems: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).
    7. Yin, Linfei & Li, Yu, 2022. "Hybrid multi-agent emotional deep Q network for generation control of multi-area integrated energy systems," Applied Energy, Elsevier, vol. 324(C).
    8. Li, Qingyang & Wang, Guosong & Wu, Xinrong & Gao, Zhigang & Dan, Bo, 2024. "Arctic short-term wind speed forecasting based on CNN-LSTM model with CEEMDAN," Energy, Elsevier, vol. 299(C).
    9. Zhong, Jin & Bollen, Math & Rönnberg, Sarah, 2021. "Towards a 100% renewable energy electricity generation system in Sweden," Renewable Energy, Elsevier, vol. 171(C), pages 812-824.
    10. Niu, Dongxiao & Yu, Min & Sun, Lijie & Gao, Tian & Wang, Keke, 2022. "Short-term multi-energy load forecasting for integrated energy systems based on CNN-BiGRU optimized by attention mechanism," Applied Energy, Elsevier, vol. 313(C).
    11. Leng, Ya-Jun & Li, Xiao-Shuang & Zhang, Huan, 2024. "NSGA-T: A novel evaluation method for renewable energy plans," Energy, Elsevier, vol. 290(C).
    12. Yu, Min & Niu, Dongxiao & Gao, Tian & Wang, Keke & Sun, Lijie & Li, Mingyu & Xu, Xiaomin, 2023. "A novel framework for ultra-short-term interval wind power prediction based on RF-WOA-VMD and BiGRU optimized by the attention mechanism," Energy, Elsevier, vol. 269(C).
    13. Li, Jiawen & Zhou, Tao, 2023. "Active fault-tolerant coordination energy management for a proton exchange membrane fuel cell using curriculum-based multiagent deep meta-reinforcement learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 185(C).
    14. Yin, Linfei & Zheng, Da, 2024. "Decomposition prediction fractional-order PID reinforcement learning for short-term smart generation control of integrated energy systems," Applied Energy, Elsevier, vol. 355(C).
    15. Zhu, Jizhong & Dong, Hanjiang & Zheng, Weiye & Li, Shenglin & Huang, Yanting & Xi, Lei, 2022. "Review and prospect of data-driven techniques for load forecasting in integrated energy systems," Applied Energy, Elsevier, vol. 321(C).
    16. Li, Jiawen & Yu, Tao & Zhang, Xiaoshun, 2022. "Coordinated load frequency control of multi-area integrated energy system using multi-agent deep reinforcement learning," Applied Energy, Elsevier, vol. 306(PA).
    17. Yin, Linfei & Wu, Yunzhi, 2022. "Mode-decomposition memory reinforcement network strategy for smart generation control in multi-area power systems containing renewable energy," Applied Energy, Elsevier, vol. 307(C).
    18. Li, Jiawen & Zhou, Tao & Keke, He & Yu, Hengwen & Du, Hongwei & Liu, Shuangyu & Cui, Haoyang, 2023. "Distributed quantum multiagent deep meta reinforcement learning for area autonomy energy management of a multiarea microgrid," Applied Energy, Elsevier, vol. 343(C).
    19. Yin, Linfei & Zhang, Bin, 2023. "Relaxed deep generative adversarial networks for real-time economic smart generation dispatch and control of integrated energy systems," Applied Energy, Elsevier, vol. 330(PA).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhao, Lulin & Yin, Linfei, 2024. "Knowledge-shareable adaptive deep dynamic programming for hierarchical generation control of distributed high-percentage renewable energy systems," Renewable Energy, Elsevier, vol. 228(C).
    2. Yin, Linfei & Zheng, Da, 2024. "Decomposition prediction fractional-order PID reinforcement learning for short-term smart generation control of integrated energy systems," Applied Energy, Elsevier, vol. 355(C).
    3. Yin, Linfei & He, Xiaoyu, 2023. "Artificial emotional deep Q learning for real-time smart voltage control of cyber-physical social power systems," Energy, Elsevier, vol. 273(C).
    4. Zheng, Xidong & Bai, Feifei & Zeng, Ziyang & Jin, Tao, 2024. "A new methodology to improve wind power prediction accuracy considering power quality disturbance dimension reduction and elimination," Energy, Elsevier, vol. 287(C).
    5. Zheng Wan & Hui Li, 2023. "Short-Term Power Load Forecasting Based on Feature Filtering and Error Compensation under Imbalanced Samples," Energies, MDPI, vol. 16(10), pages 1-22, May.
    6. Ma, Xin & Peng, Bo & Ma, Xiangxue & Tian, Changbin & Yan, Yi, 2023. "Multi-timescale optimization scheduling of regional integrated energy system based on source-load joint forecasting," Energy, Elsevier, vol. 283(C).
    7. Chen, Haoyu & Huang, Hai & Zheng, Yong & Yang, Bing, 2024. "A load forecasting approach for integrated energy systems based on aggregation hybrid modal decomposition and combined model," Applied Energy, Elsevier, vol. 375(C).
    8. Shi, Jian & Teh, Jiashen & Alharbi, Bader & Lai, Ching-Ming, 2024. "Load forecasting for regional integrated energy system based on two-phase decomposition and mixture prediction model," Energy, Elsevier, vol. 297(C).
    9. Cui, Xiwen & Yu, Xiaoyu & Niu, Dongxiao, 2024. "The ultra-short-term wind power point-interval forecasting model based on improved variational mode decomposition and bidirectional gated recurrent unit improved by improved sparrow search algorithm a," Energy, Elsevier, vol. 288(C).
    10. Zhong, Shangpeng & Wang, Xiaoming & Wu, Hongbin & He, Ye & Xu, Bin & Ding, Ming, 2024. "Energy hub management for integrated energy systems: A multi-objective optimization control strategy based on distributed output and energy conversion characteristics," Energy, Elsevier, vol. 306(C).
    11. Sun, Xiaoying & Liu, Haizhong, 2024. "Multivariate short-term wind speed prediction based on PSO-VMD-SE-ICEEMDAN two-stage decomposition and Att-S2S," Energy, Elsevier, vol. 305(C).
    12. Han, Kunlun & Yang, Kai & Yin, Linfei, 2022. "Lightweight actor-critic generative adversarial networks for real-time smart generation control of microgrids," Applied Energy, Elsevier, vol. 317(C).
    13. Long, Jian & Huang, Cheng & Deng, Kai & Wan, Lei & Hu, Guihua & Zhang, Feng, 2024. "Novel hybrid data-driven modeling integrating variational modal decomposition and dual-stage self-attention model: Applied to industrial petrochemical process," Energy, Elsevier, vol. 304(C).
    14. Xue, Lin & Wang, Jianxue & Zhang, Yao & Yong, Weizhen & Qi, Jie & Li, Haotian, 2023. "Model-data-event based community integrated energy system low-carbon economic scheduling," Renewable and Sustainable Energy Reviews, Elsevier, vol. 182(C).
    15. Fan, Pengdan & Wang, Dan & Wang, Wei & Zhang, Xiuyu & Sun, Yuying, 2024. "A novel multi-energy load forecasting method based on building flexibility feature recognition technology and multi-task learning model integrating LSTM," Energy, Elsevier, vol. 308(C).
    16. Lin, Zhengyang & Lin, Tao & Li, Jun & Li, Chen, 2025. "A novel short-term multi-energy load forecasting method for integrated energy system based on two-layer joint modal decomposition and dynamic optimal ensemble learning," Applied Energy, Elsevier, vol. 378(PA).
    17. Wang, Shuangxin & Shi, Jiarong & Yang, Wei & Yin, Qingyan, 2024. "High and low frequency wind power prediction based on Transformer and BiGRU-Attention," Energy, Elsevier, vol. 288(C).
    18. Wang, Chao & Lin, Hong & Yang, Ming & Fu, Xiaoling & Yuan, Yue & Wang, Zewei, 2024. "A novel chaotic time series wind power point and interval prediction method based on data denoising strategy and improved coati optimization algorithm," Chaos, Solitons & Fractals, Elsevier, vol. 187(C).
    19. Yin, Linfei & Zhang, Bin, 2023. "Relaxed deep generative adversarial networks for real-time economic smart generation dispatch and control of integrated energy systems," Applied Energy, Elsevier, vol. 330(PA).
    20. Yan, Qin & Lu, Zhiying & Liu, Hong & He, Xingtang & Zhang, Xihai & Guo, Jianlin, 2024. "Short-term prediction of integrated energy load aggregation using a bi-directional simple recurrent unit network with feature-temporal attention mechanism ensemble learning model," Applied Energy, Elsevier, vol. 355(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:377:y:2025:i:pd:s0306261924021561. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.