IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v324y2022ics0306261922006675.html
   My bibliography  Save this article

A multi-objective energy coordinative and management policy for solid oxide fuel cell using triune brain large-scale multi-agent deep deterministic policy gradient

Author

Listed:
  • Li, Jiawen

Abstract

In this paper, a data-driven multi-objective energy coordinative management policy is proposed in order to enhance the net output power and efficiency of a solid oxide fuel cell (SOFC) and prevent constraint violations. This study focuses on the optimization agent and controller design for a SOFC power system to maintain stable oxygen excess ratio (OER) and fuel utilization (FU) ratio as well as meet the load demand simultaneously. The optimization agent is responsible for output the reference OER and FU, aiming to achieve maximum net output power and operational efficiency as well as dynamic constraint satisfaction times in terms of OER and FU in real time. By applying reference OER and FU settings, the air and hydrogen flow within the SOFC can be effectively controlled by coordination of the air control agent and hydrogen control agent, respectively. In addition, a triune brain large-scale multi-agent deep deterministic policy gradient algorithm (TBL-MADDPG) is proposed. In order to improve the robustness of the proposed policy, the design of TBL-MADDPG entails curriculum learning, imitation learning and a large-scale multi-agent training framework. The performance of this proposed method is verified by the experiment.

Suggested Citation

  • Li, Jiawen, 2022. "A multi-objective energy coordinative and management policy for solid oxide fuel cell using triune brain large-scale multi-agent deep deterministic policy gradient," Applied Energy, Elsevier, vol. 324(C).
    • Handle: RePEc:eee:appene:v:324:y:2022:i:c:s0306261922006675
    DOI: 10.1016/j.apenergy.2022.119313
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261922006675
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2022.119313?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Shuxian Li & Minghui Hu & Changchao Gong & Sen Zhan & Datong Qin, 2018. "Energy Management Strategy for Hybrid Electric Vehicle Based on Driving Condition Identification Using KGA-Means," Energies, MDPI, vol. 11(6), pages 1-16, June.
    2. Shen, Peihong & Zhao, Zhiguo & Zhan, Xiaowen & Li, Jingwei & Guo, Qiuyi, 2018. "Optimal energy management strategy for a plug-in hybrid electric commercial vehicle based on velocity prediction," Energy, Elsevier, vol. 155(C), pages 838-852.
    3. Li, Jiawen & Yu, Tao & Zhang, Xiaoshun & Li, Fusheng & Lin, Dan & Zhu, Hanxin, 2021. "Efficient experience replay based deep deterministic policy gradient for AGC dispatch in integrated energy system," Applied Energy, Elsevier, vol. 285(C).
    4. Nayeripour, Majid & Hoseintabar, Mohammad, 2013. "A new control strategy of solid oxide fuel cell based on coordination between hydrogen fuel flow rate and utilization factor," Renewable and Sustainable Energy Reviews, Elsevier, vol. 27(C), pages 505-514.
    5. Prodromidis, George N. & Coutelieris, Frank A., 2017. "Thermodynamic analysis of biogas fed solid oxide fuel cell power plants," Renewable Energy, Elsevier, vol. 108(C), pages 1-10.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Abid, Md. Shadman & Apon, Hasan Jamil & Hossain, Salman & Ahmed, Ashik & Ahshan, Razzaqul & Lipu, M.S. Hossain, 2024. "A novel multi-objective optimization based multi-agent deep reinforcement learning approach for microgrid resources planning," Applied Energy, Elsevier, vol. 353(PA).
    2. Zhang, Gang & Zhou, Su & Gao, Jianhua & Fan, Lei & Lu, Yanda, 2023. "Stacks multi-objective allocation optimization for multi-stack fuel cell systems," Applied Energy, Elsevier, vol. 331(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wu, Yuankai & Tan, Huachun & Peng, Jiankun & Zhang, Hailong & He, Hongwen, 2019. "Deep reinforcement learning of energy management with continuous control strategy and traffic information for a series-parallel plug-in hybrid electric bus," Applied Energy, Elsevier, vol. 247(C), pages 454-466.
    2. López-Ibarra, Jon Ander & Gaztañaga, Haizea & Saez-de-Ibarra, Andoni & Camblong, Haritza, 2020. "Plug-in hybrid electric buses total cost of ownership optimization at fleet level based on battery aging," Applied Energy, Elsevier, vol. 280(C).
    3. Zhang, Hanyu & Du, Lili, 2023. "Platoon-centered control for eco-driving at signalized intersection built upon hybrid MPC system, online learning and distributed optimization part I: Modeling and solution algorithm design," Transportation Research Part B: Methodological, Elsevier, vol. 172(C), pages 174-198.
    4. Shi, Wenzhuo & Huangfu, Yigeng & Xu, Liangcai & Pang, Shengzhao, 2022. "Online energy management strategy considering fuel cell fault for multi-stack fuel cell hybrid vehicle based on multi-agent reinforcement learning," Applied Energy, Elsevier, vol. 328(C).
    5. Shi, Dehua & Xu, Han & Wang, Shaohua & Hu, Jia & Chen, Long & Yin, Chunfang, 2024. "Deep reinforcement learning based adaptive energy management for plug-in hybrid electric vehicle with double deep Q-network," Energy, Elsevier, vol. 305(C).
    6. Wang, Yue & Zeng, Xiaohua & Song, Dafeng, 2020. "Hierarchical optimal intelligent energy management strategy for a power-split hybrid electric bus based on driving information," Energy, Elsevier, vol. 199(C).
    7. Wang, Yue & Li, Keqiang & Zeng, Xiaohua & Gao, Bolin & Hong, Jichao, 2023. "Investigation of novel intelligent energy management strategies for connected HEB considering global planning of fixed-route information," Energy, Elsevier, vol. 263(PB).
    8. Vázquez-Canteli, José R. & Nagy, Zoltán, 2019. "Reinforcement learning for demand response: A review of algorithms and modeling techniques," Applied Energy, Elsevier, vol. 235(C), pages 1072-1089.
    9. Wu, Peng & Partridge, Julius & Bucknall, Richard, 2020. "Cost-effective reinforcement learning energy management for plug-in hybrid fuel cell and battery ships," Applied Energy, Elsevier, vol. 275(C).
    10. Rajput, Daizy & Herreros, Jose M. & Innocente, Mauro S. & Bryans, Jeremy & Schaub, Joschka & Dizqah, Arash M., 2022. "Impact of the number of planetary gears on the energy efficiency of electrified powertrains," Applied Energy, Elsevier, vol. 323(C).
    11. Wang, Siyang & Lin, Xianke, 2020. "Eco-driving control of connected and automated hybrid vehicles in mixed driving scenarios," Applied Energy, Elsevier, vol. 271(C).
    12. Li, Weihan & Cui, Han & Nemeth, Thomas & Jansen, Jonathan & Ünlübayir, Cem & Wei, Zhongbao & Feng, Xuning & Han, Xuebing & Ouyang, Minggao & Dai, Haifeng & Wei, Xuezhe & Sauer, Dirk Uwe, 2021. "Cloud-based health-conscious energy management of hybrid battery systems in electric vehicles with deep reinforcement learning," Applied Energy, Elsevier, vol. 293(C).
    13. Tran, Dai-Duong & Vafaeipour, Majid & El Baghdadi, Mohamed & Barrero, Ricardo & Van Mierlo, Joeri & Hegazy, Omar, 2020. "Thorough state-of-the-art analysis of electric and hybrid vehicle powertrains: Topologies and integrated energy management strategies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 119(C).
    14. Nie, Zhigen & Jia, Yuan & Wang, Wanqiong & Chen, Zheng & Outbib, Rachid, 2022. "Co-optimization of speed planning and energy management for intelligent fuel cell hybrid vehicle considering complex traffic conditions," Energy, Elsevier, vol. 247(C).
    15. Ku, Donggyun & Choi, Minje & Yoo, Nakyoung & Shin, Seungheon & Lee, Seungjae, 2021. "A new algorithm for eco-friendly path guidance focused on electric vehicles," Energy, Elsevier, vol. 233(C).
    16. Yang, Jibin & Xu, Xiaohui & Peng, Yiqiang & Zhang, Jiye & Song, Pengyun, 2019. "Modeling and optimal energy management strategy for a catenary-battery-ultracapacitor based hybrid tramway," Energy, Elsevier, vol. 183(C), pages 1123-1135.
    17. Taghavifar, Hadi, 2021. "Fuel cell hybrid range-extender vehicle sizing: Parametric power optimization," Energy, Elsevier, vol. 229(C).
    18. Kęstutis Venslauskas & Kęstutis Navickas & Marja Nappa & Petteri Kangas & Revilija Mozūraitytė & Rasa Šližytė & Vidmantas Župerka, 2021. "Energetic and Economic Evaluation of Zero-Waste Fish Co-Stream Processing," IJERPH, MDPI, vol. 18(5), pages 1-16, February.
    19. Kumar Jadoun, Vinay & Rahul Prashanth, G & Suhas Joshi, Siddharth & Narayanan, K. & Malik, Hasmat & García Márquez, Fausto Pedro, 2022. "Optimal fuzzy based economic emission dispatch of combined heat and power units using dynamically controlled Whale Optimization Algorithm," Applied Energy, Elsevier, vol. 315(C).
    20. Pengcheng Ni & Zhiyuan Ye & Can Cao & Zhimin Guo & Jian Zhao & Xing He, 2023. "Cooperative Game-Based Collaborative Optimal Regulation-Assisted Digital Twins for Wide-Area Distributed Energy," Energies, MDPI, vol. 16(6), pages 1-17, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:324:y:2022:i:c:s0306261922006675. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.