IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i12p4655-d1168966.html
   My bibliography  Save this article

Real-Time Control of Gas Supply System for a PEMFC Cold-Start Based on the MADDPG Algorithm

Author

Listed:
  • Lei Pan

    (School of Automotive Studies, Tongji University, Shanghai 201804, China)

  • Tong Zhang

    (School of Automotive Studies, Tongji University, Shanghai 201804, China)

  • Yuan Gao

    (School of Automotive Studies, Tongji University, Shanghai 201804, China)

Abstract

During the cold-start process of a PEMFC, the supply of air and hydrogen in the gas supply system has a great influence on the cold-start performance. The cold-start of a PEMFC is a complex nonlinear coupling process, and the traditional control strategy is not sensitive to the real-time characteristics of the system. Inspired by the strong perception and decision-making abilities of deep reinforcement learning, this paper proposes a cold-start control strategy for a gas supply system based on the MADDPG algorithm, and designs an air supply controller and a hydrogen supply controller based on this algorithm. The proposed strategy can optimize the control parameters of the gas supply system in real time according to the temperature rise rate of the stack during the cold-start process, the fluctuation of the OER, and the voltage output characteristics. After the strategy is trained offline according to the designed reward function, the detailed in-loop simulation experiment results are given and compared with the traditional control strategy for the gas supply system. From the results, it can be seen that the proposed MADDPG control strategy has a more effective coordination control effect.

Suggested Citation

  • Lei Pan & Tong Zhang & Yuan Gao, 2023. "Real-Time Control of Gas Supply System for a PEMFC Cold-Start Based on the MADDPG Algorithm," Energies, MDPI, vol. 16(12), pages 1-20, June.
    • Handle: RePEc:gam:jeners:v:16:y:2023:i:12:p:4655-:d:1168966
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/12/4655/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/16/12/4655/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Zuo, Jian & Lv, Hong & Zhou, Daming & Xue, Qiong & Jin, Liming & Zhou, Wei & Yang, Daijun & Zhang, Cunman, 2021. "Deep learning based prognostic framework towards proton exchange membrane fuel cell for automotive application," Applied Energy, Elsevier, vol. 281(C).
    2. Ma, Rui & Yang, Tao & Breaz, Elena & Li, Zhongliang & Briois, Pascal & Gao, Fei, 2018. "Data-driven proton exchange membrane fuel cell degradation predication through deep learning method," Applied Energy, Elsevier, vol. 231(C), pages 102-115.
    3. Sun, Li & Shen, Jiong & Hua, Qingsong & Lee, Kwang Y., 2018. "Data-driven oxygen excess ratio control for proton exchange membrane fuel cell," Applied Energy, Elsevier, vol. 231(C), pages 866-875.
    4. Li, Linjun & Wang, Shixue & Yue, Like & Wang, Guozhuo, 2019. "Cold-start method for proton-exchange membrane fuel cells based on locally heating the cathode," Applied Energy, Elsevier, vol. 254(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Deng, Zhihua & Chan, Siew Hwa & Chen, Qihong & Liu, Hao & Zhang, Liyan & Zhou, Keliang & Tong, Sirui & Fu, Zhichao, 2023. "Efficient degradation prediction of PEMFCs using ELM-AE based on fuzzy extension broad learning system," Applied Energy, Elsevier, vol. 331(C).
    2. Chen, Kui & Badji, Abderrezak & Laghrouche, Salah & Djerdir, Abdesslem, 2022. "Polymer electrolyte membrane fuel cells degradation prediction using multi-kernel relevance vector regression and whale optimization algorithm," Applied Energy, Elsevier, vol. 318(C).
    3. Danqi Su & Jiayang Zheng & Junjie Ma & Zizhe Dong & Zhangjie Chen & Yanzhou Qin, 2023. "Application of Machine Learning in Fuel Cell Research," Energies, MDPI, vol. 16(11), pages 1-32, May.
    4. He, Wenbin & Liu, Ting & Ming, Wuyi & Li, Zongze & Du, Jinguang & Li, Xiaoke & Guo, Xudong & Sun, Peiyan, 2024. "Progress in prediction of remaining useful life of hydrogen fuel cells based on deep learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 192(C).
    5. Deng, Huiwen & Hu, Weihao & Cao, Di & Chen, Weirong & Huang, Qi & Chen, Zhe & Blaabjerg, Frede, 2022. "Degradation trajectories prognosis for PEM fuel cell systems based on Gaussian process regression," Energy, Elsevier, vol. 244(PA).
    6. Zuo, Jian & Steiner, Nadia Yousfi & Li, Zhongliang & Hissel, Daniel, 2024. "Health management review for fuel cells: Focus on action phase," Renewable and Sustainable Energy Reviews, Elsevier, vol. 201(C).
    7. Liu, Ze & Xu, Sichuan & Zhao, Honghui & Wang, Yupeng, 2022. "Durability estimation and short-term voltage degradation forecasting of vehicle PEMFC system: Development and evaluation of machine learning models," Applied Energy, Elsevier, vol. 326(C).
    8. Benaggoune, Khaled & Yue, Meiling & Jemei, Samir & Zerhouni, Noureddine, 2022. "A data-driven method for multi-step-ahead prediction and long-term prognostics of proton exchange membrane fuel cell," Applied Energy, Elsevier, vol. 313(C).
    9. Lv, Jianfeng & Shen, Xiaoning & Gao, Yabin & Liu, Jianxing & Sun, Guanghui, 2024. "The seasonal-trend disentangle based prognostic framework for PEM fuel cells," Renewable Energy, Elsevier, vol. 228(C).
    10. Wang, Xuechao & Chen, Jinzhou & Quan, Shengwei & Wang, Ya-Xiong & He, Hongwen, 2020. "Hierarchical model predictive control via deep learning vehicle speed predictions for oxygen stoichiometry regulation of fuel cells," Applied Energy, Elsevier, vol. 276(C).
    11. Yue, Meiling & Jemei, Samir & Zerhouni, Noureddine & Gouriveau, Rafael, 2021. "Proton exchange membrane fuel cell system prognostics and decision-making: Current status and perspectives," Renewable Energy, Elsevier, vol. 179(C), pages 2277-2294.
    12. Zhuang Tian & Zheng Wei & Jinhui Wang & Yinxiang Wang & Yuwei Lei & Ping Hu & S. M. Muyeen & Daming Zhou, 2023. "Research Progress on Aging Prediction Methods for Fuel Cells: Mechanism, Methods, and Evaluation Criteria," Energies, MDPI, vol. 16(23), pages 1-21, November.
    13. Sun, Li & Sun, Wen & You, Fengqi, 2020. "Core temperature modelling and monitoring of lithium-ion battery in the presence of sensor bias," Applied Energy, Elsevier, vol. 271(C).
    14. Sun, Li & Li, Guanru & Hua, Q.S. & Jin, Yuhui, 2020. "A hybrid paradigm combining model-based and data-driven methods for fuel cell stack cooling control," Renewable Energy, Elsevier, vol. 147(P1), pages 1642-1652.
    15. Yuxiao Qin & Guodong Zhao & Qingsong Hua & Li Sun & Soumyadeep Nag, 2019. "Multiobjective Genetic Algorithm-Based Optimization of PID Controller Parameters for Fuel Cell Voltage and Fuel Utilization," Sustainability, MDPI, vol. 11(12), pages 1-20, June.
    16. Wu, Kangcheng & Du, Qing & Zu, Bingfeng & Wang, Yupeng & Cai, Jun & Gu, Xin & Xuan, Jin & Jiao, Kui, 2021. "Enabling real-time optimization of dynamic processes of proton exchange membrane fuel cell: Data-driven approach with semi-recurrent sliding window method," Applied Energy, Elsevier, vol. 303(C).
    17. Sanghyun Yun & Jinwon Yun & Jaeyoung Han, 2023. "Development of a 470-Horsepower Fuel Cell–Battery Hybrid Xcient Dynamic Model Using Simscape TM," Energies, MDPI, vol. 16(24), pages 1-22, December.
    18. Abel Rubio & Wilton Agila & Leandro González & Jonathan Aviles-Cedeno, 2023. "Distributed Intelligence in Autonomous PEM Fuel Cell Control," Energies, MDPI, vol. 16(12), pages 1-25, June.
    19. Hu, Haowen & Ou, Kai & Yuan, Wei-Wei, 2023. "Fused multi-model predictive control with adaptive compensation for proton exchange membrane fuel cell air supply system," Energy, Elsevier, vol. 284(C).
    20. Guarino, Antonio & Trinchero, Riccardo & Canavero, Flavio & Spagnuolo, Giovanni, 2022. "A fast fuel cell parametric identification approach based on machine learning inverse models," Energy, Elsevier, vol. 239(PC).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:12:p:4655-:d:1168966. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.