IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i24p11156-d1547741.html
   My bibliography  Save this article

Research on Speed Planning and Energy Management Strategy for Fuel Cell Hybrid Bus in Green Wave Scenarios at Traffic Light Intersections Based on Deep Reinforcement Learning

Author

Listed:
  • Fengyan Yi

    (School of Automotive Engineering, Shandong Jiaotong University, Jinan 250357, China)

  • Wei Guo

    (School of Automotive Engineering, Shandong Jiaotong University, Jinan 250357, China)

  • Hongtao Gong

    (School of Automotive Engineering, Shandong Jiaotong University, Jinan 250357, China)

  • Yang Shen

    (School of Automotive Engineering, Shandong Jiaotong University, Jinan 250357, China)

  • Jiaming Zhou

    (School of Intelligent Manufacturing, Weifang University of Science and Technology, Weifang 262700, China)

  • Wenhao Yu

    (School of Automotive Engineering, Shandong Jiaotong University, Jinan 250357, China)

  • Dagang Lu

    (School of Automotive and Traffic Engineering, Jiangsu University, Zhenjiang 212013, China)

  • Chunchun Jia

    (Department of Vehicle Engineering, School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, China)

  • Caizhi Zhang

    (The State Key Laboratory of Mechanical Transmissions, School of Mechanical and Vehicle Engineering, Chongqing Automotive Collaborative Innovation Centre, Chongqing University, Chongqing 400044, China)

  • Farui Gong

    (School of Intelligent Manufacturing, Weifang University of Science and Technology, Weifang 262700, China)

Abstract

In the context of intelligent and connected transportation, obtaining the real-time vehicle status and comprehensive traffic data is crucial for addressing challenges related to speed optimization and energy regulation in intricate transportation situations. This paper introduces a control method for the speed optimization and energy management of a fuel cell hybrid bus (FCHB) based on the Deep Deterministic Policy Gradient (DDPG) algorithm. The strategy framework is built on a dual-objective optimization deep reinforcement learning (D-DRL) architecture, which integrates traffic signal information into the energy management framework, in addition to conventional state spaces to guide control decisions. The aim is to achieve “green wave” traffic while minimizing hydrogen consumption. To validate the effectiveness of the proposed strategy, simulation tests were conducted using the SUMO platform. The results show that in terms of speed planning, the difference between the maximum and minimum speeds of the FCHB was reduced by 21.66% compared with the traditional Intelligent Driver Model (IDM), while the acceleration and its variation were reduced by 8.89% and 13.21%, respectively. In terms of the hydrogen fuel efficiency, the proposed strategy achieved 95.71% of the performance level of the dynamic programming (DP) algorithm. The solution proposed in this paper is of great significance for improving passenger comfort and FCHB economy.

Suggested Citation

  • Fengyan Yi & Wei Guo & Hongtao Gong & Yang Shen & Jiaming Zhou & Wenhao Yu & Dagang Lu & Chunchun Jia & Caizhi Zhang & Farui Gong, 2024. "Research on Speed Planning and Energy Management Strategy for Fuel Cell Hybrid Bus in Green Wave Scenarios at Traffic Light Intersections Based on Deep Reinforcement Learning," Sustainability, MDPI, vol. 16(24), pages 1-15, December.
    • Handle: RePEc:gam:jsusta:v:16:y:2024:i:24:p:11156-:d:1547741
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/24/11156/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/16/24/11156/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jia, Chunchun & Zhou, Jiaming & He, Hongwen & Li, Jianwei & Wei, Zhongbao & Li, Kunang & Shi, Man, 2023. "A novel energy management strategy for hybrid electric bus with fuel cell health and battery thermal- and health-constrained awareness," Energy, Elsevier, vol. 271(C).
    2. Peng, Jiankun & Shen, Yang & Wu, ChangCheng & Wang, Chunhai & Yi, Fengyan & Ma, Chunye, 2023. "Research on energy-saving driving control of hydrogen fuel bus based on deep reinforcement learning in freeway ramp weaving area," Energy, Elsevier, vol. 285(C).
    3. Lu, Dagang & Yi, Fengyan & Hu, Donghai & Li, Jianwei & Yang, Qingqing & Wang, Jing, 2023. "Online optimization of energy management strategy for FCV control parameters considering dual power source lifespan decay synergy," Applied Energy, Elsevier, vol. 348(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jia, Chunchun & He, Hongwen & Zhou, Jiaming & Li, Jianwei & Wei, Zhongbao & Li, Kunang, 2023. "A novel health-aware deep reinforcement learning energy management for fuel cell bus incorporating offline high-quality experience," Energy, Elsevier, vol. 282(C).
    2. Jia, Chunchun & Zhou, Jiaming & He, Hongwen & Li, Jianwei & Wei, Zhongbao & Li, Kunang, 2024. "Health-conscious deep reinforcement learning energy management for fuel cell buses integrating environmental and look-ahead road information," Energy, Elsevier, vol. 290(C).
    3. Tomás R. Pires & João F. P. Fernandes & Paulo J. Costa Branco, 2024. "Driving Profile Optimization for Energy Management in the Formula Student Técnico Prototype," Energies, MDPI, vol. 17(24), pages 1-22, December.
    4. Ramesh Kumar Chidambaram & Dipankar Chatterjee & Barnali Barman & Partha Pratim Das & Dawid Taler & Jan Taler & Tomasz Sobota, 2023. "Effect of Regenerative Braking on Battery Life," Energies, MDPI, vol. 16(14), pages 1-24, July.
    5. Song, Dafeng & Wu, Qingtao & Zeng, Xiaohua & Zhang, Xuanming & Qian, Qifeng & Yang, DongPo, 2024. "Feedback-linearization decoupling based coordinated control of air supply and thermal management for vehicular fuel cell system," Energy, Elsevier, vol. 305(C).
    6. Shangzhe Yu & Dominik Schäfer & Shidong Zhang & Roland Peters & Felix Kunz & Rüdiger-A. Eichel, 2023. "A Three-Dimensional Time-Dependent Model of the Degradation Caused by Chromium Poisoning in a Solid Oxide Fuel Cell Stack," Energies, MDPI, vol. 16(23), pages 1-23, November.
    7. Zhang, Baodi & Chang, Liang & Teng, Teng & Chen, Qifang & Li, Qiangwei & Cao, Yaoguang & Yang, Shichun & Zhang, Xin, 2024. "Multi-objective optimization with Q-learning for cruise and power allocation control parameters of connected fuel cell hybrid vehicles," Applied Energy, Elsevier, vol. 373(C).
    8. Yang Shen & Jiaming Zhou & Jinming Zhang & Fengyan Yi & Guofeng Wang & Chaofeng Pan & Wei Guo & Xing Shu, 2023. "Research on Energy Management of Hydrogen Fuel Cell Bus Based on Deep Reinforcement Learning Considering Velocity Control," Sustainability, MDPI, vol. 15(16), pages 1-19, August.
    9. Jia, Chunchun & Li, Kunang & He, Hongwen & Zhou, Jiaming & Li, Jianwei & Wei, Zhongbao, 2023. "Health-aware energy management strategy for fuel cell hybrid bus considering air-conditioning control based on TD3 algorithm," Energy, Elsevier, vol. 283(C).
    10. Wu, Jingda & Huang, Chao & He, Hongwen & Huang, Hailong, 2024. "Confidence-aware reinforcement learning for energy management of electrified vehicles," Renewable and Sustainable Energy Reviews, Elsevier, vol. 191(C).
    11. Dapai Shi & Junjie Guo & Kangjie Liu & Qingling Cai & Zhenghong Wang & Xudong Qu, 2023. "Research on an Improved Rule-Based Energy Management Strategy Enlightened by the DP Optimization Results," Sustainability, MDPI, vol. 15(13), pages 1-13, July.
    12. Hu, Donghai & Hou, Wenshuo & Cheng, Zhaoxu & Feng, Chunxiao & Lu, Dagang & Yi, Fengyan & Yang, Qingqing & Li, Jianwei & Wang, Jing, 2024. "A temperature fluctuation suppression control method of fuel cell vehicles to reduce hydrogen consumption," Energy, Elsevier, vol. 305(C).
    13. Zhiming Zhang & Chenfu Quan & Sai Wu & Tong Zhang & Jinming Zhang, 2024. "An Electrochemical Performance Model Considering of Non-Uniform Gas Distribution Based on Porous Media Method in PEMFC Stack," Sustainability, MDPI, vol. 16(2), pages 1-19, January.
    14. Liviu I. Scurtu & Ioan Szabo & Marius Gheres, 2023. "Numerical Analysis of Crashworthiness on Electric Vehicle’s Battery Case with Auxetic Structure," Energies, MDPI, vol. 16(15), pages 1-18, August.
    15. Lu, Dagang & Yi, Fengyan & Hu, Donghai & Li, Jianwei & Yang, Qingqing & Wang, Jing, 2023. "Online optimization of energy management strategy for FCV control parameters considering dual power source lifespan decay synergy," Applied Energy, Elsevier, vol. 348(C).
    16. Peng Yin & Jinzhou Chen & Hongwen He, 2023. "Control of Oxygen Excess Ratio for a PEMFC Air Supply System by Intelligent PID Methods," Sustainability, MDPI, vol. 15(11), pages 1-20, May.
    17. Li, Jianwei & Zou, Weitao & Yang, Qingqing & Yao, Fang & Zhu, Jin, 2024. "EV charging fairness protective management against charging demand uncertainty for a new “1 to N” automatic charging pile," Energy, Elsevier, vol. 306(C).
    18. Kunang Li & Chunchun Jia & Xuefeng Han & Hongwen He, 2023. "A Novel Minimal-Cost Power Allocation Strategy for Fuel Cell Hybrid Buses Based on Deep Reinforcement Learning Algorithms," Sustainability, MDPI, vol. 15(10), pages 1-15, May.
    19. Marek Guzek & Jerzy Jackowski & Rafał S. Jurecki & Emilia M. Szumska & Piotr Zdanowicz & Marcin Żmuda, 2024. "Electric Vehicles—An Overview of Current Issues—Part 1—Environmental Impact, Source of Energy, Recycling, and Second Life of Battery," Energies, MDPI, vol. 17(1), pages 1-25, January.
    20. Han, Jie & Liu, Wenxue & Zheng, Yusheng & Khalatbarisoltani, Arash & Yang, Yalian & Hu, Xiaosong, 2023. "Health-conscious predictive energy management strategy with hybrid speed predictor for plug-in hybrid electric vehicles: Investigating the impact of battery electro-thermal-aging models," Applied Energy, Elsevier, vol. 352(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:24:p:11156-:d:1547741. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.