IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v307y2024ics036054422402471x.html
   My bibliography  Save this article

Multi-performance enhanced eco-driving strategy for connected fuel cell hybrid electric bus based on stein soft actor-3-critic

Author

Listed:
  • Zhou, Jiaxuan
  • Peng, Jiankun
  • Wu, Jingda
  • Wei, Zhongbao
  • Fan, Yi
  • Guo, Xin

Abstract

Eco-driving strategies increasingly emphasize enhancing multi-performance including safety, comfort, durability, and traffic efficiency under optimal energy-saving. This paper introduces a multi-performance enhanced eco-driving strategy for connected fuel cell hybrid electric buses (FCHEBs) based on the stein soft actor-3-critic (SSA3C) algorithm. By leveraging the correlation between the international roughness index (IRI) and weighted root mean square acceleration (WRMSA), energy management system (EMS) and adaptive cruise control (ACC) are integrated the to enhancing multi-performance including vertical comfort and energy efficiency. To address the insufficient action representation and overestimation of Q-values of traditional soft actor-critic (SAC) algorithm, improvements are made to the actor and critic networks using stein variational gradient descent (SVGD) and clipped triple Q-learning (3C), respectively. Composite cycles integrating the standard cycle and IRI are developed to enhance the strategy's generalization. Experimental results indicate that the proposed eco-driving strategy, while maintaining dynamics, safety, durability, and efficiency, efficiently achieves 98.1 % energy savings and equivalent comfort level as dynamic programming (DP). Ablation experiments on vertical comfort demonstrate improvements of 1.24 % in energy efficiency and 2.94 % in WRMSA. Finally, the effectiveness of the network improvements and the adaptability of the proposed strategy are demonstrated through comparative experiments.

Suggested Citation

  • Zhou, Jiaxuan & Peng, Jiankun & Wu, Jingda & Wei, Zhongbao & Fan, Yi & Guo, Xin, 2024. "Multi-performance enhanced eco-driving strategy for connected fuel cell hybrid electric bus based on stein soft actor-3-critic," Energy, Elsevier, vol. 307(C).
    • Handle: RePEc:eee:energy:v:307:y:2024:i:c:s036054422402471x
    DOI: 10.1016/j.energy.2024.132697
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S036054422402471X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2024.132697?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zifei Nie & Hooman Farzaneh, 2021. "Role of Model Predictive Control for Enhancing Eco-Driving of Electric Vehicles in Urban Transport System of Japan," Sustainability, MDPI, vol. 13(16), pages 1-37, August.
    2. Hou, Shengyan & Yin, Hai & Xu, Fuguo & Benjamín, Pla & Gao, Jinwu & Chen, Hong, 2023. "Multihorizon predictive energy optimization and lifetime management for connected fuel cell electric vehicles," Energy, Elsevier, vol. 266(C).
    3. Xie, Shaobo & Hu, Xiaosong & Xin, Zongke & Brighton, James, 2019. "Pontryagin’s Minimum Principle based model predictive control of energy management for a plug-in hybrid electric bus," Applied Energy, Elsevier, vol. 236(C), pages 893-905.
    4. Song, Ke & Wang, Xiaodi & Li, Feiqiang & Sorrentino, Marco & Zheng, Bailin, 2020. "Pontryagin’s minimum principle-based real-time energy management strategy for fuel cell hybrid electric vehicle considering both fuel economy and power source durability," Energy, Elsevier, vol. 205(C).
    5. Wu, Jingda & He, Hongwen & Peng, Jiankun & Li, Yuecheng & Li, Zhanjiang, 2018. "Continuous reinforcement learning of energy management with deep Q network for a power split hybrid electric bus," Applied Energy, Elsevier, vol. 222(C), pages 799-811.
    6. Zhang, Hailong & Peng, Jiankun & Dong, Hanxuan & Tan, Huachun & Ding, Fan, 2023. "Hierarchical reinforcement learning based energy management strategy of plug-in hybrid electric vehicle for ecological car-following process," Applied Energy, Elsevier, vol. 333(C).
    7. Ahmed M. Ali & Dirk Söffker, 2018. "Towards Optimal Power Management of Hybrid Electric Vehicles in Real-Time: A Review on Methods, Challenges, and State-Of-The-Art Solutions," Energies, MDPI, vol. 11(3), pages 1-24, February.
    8. Anselma, Pier Giuseppe & Belingardi, Giovanni, 2022. "Fuel cell electrified propulsion systems for long-haul heavy-duty trucks: present and future cost-oriented sizing," Applied Energy, Elsevier, vol. 321(C).
    9. Feng, Zhanyu & Zhang, Jian & Jiang, Han & Yao, Xuejian & Qian, Yu & Zhang, Haiyan, 2024. "Energy consumption prediction strategy for electric vehicle based on LSTM-transformer framework," Energy, Elsevier, vol. 302(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhou, Hongxu & Yu, Zhongwei & Wu, Xiaohua & Fan, Zhanfeng & Yin, Xiaofeng & Zhou, Lingxue, 2023. "Dynamic programming improved online fuzzy power distribution in a demonstration fuel cell hybrid bus," Energy, Elsevier, vol. 284(C).
    2. Dong, Peng & Zhao, Junwei & Liu, Xuewu & Wu, Jian & Xu, Xiangyang & Liu, Yanfang & Wang, Shuhan & Guo, Wei, 2022. "Practical application of energy management strategy for hybrid electric vehicles based on intelligent and connected technologies: Development stages, challenges, and future trends," Renewable and Sustainable Energy Reviews, Elsevier, vol. 170(C).
    3. Qi, Chunyang & Song, Chuanxue & Xiao, Feng & Song, Shixin, 2022. "Generalization ability of hybrid electric vehicle energy management strategy based on reinforcement learning method," Energy, Elsevier, vol. 250(C).
    4. Lian, Renzong & Peng, Jiankun & Wu, Yuankai & Tan, Huachun & Zhang, Hailong, 2020. "Rule-interposing deep reinforcement learning based energy management strategy for power-split hybrid electric vehicle," Energy, Elsevier, vol. 197(C).
    5. Penghui Qiang & Peng Wu & Tao Pan & Huaiquan Zang, 2021. "Real-Time Approximate Equivalent Consumption Minimization Strategy Based on the Single-Shaft Parallel Hybrid Powertrain," Energies, MDPI, vol. 14(23), pages 1-22, November.
    6. Qi, Chunyang & Zhu, Yiwen & Song, Chuanxue & Yan, Guangfu & Xiao, Feng & Da wang, & Zhang, Xu & Cao, Jingwei & Song, Shixin, 2022. "Hierarchical reinforcement learning based energy management strategy for hybrid electric vehicle," Energy, Elsevier, vol. 238(PA).
    7. Sun, Wenjing & Zou, Yuan & Zhang, Xudong & Guo, Ningyuan & Zhang, Bin & Du, Guodong, 2022. "High robustness energy management strategy of hybrid electric vehicle based on improved soft actor-critic deep reinforcement learning," Energy, Elsevier, vol. 258(C).
    8. Zhuang, Weichao & Li (Eben), Shengbo & Zhang, Xiaowu & Kum, Dongsuk & Song, Ziyou & Yin, Guodong & Ju, Fei, 2020. "A survey of powertrain configuration studies on hybrid electric vehicles," Applied Energy, Elsevier, vol. 262(C).
    9. Jia, Chunchun & Li, Kunang & He, Hongwen & Zhou, Jiaming & Li, Jianwei & Wei, Zhongbao, 2023. "Health-aware energy management strategy for fuel cell hybrid bus considering air-conditioning control based on TD3 algorithm," Energy, Elsevier, vol. 283(C).
    10. Chen, Zheng & Gu, Hongji & Shen, Shiquan & Shen, Jiangwei, 2022. "Energy management strategy for power-split plug-in hybrid electric vehicle based on MPC and double Q-learning," Energy, Elsevier, vol. 245(C).
    11. Zhou, Jianhao & Xue, Yuan & Xu, Da & Li, Chaoxiong & Zhao, Wanzhong, 2022. "Self-learning energy management strategy for hybrid electric vehicle via curiosity-inspired asynchronous deep reinforcement learning," Energy, Elsevier, vol. 242(C).
    12. Bo, Lin & Han, Lijin & Xiang, Changle & Liu, Hui & Ma, Tian, 2022. "A Q-learning fuzzy inference system based online energy management strategy for off-road hybrid electric vehicles," Energy, Elsevier, vol. 252(C).
    13. Changqing Du & Shiyang Huang & Yuyao Jiang & Dongmei Wu & Yang Li, 2022. "Optimization of Energy Management Strategy for Fuel Cell Hybrid Electric Vehicles Based on Dynamic Programming," Energies, MDPI, vol. 15(12), pages 1-25, June.
    14. Peng, Hujun & Li, Jianxiang & Löwenstein, Lars & Hameyer, Kay, 2020. "A scalable, causal, adaptive energy management strategy based on optimal control theory for a fuel cell hybrid railway vehicle," Applied Energy, Elsevier, vol. 267(C).
    15. Xiao, B. & Ruan, J. & Yang, W. & Walker, P.D. & Zhang, N., 2021. "A review of pivotal energy management strategies for extended range electric vehicles," Renewable and Sustainable Energy Reviews, Elsevier, vol. 149(C).
    16. Guo, Xiaokai & Yan, Xianguo & Chen, Zhi & Meng, Zhiyu, 2022. "Research on energy management strategy of heavy-duty fuel cell hybrid vehicles based on dueling-double-deep Q-network," Energy, Elsevier, vol. 260(C).
    17. Li, Cheng & Xu, Xiangyang & Zhu, Helong & Gan, Jiongpeng & Chen, Zhige & Tang, Xiaolin, 2024. "Research on car-following control and energy management strategy of hybrid electric vehicles in connected scene," Energy, Elsevier, vol. 293(C).
    18. Zhang, Yahui & Wei, Zeyi & Wang, Zhong & Tian, Yang & Wang, Jizhe & Tian, Zhikun & Xu, Fuguo & Jiao, Xiaohong & Li, Liang & Wen, Guilin, 2024. "Hierarchical eco-driving control strategy for connected automated fuel cell hybrid vehicles and scenario-/hardware-in-the loop validation," Energy, Elsevier, vol. 292(C).
    19. Yaqian Wang & Xiaohong Jiao, 2022. "Dual Heuristic Dynamic Programming Based Energy Management Control for Hybrid Electric Vehicles," Energies, MDPI, vol. 15(9), pages 1-19, April.
    20. Zhang, Fengqi & Xiao, Lehua & Coskun, Serdar & Pang, Hui & Xie, Shaobo & Liu, Kailong & Cui, Yahui, 2023. "Comparative study of energy management in parallel hybrid electric vehicles considering battery ageing," Energy, Elsevier, vol. 264(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:307:y:2024:i:c:s036054422402471x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.