IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i16p6848-d1453345.html
   My bibliography  Save this article

Optimal Rule-Interposing Reinforcement Learning-Based Energy Management of Series—Parallel-Connected Hybrid Electric Vehicles

Author

Listed:
  • Lihong Dai

    (State Key Laboratory of Engines, Tianjin University, Tianjin 300072, China
    Chery Jetour Automobile Co., Ltd., Wuhu 241100, China)

  • Peng Hu

    (Chery Jetour Automobile Co., Ltd., Wuhu 241100, China)

  • Tianyou Wang

    (State Key Laboratory of Engines, Tianjin University, Tianjin 300072, China)

  • Guosheng Bian

    (KUNTYE Vehicle System Co., Ltd., Tongling 213025, China)

  • Haoye Liu

    (State Key Laboratory of Engines, Tianjin University, Tianjin 300072, China)

Abstract

P2–P3 series–parallel hybrid electric vehicles exhibit complex configurations with multiple power sources and operational modes, presenting a difficulty in developing efficient energy management strategies. This paper takes a P2–P3 series–parallel hybrid power system-KunTye 2DHT system as the research object and proposes a deep reinforcement learning framework based on pre-optimized energy management to improve the energy consumption performance of the hybrid electric vehicles. Firstly, a control-oriented model is established based on its system configuration and characteristics. Then, the optimal distribution of the motor energy under different operating modes is pre-optimized, which aims to reduce the energy management task’s dimensionality by equating two motors as an equivalent motor. Subsequently, based on real-time traffic information under connected conditions, deep reinforcement learning is utilized to optimize the optimal operating modes of the hybrid system and the optimal distribution between the engine and equivalent motors. Combining the pre-optimized results, the optimal energy distribution between the engine and the two motors in the system is achieved. Finally, performance comparisons are made between the predictive control and the traditional Dynamic Programming and Adaptive Equivalent Consumption Minimization Strategy, revealing the proposed optimization algorithm’s promising potential in reducing fuel consumption.

Suggested Citation

  • Lihong Dai & Peng Hu & Tianyou Wang & Guosheng Bian & Haoye Liu, 2024. "Optimal Rule-Interposing Reinforcement Learning-Based Energy Management of Series—Parallel-Connected Hybrid Electric Vehicles," Sustainability, MDPI, vol. 16(16), pages 1-17, August.
  • Handle: RePEc:gam:jsusta:v:16:y:2024:i:16:p:6848-:d:1453345
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/16/6848/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/16/16/6848/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Shi, Dehua & Liu, Sheng & Cai, Yingfeng & Wang, Shaohua & Li, Haoran & Chen, Long, 2021. "Pontryagin’s minimum principle based fuzzy adaptive energy management for hybrid electric vehicle using real-time traffic information," Applied Energy, Elsevier, vol. 286(C).
    2. Han, Lijin & Yang, Ke & Ma, Tian & Yang, Ningkang & Liu, Hui & Guo, Lingxiong, 2022. "Battery life constrained real-time energy management strategy for hybrid electric vehicles based on reinforcement learning," Energy, Elsevier, vol. 259(C).
    3. Yang, Ningkang & Ruan, Shumin & Han, Lijin & Liu, Hui & Guo, Lingxiong & Xiang, Changle, 2023. "Reinforcement learning-based real-time intelligent energy management for hybrid electric vehicles in a model predictive control framework," Energy, Elsevier, vol. 270(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Jie & Wang, Ruochen & Ding, Renkai & Luo, Ding, 2024. "Matching design and numerical optimization of automotive thermoelectric generator system applied to range-extended electric vehicle," Applied Energy, Elsevier, vol. 370(C).
    2. Zhang, Yagang & Wang, Hui & Wang, Jingchao & Cheng, Xiaodan & Wang, Tong & Zhao, Zheng, 2024. "Ensemble optimization approach based on hybrid mode decomposition and intelligent technology for wind power prediction system," Energy, Elsevier, vol. 292(C).
    3. Gao, Kai & Luo, Pan & Xie, Jin & Chen, Bin & Wu, Yue & Du, Ronghua, 2023. "Energy management of plug-in hybrid electric vehicles based on speed prediction fused driving intention and LIDAR," Energy, Elsevier, vol. 284(C).
    4. Han, Lijin & You, Congwen & Yang, Ningkang & Liu, Hui & Chen, Ke & Xiang, Changle, 2024. "Adaptive real-time energy management strategy using heuristic search for off-road hybrid electric vehicles," Energy, Elsevier, vol. 304(C).
    5. Yang, Ningkang & Han, Lijin & Bo, Lin & Liu, Baoshuai & Chen, Xiuqi & Liu, Hui & Xiang, Changle, 2023. "Real-time adaptive energy management for off-road hybrid electric vehicles based on decision-time planning," Energy, Elsevier, vol. 282(C).
    6. da Silva, Samuel Filgueira & Eckert, Jony Javorski & Corrêa, Fernanda Cristina & Silva, Fabrício Leonardo & Silva, Ludmila C.A. & Dedini, Franco Giuseppe, 2022. "Dual HESS electric vehicle powertrain design and fuzzy control based on multi-objective optimization to increase driving range and battery life cycle," Applied Energy, Elsevier, vol. 324(C).
    7. Nie, Zifei & Farzaneh, Hooman, 2022. "Real-time dynamic predictive cruise control for enhancing eco-driving of electric vehicles, considering traffic constraints and signal phase and timing (SPaT) information, using artificial-neural-netw," Energy, Elsevier, vol. 241(C).
    8. Kerbel, Lindsey & Ayalew, Beshah & Ivanco, Andrej, 2024. "Shared learning of powertrain control policies for vehicle fleets," Applied Energy, Elsevier, vol. 365(C).
    9. Shi, Dehua & Xu, Han & Wang, Shaohua & Hu, Jia & Chen, Long & Yin, Chunfang, 2024. "Deep reinforcement learning based adaptive energy management for plug-in hybrid electric vehicle with double deep Q-network," Energy, Elsevier, vol. 305(C).
    10. Huang, Ruchen & He, Hongwen & Zhao, Xuyang & Wang, Yunlong & Li, Menglin, 2022. "Battery health-aware and naturalistic data-driven energy management for hybrid electric bus based on TD3 deep reinforcement learning algorithm," Applied Energy, Elsevier, vol. 321(C).
    11. Tang, Wenbin & Wang, Yaqian & Jiao, Xiaohong & Ren, Lina, 2023. "Hierarchical energy management strategy based on adaptive dynamic programming for hybrid electric vehicles in car-following scenarios," Energy, Elsevier, vol. 265(C).
    12. Wang, Shaohua & Zhang, Kaimei & Shi, Dehua & Li, Meng & Yin, Chunfang, 2024. "Research on economical shifting strategy for multi-gear and multi-mode parallel plug-in HEV based on DIRECT algorithm," Energy, Elsevier, vol. 286(C).
    13. Fabrizio Donatantonio & Alessandro Ferrara & Pierpaolo Polverino & Ivan Arsie & Cesare Pianese, 2022. "Novel Approaches for Energy Management Strategies of Hybrid Electric Vehicles and Comparison with Conventional Solutions," Energies, MDPI, vol. 15(6), pages 1-22, March.
    14. Cui, Wei & Cui, Naxin & Li, Tao & Cui, Zhongrui & Du, Yi & Zhang, Chenghui, 2022. "An efficient multi-objective hierarchical energy management strategy for plug-in hybrid electric vehicle in connected scenario," Energy, Elsevier, vol. 257(C).
    15. Huang, Xuejin & Zhang, Jingyi & Ou, Kai & Huang, Yin & Kang, Zehao & Mao, Xuping & Zhou, Yujie & Xuan, Dongji, 2024. "Deep reinforcement learning-based health-conscious energy management for fuel cell hybrid electric vehicles in model predictive control framework," Energy, Elsevier, vol. 304(C).
    16. Zhang, Hao & Lei, Nuo & Liu, Shang & Fan, Qinhao & Wang, Zhi, 2023. "Data-driven predictive energy consumption minimization strategy for connected plug-in hybrid electric vehicles," Energy, Elsevier, vol. 283(C).
    17. Elsisi, Mahmoud & Amer, Mohammed & Dababat, Alya’ & Su, Chun-Lien, 2023. "A comprehensive review of machine learning and IoT solutions for demand side energy management, conservation, and resilient operation," Energy, Elsevier, vol. 281(C).
    18. Gao, Renjing & Zhou, Guangli & Wang, Qi, 2024. "Real-time three-level energy management strategy for series hybrid wheel loaders based on WG-MPC," Energy, Elsevier, vol. 295(C).
    19. Hou, Zhuoran & Guo, Jianhua & Chu, Liang & Hu, Jincheng & Chen, Zheng & Zhang, Yuanjian, 2023. "Exploration the route of information integration for vehicle design: A knowledge-enhanced energy management strategy," Energy, Elsevier, vol. 282(C).
    20. Kunyu Wang & Rong Yang & Yongjian Zhou & Wei Huang & Song Zhang, 2022. "Design and Improvement of SD3-Based Energy Management Strategy for a Hybrid Electric Urban Bus," Energies, MDPI, vol. 15(16), pages 1-21, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:16:p:6848-:d:1453345. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.