IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v329y2023ics030626192201529x.html
   My bibliography  Save this article

Enabling Safety-Enhanced fast charging of electric vehicles via soft actor Critic-Lagrange DRL algorithm in a Cyber-Physical system

Author

Listed:
  • Yang, Xiaofeng
  • He, Hongwen
  • Wei, Zhongbao
  • Wang, Rui
  • Xu, Ke
  • Zhang, Dong

Abstract

Fast charging of lithium-ion battery (LIB) is critical for the further popularity of electric vehicles. However, the partial pursuit of high-power charging can violate the physical limits of LIB, and further cause unexpected side effects or even catastrophic safety issues. Motivated by this, this paper proposes a multi-state-constrained fast charging strategy for LIB, enabled by a novel deep reinforcement learning (DRL) technique. In particular, the SAC-Lagrange DRL is developed, for the first time, to train the fast-charging strategy assisted by an electro-thermal model for unmeasurable state perceiving. The proposed strategy is further performed within a cyber-physical system-based management framework, where the complicated training is carried out in the cloud, while the trained low-complexity policy is executed in the onboard controller to mitigate the risk of high computing burden. Hardware-in-Loop tests and practical charging experiments are carried out for validation. Results reveal that the proposed strategy can boost the charging speed remarkably while smartly avoid violating the electrical and thermal safety limits of LIB. Compared with the advanced DDPG-based and SAC-based strategies, the proposed one has improved the optimality and stability, and thus enjoys more guaranteed convenience and versatility in practical charging applications.

Suggested Citation

  • Yang, Xiaofeng & He, Hongwen & Wei, Zhongbao & Wang, Rui & Xu, Ke & Zhang, Dong, 2023. "Enabling Safety-Enhanced fast charging of electric vehicles via soft actor Critic-Lagrange DRL algorithm in a Cyber-Physical system," Applied Energy, Elsevier, vol. 329(C).
  • Handle: RePEc:eee:appene:v:329:y:2023:i:c:s030626192201529x
    DOI: 10.1016/j.apenergy.2022.120272
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S030626192201529X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2022.120272?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ignacio Rodriguez & Rasmus Suhr Mogensen & Andreas Fink & Taus Raunholt & Søren Markussen & Per Hartmann Christensen & Gilberto Berardinelli & Preben Mogensen & Casper Schou & Ole Madsen, 2021. "An Experimental Framework for 5G Wireless System Integration into Industry 4.0 Applications," Energies, MDPI, vol. 14(15), pages 1-23, July.
    2. Zou, Changfu & Hu, Xiaosong & Wei, Zhongbao & Tang, Xiaolin, 2017. "Electrothermal dynamics-conscious lithium-ion battery cell-level charging management via state-monitored predictive control," Energy, Elsevier, vol. 141(C), pages 250-259.
    3. Xiao, Boyi & Yang, Weiwei & Wu, Jiamin & Walker, Paul D. & Zhang, Nong, 2022. "Energy management strategy via maximum entropy reinforcement learning for an extended range logistics vehicle," Energy, Elsevier, vol. 253(C).
    4. Chu, Zhengyu & Feng, Xuning & Lu, Languang & Li, Jianqiu & Han, Xuebing & Ouyang, Minggao, 2017. "Non-destructive fast charging algorithm of lithium-ion batteries based on the control-oriented electrochemical model," Applied Energy, Elsevier, vol. 204(C), pages 1240-1250.
    5. Sun, Wenjing & Zou, Yuan & Zhang, Xudong & Guo, Ningyuan & Zhang, Bin & Du, Guodong, 2022. "High robustness energy management strategy of hybrid electric vehicle based on improved soft actor-critic deep reinforcement learning," Energy, Elsevier, vol. 258(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ren, Song & Sun, Jing, 2024. "Multi-fault diagnosis strategy based on a non-redundant interleaved measurement circuit and improved fuzzy entropy for the battery system," Energy, Elsevier, vol. 292(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lin, Qian & Wang, Jun & Xiong, Rui & Shen, Weixiang & He, Hongwen, 2019. "Towards a smarter battery management system: A critical review on optimal charging methods of lithium ion batteries," Energy, Elsevier, vol. 183(C), pages 220-234.
    2. He, Hongwen & Su, Qicong & Huang, Ruchen & Niu, Zegong, 2024. "Enabling intelligent transferable energy management of series hybrid electric tracked vehicle across motion dimensions via soft actor-critic algorithm," Energy, Elsevier, vol. 294(C).
    3. Sattarzadeh, Sara & Padisala, Shanthan K. & Shi, Ying & Mishra, Partha Pratim & Smith, Kandler & Dey, Satadru, 2023. "Feedback-based fault-tolerant and health-adaptive optimal charging of batteries," Applied Energy, Elsevier, vol. 343(C).
    4. Li, Niansi & Liu, Xiaoyong & Yu, Bendong & Li, Liang & Xu, Jianqiang & Tan, Qiong, 2021. "Study on the environmental adaptability of lithium-ion battery powered UAV under extreme temperature conditions," Energy, Elsevier, vol. 219(C).
    5. Ramadan, Mohamad & Murr, Rabih & Khaled, Mahmoud & Olabi, Abdul Ghani, 2018. "Mixed numerical - Experimental approach to enhance the heat pump performance by drain water heat recovery," Energy, Elsevier, vol. 149(C), pages 1010-1021.
    6. Kang, Hyuna & Jung, Seunghoon & Kim, Hakpyeong & Jeoung, Jaewon & Hong, Taehoon, 2024. "Reinforcement learning-based optimal scheduling model of battery energy storage system at the building level," Renewable and Sustainable Energy Reviews, Elsevier, vol. 190(PA).
    7. Meng, Lingyu & See, K.W. & Wang, Guofa & Wang, Yunpeng & Zhang, Yong & Zang, Caiyun & Xie, Bin, 2022. "Explosion-proof lithium-ion battery pack – In-depth investigation and experimental study on the design criteria," Energy, Elsevier, vol. 249(C).
    8. Yang, Fangfang & Song, Xiangbao & Dong, Guangzhong & Tsui, Kwok-Leung, 2019. "A coulombic efficiency-based model for prognostics and health estimation of lithium-ion batteries," Energy, Elsevier, vol. 171(C), pages 1173-1182.
    9. Yin, Yilin & Choe, Song-Yul, 2020. "Actively temperature controlled health-aware fast charging method for lithium-ion battery using nonlinear model predictive control," Applied Energy, Elsevier, vol. 271(C).
    10. Fanqi Meng & Xiaohong Su, 2017. "Reducing WCET Overestimations by Correcting Errors in Loop Bound Constraints," Energies, MDPI, vol. 10(12), pages 1-18, December.
    11. Ardani, M.I. & Patel, Y. & Siddiq, A. & Offer, G.J. & Martinez-Botas, R.F., 2018. "Combined experimental and numerical evaluation of the differences between convective and conductive thermal control on the performance of a lithium ion cell," Energy, Elsevier, vol. 144(C), pages 81-97.
    12. Ye Yang & Youtong Zhang & Jingyi Tian & Si Zhang, 2018. "Research on a Plug-In Hybrid Electric Bus Energy Management Strategy Considering Drivability," Energies, MDPI, vol. 11(8), pages 1-22, August.
    13. Li, Junqiu & Sun, Danni & Jin, Xin & Shi, Wentong & Sun, Chao, 2019. "Lithium-ion battery overcharging thermal characteristics analysis and an impedance-based electro-thermal coupled model simulation," Applied Energy, Elsevier, vol. 254(C).
    14. Can Aksakal & Altug Sisman, 2018. "On the Compatibility of Electric Equivalent Circuit Models for Enhanced Flooded Lead Acid Batteries Based on Electrochemical Impedance Spectroscopy," Energies, MDPI, vol. 11(1), pages 1-14, January.
    15. Jiang, Benben & Berliner, Marc D. & Lai, Kun & Asinger, Patrick A. & Zhao, Hongbo & Herring, Patrick K. & Bazant, Martin Z. & Braatz, Richard D., 2022. "Fast charging design for Lithium-ion batteries via Bayesian optimization," Applied Energy, Elsevier, vol. 307(C).
    16. Kunyu Wang & Rong Yang & Yongjian Zhou & Wei Huang & Song Zhang, 2022. "Design and Improvement of SD3-Based Energy Management Strategy for a Hybrid Electric Urban Bus," Energies, MDPI, vol. 15(16), pages 1-21, August.
    17. Gao, Qinxiang & Lei, Tao & Yao, Wenli & Zhang, Xingyu & Zhang, Xiaobin, 2023. "A health-aware energy management strategy for fuel cell hybrid electric UAVs based on safe reinforcement learning," Energy, Elsevier, vol. 283(C).
    18. Mudhafar Al-Saadi & Maher Al-Greer & Michael Short, 2023. "Reinforcement Learning-Based Intelligent Control Strategies for Optimal Power Management in Advanced Power Distribution Systems: A Survey," Energies, MDPI, vol. 16(4), pages 1-38, February.
    19. Piotr Piórkowski & Adrian Chmielewski & Krzysztof Bogdziński & Jakub Możaryn & Tomasz Mydłowski, 2018. "Research on Ultracapacitors in Hybrid Systems: Case Study," Energies, MDPI, vol. 11(10), pages 1-13, September.
    20. Nguyen, Su & Peng, Wei & Sokolowski, Peter & Alahakoon, Damminda & Yu, Xinghuo, 2018. "Optimizing rooftop photovoltaic distributed generation with battery storage for peer-to-peer energy trading," Applied Energy, Elsevier, vol. 228(C), pages 2567-2580.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:329:y:2023:i:c:s030626192201529x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.