IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v286y2024ics0360544223028980.html
   My bibliography  Save this article

A multi-head attention mechanism aided hybrid network for identifying batteries’ state of charge

Author

Listed:
  • Li, Zongxiang
  • Li, Liwei
  • Chen, Jing
  • Wang, Dongqing

Abstract

A Convolution Neural Network and a Bidirectional Long Short-Term Memory network connected architecture with a Multi-Head Attention mechanism (CNN-BiLSTM-MHA) is studied for predicting state of charge (SOC) of lithium-ion batteries (LIBs). Firstly, an adaptive noise based complete ensemble empirical mode decomposition (AN-CEEMD) algorithm is adopted to catch the intrinsic features of measured battery signals by adding white noises. Secondly, a CNN-BiLSTM model with the MHA mechanism is developed to learn the mapping between processed input signals and battery SOC, it has three parts: 1) the CNN extracts features of the processed data, mine the relation among input signals, and promote estimation precision; 2) the BiLSTM has memory ability to catch battery dynamics, and the Swish activation function in the BiLSTM ensures unsaturated and reduces over-fitting due to its upper unbound and lower bound; 3) The multi-head attention mechanism uses several independent self-attention layers to associate input information and variables, extracts more associate information by adding weights; it reduces the overfitting risk of a single attention head, and improves the model generalization performance through joint learning of multiple heads. Finally, experiments and simulations are implemented under four operating conditions at five different temperatures, and the presented method is verified effective.

Suggested Citation

  • Li, Zongxiang & Li, Liwei & Chen, Jing & Wang, Dongqing, 2024. "A multi-head attention mechanism aided hybrid network for identifying batteries’ state of charge," Energy, Elsevier, vol. 286(C).
    • Handle: RePEc:eee:energy:v:286:y:2024:i:c:s0360544223028980
    DOI: 10.1016/j.energy.2023.129504
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544223028980
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2023.129504?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhao, Jian & Li, Xianguo & Shum, Chris & McPhee, John, 2023. "Control-oriented computational fuel cell dynamics modeling – Model order reduction vs. computational speed," Energy, Elsevier, vol. 266(C).
    2. Maosong Fan & Mengmeng Geng & Kai Yang & Mingjie Zhang & Hao Liu, 2023. "State of Health Estimation of Lithium-Ion Battery Based on Electrochemical Impedance Spectroscopy," Energies, MDPI, vol. 16(8), pages 1-14, April.
    3. Rezk, Hegazy & Olabi, A.G. & Ferahtia, Seydali & Sayed, Enas Taha, 2022. "Accurate parameter estimation methodology applied to model proton exchange membrane fuel cell," Energy, Elsevier, vol. 255(C).
    4. Wang, Xiaofei & Sun, Quan & Kou, Xiao & Ma, Wentao & Zhang, Hong & Liu, Rui, 2022. "Noise immune state of charge estimation of li-ion battery via the extreme learning machine with mixture generalized maximum correntropy criterion," Energy, Elsevier, vol. 239(PD).
    5. Atyabi, Seyed Ali & Afshari, Ebrahim & Shakarami, Negar, 2023. "Three-dimensional multiphase modeling of the performance of an open-cathode PEM fuel cell with additional cooling channels," Energy, Elsevier, vol. 263(PA).
    6. Momcilovic, Vladimir & Dimitrijevic, Branka & Stokic, Marko, 2023. "Supercapacitor electric bus modeling and simulation framework," Energy, Elsevier, vol. 282(C).
    7. Li, Jingmiao & Liu, Dehong, 2023. "Carbon price forecasting based on secondary decomposition and feature screening," Energy, Elsevier, vol. 278(PA).
    8. Ren, Xiaoqing & Liu, Shulin & Yu, Xiaodong & Dong, Xia, 2021. "A method for state-of-charge estimation of lithium-ion batteries based on PSO-LSTM," Energy, Elsevier, vol. 234(C).
    9. Takyi-Aninakwa, Paul & Wang, Shunli & Zhang, Hongying & Yang, Xiao & Fernandez, Carlos, 2023. "A hybrid probabilistic correction model for the state of charge estimation of lithium-ion batteries considering dynamic currents and temperatures," Energy, Elsevier, vol. 273(C).
    10. Gang Dou & Kaixuan Zhao & Mei Guo & Jun Mou, 2023. "Memristor-Based Lstm Network For Text Classification," FRACTALS (fractals), World Scientific Publishing Co. Pte. Ltd., vol. 31(06), pages 1-12.
    11. Oyewole, Isaiah & Chehade, Abdallah & Kim, Youngki, 2022. "A controllable deep transfer learning network with multiple domain adaptation for battery state-of-charge estimation," Applied Energy, Elsevier, vol. 312(C).
    12. Hu, Xiaosong & Jiang, Haifu & Feng, Fei & Liu, Bo, 2020. "An enhanced multi-state estimation hierarchy for advanced lithium-ion battery management," Applied Energy, Elsevier, vol. 257(C).
    13. Chaoran Li & Fei Xiao & Yaxiang Fan, 2019. "An Approach to State of Charge Estimation of Lithium-Ion Batteries Based on Recurrent Neural Networks with Gated Recurrent Unit," Energies, MDPI, vol. 12(9), pages 1-22, April.
    14. Xinwei Sun & Yang Zhang & Yongcheng Zhang & Licheng Wang & Kai Wang, 2023. "Summary of Health-State Estimation of Lithium-Ion Batteries Based on Electrochemical Impedance Spectroscopy," Energies, MDPI, vol. 16(15), pages 1-19, July.
    15. Jiang, Cong & Wang, Shunli & Wu, Bin & Fernandez, Carlos & Xiong, Xin & Coffie-Ken, James, 2021. "A state-of-charge estimation method of the power lithium-ion battery in complex conditions based on adaptive square root extended Kalman filter," Energy, Elsevier, vol. 219(C).
    16. Xing, Yinjiao & He, Wei & Pecht, Michael & Tsui, Kwok Leung, 2014. "State of charge estimation of lithium-ion batteries using the open-circuit voltage at various ambient temperatures," Applied Energy, Elsevier, vol. 113(C), pages 106-115.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Takyi-Aninakwa, Paul & Wang, Shunli & Zhang, Hongying & Yang, Xiao & Fernandez, Carlos, 2023. "A hybrid probabilistic correction model for the state of charge estimation of lithium-ion batteries considering dynamic currents and temperatures," Energy, Elsevier, vol. 273(C).
    2. Takyi-Aninakwa, Paul & Wang, Shunli & Zhang, Hongying & Yang, Xiaoyong & Fernandez, Carlos, 2022. "An optimized long short-term memory-weighted fading extended Kalman filtering model with wide temperature adaptation for the state of charge estimation of lithium-ion batteries," Applied Energy, Elsevier, vol. 326(C).
    3. Chen, Junxiong & Zhang, Yu & Wu, Ji & Cheng, Weisong & Zhu, Qiao, 2023. "SOC estimation for lithium-ion battery using the LSTM-RNN with extended input and constrained output," Energy, Elsevier, vol. 262(PA).
    4. Yang, Kuo & Tang, Yugui & Zhang, Shujing & Zhang, Zhen, 2022. "A deep learning approach to state of charge estimation of lithium-ion batteries based on dual-stage attention mechanism," Energy, Elsevier, vol. 244(PB).
    5. Takyi-Aninakwa, Paul & Wang, Shunli & Zhang, Hongying & Li, Huan & Xu, Wenhua & Fernandez, Carlos, 2022. "An optimized relevant long short-term memory-squared gain extended Kalman filter for the state of charge estimation of lithium-ion batteries," Energy, Elsevier, vol. 260(C).
    6. Zhang, Kai & Bai, Dongxin & Li, Yong & Song, Ke & Zheng, Bailin & Yang, Fuqian, 2024. "Robust state-of-charge estimator for lithium-ion batteries enabled by a physics-driven dual-stage attention mechanism," Applied Energy, Elsevier, vol. 359(C).
    7. Shahjalal, Mohammad & Roy, Probir Kumar & Shams, Tamanna & Fly, Ashley & Chowdhury, Jahedul Islam & Ahmed, Md. Rishad & Liu, Kailong, 2022. "A review on second-life of Li-ion batteries: prospects, challenges, and issues," Energy, Elsevier, vol. 241(C).
    8. Liu, Zheng & Zhao, Zhenhua & Qiu, Yuan & Jing, Benqin & Yang, Chunshan & Wu, Huifeng, 2023. "Enhanced state of charge estimation for Li-ion batteries through adaptive maximum correntropy Kalman filter with open circuit voltage correction," Energy, Elsevier, vol. 283(C).
    9. Yang, Bowen & Wang, Dafang & Sun, Xu & Chen, Shiqin & Wang, Xingcheng, 2023. "Offline order recognition for state estimation of Lithium-ion battery using fractional order model," Applied Energy, Elsevier, vol. 341(C).
    10. Yongquan Sun & Xinkun Qin & Lin Li & Youmei Zhang & Jiahai Zhang & Jia Qi, 2024. "The Impact of Temperature on the Performance and Reliability of Li/SOCl 2 Batteries," Energies, MDPI, vol. 17(13), pages 1-14, June.
    11. Marat Sadykov & Sam Haines & Mark Broadmeadow & Geoff Walker & David William Holmes, 2023. "Practical Evaluation of Lithium-Ion Battery State-of-Charge Estimation Using Time-Series Machine Learning for Electric Vehicles," Energies, MDPI, vol. 16(4), pages 1-34, February.
    12. Hou, Jie & Liu, Jiawei & Chen, Fengwei & Li, Penghua & Zhang, Tao & Jiang, Jincheng & Chen, Xiaolei, 2023. "Robust lithium-ion state-of-charge and battery parameters joint estimation based on an enhanced adaptive unscented Kalman filter," Energy, Elsevier, vol. 271(C).
    13. Li, Kuo & Gao, Xiao & Liu, Caixia & Chang, Chun & Li, Xiaoyu, 2023. "A novel Co-estimation framework of state-of-charge, state-of-power and capacity for lithium-ion batteries using multi-parameters fusion method," Energy, Elsevier, vol. 269(C).
    14. Xie, Yanxin & Wang, Shunli & Zhang, Gexiang & Fan, Yongcun & Fernandez, Carlos & Blaabjerg, Frede, 2023. "Optimized multi-hidden layer long short-term memory modeling and suboptimal fading extended Kalman filtering strategies for the synthetic state of charge estimation of lithium-ion batteries," Applied Energy, Elsevier, vol. 336(C).
    15. Siyi Tao & Bo Jiang & Xuezhe Wei & Haifeng Dai, 2023. "A Systematic and Comparative Study of Distinct Recurrent Neural Networks for Lithium-Ion Battery State-of-Charge Estimation in Electric Vehicles," Energies, MDPI, vol. 16(4), pages 1-17, February.
    16. Molla Shahadat Hossain Lipu & Tahia F. Karim & Shaheer Ansari & Md. Sazal Miah & Md. Siddikur Rahman & Sheikh T. Meraj & Rajvikram Madurai Elavarasan & Raghavendra Rajan Vijayaraghavan, 2022. "Intelligent SOX Estimation for Automotive Battery Management Systems: State-of-the-Art Deep Learning Approaches, Open Issues, and Future Research Opportunities," Energies, MDPI, vol. 16(1), pages 1-31, December.
    17. Lian, Gaoqi & Ye, Min & Wang, Qiao & Li, Yan & Xia, Baozhou & Zhang, Jiale & Xu, Xinxin, 2024. "Robust state-of-charge estimation for LiFePO4 batteries under wide varying temperature environments," Energy, Elsevier, vol. 293(C).
    18. Shehzar Shahzad Sheikh & Mahnoor Anjum & Muhammad Abdullah Khan & Syed Ali Hassan & Hassan Abdullah Khalid & Adel Gastli & Lazhar Ben-Brahim, 2020. "A Battery Health Monitoring Method Using Machine Learning: A Data-Driven Approach," Energies, MDPI, vol. 13(14), pages 1-16, July.
    19. Zhang, Hao & Gao, Jingyi & Kang, Le & Zhang, Yi & Wang, Licheng & Wang, Kai, 2023. "State of health estimation of lithium-ion batteries based on modified flower pollination algorithm-temporal convolutional network," Energy, Elsevier, vol. 283(C).
    20. Jiang, Bo & Tao, Siyi & Wang, Xueyuan & Zhu, Jiangong & Wei, Xuezhe & Dai, Haifeng, 2023. "Mechanics-based state of charge estimation for lithium-ion pouch battery using deep learning technique," Energy, Elsevier, vol. 278(PA).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:286:y:2024:i:c:s0360544223028980. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.