IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v17y2024i14p3553-d1438662.html
   My bibliography  Save this article

IIP-Mixer: Intra–Inter-Patch Mixing Architecture for Battery Remaining Useful Life Prediction

Author

Listed:
  • Guangzai Ye

    (School of Computer Science and Engineering, Macau University of Science and Technology, Macau SAR, China)

  • Li Feng

    (School of Computer Science and Engineering, Macau University of Science and Technology, Macau SAR, China)

  • Jianlan Guo

    (Dongguan Polytechnic, Dongguan 523808, China)

  • Yuqiang Chen

    (Dongguan Polytechnic, Dongguan 523808, China)

Abstract

Accurately estimating the Remaining Useful Life (RUL) of lithium-ion batteries is crucial for maintaining the safe and stable operation of rechargeable battery management systems. However, this task is often challenging due to the complex temporal dynamics. Recently, attention-based networks, such as Transformers and Informer, have been the popular architecture in time series forecasting. Despite their effectiveness, these models with abundant parameters necessitate substantial training time to unravel temporal patterns. To tackle these challenges, we propose a straightforward MLP-Mixer-based architecture named “Intra–Inter Patch Mixer” (IIP-Mixer), which leverages the strengths of multilayer perceptron (MLP) models to capture both local and global temporal patterns in time series data. Specifically, it extracts information using an MLP and performs mixing operations along both intra-patch and inter-patch dimensions for battery RUL prediction. The proposed IIP-Mixer comprises parallel dual-head mixer layers: the intra-patch mixing MLP, capturing local temporal patterns in the short-term period, and the inter-patch mixing MLP, capturing global temporal patterns in the long-term period. Notably, to address the varying importance of features in RUL prediction, we introduce a weighted loss function in the MLP-Mixer-based architecture, marking the first time such an approach has been employed. Our experiments demonstrate that IIP-Mixer achieves competitive performance in battery RUL prediction, outperforming other popular time series frameworks, such as Informer and DLinear, with relative reductions in mean absolute error (MAE) of 24% and 10%, respectively.

Suggested Citation

  • Guangzai Ye & Li Feng & Jianlan Guo & Yuqiang Chen, 2024. "IIP-Mixer: Intra–Inter-Patch Mixing Architecture for Battery Remaining Useful Life Prediction," Energies, MDPI, vol. 17(14), pages 1-15, July.
  • Handle: RePEc:gam:jeners:v:17:y:2024:i:14:p:3553-:d:1438662
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/17/14/3553/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/17/14/3553/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Xu, Xiaodong & Tang, Shengjin & Yu, Chuanqiang & Xie, Jian & Han, Xuebing & Ouyang, Minggao, 2021. "Remaining Useful Life Prediction of Lithium-ion Batteries Based on Wiener Process Under Time-Varying Temperature Condition," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    2. He, Jiabei & Tian, Yi & Wu, Lifeng, 2022. "A hybrid data-driven method for rapid prediction of lithium-ion battery capacity," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    3. Catherine Rincón-Maya & Fernando Guevara-Carazas & Freddy Hernández-Barajas & Carmen Patino-Rodriguez & Olga Usuga-Manco, 2023. "Remaining Useful Life Prediction of Lithium-Ion Battery Using ICC-CNN-LSTM Methodology," Energies, MDPI, vol. 16(20), pages 1-20, October.
    4. Shi, Zunya & Chehade, Abdallah, 2021. "A dual-LSTM framework combining change point detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    5. Yunlong Han & Conghui Li & Linfeng Zheng & Gang Lei & Li Li, 2023. "Remaining Useful Life Prediction of Lithium-Ion Batteries by Using a Denoising Transformer-Based Neural Network," Energies, MDPI, vol. 16(17), pages 1-16, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Jiusi & Jiang, Yuchen & Li, Xiang & Huo, Mingyi & Luo, Hao & Yin, Shen, 2022. "An adaptive remaining useful life prediction approach for single battery with unlabeled small sample data and parameter uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    2. Wei, Yupeng & Wu, Dazhong, 2023. "Prediction of state of health and remaining useful life of lithium-ion battery using graph convolutional network with dual attention mechanisms," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    3. Umar Saleem & Wenjie Liu & Saleem Riaz & Weilin Li & Ghulam Amjad Hussain & Zeeshan Rashid & Zeeshan Ahmad Arfeen, 2024. "TransRUL: A Transformer-Based Multihead Attention Model for Enhanced Prediction of Battery Remaining Useful Life," Energies, MDPI, vol. 17(16), pages 1-24, August.
    4. Meng, Huixing & Geng, Mengyao & Han, Te, 2023. "Long short-term memory network with Bayesian optimization for health prognostics of lithium-ion batteries based on partial incremental capacity analysis," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    5. Wang, Fujin & Zhao, Zhibin & Zhai, Zhi & Guo, Yanjie & Xi, Huan & Wang, Shibin & Chen, Xuefeng, 2023. "Feature disentanglement and tendency retainment with domain adaptation for Lithium-ion battery capacity estimation," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    6. Xie, Lin & Ustolin, Federico & Lundteigen, Mary Ann & Li, Tian & Liu, Yiliu, 2022. "Performance analysis of safety barriers against cascading failures in a battery pack," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    7. Wang, Fengfei & Tang, Shengjin & Han, Xuebing & Yu, Chuanqiang & Sun, Xiaoyan & Lu, Languang & Ouyang, Minggao, 2024. "Capacity prediction of lithium-ion batteries with fusing aging information," Energy, Elsevier, vol. 293(C).
    8. Xu, Xiaodong & Tang, Shengjin & Han, Xuebing & Lu, Languang & Wu, Yu & Yu, Chuanqiang & Sun, Xiaoyan & Xie, Jian & Feng, Xuning & Ouyang, Minggao, 2023. "Fast capacity prediction of lithium-ion batteries using aging mechanism-informed bidirectional long short-term memory network," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    9. Lin, Mingqiang & You, Yuqiang & Wang, Wei & Wu, Ji, 2023. "Battery health prognosis with gated recurrent unit neural networks and hidden Markov model considering uncertainty quantification," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    10. He, Jiabei & Tian, Yi & Wu, Lifeng, 2022. "A hybrid data-driven method for rapid prediction of lithium-ion battery capacity," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    11. Ardeshiri, Reza Rouhi & Liu, Ming & Ma, Chengbin, 2022. "Multivariate stacked bidirectional long short term memory for lithium-ion battery health management," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    12. Gu, Hang-Hang & Wang, Run-Zi & Tang, Min-Jin & Zhang, Xian-Cheng & Tu, Shan-Tung, 2024. "Data-physics-model based fatigue reliability assessment methodology for high-temperature components and its application in steam turbine rotor," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    13. Zhang, Ao & Wang, Zhihua & Bao, Rui & Liu, Chengrui & Wu, Qiong & Cao, Shihao, 2023. "A novel failure time estimation method for degradation analysis based on general nonlinear Wiener processes," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    14. Xiao, Lei & Tang, Junxuan & Zhang, Xinghui & Bechhoefer, Eric & Ding, Siyi, 2021. "Remaining useful life prediction based on intentional noise injection and feature reconstruction," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    15. Wei, Yupeng & Wu, Dazhong & Terpenny, Janis, 2024. "Remaining useful life prediction using graph convolutional attention networks with temporal convolution-aware nested residual connections," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    16. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    17. Liu, Lu & Song, Xiao & Zhou, Zhetao, 2022. "Aircraft engine remaining useful life estimation via a double attention-based data-driven architecture," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    18. Chen, Xiaowu & Liu, Zhen, 2022. "A long short-term memory neural network based Wiener process model for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    19. Cao, Mengda & Zhang, Tao & Liu, Yajie & Zhang, Yajun & Wang, Yu & Li, Kaiwen, 2022. "An ensemble learning prognostic method for capacity estimation of lithium-ion batteries based on the V-IOWGA operator," Energy, Elsevier, vol. 257(C).
    20. Pang, Zhenan & Li, Tianmei & Pei, Hong & Si, Xiaosheng, 2023. "A condition-based prognostic approach for age- and state-dependent partially observable nonlinear degrading system," Reliability Engineering and System Safety, Elsevier, vol. 230(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:17:y:2024:i:14:p:3553-:d:1438662. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.