IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i17p6328-d1230056.html
   My bibliography  Save this article

Remaining Useful Life Prediction of Lithium-Ion Batteries by Using a Denoising Transformer-Based Neural Network

Author

Listed:
  • Yunlong Han

    (Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia)

  • Conghui Li

    (Zibo Vocational Institute, Zibo 255314, China)

  • Linfeng Zheng

    (Institute of Rail Transportation, Jinan University, Zhuhai 510632, China)

  • Gang Lei

    (Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia)

  • Li Li

    (Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia)

Abstract

In this study, we introduce a novel denoising transformer-based neural network (DTNN) model for predicting the remaining useful life (RUL) of lithium-ion batteries. The proposed DTNN model significantly outperforms traditional machine learning models and other deep learning architectures in terms of accuracy and reliability. Specifically, the DTNN achieved an R 2 value of 0.991, a mean absolute percentage error (MAPE) of 0.632%, and an absolute RUL error of 3.2, which are superior to other models such as Random Forest (RF), Decision Trees (DT), Multilayer Perceptron (MLP), Recurrent Neural Network (RNN), Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), Dual-LSTM, and DeTransformer. These results highlight the efficacy of the DTNN model in providing precise and reliable predictions for battery RUL, making it a promising tool for battery management systems in various applications.

Suggested Citation

  • Yunlong Han & Conghui Li & Linfeng Zheng & Gang Lei & Li Li, 2023. "Remaining Useful Life Prediction of Lithium-Ion Batteries by Using a Denoising Transformer-Based Neural Network," Energies, MDPI, vol. 16(17), pages 1-16, August.
    • Handle: RePEc:gam:jeners:v:16:y:2023:i:17:p:6328-:d:1230056
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/17/6328/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/16/17/6328/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Burgos-Mellado, Claudio & Orchard, Marcos E. & Kazerani, Mehrdad & Cárdenas, Roberto & Sáez, Doris, 2016. "Particle-filtering-based estimation of maximum available power state in Lithium-Ion batteries," Applied Energy, Elsevier, vol. 161(C), pages 349-363.
    2. Grzegorz Karoń, 2022. "Energy in Smart Urban Transportation with Systemic Use of Electric Vehicles," Energies, MDPI, vol. 15(15), pages 1-5, August.
    3. Gi-Wook Cha & Hyeun Jun Moon & Young-Min Kim & Won-Hwa Hong & Jung-Ha Hwang & Won-Jun Park & Young-Chan Kim, 2020. "Development of a Prediction Model for Demolition Waste Generation Using a Random Forest Algorithm Based on Small DataSets," IJERPH, MDPI, vol. 17(19), pages 1-15, September.
    4. Shi, Zunya & Chehade, Abdallah, 2021. "A dual-LSTM framework combining change point detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    5. Holger C. Hesse & Michael Schimpe & Daniel Kucevic & Andreas Jossen, 2017. "Lithium-Ion Battery Storage for the Grid—A Review of Stationary Battery Storage System Design Tailored for Applications in Modern Power Grids," Energies, MDPI, vol. 10(12), pages 1-42, December.
    6. Berecibar, M. & Gandiaga, I. & Villarreal, I. & Omar, N. & Van Mierlo, J. & Van den Bossche, P., 2016. "Critical review of state of health estimation methods of Li-ion batteries for real applications," Renewable and Sustainable Energy Reviews, Elsevier, vol. 56(C), pages 572-587.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guangzai Ye & Li Feng & Jianlan Guo & Yuqiang Chen, 2024. "IIP-Mixer: Intra–Inter-Patch Mixing Architecture for Battery Remaining Useful Life Prediction," Energies, MDPI, vol. 17(14), pages 1-15, July.
    2. Huang, Yaodi & Zhang, Pengcheng & Lu, Jiahuan & Xiong, Rui & Cai, Zhongmin, 2024. "A transferable long-term lithium-ion battery aging trajectory prediction model considering internal resistance and capacity regeneration phenomenon," Applied Energy, Elsevier, vol. 360(C).
    3. Umar Saleem & Wenjie Liu & Saleem Riaz & Weilin Li & Ghulam Amjad Hussain & Zeeshan Rashid & Zeeshan Ahmad Arfeen, 2024. "TransRUL: A Transformer-Based Multihead Attention Model for Enhanced Prediction of Battery Remaining Useful Life," Energies, MDPI, vol. 17(16), pages 1-24, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hu, Xiaosong & Feng, Fei & Liu, Kailong & Zhang, Lei & Xie, Jiale & Liu, Bo, 2019. "State estimation for advanced battery management: Key challenges and future trends," Renewable and Sustainable Energy Reviews, Elsevier, vol. 114(C), pages 1-1.
    2. Hector Beltran & Pablo Ayuso & Emilio Pérez, 2020. "Lifetime Expectancy of Li-Ion Batteries used for Residential Solar Storage," Energies, MDPI, vol. 13(3), pages 1-18, January.
    3. Martin Henke & Getu Hailu, 2020. "Thermal Management of Stationary Battery Systems: A Literature Review," Energies, MDPI, vol. 13(16), pages 1-16, August.
    4. Yang, Lin & Cai, Yishan & Yang, Yixin & Deng, Zhongwei, 2020. "Supervisory long-term prediction of state of available power for lithium-ion batteries in electric vehicles," Applied Energy, Elsevier, vol. 257(C).
    5. Ayuso, Pablo & Beltran, Hector & Segarra-Tamarit, Jorge & Pérez, Emilio, 2021. "Optimized profitability of LFP and NMC Li-ion batteries in residential PV applications," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 183(C), pages 97-115.
    6. Iolanda Saviuc & Herbert Peremans & Steven Van Passel & Kevin Milis, 2019. "Economic Performance of Using Batteries in European Residential Microgrids under the Net-Metering Scheme," Energies, MDPI, vol. 12(1), pages 1-28, January.
    7. Luna, M. & Di Piazza, M.C. & La Tona, G. & Accetta, A. & Pucci, M., 2021. "Exploiting dynamic modeling, parameter identification, and power electronics to implement a non-dissipative Li-ion battery hardware emulator," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 183(C), pages 48-65.
    8. Sun, Li & Sun, Wen & You, Fengqi, 2020. "Core temperature modelling and monitoring of lithium-ion battery in the presence of sensor bias," Applied Energy, Elsevier, vol. 271(C).
    9. Wenxian Duan & Chuanxue Song & Silun Peng & Feng Xiao & Yulong Shao & Shixin Song, 2020. "An Improved Gated Recurrent Unit Network Model for State-of-Charge Estimation of Lithium-Ion Battery," Energies, MDPI, vol. 13(23), pages 1-19, December.
    10. Das, Kaushik & Kumar, Roushan & Krishna, Anurup, 2024. "Analyzing electric vehicle battery health performance using supervised machine learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PA).
    11. Ghorbanzadeh, Milad & Astaneh, Majid & Golzar, Farzin, 2019. "Long-term degradation based analysis for lithium-ion batteries in off-grid wind-battery renewable energy systems," Energy, Elsevier, vol. 166(C), pages 1194-1206.
    12. Li, Yi & Liu, Kailong & Foley, Aoife M. & Zülke, Alana & Berecibar, Maitane & Nanini-Maury, Elise & Van Mierlo, Joeri & Hoster, Harry E., 2019. "Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 113(C), pages 1-1.
    13. Zhang, Yajun & Liu, Yajie & Wang, Jia & Zhang, Tao, 2022. "State-of-health estimation for lithium-ion batteries by combining model-based incremental capacity analysis with support vector regression," Energy, Elsevier, vol. 239(PB).
    14. Xiao, Lei & Tang, Junxuan & Zhang, Xinghui & Bechhoefer, Eric & Ding, Siyi, 2021. "Remaining useful life prediction based on intentional noise injection and feature reconstruction," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    15. Parlikar, Anupam & Truong, Cong Nam & Jossen, Andreas & Hesse, Holger, 2021. "The carbon footprint of island grids with lithium-ion battery systems: An analysis based on levelized emissions of energy supply," Renewable and Sustainable Energy Reviews, Elsevier, vol. 149(C).
    16. Li, Shuangqi & Zhao, Pengfei & Gu, Chenghong & Huo, Da & Zeng, Xianwu & Pei, Xiaoze & Cheng, Shuang & Li, Jianwei, 2022. "Online battery-protective vehicle to grid behavior management," Energy, Elsevier, vol. 243(C).
    17. Wei, Yupeng & Wu, Dazhong & Terpenny, Janis, 2024. "Remaining useful life prediction using graph convolutional attention networks with temporal convolution-aware nested residual connections," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    18. Parlikar, Anupam & Schott, Maximilian & Godse, Ketaki & Kucevic, Daniel & Jossen, Andreas & Hesse, Holger, 2023. "High-power electric vehicle charging: Low-carbon grid integration pathways with stationary lithium-ion battery systems and renewable generation," Applied Energy, Elsevier, vol. 333(C).
    19. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    20. Liu, Lu & Song, Xiao & Zhou, Zhetao, 2022. "Aircraft engine remaining useful life estimation via a double attention-based data-driven architecture," Reliability Engineering and System Safety, Elsevier, vol. 221(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:17:p:6328-:d:1230056. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.