IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v10y2022i16p2921-d887563.html
   My bibliography  Save this article

Deep Learning-Based Remaining Useful Life Prediction Method with Transformer Module and Random Forest

Author

Listed:
  • Lefa Zhao

    (School of General Education, Shenyang Sport University, Shenyang 110115, China)

  • Yafei Zhu

    (International Engineering College, Shenyang Aerospace University, Shenyang 110136, China)

  • Tianyu Zhao

    (Key Laboratory of Structural Dynamics of Liaoning Province, College of Sciences, Northeastern University, Shenyang 110819, China)

Abstract

This paper focuses on the prognosis problem in manufacturing of the electronic chips for devices. Electronic devices are of great importance at present, which are popularly applied in daily life. The basis of supporting the electronic device is the powerful electronic chip and its manufacturing technology. Chip manufacturing has been one of the most important technologies in recent years. The etching machine is the key equipment in the etching process of the wafers in chip manufacturing. Due to the high demands for precise manufacturing, monitoring the health state and predicting the remaining useful life (RUL) of the etching system is quite important. However, the task is very hard because of the lack of knowledge of exact onset of failure or degradation and the multiple operating conditions, etc. This paper proposes a novel deep learning-based RUL prediction method for the etching system. The transformer module and random forest are integrated in the methodology to identify the health state of the machine and predict its RUL, through training with the complex data of the etching machine’s sensors and exploring its underlying features. The experiments are based on the subject of the 2018 PHM Data Challenge—for estimating time-to-failure or RUL of Ion Mill Etching Systems in an online fashion using data from multiple sensors. The results indicate the proposed method is promising for the real applications of the prognosis of the etching system for electronic devices.

Suggested Citation

  • Lefa Zhao & Yafei Zhu & Tianyu Zhao, 2022. "Deep Learning-Based Remaining Useful Life Prediction Method with Transformer Module and Random Forest," Mathematics, MDPI, vol. 10(16), pages 1-15, August.
  • Handle: RePEc:gam:jmathe:v:10:y:2022:i:16:p:2921-:d:887563
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/10/16/2921/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/10/16/2921/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Edoardo Savini & Cornelia Caragea, 2022. "Intermediate-Task Transfer Learning with BERT for Sarcasm Detection," Mathematics, MDPI, vol. 10(5), pages 1-14, March.
    2. ZhenHua Li & Yujie Zhang & Ahmed Abu-Siada & Xingxin Chen & Zhenxing Li & Yanchun Xu & Lei Zhang & Yue Tong, 2021. "Fault Diagnosis of Transformer Windings Based on Decision Tree and Fully Connected Neural Network," Energies, MDPI, vol. 14(6), pages 1-14, March.
    3. Zhang, Wei & Li, Xiang & Ma, Hui & Luo, Zhong & Li, Xu, 2021. "Transfer learning using deep representation regularization in remaining useful life prediction across operating conditions," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    4. Zaiming Sun & Chang’an Liu & Hongquan Qu & Guangda Xie, 2022. "A Novel Effective Vehicle Detection Method Based on Swin Transformer in Hazy Scenes," Mathematics, MDPI, vol. 10(13), pages 1-15, June.
    5. Vladislav Kovalnogov & Ruslan Fedorov & Vladimir Klyachkin & Dmitry Generalov & Yulia Kuvayskova & Sergey Busygin, 2022. "Applying the Random Forest Method to Improve Burner Efficiency," Mathematics, MDPI, vol. 10(12), pages 1-24, June.
    6. Nayi Wang & Xiangsuo Fan & Jinlong Fan & Chuan Yan, 2022. "Random Forest Winter Wheat Extraction Algorithm Based on Spatial Features of Neighborhood Samples," Mathematics, MDPI, vol. 10(13), pages 1-20, June.
    7. Aleksey I. Shinkevich & Irina G. Ershova & Farida F. Galimulina & Alla A. Yarlychenko, 2021. "Innovative Mesosystems Algorithm for Sustainable Development Priority Areas Identification in Industry Based on Decision Trees Construction," Mathematics, MDPI, vol. 9(23), pages 1-18, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xiang Li & Shuo Zhang & Wei Zhang, 2023. "Applied Computing and Artificial Intelligence," Mathematics, MDPI, vol. 11(10), pages 1-4, May.
    2. Shi, Jiayu & Zhong, Jingshu & Zhang, Yuxuan & Xiao, Bin & Xiao, Lei & Zheng, Yu, 2024. "A dual attention LSTM lightweight model based on exponential smoothing for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    3. Prashant Kumar & Prince Kumar & Ananda Shankar Hati & Heung Soo Kim, 2022. "Deep Transfer Learning Framework for Bearing Fault Detection in Motors," Mathematics, MDPI, vol. 10(24), pages 1-14, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aleksey I. Shinkevich & Alsu R. Akhmetshina & Ruslan R. Khalilov, 2022. "Development of a Methodology for Forecasting the Sustainable Development of Industry in Russia Based on the Tools of Factor and Discriminant Analysis," Mathematics, MDPI, vol. 10(6), pages 1-16, March.
    2. Nannan Xu & Xinze Cui & Xin Wang & Wei Zhang & Tianyu Zhao, 2022. "An Intelligent Athlete Signal Processing Methodology for Balance Control Ability Assessment with Multi-Headed Self-Attention Mechanism," Mathematics, MDPI, vol. 10(15), pages 1-16, August.
    3. Ruslan V. Fedorov & Dmitry A. Generalov & Vyacheslav V. Sherkunov & Valeriy V. Sapunov & Sergey V. Busygin, 2023. "Improving the Efficiency of Fuel Combustion with the Use of Various Designs of Embrasures," Energies, MDPI, vol. 16(11), pages 1-15, May.
    4. Yi Lyu & Qichen Zhang & Zhenfei Wen & Aiguo Chen, 2022. "Remaining Useful Life Prediction Based on Multi-Representation Domain Adaptation," Mathematics, MDPI, vol. 10(24), pages 1-18, December.
    5. Sungur, Bilal & Basar, Cem & Kaleli, Alirıza, 2023. "Multi-objective optimisation of the emission parameters and efficiency of pellet stove at different supply airflow positions based on machine learning approach," Energy, Elsevier, vol. 278(PA).
    6. Yaliu Yang & Yuan Wang & Cui Wang & Yingyan Zhang & Cuixia Zhang, 2022. "Temporal and Spatial Evolution of the Science and Technology Innovative Efficiency of Regional Industrial Enterprises: A Data-Driven Perspective," Sustainability, MDPI, vol. 14(17), pages 1-21, August.
    7. Xiaoxia Liang & Ming Zhang & Guojin Feng & Duo Wang & Yuchun Xu & Fengshou Gu, 2023. "Few-Shot Learning Approaches for Fault Diagnosis Using Vibration Data: A Comprehensive Review," Sustainability, MDPI, vol. 15(20), pages 1-17, October.
    8. Florentina Hristea & Cornelia Caragea, 2022. "Preface to the Special Issue “Natural Language Processing (NLP) and Machine Learning (ML)—Theory and Applications”," Mathematics, MDPI, vol. 10(14), pages 1-5, July.
    9. Cheng, Han & Kong, Xianguang & Wang, Qibin & Ma, Hongbo & Yang, Shengkang, 2022. "The two-stage RUL prediction across operation conditions using deep transfer learning and insufficient degradation data," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    10. Zhang, Wei & Wang, Ziwei & Li, Xiang, 2023. "Blockchain-based decentralized federated transfer learning methodology for collaborative machinery fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    11. Lyu, Dongzhen & Niu, Guangxing & Liu, Enhui & Zhang, Bin & Chen, Gang & Yang, Tao & Zio, Enrico, 2022. "Time space modelling for fault diagnosis and prognosis with uncertainty management: A general theoretical formulation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    12. Monica Aureliana Petcu & Liliana Ionescu-Feleaga & Bogdan-Ștefan Ionescu & Dumitru-Florin Moise, 2023. "A Decade for the Mathematics : Bibliometric Analysis of Mathematical Modeling in Economics, Ecology, and Environment," Mathematics, MDPI, vol. 11(2), pages 1-30, January.
    13. Jiapei Peng & Lefa Zhao & Tianyu Zhao, 2022. "Study on Dynamic Characteristics of a Rotating Sandwich Porous Pre-Twist Blade with a Setting Angle Reinforced by Graphene Nanoplatelets," Mathematics, MDPI, vol. 10(15), pages 1-15, August.
    14. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    15. Zhannan Guo & Yinlin Hao & Hanwen Shi & Zhenyu Wu & Yuhu Wu & Ximing Sun, 2023. "A Fault Diagnosis Algorithm for the Dedicated Equipment Based on the CNN-LSTM Mechanism," Energies, MDPI, vol. 16(13), pages 1-16, July.
    16. Zhang, Jiusi & Tian, Jilun & Yan, Pengfei & Wu, Shimeng & Luo, Hao & Yin, Shen, 2024. "Multi-hop graph pooling adversarial network for cross-domain remaining useful life prediction: A distributed federated learning perspective," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    17. Aleksey I. Shinkevich & Irina G. Ershova & Farida F. Galimulina, 2022. "Forecasting the Efficiency of Innovative Industrial Systems Based on Neural Networks," Mathematics, MDPI, vol. 11(1), pages 1-25, December.
    18. Jani Dugonik & Mirjam Sepesy Maučec & Domen Verber & Janez Brest, 2023. "Reduction of Neural Machine Translation Failures by Incorporating Statistical Machine Translation," Mathematics, MDPI, vol. 11(11), pages 1-22, May.
    19. Wei, Yupeng & Wu, Dazhong & Terpenny, Janis, 2021. "Learning the health index of complex systems using dynamic conditional variational autoencoders," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    20. Guan, Yang & Meng, Zong & Sun, Dengyun & Liu, Jingbo & Fan, Fengjie, 2021. "2MNet: Multi-sensor and multi-scale model toward accurate fault diagnosis of rolling bearing," Reliability Engineering and System Safety, Elsevier, vol. 216(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:10:y:2022:i:16:p:2921-:d:887563. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.