IDEAS home Printed from https://ideas.repec.org/a/spr/joinma/v33y2022i1d10.1007_s10845-021-01793-0.html
   My bibliography  Save this article

Continual learning of neural networks for quality prediction in production using memory aware synapses and weight transfer

Author

Listed:
  • Hasan Tercan

    (University of Wuppertal)

  • Philipp Deibert

    (University of Wuppertal)

  • Tobias Meisen

    (University of Wuppertal)

Abstract

Deep learning-based predictive quality enables manufacturing companies to make data-driven predictions of the quality of a produced product based on process data. A central challenge is that production processes are subject to continuous changes such as the manufacturing of new products, with the result that previously trained models may no longer perform well in the process. In this paper, we address this problem and propose a method for continual learning in such predictive quality scenarios. We therefore adapt and extend the memory-aware synapses approach to train an artificial neural network across different product variations. Our evaluation in a real-world regression problem in injection molding shows that the approach successfully prevents the neural network from forgetting of previous tasks and improves the training efficiency for new tasks. Moreover, by extending the approach with the transfer of network weights from similar previous tasks, we significantly improve its data efficiency and performance on sparse data. Our code is publicly available to reproduce our results and build upon them.

Suggested Citation

  • Hasan Tercan & Philipp Deibert & Tobias Meisen, 2022. "Continual learning of neural networks for quality prediction in production using memory aware synapses and weight transfer," Journal of Intelligent Manufacturing, Springer, vol. 33(1), pages 283-292, January.
  • Handle: RePEc:spr:joinma:v:33:y:2022:i:1:d:10.1007_s10845-021-01793-0
    DOI: 10.1007/s10845-021-01793-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10845-021-01793-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10845-021-01793-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chia-Yu Hsu & Wei-Chen Liu, 2021. "Multiple time-series convolutional neural network for fault detection and diagnosis and empirical study in semiconductor manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 32(3), pages 823-836, March.
    2. Werner Zellinger & Thomas Grubinger & Michael Zwick & Edwin Lughofer & Holger Schöner & Thomas Natschläger & Susanne Saminger-Platz, 2020. "Multi-source transfer learning of time series in cyclical manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 31(3), pages 777-787, March.
    3. Huixin Tian & Daixu Ren & Kun Li & Zhen Zhao, 2021. "An adaptive update model based on improved Long Short Term Memory for online prediction of vibration signal," Journal of Intelligent Manufacturing, Springer, vol. 32(1), pages 37-49, January.
    4. Xiang Li & Xiaodong Jia & Qibo Yang & Jay Lee, 2020. "Quality analysis in metal additive manufacturing with deep learning," Journal of Intelligent Manufacturing, Springer, vol. 31(8), pages 2003-2017, December.
    5. Michael D. T. McDonnell & Daniel Arnaldo & Etienne Pelletier & James A. Grant-Jacob & Matthew Praeger & Dimitris Karnakis & Robert W. Eason & Ben Mills, 2021. "Machine learning for multi-dimensional optimisation and predictive visualisation of laser machining," Journal of Intelligent Manufacturing, Springer, vol. 32(5), pages 1471-1483, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hasan Tercan & Tobias Meisen, 2022. "Machine learning and deep learning based predictive quality in manufacturing: a systematic review," Journal of Intelligent Manufacturing, Springer, vol. 33(7), pages 1879-1905, October.
    2. Bianca Maria Colosimo & Luca Pagani & Marco Grasso, 2024. "Modeling spatial point processes in video-imaging via Ripley’s K-function: an application to spatter analysis in additive manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 35(1), pages 429-447, January.
    3. Nannan Xu & Xinze Cui & Xin Wang & Wei Zhang & Tianyu Zhao, 2022. "An Intelligent Athlete Signal Processing Methodology for Balance Control Ability Assessment with Multi-Headed Self-Attention Mechanism," Mathematics, MDPI, vol. 10(15), pages 1-16, August.
    4. Nazanin Hosseini Arian & Alireza Pooya & Fariborz Rahimnia & Ali Sibevei, 2021. "Assessment the effect of rapid prototyping implementation on supply chain sustainability: a system dynamics approach," Operations Management Research, Springer, vol. 14(3), pages 467-493, December.
    5. Chi Ma & Hongquan Gui & Jialan Liu, 2023. "Self learning-empowered thermal error control method of precision machine tools based on digital twin," Journal of Intelligent Manufacturing, Springer, vol. 34(2), pages 695-717, February.
    6. Jeongsub Choi & Mengmeng Zhu & Jihoon Kang & Myong K. Jeong, 2024. "Convolutional neural network based multi-input multi-output model for multi-sensor multivariate virtual metrology in semiconductor manufacturing," Annals of Operations Research, Springer, vol. 339(1), pages 185-201, August.
    7. Yuwei Mao & Hui Lin & Christina Xuan Yu & Roger Frye & Darren Beckett & Kevin Anderson & Lars Jacquemetton & Fred Carter & Zhangyuan Gao & Wei-keng Liao & Alok N. Choudhary & Kornel Ehmann & Ankit Agr, 2023. "A deep learning framework for layer-wise porosity prediction in metal powder bed fusion using thermal signatures," Journal of Intelligent Manufacturing, Springer, vol. 34(1), pages 315-329, January.
    8. Sun, YongTeng & Ma, HongZhong, 2024. "Research progress on oil-immersed transformer mechanical condition identification based on vibration signals," Renewable and Sustainable Energy Reviews, Elsevier, vol. 196(C).
    9. Matteo Bugatti & Bianca Maria Colosimo, 2022. "Towards real-time in-situ monitoring of hot-spot defects in L-PBF: a new classification-based method for fast video-imaging data analysis," Journal of Intelligent Manufacturing, Springer, vol. 33(1), pages 293-309, January.
    10. Cinzia Giannetti & Aniekan Essien, 2022. "Towards scalable and reusable predictive models for cyber twins in manufacturing systems," Journal of Intelligent Manufacturing, Springer, vol. 33(2), pages 441-455, February.
    11. Yanan Pan & Renke Kang & Zhigang Dong & Wenhao Du & Sen Yin & Yan Bao, 2022. "On-line prediction of ultrasonic elliptical vibration cutting surface roughness of tungsten heavy alloy based on deep learning," Journal of Intelligent Manufacturing, Springer, vol. 33(3), pages 675-685, March.
    12. Peng Zhan & Shaokun Wang & Jun Wang & Leigang Qu & Kun Wang & Yupeng Hu & Xueqing Li, 2021. "Temporal anomaly detection on IIoT-enabled manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 32(6), pages 1669-1678, August.
    13. Kai Liao & Wenjun Wang & Xuesong Mei & Wenwen Tian & Hai Yuan & Mingqiong Wang & Bozhe Wang, 2023. "Shape regulation of tapered microchannels in silica glass ablated by femtosecond laser with theoretical modeling and machine learning," Journal of Intelligent Manufacturing, Springer, vol. 34(7), pages 2907-2924, October.
    14. Minyoung Lee & Joohyoung Jeon & Hongchul Lee, 2022. "Explainable AI for domain experts: a post Hoc analysis of deep learning for defect classification of TFT–LCD panels," Journal of Intelligent Manufacturing, Springer, vol. 33(6), pages 1747-1759, August.
    15. Ying Zhang & Mutahar Safdar & Jiarui Xie & Jinghao Li & Manuel Sage & Yaoyao Fiona Zhao, 2023. "A systematic review on data of additive manufacturing for machine learning applications: the data quality, type, preprocessing, and management," Journal of Intelligent Manufacturing, Springer, vol. 34(8), pages 3305-3340, December.
    16. Yunhan Kim & Taekyum Kim & Byeng D. Youn & Sung-Hoon Ahn, 2022. "Machining quality monitoring (MQM) in laser-assisted micro-milling of glass using cutting force signals: an image-based deep transfer learning," Journal of Intelligent Manufacturing, Springer, vol. 33(6), pages 1813-1828, August.
    17. Jun-Qiang Wang & Yun-Lei Song & Peng-Hao Cui & Yang Li, 2023. "A data-driven method for performance analysis and improvement in production systems with quality inspection," Journal of Intelligent Manufacturing, Springer, vol. 34(2), pages 455-469, February.
    18. Jinping Liu & Jie Wang & Xianfeng Liu & Tianyu Ma & Zhaohui Tang, 2022. "MWRSPCA: online fault monitoring based on moving window recursive sparse principal component analysis," Journal of Intelligent Manufacturing, Springer, vol. 33(5), pages 1255-1271, June.
    19. Omid Davtalab & Ali Kazemian & Xiao Yuan & Behrokh Khoshnevis, 2022. "Automated inspection in robotic additive manufacturing using deep learning for layer deformation detection," Journal of Intelligent Manufacturing, Springer, vol. 33(3), pages 771-784, March.
    20. Md Doulotuzzaman Xames & Fariha Kabir Torsha & Ferdous Sarwar, 2023. "A systematic literature review on recent trends of machine learning applications in additive manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 34(6), pages 2529-2555, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joinma:v:33:y:2022:i:1:d:10.1007_s10845-021-01793-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.