IDEAS home Printed from https://ideas.repec.org/a/spr/joinma/v35y2024i7d10.1007_s10845-023-02232-y.html
   My bibliography  Save this article

A novel image feature based self-supervised learning model for effective quality inspection in additive manufacturing

Author

Listed:
  • Chun Fai Lui

    (City University of Hong Kong)

  • Ahmed Maged

    (Benha University)

  • Min Xie

    (City University of Hong Kong
    City University of Hong Kong Shenzhen Research Institute)

Abstract

With the rapid development of additive manufacturing (AM) technology, quality inspection has become one of the most crucial research topics in additive manufacturing. Although numerous image-based deep learning methods have been successfully developed to monitor and inspect AM product quality effectively, many require substantial labels in order to achieve satisfactory training, which is often impractical in real-life AM processes. In this article, a novel image feature-based self-supervised learning (IFSSL) model is proposed for effective quality inspection in AM. Through a feature-based image fusion approach based on defect-relevant feature extraction, the IFSSL model is able to guide machine vision to focus on highlighted defect-relevant regions in the AM product image. In addition, the defect-relevant features are used to generate pseudo-labels for self-supervised learning. With self-supervision, the IFSSL model leverages the advantages of supervised learning and unsupervised learning by requiring no sample label while retaining defect-relevant information. The effectiveness of the proposed IFSSL method is demonstrated through a real case study of fused deposition modeling product image dataset. Results show that the IFSSL model can guide machine vision to pay more attention to potential defective regions, enabling it to detect and locate faults effectively and automatically for machine vision guided quality inspection.

Suggested Citation

  • Chun Fai Lui & Ahmed Maged & Min Xie, 2024. "A novel image feature based self-supervised learning model for effective quality inspection in additive manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 35(7), pages 3543-3558, October.
  • Handle: RePEc:spr:joinma:v:35:y:2024:i:7:d:10.1007_s10845-023-02232-y
    DOI: 10.1007/s10845-023-02232-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10845-023-02232-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10845-023-02232-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Felix W. Baumann & Julian R. Eichhoff & Dieter Roller, 2017. "Scanned Image Data from 3D-Printed Specimens Using Fused Deposition Modeling," Data, MDPI, vol. 2(1), pages 1-24, January.
    2. Matteo Bugatti & Bianca Maria Colosimo, 2022. "Towards real-time in-situ monitoring of hot-spot defects in L-PBF: a new classification-based method for fast video-imaging data analysis," Journal of Intelligent Manufacturing, Springer, vol. 33(1), pages 293-309, January.
    3. Sachin Kumar & T. Gopi & N. Harikeerthana & Munish Kumar Gupta & Vidit Gaur & Grzegorz M. Krolczyk & ChuanSong Wu, 2023. "Machine learning techniques in additive manufacturing: a state of the art review on design, processes and production control," Journal of Intelligent Manufacturing, Springer, vol. 34(1), pages 21-55, January.
    4. Domen Tabernik & Samo Šela & Jure Skvarč & Danijel Skočaj, 2020. "Segmentation-based deep-learning approach for surface-defect detection," Journal of Intelligent Manufacturing, Springer, vol. 31(3), pages 759-776, March.
    5. Jingchang Li & Qi Zhou & Xufeng Huang & Menglei Li & Longchao Cao, 2023. "In situ quality inspection with layer-wise visual images based on deep transfer learning during selective laser melting," Journal of Intelligent Manufacturing, Springer, vol. 34(2), pages 853-867, February.
    6. Zhenyu Liu & Yiguo Song & Ruining Tang & Guifang Duan & Jianrong Tan, 2023. "Few-shot defect recognition of metal surfaces via attention-embedding and self-supervised learning," Journal of Intelligent Manufacturing, Springer, vol. 34(8), pages 3507-3521, December.
    7. Xiang Li & Xiaodong Jia & Qibo Yang & Jay Lee, 2020. "Quality analysis in metal additive manufacturing with deep learning," Journal of Intelligent Manufacturing, Springer, vol. 31(8), pages 2003-2017, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nannan Xu & Xinze Cui & Xin Wang & Wei Zhang & Tianyu Zhao, 2022. "An Intelligent Athlete Signal Processing Methodology for Balance Control Ability Assessment with Multi-Headed Self-Attention Mechanism," Mathematics, MDPI, vol. 10(15), pages 1-16, August.
    2. Abtin Djavadifar & John Brandon Graham-Knight & Marian Kӧrber & Patricia Lasserre & Homayoun Najjaran, 2022. "Automated visual detection of geometrical defects in composite manufacturing processes using deep convolutional neural networks," Journal of Intelligent Manufacturing, Springer, vol. 33(8), pages 2257-2275, December.
    3. Li Wei & Mahmud Iwan Solihin & Sarah ‘Atifah Saruchi & Winda Astuti & Lim Wei Hong & Ang Chun Kit, 2024. "Surface Defects Detection of Cylindrical High-Precision Industrial Parts Based on Deep Learning Algorithms: A Review," SN Operations Research Forum, Springer, vol. 5(3), pages 1-71, September.
    4. Zichen Bai & Junfeng Jing, 2024. "Mobile-Deeplab: a lightweight pixel segmentation-based method for fabric defect detection," Journal of Intelligent Manufacturing, Springer, vol. 35(7), pages 3315-3330, October.
    5. Yuwei Mao & Hui Lin & Christina Xuan Yu & Roger Frye & Darren Beckett & Kevin Anderson & Lars Jacquemetton & Fred Carter & Zhangyuan Gao & Wei-keng Liao & Alok N. Choudhary & Kornel Ehmann & Ankit Agr, 2023. "A deep learning framework for layer-wise porosity prediction in metal powder bed fusion using thermal signatures," Journal of Intelligent Manufacturing, Springer, vol. 34(1), pages 315-329, January.
    6. Matteo Bugatti & Bianca Maria Colosimo, 2022. "Towards real-time in-situ monitoring of hot-spot defects in L-PBF: a new classification-based method for fast video-imaging data analysis," Journal of Intelligent Manufacturing, Springer, vol. 33(1), pages 293-309, January.
    7. Yuanyuan Wang & Ling Ma & Lihua Jian & Huiqin Jiang, 2023. "Conductive particle detection via efficient encoder–decoder network," Journal of Intelligent Manufacturing, Springer, vol. 34(8), pages 3563-3577, December.
    8. Swarit Anand Singh & K. A. Desai, 2023. "Automated surface defect detection framework using machine vision and convolutional neural networks," Journal of Intelligent Manufacturing, Springer, vol. 34(4), pages 1995-2011, April.
    9. Yanan Pan & Renke Kang & Zhigang Dong & Wenhao Du & Sen Yin & Yan Bao, 2022. "On-line prediction of ultrasonic elliptical vibration cutting surface roughness of tungsten heavy alloy based on deep learning," Journal of Intelligent Manufacturing, Springer, vol. 33(3), pages 675-685, March.
    10. Ruiyang Hao & Bingyu Lu & Ying Cheng & Xiu Li & Biqing Huang, 2021. "A steel surface defect inspection approach towards smart industrial monitoring," Journal of Intelligent Manufacturing, Springer, vol. 32(7), pages 1833-1843, October.
    11. Yunhan Kim & Taekyum Kim & Byeng D. Youn & Sung-Hoon Ahn, 2022. "Machining quality monitoring (MQM) in laser-assisted micro-milling of glass using cutting force signals: an image-based deep transfer learning," Journal of Intelligent Manufacturing, Springer, vol. 33(6), pages 1813-1828, August.
    12. Omid Davtalab & Ali Kazemian & Xiao Yuan & Behrokh Khoshnevis, 2022. "Automated inspection in robotic additive manufacturing using deep learning for layer deformation detection," Journal of Intelligent Manufacturing, Springer, vol. 33(3), pages 771-784, March.
    13. Danqing Kang & Jianhuang Lai & Junyong Zhu & Yu Han, 2023. "An adaptive feature reconstruction network for the precise segmentation of surface defects on printed circuit boards," Journal of Intelligent Manufacturing, Springer, vol. 34(7), pages 3197-3214, October.
    14. Md Doulotuzzaman Xames & Fariha Kabir Torsha & Ferdous Sarwar, 2023. "A systematic literature review on recent trends of machine learning applications in additive manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 34(6), pages 2529-2555, August.
    15. Saksham Jain & Gautam Seth & Arpit Paruthi & Umang Soni & Girish Kumar, 2022. "Synthetic data augmentation for surface defect detection and classification using deep learning," Journal of Intelligent Manufacturing, Springer, vol. 33(4), pages 1007-1020, April.
    16. Salomé Sanchez & Divish Rengasamy & Christopher J. Hyde & Grazziela P. Figueredo & Benjamin Rothwell, 2021. "Machine learning to determine the main factors affecting creep rates in laser powder bed fusion," Journal of Intelligent Manufacturing, Springer, vol. 32(8), pages 2353-2373, December.
    17. Changqing Wang & Maoxuan Sun & Yuan Cao & Kunyu He & Bei Zhang & Zhonghao Cao & Meng Wang, 2023. "Lightweight Network-Based Surface Defect Detection Method for Steel Plates," Sustainability, MDPI, vol. 15(4), pages 1-12, February.
    18. Rong Luo & Ruihu Chen & Fengting Jia & Biru Lin & Jie Liu & Yafei Sun & Xinbo Yang & Weikuan Jia, 2023. "RBD-Net: robust breakage detection algorithm for industrial leather," Journal of Intelligent Manufacturing, Springer, vol. 34(6), pages 2783-2796, August.
    19. Bianca Maria Colosimo & Luca Pagani & Marco Grasso, 2024. "Modeling spatial point processes in video-imaging via Ripley’s K-function: an application to spatter analysis in additive manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 35(1), pages 429-447, January.
    20. José M. Navarro-Jiménez & José V. Aguado & Grégoire Bazin & Vicente Albero & Domenico Borzacchiello, 2023. "Reconstruction of 3D surfaces from incomplete digitisations using statistical shape models for manufacturing processes," Journal of Intelligent Manufacturing, Springer, vol. 34(5), pages 2345-2358, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joinma:v:35:y:2024:i:7:d:10.1007_s10845-023-02232-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.