IDEAS home Printed from https://ideas.repec.org/a/spr/joinma/v33y2022i3d10.1007_s10845-020-01684-w.html
   My bibliography  Save this article

Automated inspection in robotic additive manufacturing using deep learning for layer deformation detection

Author

Listed:
  • Omid Davtalab

    (University of Southern California
    Contour Crafting Corporation)

  • Ali Kazemian

    (Louisiana State University)

  • Xiao Yuan

    (Contour Crafting Corporation
    University of Southern California)

  • Behrokh Khoshnevis

    (Contour Crafting Corporation
    University of Southern California)

Abstract

In this paper, an automated layer defect detection system for construction 3D printing is proposed. Initially, a step-by-step procedure is implemented to develop a deep convolutional neural network that receives images as input and is able to distinguish concrete layers from other surrounding objects through semantic pixel-wise segmentation. Using data augmentation techniques, 1M labeled images are generated and used to train and test the CNN model. Then, a defect detection module is developed which is able to detect deformations in the printed concrete layers extracted from the images using the CNN model. The evaluation results based on metrics such as accuracy, F1 score, and miss rate verify the acceptable performance of the developed system.

Suggested Citation

  • Omid Davtalab & Ali Kazemian & Xiao Yuan & Behrokh Khoshnevis, 2022. "Automated inspection in robotic additive manufacturing using deep learning for layer deformation detection," Journal of Intelligent Manufacturing, Springer, vol. 33(3), pages 771-784, March.
    • Handle: RePEc:spr:joinma:v:33:y:2022:i:3:d:10.1007_s10845-020-01684-w
    DOI: 10.1007/s10845-020-01684-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10845-020-01684-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10845-020-01684-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hui Lin & Bin Li & Xinggang Wang & Yufeng Shu & Shuanglong Niu, 2019. "Automated defect inspection of LED chip using deep convolutional neural network," Journal of Intelligent Manufacturing, Springer, vol. 30(6), pages 2525-2534, August.
    2. Xiang Li & Xiaodong Jia & Qibo Yang & Jay Lee, 2020. "Quality analysis in metal additive manufacturing with deep learning," Journal of Intelligent Manufacturing, Springer, vol. 31(8), pages 2003-2017, December.
    3. Andrej Tibaut & Danijel Rebolj & Matjaž Nekrep Perc, 2016. "Interoperability requirements for automated manufacturing systems in construction," Journal of Intelligent Manufacturing, Springer, vol. 27(1), pages 251-262, February.
    4. Olatomiwa Badmos & Andreas Kopp & Timo Bernthaler & Gerhard Schneider, 2020. "Image-based defect detection in lithium-ion battery electrode using convolutional neural networks," Journal of Intelligent Manufacturing, Springer, vol. 31(4), pages 885-897, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tan Kai Noel Quah & Yi Wei Daniel Tay & Jian Hui Lim & Ming Jen Tan & Teck Neng Wong & King Ho Holden Li, 2023. "Concrete 3D Printing: Process Parameters for Process Control, Monitoring and Diagnosis in Automation and Construction," Mathematics, MDPI, vol. 11(6), pages 1-34, March.
    2. Md Doulotuzzaman Xames & Fariha Kabir Torsha & Ferdous Sarwar, 2023. "A systematic literature review on recent trends of machine learning applications in additive manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 34(6), pages 2529-2555, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuwei Mao & Hui Lin & Christina Xuan Yu & Roger Frye & Darren Beckett & Kevin Anderson & Lars Jacquemetton & Fred Carter & Zhangyuan Gao & Wei-keng Liao & Alok N. Choudhary & Kornel Ehmann & Ankit Agr, 2023. "A deep learning framework for layer-wise porosity prediction in metal powder bed fusion using thermal signatures," Journal of Intelligent Manufacturing, Springer, vol. 34(1), pages 315-329, January.
    2. Chia-Yu Hsu & Ju-Chien Chien, 2022. "Ensemble convolutional neural networks with weighted majority for wafer bin map pattern classification," Journal of Intelligent Manufacturing, Springer, vol. 33(3), pages 831-844, March.
    3. Swarit Anand Singh & K. A. Desai, 2023. "Automated surface defect detection framework using machine vision and convolutional neural networks," Journal of Intelligent Manufacturing, Springer, vol. 34(4), pages 1995-2011, April.
    4. Minyoung Lee & Joohyoung Jeon & Hongchul Lee, 2022. "Explainable AI for domain experts: a post Hoc analysis of deep learning for defect classification of TFT–LCD panels," Journal of Intelligent Manufacturing, Springer, vol. 33(6), pages 1747-1759, August.
    5. Feiyang Li & Nian Cai & Xueliang Deng & Jiahao Li & Jianfa Lin & Han Wang, 2022. "Serial number inspection for ceramic membranes via an end-to-end photometric-induced convolutional neural network framework," Journal of Intelligent Manufacturing, Springer, vol. 33(5), pages 1373-1392, June.
    6. Nhat-To Huynh & Duong-Dong Ho & Hong-Nguyen Nguyen, 2023. "An Approach for Designing an Optimal CNN Model Based on Auto-Tuning GA with 2D Chromosome for Defect Detection and Classification," Sustainability, MDPI, vol. 15(6), pages 1-14, March.
    7. Bianca Maria Colosimo & Luca Pagani & Marco Grasso, 2024. "Modeling spatial point processes in video-imaging via Ripley’s K-function: an application to spatter analysis in additive manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 35(1), pages 429-447, January.
    8. Nannan Xu & Xinze Cui & Xin Wang & Wei Zhang & Tianyu Zhao, 2022. "An Intelligent Athlete Signal Processing Methodology for Balance Control Ability Assessment with Multi-Headed Self-Attention Mechanism," Mathematics, MDPI, vol. 10(15), pages 1-16, August.
    9. Bikash Koli Dey & Hyesung Seok, 2024. "Intelligent inventory management with autonomation and service strategy," Journal of Intelligent Manufacturing, Springer, vol. 35(1), pages 307-330, January.
    10. Cheng Hao Jin & Hyun-Jin Kim & Yongjun Piao & Meijing Li & Minghao Piao, 2020. "Wafer map defect pattern classification based on convolutional neural network features and error-correcting output codes," Journal of Intelligent Manufacturing, Springer, vol. 31(8), pages 1861-1875, December.
    11. Xinyu Suo & Jian Liu & Licheng Dong & Chen Shengfeng & Lu Enhui & Chen Ning, 2022. "A machine vision-based defect detection system for nuclear-fuel rod groove," Journal of Intelligent Manufacturing, Springer, vol. 33(6), pages 1649-1663, August.
    12. Shuo Meng & Ruru Pan & Weidong Gao & Jian Zhou & Jingan Wang & Wentao He, 2021. "A multi-task and multi-scale convolutional neural network for automatic recognition of woven fabric pattern," Journal of Intelligent Manufacturing, Springer, vol. 32(4), pages 1147-1161, April.
    13. Nazanin Hosseini Arian & Alireza Pooya & Fariborz Rahimnia & Ali Sibevei, 2021. "Assessment the effect of rapid prototyping implementation on supply chain sustainability: a system dynamics approach," Operations Management Research, Springer, vol. 14(3), pages 467-493, December.
    14. Chengjun Xu & Guobin Zhu, 2021. "Intelligent manufacturing Lie Group Machine Learning: real-time and efficient inspection system based on fog computing," Journal of Intelligent Manufacturing, Springer, vol. 32(1), pages 237-249, January.
    15. Wurong Fu, 2021. "Macroscopic numerical model of reinforced concrete shear walls based on material properties," Journal of Intelligent Manufacturing, Springer, vol. 32(5), pages 1401-1410, June.
    16. Diyi Zhou & Shihua Gong & Ziyue Wang & Delong Li & Huaiqing Lu, 2021. "Error analysis based on error transfer theory and compensation strategy for LED chip visual localization systems," Journal of Intelligent Manufacturing, Springer, vol. 32(5), pages 1345-1359, June.
    17. Shuai Ma & Kechen Song & Menghui Niu & Hongkun Tian & Yunhui Yan, 2024. "Cross-scale fusion and domain adversarial network for generalizable rail surface defect segmentation on unseen datasets," Journal of Intelligent Manufacturing, Springer, vol. 35(1), pages 367-386, January.
    18. Pan, Yue & Kong, Xiangdong & Yuan, Yuebo & Sun, Yukun & Han, Xuebing & Yang, Hongxin & Zhang, Jianbiao & Liu, Xiaoan & Gao, Panlong & Li, Yihui & Lu, Languang & Ouyang, Minggao, 2023. "Detecting the foreign matter defect in lithium-ion batteries based on battery pilot manufacturing line data analyses," Energy, Elsevier, vol. 262(PB).
    19. Seunghwan Jung & Minseok Kim & Eunkyeong Kim & Baekcheon Kim & Jinyong Kim & Kyeong-Hee Cho & Hyang-A Park & Sungshin Kim, 2024. "The Early Detection of Faults for Lithium-Ion Batteries in Energy Storage Systems Using Independent Component Analysis with Mahalanobis Distance," Energies, MDPI, vol. 17(2), pages 1-23, January.
    20. Zeqing Yang & Mingxuan Zhang & Yingshu Chen & Ning Hu & Lingxiao Gao & Libing Liu & Enxu Ping & Jung Il Song, 2024. "Surface defect detection method for air rudder based on positive samples," Journal of Intelligent Manufacturing, Springer, vol. 35(1), pages 95-113, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joinma:v:33:y:2022:i:3:d:10.1007_s10845-020-01684-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.