IDEAS home Printed from https://ideas.repec.org/a/spr/joinma/v33y2022i6d10.1007_s10845-021-01758-3.html
   My bibliography  Save this article

Explainable AI for domain experts: a post Hoc analysis of deep learning for defect classification of TFT–LCD panels

Author

Listed:
  • Minyoung Lee

    (Korea University)

  • Joohyoung Jeon

    (Korea University)

  • Hongchul Lee

    (Korea University)

Abstract

The deep learning (DL) model has performed successfully in various fields, including manufacturing. DL models for defect image data analysis in the manufacturing field have been applied to multiple domains such as defect detection, classification, and localization. However, DL models require trade-offs in accuracy and interpretability. We use explainable artificial intelligence techniques to analyze the predicted results of the defect image classification model, which is considered as a “black-box” model, to produce human-understandable results. We visualize defects using layer-wise relevance propagation-based methods, fit the model into a decision tree, and convert prediction results into human-interpretable text. Our research complements the interpretation of prediction results for the classification model. The domain expert can obtain the reliability and explanatory ability for the defect classification of TFT–LCD panel data of the DL model through the results of the proposed analysis.

Suggested Citation

  • Minyoung Lee & Joohyoung Jeon & Hongchul Lee, 2022. "Explainable AI for domain experts: a post Hoc analysis of deep learning for defect classification of TFT–LCD panels," Journal of Intelligent Manufacturing, Springer, vol. 33(6), pages 1747-1759, August.
    • Handle: RePEc:spr:joinma:v:33:y:2022:i:6:d:10.1007_s10845-021-01758-3
    DOI: 10.1007/s10845-021-01758-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10845-021-01758-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10845-021-01758-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wangzhe Du & Hongyao Shen & Jianzhong Fu & Ge Zhang & Xuanke Shi & Quan He, 2021. "Automated detection of defects with low semantic information in X-ray images based on deep learning," Journal of Intelligent Manufacturing, Springer, vol. 32(1), pages 141-156, January.
    2. Konstantakopoulos, Ioannis C. & Barkan, Andrew R. & He, Shiying & Veeravalli, Tanya & Liu, Huihan & Spanos, Costas, 2019. "A deep learning and gamification approach to improving human-building interaction and energy efficiency in smart infrastructure," Applied Energy, Elsevier, vol. 237(C), pages 810-821.
    3. Cheng Hao Jin & Hyun-Jin Kim & Yongjun Piao & Meijing Li & Minghao Piao, 2020. "Wafer map defect pattern classification based on convolutional neural network features and error-correcting output codes," Journal of Intelligent Manufacturing, Springer, vol. 31(8), pages 1861-1875, December.
    4. Xiang Li & Xiaodong Jia & Qibo Yang & Jay Lee, 2020. "Quality analysis in metal additive manufacturing with deep learning," Journal of Intelligent Manufacturing, Springer, vol. 31(8), pages 2003-2017, December.
    5. Fangwei Ning & Yan Shi & Maolin Cai & Weiqing Xu, 2020. "Various realization methods of machine-part classification based on deep learning," Journal of Intelligent Manufacturing, Springer, vol. 31(8), pages 2019-2032, December.
    6. Sebastian Lapuschkin & Stephan Wäldchen & Alexander Binder & Grégoire Montavon & Wojciech Samek & Klaus-Robert Müller, 2019. "Unmasking Clever Hans predictors and assessing what machines really learn," Nature Communications, Nature, vol. 10(1), pages 1-8, December.
    7. Sebastian Bach & Alexander Binder & Grégoire Montavon & Frederick Klauschen & Klaus-Robert Müller & Wojciech Samek, 2015. "On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-46, July.
    8. Chengbao Liu & Jie Tan & Xuelei Wang, 2020. "A data-driven decision-making optimization approach for inconsistent lithium-ion cell screening," Journal of Intelligent Manufacturing, Springer, vol. 31(4), pages 833-845, April.
    9. Olatomiwa Badmos & Andreas Kopp & Timo Bernthaler & Gerhard Schneider, 2020. "Image-based defect detection in lithium-ion battery electrode using convolutional neural networks," Journal of Intelligent Manufacturing, Springer, vol. 31(4), pages 885-897, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chia-Yu Hsu & Ju-Chien Chien, 2022. "Ensemble convolutional neural networks with weighted majority for wafer bin map pattern classification," Journal of Intelligent Manufacturing, Springer, vol. 33(3), pages 831-844, March.
    2. Omid Davtalab & Ali Kazemian & Xiao Yuan & Behrokh Khoshnevis, 2022. "Automated inspection in robotic additive manufacturing using deep learning for layer deformation detection," Journal of Intelligent Manufacturing, Springer, vol. 33(3), pages 771-784, March.
    3. Wang, Fujin & Zhao, Zhibin & Zhai, Zhi & Shang, Zuogang & Yan, Ruqiang & Chen, Xuefeng, 2023. "Explainability-driven model improvement for SOH estimation of lithium-ion battery," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    4. Bianca Maria Colosimo & Luca Pagani & Marco Grasso, 2024. "Modeling spatial point processes in video-imaging via Ripley’s K-function: an application to spatter analysis in additive manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 35(1), pages 429-447, January.
    5. Nannan Xu & Xinze Cui & Xin Wang & Wei Zhang & Tianyu Zhao, 2022. "An Intelligent Athlete Signal Processing Methodology for Balance Control Ability Assessment with Multi-Headed Self-Attention Mechanism," Mathematics, MDPI, vol. 10(15), pages 1-16, August.
    6. Liu, Xiaoqi & Lee, Seungjae & Bilionis, Ilias & Karava, Panagiota & Joe, Jaewan & Sadeghi, Seyed Amir, 2021. "A user-interactive system for smart thermal environment control in office buildings," Applied Energy, Elsevier, vol. 298(C).
    7. Tobias Thomas & Dominik Straub & Fabian Tatai & Megan Shene & Tümer Tosik & Kristian Kersting & Constantin A. Rothkopf, 2024. "Modelling dataset bias in machine-learned theories of economic decision-making," Nature Human Behaviour, Nature, vol. 8(4), pages 679-691, April.
    8. Xinyu Suo & Jian Liu & Licheng Dong & Chen Shengfeng & Lu Enhui & Chen Ning, 2022. "A machine vision-based defect detection system for nuclear-fuel rod groove," Journal of Intelligent Manufacturing, Springer, vol. 33(6), pages 1649-1663, August.
    9. Nazanin Hosseini Arian & Alireza Pooya & Fariborz Rahimnia & Ali Sibevei, 2021. "Assessment the effect of rapid prototyping implementation on supply chain sustainability: a system dynamics approach," Operations Management Research, Springer, vol. 14(3), pages 467-493, December.
    10. Liu, Xingtao & Tang, Qinbin & Feng, Yitian & Lin, Mingqiang & Meng, Jinhao & Wu, Ji, 2023. "Fast sorting method of retired batteries based on multi-feature extraction from partial charging segment," Applied Energy, Elsevier, vol. 351(C).
    11. Van Den Hauwe, Ludwig, 2023. "Why Machines Will Not Replace Entrepreneurs. On the Inevitable Limitations of Artificial Intelligence in Economic Life," MPRA Paper 118307, University Library of Munich, Germany.
    12. Tien, Paige Wenbin & Wei, Shuangyu & Calautit, John Kaiser & Darkwa, Jo & Wood, Christopher, 2022. "Real-time monitoring of occupancy activities and window opening within buildings using an integrated deep learning-based approach for reducing energy demand," Applied Energy, Elsevier, vol. 308(C).
    13. Kevin Fauvel & Tao Lin & Véronique Masson & Élisa Fromont & Alexandre Termier, 2021. "XCM: An Explainable Convolutional Neural Network for Multivariate Time Series Classification," Mathematics, MDPI, vol. 9(23), pages 1-19, December.
    14. Xinhua Yao & Di Wang & Tao Yu & Congcong Luan & Jianzhong Fu, 2023. "A machining feature recognition approach based on hierarchical neural network for multi-feature point cloud models," Journal of Intelligent Manufacturing, Springer, vol. 34(6), pages 2599-2610, August.
    15. Damiano Brigo & Xiaoshan Huang & Andrea Pallavicini & Haitz Saez de Ocariz Borde, 2021. "Interpretability in deep learning for finance: a case study for the Heston model," Papers 2104.09476, arXiv.org.
    16. Tien, Paige Wenbin & Wei, Shuangyu & Liu, Tianshu & Calautit, John & Darkwa, Jo & Wood, Christopher, 2021. "A deep learning approach towards the detection and recognition of opening of windows for effective management of building ventilation heat losses and reducing space heating demand," Renewable Energy, Elsevier, vol. 177(C), pages 603-625.
    17. Chengjun Xu & Guobin Zhu, 2021. "Intelligent manufacturing Lie Group Machine Learning: real-time and efficient inspection system based on fog computing," Journal of Intelligent Manufacturing, Springer, vol. 32(1), pages 237-249, January.
    18. Jafari, Hamed & Safarzadeh, Soroush & Azad-Farsani, Ehsan, 2022. "Effects of governmental policies on energy-efficiency improvement of hydrogen fuel cell cars: A game-theoretic approach," Energy, Elsevier, vol. 254(PC).
    19. Ali Ghofrani & Esmat Zaidan & Mohsen Jafari, 2021. "Reshaping energy policy based on social and human dimensions: an analysis of human-building interactions among societies in transition in GCC countries," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-26, December.
    20. Martin Obschonka & David B. Audretsch, 2020. "Artificial intelligence and big data in entrepreneurship: a new era has begun," Small Business Economics, Springer, vol. 55(3), pages 529-539, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joinma:v:33:y:2022:i:6:d:10.1007_s10845-021-01758-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.