IDEAS home Printed from https://ideas.repec.org/a/spr/joinma/v33y2022i7d10.1007_s10845-022-01975-4.html
   My bibliography  Save this article

Capturing and incorporating expert knowledge into machine learning models for quality prediction in manufacturing

Author

Listed:
  • Patrick Link

    (Fraunhofer Institute for Machine Tools and Forming Technology IWU)

  • Miltiadis Poursanidis

    (Fraunhofer Institute for Industrial Mathematics ITWM)

  • Jochen Schmid

    (Fraunhofer Institute for Industrial Mathematics ITWM)

  • Rebekka Zache

    (Fraunhofer Institute for Machine Tools and Forming Technology IWU)

  • Martin Kurnatowski

    (Fraunhofer Institute for Industrial Mathematics ITWM)

  • Uwe Teicher

    (Fraunhofer Institute for Machine Tools and Forming Technology IWU)

  • Steffen Ihlenfeldt

    (Fraunhofer Institute for Machine Tools and Forming Technology IWU
    Technische Universität Dresden)

Abstract

Increasing digitalization enables the use of machine learning (ML) methods for analyzing and optimizing manufacturing processes. A main application of ML is the construction of quality prediction models, which can be used, among other things, for documentation purposes, as assistance systems for process operators, or for adaptive process control. The quality of such ML models typically strongly depends on the amount and the quality of data used for training. In manufacturing, the size of available datasets before start of production (SOP) is often limited. In contrast to data, expert knowledge commonly is available in manufacturing. Therefore, this study introduces a general methodology for building quality prediction models with ML methods on small datasets by integrating shape expert knowledge, that is, prior knowledge about the shape of the input–output relationship to be learned. The proposed methodology is applied to a brushing process with 125 data points for predicting the surface roughness as a function of five process variables. As opposed to conventional ML methods for small datasets, the proposed methodology produces prediction models that strictly comply with all the expert knowledge specified by the involved process specialists. In particular, the direct involvement of process experts in the training of the models leads to a very clear interpretation and, by extension, to a high acceptance of the models. While working out the shape knowledge requires some iterations in general, another clear merit of the proposed methodology is that, in contrast to most conventional ML, it involves no time-consuming and often heuristic hyperparameter tuning or model selection step.

Suggested Citation

  • Patrick Link & Miltiadis Poursanidis & Jochen Schmid & Rebekka Zache & Martin Kurnatowski & Uwe Teicher & Steffen Ihlenfeldt, 2022. "Capturing and incorporating expert knowledge into machine learning models for quality prediction in manufacturing," Journal of Intelligent Manufacturing, Springer, vol. 33(7), pages 2129-2142, October.
  • Handle: RePEc:spr:joinma:v:33:y:2022:i:7:d:10.1007_s10845-022-01975-4
    DOI: 10.1007/s10845-022-01975-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10845-022-01975-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10845-022-01975-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. V. Chernozhukov & I. Fernández-Val & A. Galichon, 2009. "Improving point and interval estimators of monotone functions by rearrangement," Biometrika, Biometrika Trust, vol. 96(3), pages 559-575.
    2. Che-Jung Chang & Wen-Li Dai & Chien-Chih Chen, 2015. "A novel procedure for multimodel development using the grey silhouette coefficient for small-data-set forecasting," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(11), pages 1887-1894, November.
    3. Jia Hao & Mengying Zhou & Guoxin Wang & Liangyue Jia & Yan Yan, 2020. "Design optimization by integrating limited simulation data and shape engineering knowledge with Bayesian optimization (BO-DK4DO)," Journal of Intelligent Manufacturing, Springer, vol. 31(8), pages 2049-2067, December.
    4. Lizhen Lin & David B. Dunson, 2014. "Bayesian monotone regression using Gaussian process projection," Biometrika, Biometrika Trust, vol. 101(2), pages 303-317.
    5. Heng Zhang & Utpal Roy & Yung-Tsun Tina Lee, 2020. "Enriching analytics models with domain knowledge for smart manufacturing data analysis," International Journal of Production Research, Taylor & Francis Journals, vol. 58(20), pages 6399-6415, October.
    6. V. Chernozhukov & I. Fernández-Val & A. Galichon, 2009. "Improving point and interval estimators of monotone functions by rearrangement," Biometrika, Biometrika Trust, vol. 96(3), pages 559-575.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Victor Chernozhukov & Iván Fernández-Val & Blaise Melly & Kaspar Wüthrich, 2020. "Generic Inference on Quantile and Quantile Effect Functions for Discrete Outcomes," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(529), pages 123-137, January.
    2. Horowitz, Joel L. & Lee, Sokbae, 2017. "Nonparametric estimation and inference under shape restrictions," Journal of Econometrics, Elsevier, vol. 201(1), pages 108-126.
    3. Belloni, Alexandre & Chernozhukov, Victor & Chetverikov, Denis & Fernández-Val, Iván, 2019. "Conditional quantile processes based on series or many regressors," Journal of Econometrics, Elsevier, vol. 213(1), pages 4-29.
    4. Koen Jochmans, 2013. "Pairwise‐comparison estimation with non‐parametric controls," Econometrics Journal, Royal Economic Society, vol. 16(3), pages 340-372, October.
    5. Kneib, Thomas & Silbersdorff, Alexander & Säfken, Benjamin, 2023. "Rage Against the Mean – A Review of Distributional Regression Approaches," Econometrics and Statistics, Elsevier, vol. 26(C), pages 99-123.
    6. Victor Chernozhukov & Mert Demirer & Esther Duflo & Ivan Fernandez-Val, 2017. "Generic machine learning inference on heterogenous treatment effects in randomized experiments," CeMMAP working papers 61/17, Institute for Fiscal Studies.
    7. Yunyun Wang & Tatsushi Oka & Dan Zhu, 2023. "Distributional Vector Autoregression: Eliciting Macro and Financial Dependence," Papers 2303.04994, arXiv.org.
    8. Victor Chernozhukov & Whitney K. Newey & Andres Santos, 2023. "Constrained Conditional Moment Restriction Models," Econometrica, Econometric Society, vol. 91(2), pages 709-736, March.
    9. Marc Henry & Koen Jochmans & Bernard Salanié, 2014. "Inference on Mixtures Under Tail Restrictions," SciencePo Working papers Main hal-01053810, HAL.
    10. Denis Chetverikov & Daniel Wilhelm, 2016. "Nonparametric instrumental variable estimation under monotonicity," CeMMAP working papers 48/16, Institute for Fiscal Studies.
    11. José F. Tudón M., 2019. "Perception, utility, and evolution," Economic Theory Bulletin, Springer;Society for the Advancement of Economic Theory (SAET), vol. 7(2), pages 191-208, December.
    12. Che-Jung Chang & Liping Yu & Peng Jin, 2016. "A mega-trend-diffusion grey forecasting model for short-term manufacturing demand," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 67(12), pages 1439-1445, December.
    13. Victor Chernozhukov & Iván Fernández‐Val & Blaise Melly, 2013. "Inference on Counterfactual Distributions," Econometrica, Econometric Society, vol. 81(6), pages 2205-2268, November.
    14. Gabriel Montes-Rojas & Lucas Siga & Ram Mainali, 2017. "Mean and quantile regression Oaxaca-Blinder decompositions with an application to caste discrimination," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 15(3), pages 245-255, September.
    15. Chernozhukov, Victor & Fernández-Val, Iván & Weidner, Martin, 2024. "Network and panel quantile effects via distribution regression," Journal of Econometrics, Elsevier, vol. 240(2).
    16. Marc Henry & Romuald Meango & Ismael Mourifie, 2020. "Role models and revealed gender-specific costs of STEM in an extended Roy model of major choice," Papers 2005.09095, arXiv.org, revised Aug 2023.
    17. Ghossoub, Mario, 2011. "Monotone equimeasurable rearrangements with non-additive probabilities," MPRA Paper 37629, University Library of Munich, Germany, revised 23 Mar 2012.
    18. Isaiah Andrews & Jesse M. Shapiro, 2021. "A Model of Scientific Communication," Econometrica, Econometric Society, vol. 89(5), pages 2117-2142, September.
    19. repec:spo:wpmain:info:hdl:2441/f6h8764enu2lskk9p2m96cphi is not listed on IDEAS
    20. Stéphane Bonhomme & Koen Jochmans & Jean-Marc Robin, 2016. "Non-parametric estimation of finite mixtures from repeated measurements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(1), pages 211-229, January.
    21. Charles-Olivier Amédée-Manesme & Fabrice Barthélémy, 2022. "Proper use of the modified Sharpe ratios in performance measurement: rearranging the Cornish Fisher expansion," Annals of Operations Research, Springer, vol. 313(2), pages 691-712, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joinma:v:33:y:2022:i:7:d:10.1007_s10845-022-01975-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.