IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v165y2017icp22-33.html
   My bibliography  Save this article

Design of validation experiments for life prediction models

Author

Listed:
  • Ao, Dan
  • Hu, Zhen
  • Mahadevan, Sankaran

Abstract

This paper proposes a novel validation experiment design optimization (VEDO) method for the assurance of life prediction model, which is one of the key steps in guaranteeing the reliable design of products in meeting the target service life. Life testing data collected from experiments are important for the validation of time-dependent models. However, directly collecting life data for model validation at the operating stress level is usually time-consuming and expensive. In order to overcome this challenge, the accelerated life testing (ALT) method is employed in the proposed method to collect data for model validation. The connection between ALT and model validation is established first; then a VEDO model is developed using the prior information obtained from the computer simulation model. In the VEDO model, the information gain for model validation is maximized within the testing budget and available testing chamber constraints. The obtained optimal number of tests and testing stress levels are designed to maximize the confidence in the validation results. Various sources of uncertainty such as prediction uncertainty, uncertainty of prior information, and observation errors are included within the optimization process in order to improve the robustness of validation experiment design. A composite helicopter rotor hub component is used to demonstrate the effectiveness of the proposed VEDO method.

Suggested Citation

  • Ao, Dan & Hu, Zhen & Mahadevan, Sankaran, 2017. "Design of validation experiments for life prediction models," Reliability Engineering and System Safety, Elsevier, vol. 165(C), pages 22-33.
  • Handle: RePEc:eee:reensy:v:165:y:2017:i:c:p:22-33
    DOI: 10.1016/j.ress.2017.03.030
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832016302009
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2017.03.030?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kleijnen, Jack P. C., 1995. "Verification and validation of simulation models," European Journal of Operational Research, Elsevier, vol. 82(1), pages 145-162, April.
    2. Li, Wei & Chen, Wei & Jiang, Zhen & Lu, Zhenzhou & Liu, Yu, 2014. "New validation metrics for models with multiple correlated responses," Reliability Engineering and System Safety, Elsevier, vol. 127(C), pages 1-11.
    3. Rebba, Ramesh & Mahadevan, Sankaran, 2006. "Validation of models with multivariate output," Reliability Engineering and System Safety, Elsevier, vol. 91(8), pages 861-871.
    4. Ling, You & Mahadevan, Sankaran, 2013. "Quantitative model validation techniques: New insights," Reliability Engineering and System Safety, Elsevier, vol. 111(C), pages 217-231.
    5. Elsayed, E.A. & Zhang, Hao, 2007. "Design of PH-based accelerated life testing plans under multiple-stress-type," Reliability Engineering and System Safety, Elsevier, vol. 92(3), pages 286-292.
    6. Mullins, Joshua & Ling, You & Mahadevan, Sankaran & Sun, Lin & Strachan, Alejandro, 2016. "Separation of aleatory and epistemic uncertainty in probabilistic model validation," Reliability Engineering and System Safety, Elsevier, vol. 147(C), pages 49-59.
    7. Hu, Zhen & Du, Xiaoping, 2012. "Reliability analysis for hydrokinetic turbine blades," Renewable Energy, Elsevier, vol. 48(C), pages 251-262.
    8. Haitao Liao & Elsayed A. Elsayed, 2006. "Reliability inference for field conditions from accelerated degradation testing," Naval Research Logistics (NRL), John Wiley & Sons, vol. 53(6), pages 576-587, September.
    9. Rebba, Ramesh & Mahadevan, Sankaran, 2008. "Computational methods for model reliability assessment," Reliability Engineering and System Safety, Elsevier, vol. 93(8), pages 1197-1207.
    10. Rebba, Ramesh & Mahadevan, Sankaran & Huang, Shuping, 2006. "Validation and error estimation of computational models," Reliability Engineering and System Safety, Elsevier, vol. 91(10), pages 1390-1397.
    11. Jiang, Xiaomo & Mahadevan, Sankaran, 2007. "Bayesian risk-based decision method for model validation under uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 92(6), pages 707-718.
    12. Scott Ferson & William L. Oberkampf, 2009. "Validation of imprecise probability models," International Journal of Reliability and Safety, Inderscience Enterprises Ltd, vol. 3(1/2/3), pages 3-22.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jung, Yongsu & Lee, Ikjin, 2021. "Optimal design of experiments for optimization-based model calibration using Fisher information matrix," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    2. Moustafa, Kassem & Hu, Zhen & Mourelatos, Zissimos P. & Baseski, Igor & Majcher, Monica, 2021. "System reliability analysis using component-level and system-level accelerated life testing," Reliability Engineering and System Safety, Elsevier, vol. 214(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ling, You & Mahadevan, Sankaran, 2013. "Quantitative model validation techniques: New insights," Reliability Engineering and System Safety, Elsevier, vol. 111(C), pages 217-231.
    2. Vanslette, Kevin & Tohme, Tony & Youcef-Toumi, Kamal, 2020. "A general model validation and testing tool," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    3. Wang, Chong & Matthies, Hermann G., 2019. "Novel model calibration method via non-probabilistic interval characterization and Bayesian theory," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 84-92.
    4. Sankararaman, Shankar & Mahadevan, Sankaran, 2015. "Integration of model verification, validation, and calibration for uncertainty quantification in engineering systems," Reliability Engineering and System Safety, Elsevier, vol. 138(C), pages 194-209.
    5. Mullins, Joshua & Ling, You & Mahadevan, Sankaran & Sun, Lin & Strachan, Alejandro, 2016. "Separation of aleatory and epistemic uncertainty in probabilistic model validation," Reliability Engineering and System Safety, Elsevier, vol. 147(C), pages 49-59.
    6. Sankararaman, Shankar & Mahadevan, Sankaran, 2011. "Model validation under epistemic uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 96(9), pages 1232-1241.
    7. Kwag, Shinyoung & Gupta, Abhinav & Dinh, Nam, 2018. "Probabilistic risk assessment based model validation method using Bayesian network," Reliability Engineering and System Safety, Elsevier, vol. 169(C), pages 380-393.
    8. Zhao, Lufeng & Lu, Zhenzhou & Yun, Wanying & Wang, Wenjin, 2017. "Validation metric based on Mahalanobis distance for models with multiple correlated responses," Reliability Engineering and System Safety, Elsevier, vol. 159(C), pages 80-89.
    9. Jiang, Xiaomo & Mahadevan, Sankaran, 2009. "Bayesian structural equation modeling method for hierarchical model validation," Reliability Engineering and System Safety, Elsevier, vol. 94(4), pages 796-809.
    10. Li, Wei & Chen, Wei & Jiang, Zhen & Lu, Zhenzhou & Liu, Yu, 2014. "New validation metrics for models with multiple correlated responses," Reliability Engineering and System Safety, Elsevier, vol. 127(C), pages 1-11.
    11. Bin Suo & Yang Qi & Kai Sun & Jingyuan Xu, 2023. "A Novel Model Validation Method Based on Area Metric Disagreement between Accelerated Storage Distributions and Natural Storage Data," Mathematics, MDPI, vol. 11(11), pages 1-18, May.
    12. Li, Chenzhao & Mahadevan, Sankaran, 2016. "Role of calibration, validation, and relevance in multi-level uncertainty integration," Reliability Engineering and System Safety, Elsevier, vol. 148(C), pages 32-43.
    13. Hund, Lauren & Schroeder, Benjamin & Rumsey, Kellin & Huerta, Gabriel, 2018. "Distinguishing between model- and data-driven inferences for high reliability statistical predictions," Reliability Engineering and System Safety, Elsevier, vol. 180(C), pages 201-210.
    14. Tohme, Tony & Vanslette, Kevin & Youcef-Toumi, Kamal, 2020. "A generalized Bayesian approach to model calibration," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    15. Jiang, Xiaomo & Yuan, Yong & Liu, Xian, 2013. "Bayesian inference method for stochastic damage accumulation modeling," Reliability Engineering and System Safety, Elsevier, vol. 111(C), pages 126-138.
    16. Li, Luyi & Lu, Zhenzhou, 2018. "A new method for model validation with multivariate output," Reliability Engineering and System Safety, Elsevier, vol. 169(C), pages 579-592.
    17. An, Dawn & Kim, Nam H. & Choi, Joo-Ho, 2015. "Practical options for selecting data-driven or physics-based prognostics algorithms with reviews," Reliability Engineering and System Safety, Elsevier, vol. 133(C), pages 223-236.
    18. Ray, Douglas & Ramirez-Marquez, Jose, 2020. "A framework for probabilistic model-based engineering and data synthesis," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    19. Teferra, Kirubel & Shields, Michael D. & Hapij, Adam & Daddazio, Raymond P., 2014. "Mapping model validation metrics to subject matter expert scores for model adequacy assessment," Reliability Engineering and System Safety, Elsevier, vol. 132(C), pages 9-19.
    20. McKeand, Austin M. & Gorguluarslan, Recep M. & Choi, Seung-Kyum, 2021. "Stochastic analysis and validation under aleatory and epistemic uncertainties," Reliability Engineering and System Safety, Elsevier, vol. 205(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:165:y:2017:i:c:p:22-33. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.