IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v202y2020ics0951832020305020.html
   My bibliography  Save this article

A standard-based approach for multi-criteria performance evaluation of engineered systems

Author

Listed:
  • Jiang, R.
  • Chen, Zhigao

Abstract

It is a common practice to periodically monitor the key performance indicators of an engineered system (ES) and quantitatively evaluate the system's ability to perform its functions. For a specific ES, the technical standards for managing its operations and maintenance are usually available and deal with multiple aspects. Therefore, the performance evaluation of ESs should use a standard-based multi-criteria decision analysis (MCDA) approach. It is different from the generic MCDA methods where the performance evaluation for alternatives is based on the decision matrices of alternatives. The literature on performance evaluation of ESs is vast but the literature on standard-based performance evaluation is very limited. This paper aims to fill this gap by proposing a standard-based MCDA approach for evaluating operational performance of ESs. The proposed approach derives the weights of the performance parameters and the parameters of their normalization functions based on the information specified in the technical standards. The robustness and weak compensation degree of the reverse quadratic mean model are identified and it can be used as an aggregation model. A real-world case study is included to illustrate the proposed approach and its usefulness.

Suggested Citation

  • Jiang, R. & Chen, Zhigao, 2020. "A standard-based approach for multi-criteria performance evaluation of engineered systems," Reliability Engineering and System Safety, Elsevier, vol. 202(C).
    • Handle: RePEc:eee:reensy:v:202:y:2020:i:c:s0951832020305020
    DOI: 10.1016/j.ress.2020.107001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832020305020
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2020.107001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Adiel Teixeira de Almeida & Cristiano Alexandre Virgínio Cavalcante & Marcelo Hazin Alencar & Rodrigo José Pires Ferreira & Adiel Teixeira de Almeida-Filho & Thalles Vitelli Garcez, 2015. "Multicriteria and Multiobjective Models for Risk, Reliability and Maintenance Decision Analysis," International Series in Operations Research and Management Science, Springer, edition 127, number 978-3-319-17969-8, July-Dece.
    2. Dhanisetty, V.S. Viswanath & Verhagen, W.J.C. & Curran, Richard, 2018. "Multi-criteria weighted decision making for operational maintenance processes," Journal of Air Transport Management, Elsevier, vol. 68(C), pages 152-164.
    3. Kadak, Andrew C. & Matsuo, Toshihiro, 2007. "The nuclear industry's transition to risk-informed regulation and operation in the United States," Reliability Engineering and System Safety, Elsevier, vol. 92(5), pages 609-618.
    4. P Ji & R Jiang, 2003. "Scale transitivity in the AHP," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(8), pages 896-905, August.
    5. Alberti, Alexandre R. & Cavalcante, Cristiano A.V. & Scarf, Philip & Silva, André L.O., 2018. "Modelling inspection and replacement quality for a protection system," Reliability Engineering and System Safety, Elsevier, vol. 176(C), pages 145-153.
    6. Podofillini, Luca & Zio, Enrico & Vatn, Jørn, 2006. "Risk-informed optimisation of railway tracks inspection and maintenance procedures," Reliability Engineering and System Safety, Elsevier, vol. 91(1), pages 20-35.
    7. Fischer, Gregory W., 1995. "Range Sensitivity of Attribute Weights in Multiattribute Value Models," Organizational Behavior and Human Decision Processes, Elsevier, vol. 62(3), pages 252-266, June.
    8. Opricovic, Serafim & Tzeng, Gwo-Hshiung, 2004. "Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS," European Journal of Operational Research, Elsevier, vol. 156(2), pages 445-455, July.
    9. Scarf, Philip A. & Cavalcante, Cristiano A.V., 2012. "Modelling quality in replacement and inspection maintenance," International Journal of Production Economics, Elsevier, vol. 135(1), pages 372-381.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Santos, Augusto César de Jesus & Cavalcante, Cristiano Alexandre Virgínio, 2022. "A study on the economic and environmental viability of second-hand items in maintenance policies," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    2. Scarf, P.A. & Cavalcante, C.A.V. & Lopes, R.S., 2019. "Delay-time modelling of a critical system subject to random inspections," European Journal of Operational Research, Elsevier, vol. 278(3), pages 772-782.
    3. Sinisterra, Wilfrido Quiñones & Lima, Victor Hugo Resende & Cavalcante, Cristiano Alexandre Virginio & Aribisala, Adetoye Ayokunle, 2023. "A delay-time model to integrate the sequence of resumable jobs, inspection policy, and quality for a single-component system," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    4. Alberti, Alexandre R. & Cavalcante, Cristiano A.V., 2020. "A two-scale maintenance policy for protection systems subject to shocks when meeting demands," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    5. Wakiru, James M. & Pintelon, Liliane & Muchiri, Peter N. & Chemweno, Peter K., 2019. "A simulation-based optimization approach evaluating maintenance and spare parts demand interaction effects," International Journal of Production Economics, Elsevier, vol. 208(C), pages 329-342.
    6. Cavalcante, C.A.V. & Lopes, R.S. & Scarf, P.A., 2018. "A general inspection and opportunistic replacement policy for one-component systems of variable quality," European Journal of Operational Research, Elsevier, vol. 266(3), pages 911-919.
    7. Alberti, A.R. & Neto, W.A. Ferreira & Cavalcante, C.A.V. & Santos, A.C.J., 2022. "Modelling a flexible two-phase inspection-maintenance policy for safety-critical systems considering revised and non-revised inspections," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    8. Cavalcante, Cristiano A.V. & Lopes, Rodrigo S. & Scarf, Philip A., 2021. "Inspection and replacement policy with a fixed periodic schedule," Reliability Engineering and System Safety, Elsevier, vol. 208(C).
    9. Yi Peng, 2015. "Regional earthquake vulnerability assessment using a combination of MCDM methods," Annals of Operations Research, Springer, vol. 234(1), pages 95-110, November.
    10. Zheng, Guozhong & Wang, Xiao, 2020. "The comprehensive evaluation of renewable energy system schemes in tourist resorts based on VIKOR method," Energy, Elsevier, vol. 193(C).
    11. Milad Zamanifar & Seyed Mohammad Seyedhoseyni, 2017. "Recovery planning model for roadways network after natural hazards," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 87(2), pages 699-716, June.
    12. Pedro Ponce & Citlaly Pérez & Aminah Robinson Fayek & Arturo Molina, 2022. "Solar Energy Implementation in Manufacturing Industry Using Multi-Criteria Decision-Making Fuzzy TOPSIS and S4 Framework," Energies, MDPI, vol. 15(23), pages 1-19, November.
    13. Wenyao Niu & Yuan Rong & Liying Yu & Lu Huang, 2022. "A Novel Hybrid Group Decision Making Approach Based on EDAS and Regret Theory under a Fermatean Cubic Fuzzy Environment," Mathematics, MDPI, vol. 10(17), pages 1-30, August.
    14. Zhang, Fengxia & Shen, Jingyuan & Liao, Haitao & Ma, Yizhong, 2021. "Optimal preventive maintenance policy for a system subject to two-phase imperfect inspections," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    15. Hisham Alidrisi, 2021. "An Innovative Job Evaluation Approach Using the VIKOR Algorithm," JRFM, MDPI, vol. 14(6), pages 1-19, June.
    16. Abbas Keramati & Fatemeh Shapouri, 2016. "Multidimensional appraisal of customer relationship management: integrating balanced scorecard and multi criteria decision making approaches," Information Systems and e-Business Management, Springer, vol. 14(2), pages 217-251, May.
    17. Serafim Opricovic, 2009. "A Compromise Solution in Water Resources Planning," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 23(8), pages 1549-1561, June.
    18. María Pilar de la Cruz López & Juan José Cartelle Barros & Alfredo del Caño Gochi & Manuel Lara Coira, 2021. "New Approach for Managing Sustainability in Projects," Sustainability, MDPI, vol. 13(13), pages 1-27, June.
    19. Zheng Yuan & Baohua Wen & Cheng He & Jin Zhou & Zhonghua Zhou & Feng Xu, 2022. "Application of Multi-Criteria Decision-Making Analysis to Rural Spatial Sustainability Evaluation: A Systematic Review," IJERPH, MDPI, vol. 19(11), pages 1-31, May.
    20. Khaled Alshehri & Mohadese Basirati & Devin Sapsford & Michael Harbottle & Peter Cleall, 2024. "Nature-Based Secondary Resource Recovery under Climate Change Uncertainty: A Robust Multi-Objective Optimisation Methodology," Sustainability, MDPI, vol. 16(16), pages 1-27, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:202:y:2020:i:c:s0951832020305020. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.