IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v234y2023ics0951832023000923.html
   My bibliography  Save this article

A comparison between Sobol’s indices and Shapley’s effect for global sensitivity analysis of systems with independent input variables

Author

Listed:
  • Vuillod, Bruno
  • Montemurro, Marco
  • Panettieri, Enrico
  • Hallo, Ludovic

Abstract

The model-based system engineering approach consists of assembling subsystems together to model a complete system. In this context, some functional blocks can have a considerable influence on the overall behaviour of the system. A preliminary identification of the influence of the subsystems on the output responses can help reducing the complexity of the overall system, with a negligible impact on the overall accuracy. Therefore, pertinent indicators must be introduced to achieve this goal. To this purpose, in this work, some well-established methods and algorithms for global sensitivity analysis (GSA) of linear and non-linear systems with independent input variables, i.e., approaches based on Sobol’s indices (different algorithms are considered), and Shapley’s effect, are compared on both benchmark functions and real-world engineering problems.

Suggested Citation

  • Vuillod, Bruno & Montemurro, Marco & Panettieri, Enrico & Hallo, Ludovic, 2023. "A comparison between Sobol’s indices and Shapley’s effect for global sensitivity analysis of systems with independent input variables," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    • Handle: RePEc:eee:reensy:v:234:y:2023:i:c:s0951832023000923
    DOI: 10.1016/j.ress.2023.109177
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832023000923
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2023.109177?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kleijnen, J.P.C., 1995. "Sensitivity analysis and optimization of system dynamics models : Regression analysis and statistical design of experiments," Other publications TiSEM 87ee6ee0-592c-4204-ac50-6, Tilburg University, School of Economics and Management.
    2. Tabandeh, Armin & Sharma, Neetesh & Gardoni, Paolo, 2022. "Uncertainty propagation in risk and resilience analysis of hierarchical systems," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    3. Thapa, Mishal & Missoum, Samy, 2022. "Uncertainty quantification and global sensitivity analysis of composite wind turbine blades," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    4. Wu, Zeping & Wang, Wenjie & Wang, Donghui & Zhao, Kun & Zhang, Weihua, 2019. "Global sensitivity analysis using orthogonal augmented radial basis function," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 291-302.
    5. Tarantola, S. & Gatelli, D. & Mara, T.A., 2006. "Random balance designs for the estimation of first order global sensitivity indices," Reliability Engineering and System Safety, Elsevier, vol. 91(6), pages 717-727.
    6. Lamboni, Matieyendou & Kucherenko, Sergei, 2021. "Multivariate sensitivity analysis and derivative-based global sensitivity measures with dependent variables," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    7. Zhang, Kaichao & Lu, Zhenzhou & Cheng, Kai & Wang, Laijun & Guo, Yanling, 2020. "Global sensitivity analysis for multivariate output model and dynamic models," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    8. Sarazin, Gabriel & Morio, Jérôme & Lagnoux, Agnès & Balesdent, Mathieu & Brevault, Loïc, 2021. "Reliability-oriented sensitivity analysis in presence of data-driven epistemic uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    9. Becker, William, 2020. "Metafunctions for benchmarking in sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    10. Zhu, Xujia & Sudret, Bruno, 2021. "Global sensitivity analysis for stochastic simulators based on generalized lambda surrogate models," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    11. Zhou, Changcong & Shi, Zhuangke & Kucherenko, Sergei & Zhao, Haodong, 2022. "A unified approach for global sensitivity analysis based on active subspace and Kriging," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    12. Azzini, Ivano & Rosati, Rossana, 2021. "Sobol’ main effect index: an Innovative Algorithm (IA) using Dynamic Adaptive Variances," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    13. Ballester-Ripoll, Rafael & Paredes, Enrique G. & Pajarola, Renato, 2019. "Sobol tensor trains for global sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 311-322.
    14. Konakli, Katerina & Sudret, Bruno, 2016. "Global sensitivity analysis using low-rank tensor approximations," Reliability Engineering and System Safety, Elsevier, vol. 156(C), pages 64-83.
    15. Antoniadis, Anestis & Lambert-Lacroix, Sophie & Poggi, Jean-Michel, 2021. "Random forests for global sensitivity analysis: A selective review," Reliability Engineering and System Safety, Elsevier, vol. 206(C).
    16. Heredia, María Belén & Prieur, Clémentine & Eckert, Nicolas, 2022. "Global sensitivity analysis with aggregated Shapley effects, application to avalanche hazard assessment," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    17. Perrin, T.V.E. & Roustant, O. & Rohmer, J. & Alata, O. & Naulin, J.P. & Idier, D. & Pedreros, R. & Moncoulon, D. & Tinard, P., 2021. "Functional principal component analysis for global sensitivity analysis of model with spatial output," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    18. Mara, Thierry Alex, 2009. "Extension of the RBD-FAST method to the computation of global sensitivity indices," Reliability Engineering and System Safety, Elsevier, vol. 94(8), pages 1274-1281.
    19. Saltelli, Andrea & Bolado, Ricardo, 1998. "An alternative way to compute Fourier amplitude sensitivity test (FAST)," Computational Statistics & Data Analysis, Elsevier, vol. 26(4), pages 445-460, February.
    20. Tissot, Jean-Yves & Prieur, Clémentine, 2012. "Bias correction for the estimation of sensitivity indices based on random balance designs," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 205-213.
    21. Liu, Fuchao & Wei, Pengfei & Tang, Chenghu & Wang, Pan & Yue, Zhufeng, 2019. "Global sensitivity analysis for multivariate outputs based on multiple response Gaussian process model," Reliability Engineering and System Safety, Elsevier, vol. 189(C), pages 287-298.
    22. Broto, Baptiste & Bachoc, François & Depecker, Marine & Martinez, Jean-Marc, 2019. "Sensitivity indices for independent groups of variables," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 163(C), pages 19-31.
    23. Goda, Takashi, 2021. "A simple algorithm for global sensitivity analysis with Shapley effects," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    24. Ge, Qiao & Menendez, Monica, 2017. "Extending Morris method for qualitative global sensitivity analysis of models with dependent inputs," Reliability Engineering and System Safety, Elsevier, vol. 162(C), pages 28-39.
    25. Plischke, Elmar, 2010. "An effective algorithm for computing global sensitivity indices (EASI)," Reliability Engineering and System Safety, Elsevier, vol. 95(4), pages 354-360.
    26. Xu, Chonggang & Gertner, George Zdzislaw, 2008. "Uncertainty and sensitivity analysis for models with correlated parameters," Reliability Engineering and System Safety, Elsevier, vol. 93(10), pages 1563-1573.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shang, Xiaobing & Wang, Lipeng & Fang, Hai & Lu, Lingyun & Zhang, Zhi, 2024. "Active Learning of Ensemble Polynomial Chaos Expansion Method for Global Sensitivity Analysis," Reliability Engineering and System Safety, Elsevier, vol. 249(C).
    2. Ebrahimi, Mehrdad & Nobahar, Elnaz & Mohammadi, Reza Karami & Noroozinejad Farsangi, Ehsan & Noori, Mohammad & Li, Shaofan, 2023. "The influence of model and measurement uncertainties on damage detection of experimental structures through recursive algorithms," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    3. Ma, Yuan-Zhuo & Jin, Xiang-Xiang & Zhao, Xiang & Li, Hong-Shuang & Zhao, Zhen-Zhou & Xu, Chang, 2024. "Reliability-oriented global sensitivity analysis using subset simulation and space partition," Reliability Engineering and System Safety, Elsevier, vol. 242(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Torii, André Jacomel & Novotny, Antonio André, 2021. "A priori error estimates for local reliability-based sensitivity analysis with Monte Carlo Simulation," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    2. Jung, WoongHee & Taflanidis, Alexandros A., 2023. "Efficient global sensitivity analysis for high-dimensional outputs combining data-driven probability models and dimensionality reduction," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    3. Zhang, Xiaodong & Dimitrov, Nikolay, 2024. "Variable importance analysis of wind turbine extreme responses with Shapley value explanation," Renewable Energy, Elsevier, vol. 232(C).
    4. Shang, Xiaobing & Su, Li & Fang, Hai & Zeng, Bowen & Zhang, Zhi, 2023. "An efficient multi-fidelity Kriging surrogate model-based method for global sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    5. Ma, Yuan-Zhuo & Jin, Xiang-Xiang & Zhao, Xiang & Li, Hong-Shuang & Zhao, Zhen-Zhou & Xu, Chang, 2024. "Reliability-oriented global sensitivity analysis using subset simulation and space partition," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    6. Goda, Takashi, 2021. "A simple algorithm for global sensitivity analysis with Shapley effects," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    7. Mirko Ginocchi & Ferdinanda Ponci & Antonello Monti, 2021. "Sensitivity Analysis and Power Systems: Can We Bridge the Gap? A Review and a Guide to Getting Started," Energies, MDPI, vol. 14(24), pages 1-59, December.
    8. Shi, Wen & Zhou, Qing & Zhou, Yanju, 2023. "An efficient elementary effect-based method for sensitivity analysis in identifying main and two-factor interaction effects," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    9. Mara, Thierry A. & Tarantola, Stefano, 2012. "Variance-based sensitivity indices for models with dependent inputs," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 115-121.
    10. Wei, Pengfei & Lu, Zhenzhou & Song, Jingwen, 2015. "Variable importance analysis: A comprehensive review," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 399-432.
    11. Heredia, María Belén & Prieur, Clémentine & Eckert, Nicolas, 2021. "Nonparametric estimation of aggregated Sobol’ indices: Application to a depth averaged snow avalanche model," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    12. Tissot, Jean-Yves & Prieur, Clémentine, 2012. "Bias correction for the estimation of sensitivity indices based on random balance designs," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 205-213.
    13. Ballester-Ripoll, Rafael & Leonelli, Manuele, 2022. "Computing Sobol indices in probabilistic graphical models," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    14. Hu, Zhen & Mahadevan, Sankaran, 2019. "Probability models for data-Driven global sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 187(C), pages 40-57.
    15. Wang, Zhenqiang & Jia, Gaofeng, 2023. "Extended sample-based approach for efficient sensitivity analysis of group of random variables," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    16. Plischke, Elmar, 2012. "An adaptive correlation ratio method using the cumulative sum of the reordered output," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 149-156.
    17. Barr, John & Rabitz, Herschel, 2023. "Kernel-based global sensitivity analysis obtained from a single data set," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    18. Shang, Xiaobing & Wang, Lipeng & Fang, Hai & Lu, Lingyun & Zhang, Zhi, 2024. "Active Learning of Ensemble Polynomial Chaos Expansion Method for Global Sensitivity Analysis," Reliability Engineering and System Safety, Elsevier, vol. 249(C).
    19. Zhiwei Bai & Hongkui Wei & Yingying Xiao & Shufang Song & Sergei Kucherenko, 2021. "A Vine Copula-Based Global Sensitivity Analysis Method for Structures with Multidimensional Dependent Variables," Mathematics, MDPI, vol. 9(19), pages 1-20, October.
    20. Moglen, Rachel L. & Barth, Julius & Gupta, Shagun & Kawai, Eiji & Klise, Katherine & Leibowicz, Benjamin D., 2023. "A nexus approach to infrastructure resilience planning under uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 230(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:234:y:2023:i:c:s0951832023000923. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.