IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v318y2024i3p911-926.html
   My bibliography  Save this article

The many Shapley values for explainable artificial intelligence: A sensitivity analysis perspective

Author

Listed:
  • Borgonovo, Emanuele
  • Plischke, Elmar
  • Rabitti, Giovanni

Abstract

Predictive models are increasingly used for managerial and operational decision-making. The use of complex machine learning algorithms, the growth in computing power, and the increase in data acquisitions have amplified the black-box effects in data science. Consequently, a growing body of literature is investigating methods for interpretability and explainability. We focus on methods based on Shapley values, which are gaining attention as measures of feature importance for explaining black-box predictions. Our analysis follows a hierarchy of value functions, and proves several theoretical properties that connect the indices at the alternative levels. We bridge the notions of totally monotone games and Shapley values, and introduce new interaction indices based on the Shapley-Owen values. The hierarchy evidences synergies that emerge when combining Shapley effects computed at different levels. We then propose a novel sensitivity analysis setting that combines the benefits of both local and global Shapley explanations, which we refer to as the “glocal” approach. We illustrate our integrated approach and discuss the managerial insights it provides in the context of a data-science problem related to health insurance policy-making.

Suggested Citation

  • Borgonovo, Emanuele & Plischke, Elmar & Rabitti, Giovanni, 2024. "The many Shapley values for explainable artificial intelligence: A sensitivity analysis perspective," European Journal of Operational Research, Elsevier, vol. 318(3), pages 911-926.
  • Handle: RePEc:eee:ejores:v:318:y:2024:i:3:p:911-926
    DOI: 10.1016/j.ejor.2024.06.023
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221724004715
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2024.06.023?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bergantiños, Gustavo & Groba, Carlos & Sartal, Antonio, 2023. "Applying the Shapley value to the tuna fishery," European Journal of Operational Research, Elsevier, vol. 309(1), pages 306-318.
    2. Csóka, Péter & Illés, Ferenc & Solymosi, Tamás, 2022. "On the Shapley value of liability games," European Journal of Operational Research, Elsevier, vol. 300(1), pages 378-386.
    3. Naumzik, Christof & Feuerriegel, Stefan & Nielsen, Anne Molgaard, 2023. "Data-driven dynamic treatment planning for chronic diseases," European Journal of Operational Research, Elsevier, vol. 305(2), pages 853-867.
    4. Stan Lipovetsky & Michael Conklin, 2001. "Analysis of regression in game theory approach," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 17(4), pages 319-330, October.
    5. Harvey M. Wagner, 1995. "Global Sensitivity Analysis," Operations Research, INFORMS, vol. 43(6), pages 948-969, December.
    6. Marc Roubens & Michel Grabisch, 1999. "An axiomatic approach to the concept of interaction among players in cooperative games," International Journal of Game Theory, Springer;Game Theory Society, vol. 28(4), pages 547-565.
    7. Andreas Tsanakas & Pietro Millossovich, 2016. "Sensitivity Analysis Using Risk Measures," Risk Analysis, John Wiley & Sons, vol. 36(1), pages 30-48, January.
    8. Koen W. de Bock & Kristof Coussement & Arno De Caigny & Roman Slowiński & Bart Baesens & Robert N Boute & Tsan-Ming Choi & Dursun Delen & Mathias Kraus & Stefan Lessmann & Sebastián Maldonado & David , 2023. "Explainable AI for Operational Research: A Defining Framework, Methods, Applications, and a Research Agenda," Post-Print hal-04219546, HAL.
    9. Julian Senoner & Torbjørn Netland & Stefan Feuerriegel, 2022. "Using Explainable Artificial Intelligence to Improve Process Quality: Evidence from Semiconductor Manufacturing," Management Science, INFORMS, vol. 68(8), pages 5704-5723, August.
    10. Liu, Ruixue & Owen, Art B., 2006. "Estimating Mean Dimensionality of Analysis of Variance Decompositions," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 712-721, June.
    11. Nazemi, Abdolreza & Baumann, Friedrich & Fabozzi, Frank J., 2022. "Intertemporal defaulted bond recoveries prediction via machine learning," European Journal of Operational Research, Elsevier, vol. 297(3), pages 1162-1177.
    12. Borgonovo, Emanuele & Ghidini, Valentina & Hahn, Roman & Plischke, Elmar, 2023. "Explaining classifiers with measures of statistical association," Computational Statistics & Data Analysis, Elsevier, vol. 182(C).
    13. Borgonovo, E., 2010. "Sensitivity analysis with finite changes: An application to modified EOQ models," European Journal of Operational Research, Elsevier, vol. 200(1), pages 127-138, January.
    14. Sobol’, I.M. & Kucherenko, S., 2009. "Derivative based global sensitivity measures and their link with global sensitivity indices," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 79(10), pages 3009-3017.
    15. Masayoshi Mase & Art B. Owen & Benjamin Seiler, 2019. "Explaining black box decisions by Shapley cohort refinement," Papers 1911.00467, arXiv.org, revised Oct 2020.
    16. Ahmed, Abdulaziz & Topuz, Kazim & Moqbel, Murad & Abdulrashid, Ismail, 2024. "What makes accidents severe! explainable analytics framework with parameter optimization," European Journal of Operational Research, Elsevier, vol. 317(2), pages 425-436.
    17. Florez-Lopez, Raquel, 2007. "Modelling of insurers' rating determinants. An application of machine learning techniques and statistical models," European Journal of Operational Research, Elsevier, vol. 183(3), pages 1488-1512, December.
    18. Kriebel, Johannes & Stitz, Lennart, 2022. "Credit default prediction from user-generated text in peer-to-peer lending using deep learning," European Journal of Operational Research, Elsevier, vol. 302(1), pages 309-323.
    19. Borgonovo, Emanuele & Rabitti, Giovanni, 2023. "Screening: From tornado diagrams to effective dimensions," European Journal of Operational Research, Elsevier, vol. 304(3), pages 1200-1211.
    20. Roustant, O. & Fruth, J. & Iooss, B. & Kuhnt, S., 2014. "Crossed-derivative based sensitivity measures for interaction screening," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 105(C), pages 105-118.
    21. Manel Baucells & Emanuele Borgonovo, 2013. "Invariant Probabilistic Sensitivity Analysis," Management Science, INFORMS, vol. 59(11), pages 2536-2549, November.
    22. L. Jeff Hong & Guangwu Liu, 2009. "Simulating Sensitivities of Conditional Value at Risk," Management Science, INFORMS, vol. 55(2), pages 281-293, February.
    23. Kedar Dhamdhere & Ashish Agarwal & Mukund Sundararajan, 2019. "The Shapley Taylor Interaction Index," Papers 1902.05622, arXiv.org, revised Feb 2020.
    24. Balog, Dóra & Bátyi, Tamás László & Csóka, Péter & Pintér, Miklós, 2017. "Properties and comparison of risk capital allocation methods," European Journal of Operational Research, Elsevier, vol. 259(2), pages 614-625.
    25. Chen, Yujia & Calabrese, Raffaella & Martin-Barragan, Belen, 2024. "Interpretable machine learning for imbalanced credit scoring datasets," European Journal of Operational Research, Elsevier, vol. 312(1), pages 357-372.
    26. Guillermo Owen, 1972. "Multilinear Extensions of Games," Management Science, INFORMS, vol. 18(5-Part-2), pages 64-79, January.
    27. Sourav Chatterjee, 2021. "A New Coefficient of Correlation," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 2009-2022, October.
    28. Ni, Ji & Chen, Bowei & Allinson, Nigel M. & Ye, Xujiong, 2020. "A hybrid model for predicting human physical activity status from lifelogging data," European Journal of Operational Research, Elsevier, vol. 281(3), pages 532-542.
    29. L. Jeff Hong & Guangwu Liu, 2010. "Pathwise Estimation of Probability Sensitivities Through Terminating or Steady-State Simulations," Operations Research, INFORMS, vol. 58(2), pages 357-370, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gustavo Berganti~nos & Juan D. Moreno-Ternero, 2024. "Streaming problems as (multi-issue) claims problems," Papers 2412.18628, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. S. Cucurachi & E. Borgonovo & R. Heijungs, 2016. "A Protocol for the Global Sensitivity Analysis of Impact Assessment Models in Life Cycle Assessment," Risk Analysis, John Wiley & Sons, vol. 36(2), pages 357-377, February.
    2. Borgonovo, Emanuele & Plischke, Elmar, 2016. "Sensitivity analysis: A review of recent advances," European Journal of Operational Research, Elsevier, vol. 248(3), pages 869-887.
    3. Borgonovo, Emanuele & Rabitti, Giovanni, 2023. "Screening: From tornado diagrams to effective dimensions," European Journal of Operational Research, Elsevier, vol. 304(3), pages 1200-1211.
    4. Silvana M. Pesenti & Pietro Millossovich & Andreas Tsanakas, 2023. "Differential Quantile-Based Sensitivity in Discontinuous Models," Papers 2310.06151, arXiv.org, revised Oct 2024.
    5. Lamboni, Matieyendou, 2021. "Derivative-based integral equalities and inequality: A proxy-measure for sensitivity analysis," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 179(C), pages 137-161.
    6. Lamboni, Matieyendou, 2020. "Derivative-based generalized sensitivity indices and Sobol’ indices," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 170(C), pages 236-256.
    7. Wei, Pengfei & Lu, Zhenzhou & Song, Jingwen, 2015. "Variable importance analysis: A comprehensive review," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 399-432.
    8. Borgonovo, Emanuele & Clemente, Gian Paolo & Rabitti, Giovanni, 2024. "Why insurance regulators need to require sensitivity settings of internal models for their approval," Finance Research Letters, Elsevier, vol. 60(C).
    9. Emanuele Borgonovo & Elmar Plischke & Giovanni Rabitti, 2022. "Interactions and computer experiments," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 49(3), pages 1274-1303, September.
    10. Isadora Antoniano‐Villalobos & Emanuele Borgonovo & Sumeda Siriwardena, 2018. "Which Parameters Are Important? Differential Importance Under Uncertainty," Risk Analysis, John Wiley & Sons, vol. 38(11), pages 2459-2477, November.
    11. Nguyen, Tri-Dung, 2024. "Game of banks - biform game theoretical framework for ATM network cost sharing," European Journal of Operational Research, Elsevier, vol. 316(3), pages 1158-1178.
    12. Ulrich Faigle & Michel Grabisch, 2017. "Game Theoretic Interaction and Decision: A Quantum Analysis," Games, MDPI, vol. 8(4), pages 1-25, November.
    13. Tianyang Wang & James S. Dyer & Warren J. Hahn, 2017. "Sensitivity analysis of decision making under dependent uncertainties using copulas," EURO Journal on Decision Processes, Springer;EURO - The Association of European Operational Research Societies, vol. 5(1), pages 117-139, November.
    14. da Costa, B. Freitas Paulo & Pesenti, Silvana M. & Targino, Rodrigo S., 2023. "Risk budgeting portfolios from simulations," European Journal of Operational Research, Elsevier, vol. 311(3), pages 1040-1056.
    15. Ulrich Faigle & Michel Grabisch, 2016. "Bases and linear transforms of TU-games and cooperation systems," International Journal of Game Theory, Springer;Game Theory Society, vol. 45(4), pages 875-892, November.
    16. Michel Grabisch & Fabien Lange, 2007. "Games on lattices, multichoice games and the shapley value: a new approach," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 65(1), pages 153-167, February.
    17. Wong, Chun Yui & Seshadri, Pranay & Parks, Geoffrey, 2021. "Extremum sensitivity analysis with polynomial Monte Carlo filtering," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    18. Lamboni, Matieyendou, 2022. "Weak derivative-based expansion of functions: ANOVA and some inequalities," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 194(C), pages 691-718.
    19. Wei Li & Wolfgang Karl Hardle & Stefan Lessmann, 2022. "A Data-driven Case-based Reasoning in Bankruptcy Prediction," Papers 2211.00921, arXiv.org.
    20. Bernd Heidergott & Warren Volk-Makarewicz, 2016. "A Measure-Valued Differentiation Approach to Sensitivities of Quantiles," Mathematics of Operations Research, INFORMS, vol. 41(1), pages 293-317, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:318:y:2024:i:3:p:911-926. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.