IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v59y2013i11p2536-2549.html
   My bibliography  Save this article

Invariant Probabilistic Sensitivity Analysis

Author

Listed:
  • Manel Baucells

    (RAND Corporation, Santa Monica, California 90401; and Department of Economics and Business, Universitat Pompeu Fabra, 08018 Barcelona, Spain)

  • Emanuele Borgonovo

    (Department of Decision Sciences and ELEUSI, Bocconi University, 20136 Milan, Italy)

Abstract

In evaluating opportunities, investors wish to identify key sources of uncertainty. We propose a new way to measure how sensitive model outputs are to each probabilistic input (e.g., revenues, growth, idiosyncratic risk parameters). We base our approach on measuring the distance between cumulative distributions (risk profiles) using a metric that is invariant to monotonic transformations. Thus, the sensitivity measure will not vary by alternative specifications of the utility function over the output. To measure separation, we propose using either Kuiper's metric or Kolmogorov--Smirnov's metric. We illustrate the advantages of our proposed sensitivity measure by comparing it with others, most notably, the contribution-to-variance measures. Our measure can be obtained as a by-product of a Monte Carlo simulation. We illustrate our approach in several examples, focusing on investment analysis situations. This paper was accepted by Peter Wakker, decision analysis.

Suggested Citation

  • Manel Baucells & Emanuele Borgonovo, 2013. "Invariant Probabilistic Sensitivity Analysis," Management Science, INFORMS, vol. 59(11), pages 2536-2549, November.
  • Handle: RePEc:inm:ormnsc:v:59:y:2013:i:11:p:2536-2549
    DOI: 10.1287/mnsc.2013.1719
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2013.1719
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2013.1719?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Frederick S. Hillier, 1963. "The Derivation of Probabilistic Information for the Evaluation of Risky Investments," Management Science, INFORMS, vol. 9(3), pages 443-457, April.
    2. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    3. Emanuele Borgonovo & William Castaings & Stefano Tarantola, 2011. "Moment Independent Importance Measures: New Results and Analytical Test Cases," Risk Analysis, John Wiley & Sons, vol. 31(3), pages 404-428, March.
    4. Harvey M. Wagner, 1995. "Global Sensitivity Analysis," Operations Research, INFORMS, vol. 43(6), pages 948-969, December.
    5. Ronald A. Howard, 1988. "Decision Analysis: Practice and Promise," Management Science, INFORMS, vol. 34(6), pages 679-695, June.
    6. Robert Bordley & Marco LiCalzi, 2000. "Decision analysis using targets instead of utility functions," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 23(1), pages 53-74.
    7. James E. Smith, 1998. "Evaluating Income Streams: A Decision Analysis Approach," Management Science, INFORMS, vol. 44(12-Part-1), pages 1690-1708, December.
    8. Plischke, Elmar, 2010. "An effective algorithm for computing global sensitivity indices (EASI)," Reliability Engineering and System Safety, Elsevier, vol. 95(4), pages 354-360.
    9. Victor Richmond R. Jose & Robert F. Nau & Robert L. Winkler, 2008. "Scoring Rules, Generalized Entropy, and Utility Maximization," Operations Research, INFORMS, vol. 56(5), pages 1146-1157, October.
    10. Borgonovo, E., 2007. "A new uncertainty importance measure," Reliability Engineering and System Safety, Elsevier, vol. 92(6), pages 771-784.
    11. Manel Baucells & Rakesh Sarin, 2007. "Evaluating Time Streams of Income: Discounting What?," Theory and Decision, Springer, vol. 63(2), pages 95-120, September.
    12. Gordon B. Hazen & Min Huang, 2006. "Parametric Sensitivity Analysis Using Large-Sample Approximate Bayesian Posterior Distributions," Decision Analysis, INFORMS, vol. 3(4), pages 208-219, December.
    13. James C. Felli & Gordon B. Hazen, 1998. "Sensitivity Analysis and the Expected Value of Perfect Information," Medical Decision Making, , vol. 18(1), pages 95-109, January.
    14. Victor Richmond R. Jose & Robert F. Nau & Robert L. Winkler, 2009. "Sensitivity to Distance and Baseline Distributions in Forecast Evaluation," Management Science, INFORMS, vol. 55(4), pages 582-590, April.
    15. Jeremy E. Oakley & Anthony O'Hagan, 2004. "Probabilistic sensitivity analysis of complex models: a Bayesian approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 751-769, August.
    16. Ronald L. Iman & Stephen C. Hora, 1990. "A Robust Measure of Uncertainty Importance for Use in Fault Tree System Analysis," Risk Analysis, John Wiley & Sons, vol. 10(3), pages 401-406, September.
    17. Gordon Hazen, 2009. "An Extension of the Internal Rate of Return to Stochastic Cash Flows," Management Science, INFORMS, vol. 55(6), pages 1030-1034, June.
    18. James C. Felli & Gordon B. Hazen, 2004. "Javelin Diagrams: A Graphical Tool for Probabilistic Sensitivity Analysis," Decision Analysis, INFORMS, vol. 1(2), pages 93-107, June.
    19. Lopez, Jose A. & Saidenberg, Marc R., 2000. "Evaluating credit risk models," Journal of Banking & Finance, Elsevier, vol. 24(1-2), pages 151-165, January.
    20. Plischke, Elmar & Borgonovo, Emanuele & Smith, Curtis L., 2013. "Global sensitivity measures from given data," European Journal of Operational Research, Elsevier, vol. 226(3), pages 536-550.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Emanuele Borgonovo & Gordon B. Hazen & Elmar Plischke, 2016. "A Common Rationale for Global Sensitivity Measures and Their Estimation," Risk Analysis, John Wiley & Sons, vol. 36(10), pages 1871-1895, October.
    2. Borgonovo, Emanuele & Plischke, Elmar, 2016. "Sensitivity analysis: A review of recent advances," European Journal of Operational Research, Elsevier, vol. 248(3), pages 869-887.
    3. Borgonovo, Emanuele & Hazen, Gordon B. & Jose, Victor Richmond R. & Plischke, Elmar, 2021. "Probabilistic sensitivity measures as information value," European Journal of Operational Research, Elsevier, vol. 289(2), pages 595-610.
    4. S. Cucurachi & E. Borgonovo & R. Heijungs, 2016. "A Protocol for the Global Sensitivity Analysis of Impact Assessment Models in Life Cycle Assessment," Risk Analysis, John Wiley & Sons, vol. 36(2), pages 357-377, February.
    5. Plischke, Elmar & Borgonovo, Emanuele & Smith, Curtis L., 2013. "Global sensitivity measures from given data," European Journal of Operational Research, Elsevier, vol. 226(3), pages 536-550.
    6. Tianyang Wang & James S. Dyer & Warren J. Hahn, 2017. "Sensitivity analysis of decision making under dependent uncertainties using copulas," EURO Journal on Decision Processes, Springer;EURO - The Association of European Operational Research Societies, vol. 5(1), pages 117-139, November.
    7. Barry Anderson & Emanuele Borgonovo & Marzio Galeotti & Roberto Roson, 2014. "Uncertainty in Climate Change Modeling: Can Global Sensitivity Analysis Be of Help?," Risk Analysis, John Wiley & Sons, vol. 34(2), pages 271-293, February.
    8. Tatsuya Sakurahara & Seyed Reihani & Ernie Kee & Zahra Mohaghegh, 2020. "Global importance measure methodology for integrated probabilistic risk assessment," Journal of Risk and Reliability, , vol. 234(2), pages 377-396, April.
    9. Mirko Ginocchi & Ferdinanda Ponci & Antonello Monti, 2021. "Sensitivity Analysis and Power Systems: Can We Bridge the Gap? A Review and a Guide to Getting Started," Energies, MDPI, vol. 14(24), pages 1-59, December.
    10. Pesenti, Silvana M. & Millossovich, Pietro & Tsanakas, Andreas, 2019. "Reverse sensitivity testing: What does it take to break the model?," European Journal of Operational Research, Elsevier, vol. 274(2), pages 654-670.
    11. Gordon Hazen & Emanuele Borgonovo & Xuefei Lu, 2023. "Information Density in Decision Analysis," Decision Analysis, INFORMS, vol. 20(2), pages 89-108, June.
    12. Borgonovo, Emanuele & Marinacci, Massimo, 2015. "Decision analysis under ambiguity," European Journal of Operational Research, Elsevier, vol. 244(3), pages 823-836.
    13. Plischke, Elmar & Borgonovo, Emanuele, 2019. "Copula theory and probabilistic sensitivity analysis: Is there a connection?," European Journal of Operational Research, Elsevier, vol. 277(3), pages 1046-1059.
    14. Elmar Plischke & Emanuele Borgonovo, 2020. "Fighting the Curse of Sparsity: Probabilistic Sensitivity Measures From Cumulative Distribution Functions," Risk Analysis, John Wiley & Sons, vol. 40(12), pages 2639-2660, December.
    15. Borgonovo, Emanuele & Gatti, Stefano, 2013. "Risk analysis with contractual default. Does covenant breach matter?," European Journal of Operational Research, Elsevier, vol. 230(2), pages 431-443.
    16. Manel Baucells & Samuel E. Bodily, 2024. "The Discount Rate for Investment Analysis Applying Expected Utility," Decision Analysis, INFORMS, vol. 21(2), pages 125-141, June.
    17. Xing Liu & Enrico Zio & Emanuele Borgonovo & Elmar Plischke, 2024. "A Systematic Approach of Global Sensitivity Analysis and Its Application to a Model for the Quantification of Resilience of Interconnected Critical Infrastructures," Energies, MDPI, vol. 17(8), pages 1-24, April.
    18. Derennes, Pierre & Morio, Jérôme & Simatos, Florian, 2019. "A nonparametric importance sampling estimator for moment independent importance measures," Reliability Engineering and System Safety, Elsevier, vol. 187(C), pages 3-16.
    19. Kucherenko, Sergei & Song, Shufang & Wang, Lu, 2019. "Quantile based global sensitivity measures," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 35-48.
    20. Emanuele Borgonovo & William Castaings & Stefano Tarantola, 2011. "Moment Independent Importance Measures: New Results and Analytical Test Cases," Risk Analysis, John Wiley & Sons, vol. 31(3), pages 404-428, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:59:y:2013:i:11:p:2536-2549. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.