IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v55y2011i1p184-198.html
   My bibliography  Save this article

Understanding and comparisons of different sampling approaches for the Fourier Amplitudes Sensitivity Test (FAST)

Author

Listed:
  • Xu, Chonggang
  • Gertner, George

Abstract

Fourier Amplitude Sensitivity Test (FAST) is one of the most popular uncertainty and sensitivity analysis techniques. It uses a periodic sampling approach and a Fourier transformation to decompose the variance of a model output into partial variances contributed by different model parameters. Until now, the FAST analysis is mainly confined to the estimation of partial variances contributed by the main effects of model parameters, but does not allow for those contributed by specific interactions among parameters. In this paper, we theoretically show that FAST analysis can be used to estimate partial variances contributed by both main effects and interaction effects of model parameters using different sampling approaches (i.e., traditional search-curve based sampling, simple random sampling and random balance design sampling). We also analytically calculate the potential errors and biases in the estimation of partial variances. Hypothesis tests are constructed to reduce the effect of sampling errors on the estimation of partial variances. Our results show that compared to simple random sampling and random balance design sampling, sensitivity indices (ratios of partial variances to variance of a specific model output) estimated by search-curve based sampling generally have higher precision but larger underestimations. Compared to simple random sampling, random balance design sampling generally provides higher estimation precision for partial variances contributed by the main effects of parameters. The theoretical derivation of partial variances contributed by higher-order interactions and the calculation of their corresponding estimation errors in different sampling schemes can help us better understand the FAST method and provide a fundamental basis for FAST applications and further improvements.

Suggested Citation

  • Xu, Chonggang & Gertner, George, 2011. "Understanding and comparisons of different sampling approaches for the Fourier Amplitudes Sensitivity Test (FAST)," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 184-198, January.
    • Handle: RePEc:eee:csdana:v:55:y:2011:i:1:p:184-198
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-9473(10)00275-6
    Download Restriction: Full text for ScienceDirect subscribers only.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Borgonovo, E., 2007. "A new uncertainty importance measure," Reliability Engineering and System Safety, Elsevier, vol. 92(6), pages 771-784.
    2. Xu, Chonggang & Gertner, George Zdzislaw, 2008. "A general first-order global sensitivity analysis method," Reliability Engineering and System Safety, Elsevier, vol. 93(7), pages 1060-1071.
    3. Sobol′ , I.M, 2001. "Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 55(1), pages 271-280.
    4. Tarantola, S. & Gatelli, D. & Mara, T.A., 2006. "Random balance designs for the estimation of first order global sensitivity indices," Reliability Engineering and System Safety, Elsevier, vol. 91(6), pages 717-727.
    5. Xu, Chonggang & Gertner, George Z., 2009. "Uncertainty analysis of transient population dynamics," Ecological Modelling, Elsevier, vol. 220(3), pages 283-293.
    6. Saltelli A. & Tarantola S., 2002. "On the Relative Importance of Input Factors in Mathematical Models: Safety Assessment for Nuclear Waste Disposal," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 702-709, September.
    7. Helton, J.C. & Johnson, J.D. & Sallaberry, C.J. & Storlie, C.B., 2006. "Survey of sampling-based methods for uncertainty and sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 91(10), pages 1175-1209.
    8. Xu, C. & Gertner, G., 2007. "Extending a global sensitivity analysis technique to models with correlated parameters," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 5579-5590, August.
    9. Saltelli, A. & Andres, T. H. & Homma, T., 1995. "Sensitivity analysis of model output. Performance of the iterated fractional factorial design method," Computational Statistics & Data Analysis, Elsevier, vol. 20(4), pages 387-407, October.
    10. Saltelli, Andrea & Campolongo, Francesca & Cariboni, Jessica, 2009. "Screening important inputs in models with strong interaction properties," Reliability Engineering and System Safety, Elsevier, vol. 94(7), pages 1149-1155.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wei, Pengfei & Lu, Zhenzhou & Song, Jingwen, 2015. "Variable importance analysis: A comprehensive review," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 399-432.
    2. Song, Xiaodong & Bryan, Brett A. & Almeida, Auro C. & Paul, Keryn I. & Zhao, Gang & Ren, Yin, 2013. "Time-dependent sensitivity of a process-based ecological model," Ecological Modelling, Elsevier, vol. 265(C), pages 114-123.
    3. Wang, Pan & Lu, Zhenzhou & Ren, Bo & Cheng, Lei, 2013. "The derivative based variance sensitivity analysis for the distribution parameters and its computation," Reliability Engineering and System Safety, Elsevier, vol. 119(C), pages 305-315.
    4. Rui Zhang & Taotao Chen & Daocai Chi, 2020. "Global Sensitivity Analysis of the Standardized Precipitation Evapotranspiration Index at Different Time Scales in Jilin Province, China," Sustainability, MDPI, vol. 12(5), pages 1-19, February.
    5. Tissot, Jean-Yves & Prieur, Clémentine, 2012. "Bias correction for the estimation of sensitivity indices based on random balance designs," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 205-213.
    6. Paolo Paruolo & Michaela Saisana & Andrea Saltelli, 2013. "Ratings and rankings: voodoo or science?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 609-634, June.
    7. Paleari, Livia & Movedi, Ermes & Zoli, Michele & Burato, Andrea & Cecconi, Irene & Errahouly, Jabir & Pecollo, Eleonora & Sorvillo, Carla & Confalonieri, Roberto, 2021. "Sensitivity analysis using Morris: Just screening or an effective ranking method?," Ecological Modelling, Elsevier, vol. 455(C).
    8. Dibike, Yonas & Marshall, Rebecca & de Rham, Laurent, 2024. "Climatic sensitivity of seasonal ice-cover, water temperature and biogeochemical cycling in Lake 239 of the Experimental Lakes Area (ELA), Ontario, Canada," Ecological Modelling, Elsevier, vol. 489(C).
    9. Zhai, Qingqing & Yang, Jun & Zhao, Yu, 2014. "Space-partition method for the variance-based sensitivity analysis: Optimal partition scheme and comparative study," Reliability Engineering and System Safety, Elsevier, vol. 131(C), pages 66-82.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wei, Pengfei & Lu, Zhenzhou & Song, Jingwen, 2015. "Variable importance analysis: A comprehensive review," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 399-432.
    2. Xu, Chonggang & Gertner, George Zdzislaw, 2008. "A general first-order global sensitivity analysis method," Reliability Engineering and System Safety, Elsevier, vol. 93(7), pages 1060-1071.
    3. Zhai, Qingqing & Yang, Jun & Zhao, Yu, 2014. "Space-partition method for the variance-based sensitivity analysis: Optimal partition scheme and comparative study," Reliability Engineering and System Safety, Elsevier, vol. 131(C), pages 66-82.
    4. Song, Xiaodong & Bryan, Brett A. & Almeida, Auro C. & Paul, Keryn I. & Zhao, Gang & Ren, Yin, 2013. "Time-dependent sensitivity of a process-based ecological model," Ecological Modelling, Elsevier, vol. 265(C), pages 114-123.
    5. Borgonovo, Emanuele & Plischke, Elmar, 2016. "Sensitivity analysis: A review of recent advances," European Journal of Operational Research, Elsevier, vol. 248(3), pages 869-887.
    6. Plischke, Elmar & Borgonovo, Emanuele & Smith, Curtis L., 2013. "Global sensitivity measures from given data," European Journal of Operational Research, Elsevier, vol. 226(3), pages 536-550.
    7. Allaire, Douglas L. & Willcox, Karen E., 2012. "A variance-based sensitivity index function for factor prioritization," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 107-114.
    8. Plischke, Elmar & Borgonovo, Emanuele, 2019. "Copula theory and probabilistic sensitivity analysis: Is there a connection?," European Journal of Operational Research, Elsevier, vol. 277(3), pages 1046-1059.
    9. Wu, Qiong-Li & Cournède, Paul-Henry & Mathieu, Amélie, 2012. "An efficient computational method for global sensitivity analysis and its application to tree growth modelling," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 35-43.
    10. Ge, Qiao & Menendez, Monica, 2017. "Extending Morris method for qualitative global sensitivity analysis of models with dependent inputs," Reliability Engineering and System Safety, Elsevier, vol. 162(C), pages 28-39.
    11. Cui, Lijie & Lu, Zhenzhou & Wang, Pan & Wang, Weihu, 2014. "The ordering importance measure of random variable and its estimation," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 105(C), pages 132-143.
    12. Mara, Thierry A. & Tarantola, Stefano, 2012. "Variance-based sensitivity indices for models with dependent inputs," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 115-121.
    13. Delenne, C. & Cappelaere, B. & Guinot, V., 2012. "Uncertainty analysis of river flooding and dam failure risks using local sensitivity computations," Reliability Engineering and System Safety, Elsevier, vol. 107(C), pages 171-183.
    14. Sinan Xiao & Zhenzhou Lu & Pan Wang, 2018. "Multivariate Global Sensitivity Analysis Based on Distance Components Decomposition," Risk Analysis, John Wiley & Sons, vol. 38(12), pages 2703-2721, December.
    15. Goda, Takashi, 2021. "A simple algorithm for global sensitivity analysis with Shapley effects," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    16. Hu, Zhen & Mahadevan, Sankaran, 2019. "Probability models for data-Driven global sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 187(C), pages 40-57.
    17. Xu, Chonggang & Gertner, George Z., 2009. "Uncertainty analysis of transient population dynamics," Ecological Modelling, Elsevier, vol. 220(3), pages 283-293.
    18. Mara, Thierry Alex, 2009. "Extension of the RBD-FAST method to the computation of global sensitivity indices," Reliability Engineering and System Safety, Elsevier, vol. 94(8), pages 1274-1281.
    19. Wei, Pengfei & Lu, Zhenzhou & Ruan, Wenbin & Song, Jingwen, 2014. "Regional sensitivity analysis using revised mean and variance ratio functions," Reliability Engineering and System Safety, Elsevier, vol. 121(C), pages 121-135.
    20. Cheng, Lei & Lu, Zhenzhou & Zhang, Leigang, 2015. "Application of Rejection Sampling based methodology to variance based parametric sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 9-18.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:55:y:2011:i:1:p:184-198. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.