IDEAS home Printed from https://ideas.repec.org/a/gam/jstats/v7y2024i3p42-718d1434816.html
   My bibliography  Save this article

Optimal Estimators of Cross-Partial Derivatives and Surrogates of Functions

Author

Listed:
  • Matieyendou Lamboni

    (Department DFR-ST, University of Guyane, 97346 Cayenne, France
    228-UMR Espace-Dev, University of Guyane, University of Réunion, IRD, University of Montpellier, 34090 Montpellier, France)

Abstract

Computing cross-partial derivatives using fewer model runs is relevant in modeling, such as stochastic approximation, derivative-based ANOVA, exploring complex models, and active subspaces. This paper introduces surrogates of all the cross-partial derivatives of functions by evaluating such functions at N randomized points and using a set of L constraints. Randomized points rely on independent, central, and symmetric variables. The associated estimators, based on N L model runs, reach the optimal rates of convergence (i.e., O ( N − 1 ) ), and the biases of our approximations do not suffer from the curse of dimensionality for a wide class of functions. Such results are used for (i) computing the main and upper bounds of sensitivity indices, and (ii) deriving emulators of simulators or surrogates of functions thanks to the derivative-based ANOVA. Simulations are presented to show the accuracy of our emulators and estimators of sensitivity indices. The plug-in estimates of indices using the U-statistics of one sample are numerically much stable.

Suggested Citation

  • Matieyendou Lamboni, 2024. "Optimal Estimators of Cross-Partial Derivatives and Surrogates of Functions," Stats, MDPI, vol. 7(3), pages 1-22, July.
    • Handle: RePEc:gam:jstats:v:7:y:2024:i:3:p:42-718:d:1434816
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2571-905X/7/3/42/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2571-905X/7/3/42/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kucherenko, S. & Rodriguez-Fernandez, M. & Pantelides, C. & Shah, N., 2009. "Monte Carlo evaluation of derivative-based global sensitivity measures," Reliability Engineering and System Safety, Elsevier, vol. 94(7), pages 1135-1148.
    2. Sudret, Bruno, 2008. "Global sensitivity analysis using polynomial chaos expansions," Reliability Engineering and System Safety, Elsevier, vol. 93(7), pages 964-979.
    3. Marc C. Kennedy & Anthony O'Hagan, 2001. "Bayesian calibration of computer models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(3), pages 425-464.
    4. Lamboni, Matieyendou, 2019. "Multivariate sensitivity analysis: Minimum variance unbiased estimators of the first-order and total-effect covariance matrices," Reliability Engineering and System Safety, Elsevier, vol. 187(C), pages 67-92.
    5. Roustant, O. & Fruth, J. & Iooss, B. & Kuhnt, S., 2014. "Crossed-derivative based sensitivity measures for interaction screening," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 105(C), pages 105-118.
    6. Lamboni, Matieyendou, 2020. "Derivative-based generalized sensitivity indices and Sobol’ indices," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 170(C), pages 236-256.
    7. Jeremy E. Oakley & Anthony O'Hagan, 2004. "Probabilistic sensitivity analysis of complex models: a Bayesian approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 751-769, August.
    8. Lamboni, Matieyendou, 2022. "Weak derivative-based expansion of functions: ANOVA and some inequalities," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 194(C), pages 691-718.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lamboni, Matieyendou, 2021. "Derivative-based integral equalities and inequality: A proxy-measure for sensitivity analysis," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 179(C), pages 137-161.
    2. Lamboni, Matieyendou, 2022. "Weak derivative-based expansion of functions: ANOVA and some inequalities," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 194(C), pages 691-718.
    3. Wu, Zeping & Wang, Donghui & Okolo N, Patrick & Hu, Fan & Zhang, Weihua, 2016. "Global sensitivity analysis using a Gaussian Radial Basis Function metamodel," Reliability Engineering and System Safety, Elsevier, vol. 154(C), pages 171-179.
    4. Lamboni, Matieyendou, 2020. "Derivative-based generalized sensitivity indices and Sobol’ indices," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 170(C), pages 236-256.
    5. Daniel W. Gladish & Daniel E. Pagendam & Luk J. M. Peeters & Petra M. Kuhnert & Jai Vaze, 2018. "Emulation Engines: Choice and Quantification of Uncertainty for Complex Hydrological Models," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 23(1), pages 39-62, March.
    6. Lamboni, Matieyendou & Kucherenko, Sergei, 2021. "Multivariate sensitivity analysis and derivative-based global sensitivity measures with dependent variables," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    7. Daneshkhah, Alireza & Bedford, Tim, 2013. "Probabilistic sensitivity analysis of system availability using Gaussian processes," Reliability Engineering and System Safety, Elsevier, vol. 112(C), pages 82-93.
    8. Ye, Dongwei & Nikishova, Anna & Veen, Lourens & Zun, Pavel & Hoekstra, Alfons G., 2021. "Non-intrusive and semi-intrusive uncertainty quantification of a multiscale in-stent restenosis model," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    9. Arnst, M. & Goyal, K., 2017. "Sensitivity analysis of parametric uncertainties and modeling errors in computational-mechanics models by using a generalized probabilistic modeling approach," Reliability Engineering and System Safety, Elsevier, vol. 167(C), pages 394-405.
    10. Matieyendou Lamboni, 2020. "Uncertainty quantification: a minimum variance unbiased (joint) estimator of the non-normalized Sobol’ indices," Statistical Papers, Springer, vol. 61(5), pages 1939-1970, October.
    11. Matieyendou Lamboni, 2018. "Global sensitivity analysis: a generalized, unbiased and optimal estimator of total-effect variance," Statistical Papers, Springer, vol. 59(1), pages 361-386, March.
    12. Sudret, B. & Mai, C.V., 2015. "Computing derivative-based global sensitivity measures using polynomial chaos expansions," Reliability Engineering and System Safety, Elsevier, vol. 134(C), pages 241-250.
    13. Wei, Pengfei & Lu, Zhenzhou & Song, Jingwen, 2015. "Variable importance analysis: A comprehensive review," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 399-432.
    14. Becker, William, 2020. "Metafunctions for benchmarking in sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    15. Nagel, Joseph B. & Rieckermann, Jörg & Sudret, Bruno, 2020. "Principal component analysis and sparse polynomial chaos expansions for global sensitivity analysis and model calibration: Application to urban drainage simulation," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    16. Kapusuzoglu, Berkcan & Mahadevan, Sankaran, 2021. "Information fusion and machine learning for sensitivity analysis using physics knowledge and experimental data," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    17. Petropoulos, G. & Wooster, M.J. & Carlson, T.N. & Kennedy, M.C. & Scholze, M., 2009. "A global Bayesian sensitivity analysis of the 1d SimSphere soil–vegetation–atmospheric transfer (SVAT) model using Gaussian model emulation," Ecological Modelling, Elsevier, vol. 220(19), pages 2427-2440.
    18. Ge, Qiao & Menendez, Monica, 2017. "Extending Morris method for qualitative global sensitivity analysis of models with dependent inputs," Reliability Engineering and System Safety, Elsevier, vol. 162(C), pages 28-39.
    19. Pronzato, Luc, 2019. "Sensitivity analysis via Karhunen–Loève expansion of a random field model: Estimation of Sobol’ indices and experimental design," Reliability Engineering and System Safety, Elsevier, vol. 187(C), pages 93-109.
    20. Antony M. Overstall & David C. Woods, 2016. "Multivariate emulation of computer simulators: model selection and diagnostics with application to a humanitarian relief model," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 65(4), pages 483-505, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jstats:v:7:y:2024:i:3:p:42-718:d:1434816. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.