IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v71y2014icp1088-1102.html
   My bibliography  Save this article

Optimal design for correlated processes with input-dependent noise

Author

Listed:
  • Boukouvalas, A.
  • Cornford, D.
  • Stehlík, M.

Abstract

Optimal design for parameter estimation in Gaussian process regression models with input-dependent noise is examined. The motivation stems from the area of computer experiments, where computationally demanding simulators are approximated using Gaussian process emulators to act as statistical surrogates. In the case of stochastic simulators, which produce a random output for a given set of model inputs, repeated evaluations are useful, supporting the use of replicate observations in the experimental design. The findings are also applicable to the wider context of experimental design for Gaussian process regression and kriging. Designs are proposed with the aim of minimising the variance of the Gaussian process parameter estimates. A heteroscedastic Gaussian process model is presented which allows for an experimental design technique based on an extension of Fisher information to heteroscedastic models. It is empirically shown that the error of the approximation of the parameter variance by the inverse of the Fisher information is reduced as the number of replicated points is increased. Through a series of simulation experiments on both synthetic data and a systems biology stochastic simulator, optimal designs with replicate observations are shown to outperform space-filling designs both with and without replicate observations. Guidance is provided on best practice for optimal experimental design for stochastic response models.

Suggested Citation

  • Boukouvalas, A. & Cornford, D. & Stehlík, M., 2014. "Optimal design for correlated processes with input-dependent noise," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 1088-1102.
  • Handle: RePEc:eee:csdana:v:71:y:2014:i:c:p:1088-1102
    DOI: 10.1016/j.csda.2013.09.024
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947313003484
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2013.09.024?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. A. N. Pettitt & A. B. McBRATNEY, 1993. "Sampling Designs for Estimating Spatial Variance Components," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 42(1), pages 185-209, March.
    2. Hao Zhang & Dale L. Zimmerman, 2005. "Towards reconciling two asymptotic frameworks in spatial statistics," Biometrika, Biometrika Trust, vol. 92(4), pages 921-936, December.
    3. Henderson, Daniel A. & Boys, Richard J. & Krishnan, Kim J. & Lawless, Conor & Wilkinson, Darren J., 2009. "Bayesian Emulation and Calibration of a Stochastic Computer Model of Mitochondrial DNA Deletions in Substantia Nigra Neurons," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 76-87.
    4. Uddin, Nizam, 2008. "MV-optimal block designs for correlated errors," Statistics & Probability Letters, Elsevier, vol. 78(17), pages 2926-2931, December.
    5. Kiselák, Jozef & Stehlík, Milan, 2008. "Equidistant and D-optimal designs for parameters of Ornstein-Uhlenbeck process," Statistics & Probability Letters, Elsevier, vol. 78(12), pages 1388-1396, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Santiago Campos-Barreiro & Jesús López-Fidalgo, 2015. "D-optimal experimental designs for a growth model applied to a Holstein-Friesian dairy farm," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 24(3), pages 491-505, September.
    2. I. Andrianakis & I. Vernon & N. McCreesh & T. J. McKinley & J. E. Oakley & R. N. Nsubuga & M. Goldstein & R. G. White, 2017. "History matching of a complex epidemiological model of human immunodeficiency virus transmission by using variance emulation," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(4), pages 717-740, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Baran, Sándor & Sikolya, Kinga & Stehlík, Milan, 2013. "On the optimal designs for the prediction of Ornstein–Uhlenbeck sheets," Statistics & Probability Letters, Elsevier, vol. 83(6), pages 1580-1587.
    2. Girard, Didier A., 2020. "Asymptotic near-efficiency of the “Gibbs-energy (GE) and empirical-variance” estimating functions for fitting Matérn models - II: Accounting for measurement errors via “conditional GE mean”," Statistics & Probability Letters, Elsevier, vol. 162(C).
    3. Yuan, Jun & Ng, Szu Hui, 2013. "A sequential approach for stochastic computer model calibration and prediction," Reliability Engineering and System Safety, Elsevier, vol. 111(C), pages 273-286.
    4. Maroussa Zagoraiou & Alessandro Baldi Antognini, 2009. "Optimal designs for parameter estimation of the Ornstein–Uhlenbeck process," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 25(5), pages 583-600, September.
    5. Dette, Holger & Schorning, Kirsten & Konstantinou, Maria, 2017. "Optimal designs for comparing regression models with correlated observations," Computational Statistics & Data Analysis, Elsevier, vol. 113(C), pages 273-286.
    6. Bachoc, François & Lagnoux, Agnès & Nguyen, Thi Mong Ngoc, 2017. "Cross-validation estimation of covariance parameters under fixed-domain asymptotics," Journal of Multivariate Analysis, Elsevier, vol. 160(C), pages 42-67.
    7. Alain Pirotte & Jesús Mur, 2017. "Neglected dynamics and spatial dependence on panel data: consequences for convergence of the usual static model estimators," Spatial Economic Analysis, Taylor & Francis Journals, vol. 12(2-3), pages 202-229, July.
    8. Dette, Holger & Pepelyshev, Andrey & Zhigljavsky, Anatoly, 2014. "‘Nearly’ universally optimal designs for models with correlated observations," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 1103-1112.
    9. Tae Kim & Jeong Park & Gyu Song, 2010. "An asymptotic theory for the nugget estimator in spatial models," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 22(2), pages 181-195.
    10. Lim, Chae Young & Stein, Michael, 2008. "Properties of spatial cross-periodograms using fixed-domain asymptotics," Journal of Multivariate Analysis, Elsevier, vol. 99(9), pages 1962-1984, October.
    11. Antony M. Overstall & David C. Woods, 2013. "A Strategy for Bayesian Inference for Computationally Expensive Models with Application to the Estimation of Stem Cell Properties," Biometrics, The International Biometric Society, vol. 69(2), pages 458-468, June.
    12. H. F. Fisher & R. J. Boys & C. S. Gillespie & C. J. Proctor & A. Golightly, 2022. "Parameter inference for a stochastic kinetic model of expanded polyglutamine proteins," Biometrics, The International Biometric Society, vol. 78(3), pages 1195-1208, September.
    13. Haozhe Zhang & Yehua Li, 2020. "Unified Principal Component Analysis for Sparse and Dense Functional Data under Spatial Dependency," Papers 2006.13489, arXiv.org, revised Jun 2021.
    14. Wu, Wei-Ying & Lim, Chae Young & Xiao, Yimin, 2013. "Tail estimation of the spectral density for a stationary Gaussian random field," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 74-91.
    15. Kiselák, Jozef & Stehlík, Milan, 2008. "Equidistant and D-optimal designs for parameters of Ornstein-Uhlenbeck process," Statistics & Probability Letters, Elsevier, vol. 78(12), pages 1388-1396, September.
    16. Ioannis Andrianakis & Ian R Vernon & Nicky McCreesh & Trevelyan J McKinley & Jeremy E Oakley & Rebecca N Nsubuga & Michael Goldstein & Richard G White, 2015. "Bayesian History Matching of Complex Infectious Disease Models Using Emulation: A Tutorial and a Case Study on HIV in Uganda," PLOS Computational Biology, Public Library of Science, vol. 11(1), pages 1-18, January.
    17. Mevin Hooten & Christopher Wikle & Michael Schwob, 2020. "Statistical Implementations of Agent‐Based Demographic Models," International Statistical Review, International Statistical Institute, vol. 88(2), pages 441-461, August.
    18. Wenpin Tang & Lu Zhang & Sudipto Banerjee, 2021. "On identifiability and consistency of the nugget in Gaussian spatial process models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(5), pages 1044-1070, November.
    19. I. Andrianakis & I. Vernon & N. McCreesh & T. J. McKinley & J. E. Oakley & R. N. Nsubuga & M. Goldstein & R. G. White, 2017. "History matching of a complex epidemiological model of human immunodeficiency virus transmission by using variance emulation," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(4), pages 717-740, August.
    20. D. A. Henderson & R. J. Boys & D. J. Wilkinson, 2010. "Bayesian Calibration of a Stochastic Kinetic Computer Model Using Multiple Data Sources," Biometrics, The International Biometric Society, vol. 66(1), pages 249-256, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:71:y:2014:i:c:p:1088-1102. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.