IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v113y2017icp207-225.html
   My bibliography  Save this article

Developments of the total entropy utility function for the dual purpose of model discrimination and parameter estimation in Bayesian design

Author

Listed:
  • McGree, J.M.

Abstract

The total entropy utility function is considered for the dual purpose of model discrimination and parameter estimation in Bayesian design. A sequential design setting is considered where it is shown how to efficiently estimate the total entropy utility function in discrete data settings. Utility estimation relies on forming particle approximations to a number of intractable integrals which is afforded by the use of the sequential Monte Carlo algorithm for Bayesian inference. A number of motivating examples are considered for demonstrating the performance of total entropy in comparison to utilities for model discrimination and parameter estimation. The results suggest that the total entropy utility selects designs which are efficient under both experimental goals with little compromise in achieving either goal. As such, for the type of problems considered in this paper, the total entropy utility is advocated as a general utility for Bayesian design in the presence of model uncertainty.

Suggested Citation

  • McGree, J.M., 2017. "Developments of the total entropy utility function for the dual purpose of model discrimination and parameter estimation in Bayesian design," Computational Statistics & Data Analysis, Elsevier, vol. 113(C), pages 207-225.
    • Handle: RePEc:eee:csdana:v:113:y:2017:i:c:p:207-225
    DOI: 10.1016/j.csda.2016.05.020
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947316301323
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2016.05.020?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pierre Del Moral & Arnaud Doucet & Ajay Jasra, 2006. "Sequential Monte Carlo samplers," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 411-436, June.
    2. Elizabeth G. Ryan & Christopher C. Drovandi & James M. McGree & Anthony N. Pettitt, 2016. "A Review of Modern Computational Algorithms for Bayesian Optimal Design," International Statistical Review, International Statistical Institute, vol. 84(1), pages 128-154, April.
    3. Drovandi, Christopher C. & McGree, James M. & Pettitt, Anthony N., 2013. "Sequential Monte Carlo for Bayesian sequentially designed experiments for discrete data," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 320-335.
    4. Hsin-Ping Wu & John Stufken, 2014. "Locally ϕp-optimal designs for generalized linear models with a single-variable quadratic polynomial predictor," Biometrika, Biometrika Trust, vol. 101(2), pages 365-375.
    5. Nicolas Chopin, 2002. "A sequential particle filter method for static models," Biometrika, Biometrika Trust, vol. 89(3), pages 539-552, August.
    6. Jonathan R. Stroud & Peter Müller & Gary L. Rosner, 2001. "Optimal sampling times in population pharmacokinetic studies," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 50(3), pages 345-359.
    7. Christopher C. Drovandi & Anthony N. Pettitt, 2013. "Bayesian Experimental Design for Models with Intractable Likelihoods," Biometrics, The International Biometric Society, vol. 69(4), pages 937-948, December.
    8. Dror, Hovav A. & Steinberg, David M., 2008. "Sequential Experimental Designs for Generalized Linear Models," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 288-298, March.
    9. Håvard Rue & Sara Martino & Nicolas Chopin, 2009. "Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(2), pages 319-392, April.
    10. Stefanie Biedermann & David C. Woods, 2011. "Optimal designs for generalized non‐linear models with application to second‐harmonic generation experiments," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 60(2), pages 281-299, March.
    11. Unknown, 2000. "Back Matter," Food Review/ National Food Review, United States Department of Agriculture, Economic Research Service, vol. 23(2), pages 1-2.
    12. Ryan, Elizabeth G. & Drovandi, Christopher C. & Pettitt, Anthony N., 2015. "Simulation-based fully Bayesian experimental design for mixed effects models," Computational Statistics & Data Analysis, Elsevier, vol. 92(C), pages 26-39.
    13. Unknown, 2000. "Back Matter," Food Review/ National Food Review, United States Department of Agriculture, Economic Research Service, vol. 23(01), pages 1-2.
    14. Dette, Holger & Bretz, Frank & Pepelyshev, Andrey & Pinheiro, José, 2008. "Optimal Designs for Dose-Finding Studies," Journal of the American Statistical Association, American Statistical Association, vol. 103(483), pages 1225-1237.
    15. Dette, Holger & Franke, Tobias, 2000. "Constrained D- and D1-optimal designs for polynomial regression," Technical Reports 2000,37, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    16. Unknown, 2001. "Back Matter," SS-AAEA Journal of Agricultural Economics, Agricultural and Applied Economics Association, pages 1-4.
    17. Stefanie Biedermann & Holger Dette & Philipp Hoffmann, 2009. "Constrained optimal discrimination designs for Fourier regression models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 61(1), pages 143-157, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. S. G. J. Senarathne & C. C. Drovandi & J. M. McGree, 2020. "Bayesian sequential design for Copula models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 29(2), pages 454-478, June.
    2. Dehideniya, Mahasen B. & Drovandi, Christopher C. & McGree, James M., 2018. "Optimal Bayesian design for discriminating between models with intractable likelihoods in epidemiology," Computational Statistics & Data Analysis, Elsevier, vol. 124(C), pages 277-297.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Drovandi, Christopher C. & McGree, James M. & Pettitt, Anthony N., 2013. "Sequential Monte Carlo for Bayesian sequentially designed experiments for discrete data," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 320-335.
    2. Ward, Eric J., 2008. "A review and comparison of four commonly used Bayesian and maximum likelihood model selection tools," Ecological Modelling, Elsevier, vol. 211(1), pages 1-10.
    3. Dehideniya, Mahasen B. & Drovandi, Christopher C. & McGree, James M., 2018. "Optimal Bayesian design for discriminating between models with intractable likelihoods in epidemiology," Computational Statistics & Data Analysis, Elsevier, vol. 124(C), pages 277-297.
    4. Bauder, David & Bodnar, Taras & Parolya, Nestor & Schmid, Wolfgang, 2020. "Bayesian inference of the multi-period optimal portfolio for an exponential utility," Journal of Multivariate Analysis, Elsevier, vol. 175(C).
    5. Alexander Karlsson & Björn Hammarfelt & H. Joe Steinhauer & Göran Falkman & Nasrine Olson & Gustaf Nelhans & Jan Nolin, 2015. "Modeling uncertainty in bibliometrics and information retrieval: an information fusion approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2255-2274, March.
    6. Ryan, Elizabeth G. & Drovandi, Christopher C. & Thompson, M. Helen & Pettitt, Anthony N., 2014. "Towards Bayesian experimental design for nonlinear models that require a large number of sampling times," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 45-60.
    7. Dencker Peter & Liese Friedrich, 2004. "Local maximin properties of tests in Gaussian shift experiments," Statistics & Risk Modeling, De Gruyter, vol. 22(2), pages 83-108, February.
    8. Le, Tri & Clarke, Bertrand, 2016. "Using the Bayesian Shtarkov solution for predictions," Computational Statistics & Data Analysis, Elsevier, vol. 104(C), pages 183-196.
    9. Hosack, Geoffrey R. & Hayes, Keith R. & Barry, Simon C., 2017. "Prior elicitation for Bayesian generalised linear models with application to risk control option assessment," Reliability Engineering and System Safety, Elsevier, vol. 167(C), pages 351-361.
    10. Elizabeth G. Ryan & Christopher C. Drovandi & James M. McGree & Anthony N. Pettitt, 2016. "A Review of Modern Computational Algorithms for Bayesian Optimal Design," International Statistical Review, International Statistical Institute, vol. 84(1), pages 128-154, April.
    11. James Martin & Ajay Jasra & Emma McCoy, 2013. "Inference for a class of partially observed point process models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 65(3), pages 413-437, June.
    12. Xiaohong Chen & Timothy M. Christensen & Elie Tamer, 2018. "Monte Carlo Confidence Sets for Identified Sets," Econometrica, Econometric Society, vol. 86(6), pages 1965-2018, November.
    13. Nicolas Chopin & Mathieu Gerber, 2017. "Sequential quasi-Monte Carlo: Introduction for Non-Experts, Dimension Reduction, Application to Partly Observed Diffusion Processes," Working Papers 2017-35, Center for Research in Economics and Statistics.
    14. Edward Herbst & Frank Schorfheide, 2014. "Sequential Monte Carlo Sampling For Dsge Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(7), pages 1073-1098, November.
    15. Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
    16. Lau, F. Din-Houn & Gandy, Axel, 2014. "RMCMC: A system for updating Bayesian models," Computational Statistics & Data Analysis, Elsevier, vol. 80(C), pages 99-110.
    17. Geweke, John & Durham, Garland, 2019. "Sequentially adaptive Bayesian learning algorithms for inference and optimization," Journal of Econometrics, Elsevier, vol. 210(1), pages 4-25.
    18. Salima El Kolei, 2013. "Parametric estimation of hidden stochastic model by contrast minimization and deconvolution," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 76(8), pages 1031-1081, November.
    19. Joel A Paulson & Marc Martin-Casas & Ali Mesbah, 2019. "Fast uncertainty quantification for dynamic flux balance analysis using non-smooth polynomial chaos expansions," PLOS Computational Biology, Public Library of Science, vol. 15(8), pages 1-35, August.
    20. Arnaud Dufays, 2016. "Evolutionary Sequential Monte Carlo Samplers for Change-Point Models," Econometrics, MDPI, vol. 4(1), pages 1-33, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:113:y:2017:i:c:p:207-225. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.