IDEAS home Printed from https://ideas.repec.org/a/bpj/sagmbi/v12y2013i1p87-107n6.html
   My bibliography  Save this article

On optimality of kernels for approximate Bayesian computation using sequential Monte Carlo

Author

Listed:
  • Filippi Sarah

    (Imperial College London, London, UK)

  • Barnes Chris P.

    (Imperial College London, London, UK)

  • Cornebise Julien

    (University College London, London, UK)

  • Stumpf Michael P.H.

    (Imperial College London, London, UK)

Abstract

Approximate Bayesian computation (ABC) has gained popularity over the past few years for the analysis of complex models arising in population genetics, epidemiology and system biology. Sequential Monte Carlo (SMC) approaches have become work-horses in ABC. Here we discuss how to construct the perturbation kernels that are required in ABC SMC approaches, in order to construct a sequence of distributions that start out from a suitably defined prior and converge towards the unknown posterior. We derive optimality criteria for different kernels, which are based on the Kullback-Leibler divergence between a distribution and the distribution of the perturbed particles. We will show that for many complicated posterior distributions, locally adapted kernels tend to show the best performance. We find that the added moderate cost of adapting kernel functions is easily regained in terms of the higher acceptance rate. We demonstrate the computational efficiency gains in a range of toy examples which illustrate some of the challenges faced in real-world applications of ABC, before turning to two demanding parameter inference problems in molecular biology, which highlight the huge increases in efficiency that can be gained from choice of optimal kernels. We conclude with a general discussion of the rational choice of perturbation kernels in ABC SMC settings.

Suggested Citation

  • Filippi Sarah & Barnes Chris P. & Cornebise Julien & Stumpf Michael P.H., 2013. "On optimality of kernels for approximate Bayesian computation using sequential Monte Carlo," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 12(1), pages 87-107, March.
  • Handle: RePEc:bpj:sagmbi:v:12:y:2013:i:1:p:87-107:n:6
    DOI: 10.1515/sagmb-2012-0069
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/sagmb-2012-0069
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.

    File URL: https://libkey.io/10.1515/sagmb-2012-0069?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. C. C. Drovandi & A. N. Pettitt, 2011. "Estimation of Parameters for Macroparasite Population Evolution Using Approximate Bayesian Computation," Biometrics, The International Biometric Society, vol. 67(1), pages 225-233, March.
    2. Pierre Del Moral & Arnaud Doucet & Ajay Jasra, 2006. "Sequential Monte Carlo samplers," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 411-436, June.
    3. Jean-Marie Cornuet & Jean-Michel Marin & Antonietta Mira & Christian P. Robert, 2012. "Adaptive Multiple Importance Sampling," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 39(4), pages 798-812, December.
    4. McKinley Trevelyan & Cook Alex R & Deardon Robert, 2009. "Inference in Epidemic Models without Likelihoods," The International Journal of Biostatistics, De Gruyter, vol. 5(1), pages 1-40, July.
    5. Michael B. Elowitz & Stanislas Leibler, 2000. "A synthetic oscillatory network of transcriptional regulators," Nature, Nature, vol. 403(6767), pages 335-338, January.
    6. repec:dau:papers:123456789/6334 is not listed on IDEAS
    7. Ryan N Gutenkunst & Joshua J Waterfall & Fergal P Casey & Kevin S Brown & Christopher R Myers & James P Sethna, 2007. "Universally Sloppy Parameter Sensitivities in Systems Biology Models," PLOS Computational Biology, Public Library of Science, vol. 3(10), pages 1-8, October.
    8. Paul Fearnhead & Dennis Prangle, 2012. "Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(3), pages 419-474, June.
    9. Daniel Silk & Paul D.W. Kirk & Chris P. Barnes & Tina Toni & Anna Rose & Simon Moon & Margaret J. Dallman & Michael P.H. Stumpf, 2011. "Designing attractive models via automated identification of chaotic and oscillatory dynamical regimes," Nature Communications, Nature, vol. 2(1), pages 1-6, September.
    10. repec:dau:papers:123456789/10690 is not listed on IDEAS
    11. Mark Girolami & Ben Calderhead, 2011. "Riemann manifold Langevin and Hamiltonian Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(2), pages 123-214, March.
    12. Mark A. Beaumont & Jean-Marie Cornuet & Jean-Michel Marin & Christian P. Robert, 2009. "Adaptive approximate Bayesian computation," Biometrika, Biometrika Trust, vol. 96(4), pages 983-990.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xing Ju Lee & Christopher C. Drovandi & Anthony N. Pettitt, 2015. "Model choice problems using approximate Bayesian computation with applications to pathogen transmission data sets," Biometrics, The International Biometric Society, vol. 71(1), pages 198-207, March.
    2. Warne, David J. & Baker, Ruth E. & Simpson, Matthew J., 2018. "Multilevel rejection sampling for approximate Bayesian computation," Computational Statistics & Data Analysis, Elsevier, vol. 124(C), pages 71-86.
    3. McKinley, Trevelyan J. & Ross, Joshua V. & Deardon, Rob & Cook, Alex R., 2014. "Simulation-based Bayesian inference for epidemic models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 434-447.
    4. Li, J. & Nott, D.J. & Fan, Y. & Sisson, S.A., 2017. "Extending approximate Bayesian computation methods to high dimensions via a Gaussian copula model," Computational Statistics & Data Analysis, Elsevier, vol. 106(C), pages 77-89.
    5. Bertl Johanna & Ewing Gregory & Kosiol Carolin & Futschik Andreas, 2017. "Approximate maximum likelihood estimation for population genetic inference," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 16(5-6), pages 291-312, December.
    6. Henri Pesonen & Umberto Simola & Alvaro Köhn‐Luque & Henri Vuollekoski & Xiaoran Lai & Arnoldo Frigessi & Samuel Kaski & David T. Frazier & Worapree Maneesoonthorn & Gael M. Martin & Jukka Corander, 2023. "ABC of the future," International Statistical Review, International Statistical Institute, vol. 91(2), pages 243-268, August.
    7. Maxime Lenormand & Franck Jabot & Guillaume Deffuant, 2013. "Adaptive approximate Bayesian computation for complex models," Computational Statistics, Springer, vol. 28(6), pages 2777-2796, December.
    8. Brenda N Vo & Christopher C Drovandi & Anthony N Pettitt & Graeme J Pettet, 2015. "Melanoma Cell Colony Expansion Parameters Revealed by Approximate Bayesian Computation," PLOS Computational Biology, Public Library of Science, vol. 11(12), pages 1-22, December.
    9. repec:dau:papers:123456789/5724 is not listed on IDEAS
    10. Christian P. Robert, 2013. "Bayesian Computational Tools," Working Papers 2013-45, Center for Research in Economics and Statistics.
    11. Gareth W. Peters & Efstathios Panayi & Francois Septier, 2015. "SMC-ABC methods for the estimation of stochastic simulation models of the limit order book," Papers 1504.05806, arXiv.org.
    12. Juliane Liepe & Sarah Filippi & Michał Komorowski & Michael P H Stumpf, 2013. "Maximizing the Information Content of Experiments in Systems Biology," PLOS Computational Biology, Public Library of Science, vol. 9(1), pages 1-13, January.
    13. Creel, Michael & Kristensen, Dennis, 2016. "On selection of statistics for approximate Bayesian computing (or the method of simulated moments)," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 99-114.
    14. Lee, Xing Ju & Hainy, Markus & McKeone, James P. & Drovandi, Christopher C. & Pettitt, Anthony N., 2018. "ABC model selection for spatial extremes models applied to South Australian maximum temperature data," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 128-144.
    15. repec:bla:istatr:v:83:y:2015:i:3:p:405-435 is not listed on IDEAS
    16. Golchi, Shirin & Campbell, David A., 2016. "Sequentially Constrained Monte Carlo," Computational Statistics & Data Analysis, Elsevier, vol. 97(C), pages 98-113.
    17. Hasegawa, Takanori & Niida, Atsushi & Mori, Tomoya & Shimamura, Teppei & Yamaguchi, Rui & Miyano, Satoru & Akutsu, Tatsuya & Imoto, Seiya, 2016. "A likelihood-free filtering method via approximate Bayesian computation in evaluating biological simulation models," Computational Statistics & Data Analysis, Elsevier, vol. 94(C), pages 63-74.
    18. Silk Daniel & Filippi Sarah & Stumpf Michael P. H., 2013. "Optimizing threshold-schedules for sequential approximate Bayesian computation: applications to molecular systems," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 12(5), pages 603-618, October.
    19. Drovandi, Christopher C. & Pettitt, Anthony N., 2011. "Likelihood-free Bayesian estimation of multivariate quantile distributions," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2541-2556, September.
    20. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    21. Pierre-Olivier Goffard & Patrick Laub, 2021. "Approximate Bayesian Computations to fit and compare insurance loss models," Working Papers hal-02891046, HAL.
    22. Anthony Ebert & Ritabrata Dutta & Kerrie Mengersen & Antonietta Mira & Fabrizio Ruggeri & Paul Wu, 2021. "Likelihood‐free parameter estimation for dynamic queueing networks: Case study of passenger flow in an international airport terminal," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(3), pages 770-792, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:sagmbi:v:12:y:2013:i:1:p:87-107:n:6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.