IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v136y2019icp92-107.html
   My bibliography  Save this article

Correlated pseudo-marginal schemes for time-discretised stochastic kinetic models

Author

Listed:
  • Golightly, Andrew
  • Bradley, Emma
  • Lowe, Tom
  • Gillespie, Colin S.

Abstract

The challenging problem of conducting fully Bayesian inference for the reaction rate constants governing stochastic kinetic models (SKMs) is considered. Given the challenges underlying this problem, the Markov jump process representation is routinely replaced by an approximation based on a suitable time-discretisation of the system of interest. Improving the accuracy of these schemes amounts to using an ever finer discretisation level, which in the context of the inference problem, requires integrating over the uncertainty in the process at a predetermined number of intermediate times between observations. Pseudo-marginal Metropolis–Hastings schemes are increasingly used, since for a given discretisation level, the observed data likelihood can be unbiasedly estimated using a particle filter. When observations are particularly informative, an auxiliary particle filter can be implemented, by propagating particles conditional on the next observation. Recent work in state-space settings has shown how the pseudo-marginal approach can be made much more efficient by correlating the underlying pseudo-random numbers used to form the estimate of likelihood at the current and proposed values of the unknown parameters. This approach is extended to the time-discretised SKM framework by correlating the innovations that drive the auxiliary particle filter. The resulting approach is found to offer substantial gains in efficiency over a standard implementation.

Suggested Citation

  • Golightly, Andrew & Bradley, Emma & Lowe, Tom & Gillespie, Colin S., 2019. "Correlated pseudo-marginal schemes for time-discretised stochastic kinetic models," Computational Statistics & Data Analysis, Elsevier, vol. 136(C), pages 92-107.
  • Handle: RePEc:eee:csdana:v:136:y:2019:i:c:p:92-107
    DOI: 10.1016/j.csda.2019.01.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947319300076
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2019.01.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. P. D. O’Neill & G. O. Roberts, 1999. "Bayesian inference for partially observed stochastic epidemics," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 162(1), pages 121-129.
    2. Durham, Garland B & Gallant, A Ronald, 2002. "Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 335-338, July.
    3. Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
    4. Golightly, A. & Wilkinson, D.J., 2008. "Bayesian inference for nonlinear multivariate diffusion models observed with error," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1674-1693, January.
    5. Kohn, R. & Quiroz, M. & Tran, M.-N. & Villani, M., 2016. "Block-Wise Pseudo-Marginal Metropolis-Hastings," Working Papers 2016-03, University of Sydney Business School, Discipline of Business Analytics.
    6. McKinley, Trevelyan J. & Ross, Joshua V. & Deardon, Rob & Cook, Alex R., 2014. "Simulation-based Bayesian inference for epidemic models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 434-447.
    7. Durham, Garland B & Gallant, A Ronald, 2002. "Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 297-316, July.
    8. Pitt, Michael K. & Silva, Ralph dos Santos & Giordani, Paolo & Kohn, Robert, 2012. "On some properties of Markov chain Monte Carlo simulation methods based on the particle filter," Journal of Econometrics, Elsevier, vol. 171(2), pages 134-151.
    9. Mathieu Gerber & Nicolas Chopin, 2015. "Sequential quasi Monte Carlo," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 77(3), pages 509-579, June.
    10. Colin S. Gillespie & Andrew Golightly, 2010. "Bayesian inference for generalized stochastic population growth models with application to aphids," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 59(2), pages 341-357, March.
    11. George Deligiannidis & Arnaud Doucet & Michael K. Pitt, 2018. "The correlated pseudomarginal method," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 80(5), pages 839-870, November.
    12. A. Doucet & M. K. Pitt & G. Deligiannidis & R. Kohn, 2015. "Efficient implementation of Markov chain Monte Carlo when using an unbiased likelihood estimator," Biometrika, Biometrika Trust, vol. 102(2), pages 295-313.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wiqvist, Samuel & Golightly, Andrew & McLean, Ashleigh T. & Picchini, Umberto, 2021. "Efficient inference for stochastic differential equation mixed-effects models using correlated particle pseudo-marginal algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wiqvist, Samuel & Golightly, Andrew & McLean, Ashleigh T. & Picchini, Umberto, 2021. "Efficient inference for stochastic differential equation mixed-effects models using correlated particle pseudo-marginal algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).
    2. Golightly Andrew & Wilkinson Darren J., 2015. "Bayesian inference for Markov jump processes with informative observations," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 14(2), pages 169-188, April.
    3. Beskos, Alexandros & Kalogeropoulos, Konstantinos & Pazos, Erik, 2013. "Advanced MCMC methods for sampling on diffusion pathspace," Stochastic Processes and their Applications, Elsevier, vol. 123(4), pages 1415-1453.
    4. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    5. Fulop, Andras & Li, Junye, 2019. "Bayesian estimation of dynamic asset pricing models with informative observations," Journal of Econometrics, Elsevier, vol. 209(1), pages 114-138.
    6. Matti Vihola & Jouni Helske & Jordan Franks, 2020. "Importance sampling type estimators based on approximate marginal Markov chain Monte Carlo," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(4), pages 1339-1376, December.
    7. Gael M. Martin & David T. Frazier & Christian P. Robert, 2022. "Computing Bayes: From Then `Til Now," Monash Econometrics and Business Statistics Working Papers 14/22, Monash University, Department of Econometrics and Business Statistics.
    8. Matias Quiroz & Robert Kohn & Mattias Villani & Minh-Ngoc Tran, 2019. "Speeding Up MCMC by Efficient Data Subsampling," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 831-843, April.
    9. James M. Nason & Gregor W. Smith, 2021. "Measuring the slowly evolving trend in US inflation with professional forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(1), pages 1-17, January.
    10. Chris Sherlock, 2016. "Optimal Scaling for the Pseudo-Marginal Random Walk Metropolis: Insensitivity to the Noise Generating Mechanism," Methodology and Computing in Applied Probability, Springer, vol. 18(3), pages 869-884, September.
    11. Thomas Lux, 2022. "Bayesian Estimation of Agent-Based Models via Adaptive Particle Markov Chain Monte Carlo," Computational Economics, Springer;Society for Computational Economics, vol. 60(2), pages 451-477, August.
    12. Quentin Clairon & Adeline Samson, 2020. "Optimal control for estimation in partially observed elliptic and hypoelliptic linear stochastic differential equations," Statistical Inference for Stochastic Processes, Springer, vol. 23(1), pages 105-127, April.
    13. Mogens Bladt & Samuel Finch & Michael Sørensen, 2016. "Simulation of multivariate diffusion bridges," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(2), pages 343-369, March.
    14. Dang, Khue-Dung & Quiroz, Matias & Kohn, Robert & Tran, Minh-Ngoc & Villani, Mattias, 2019. "Hamiltonian Monte Carlo with Energy Conserving Subsampling," Working Paper Series 372, Sveriges Riksbank (Central Bank of Sweden).
    15. Peavoy, Daniel & Franzke, Christian L.E. & Roberts, Gareth O., 2015. "Systematic physics constrained parameter estimation of stochastic differential equations," Computational Statistics & Data Analysis, Elsevier, vol. 83(C), pages 182-199.
    16. Pitt, Michael K. & Silva, Ralph dos Santos & Giordani, Paolo & Kohn, Robert, 2012. "On some properties of Markov chain Monte Carlo simulation methods based on the particle filter," Journal of Econometrics, Elsevier, vol. 171(2), pages 134-151.
    17. Nina Munkholt Jakobsen & Michael Sørensen, 2015. "Efficient Estimation for Diffusions Sampled at High Frequency Over a Fixed Time Interval," CREATES Research Papers 2015-33, Department of Economics and Business Economics, Aarhus University.
    18. Sun, Libo & Lee, Chihoon & Hoeting, Jennifer A., 2015. "A penalized simulated maximum likelihood approach in parameter estimation for stochastic differential equations," Computational Statistics & Data Analysis, Elsevier, vol. 84(C), pages 54-67.
    19. Zhao-Hua Lu & Sy-Miin Chow & Nilam Ram & Pamela M. Cole, 2019. "Zero-Inflated Regime-Switching Stochastic Differential Equation Models for Highly Unbalanced Multivariate, Multi-Subject Time-Series Data," Psychometrika, Springer;The Psychometric Society, vol. 84(2), pages 611-645, June.
    20. S. C. Kou & Benjamin P. Olding & Martin Lysy & Jun S. Liu, 2012. "A Multiresolution Method for Parameter Estimation of Diffusion Processes," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(500), pages 1558-1574, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:136:y:2019:i:c:p:92-107. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.