IDEAS home Printed from https://ideas.repec.org/a/bpj/sagmbi/v14y2015i2p169-188n5.html
   My bibliography  Save this article

Bayesian inference for Markov jump processes with informative observations

Author

Listed:
  • Golightly Andrew

    (School of Mathematics and Statistics, Newcastle University, Newcastle-Upon-Tyne, NE1 7RU, UK)

  • Wilkinson Darren J.

    (School of Mathematics and Statistics, Newcastle University, Newcastle-Upon-Tyne, NE1 7RU, UK)

Abstract

In this paper we consider the problem of parameter inference for Markov jump process (MJP) representations of stochastic kinetic models. Since transition probabilities are intractable for most processes of interest yet forward simulation is straightforward, Bayesian inference typically proceeds through computationally intensive methods such as (particle) MCMC. Such methods ostensibly require the ability to simulate trajectories from the conditioned jump process. When observations are highly informative, use of the forward simulator is likely to be inefficient and may even preclude an exact (simulation based) analysis. We therefore propose three methods for improving the efficiency of simulating conditioned jump processes. A conditioned hazard is derived based on an approximation to the jump process, and used to generate end-point conditioned trajectories for use inside an importance sampling algorithm. We also adapt a recently proposed sequential Monte Carlo scheme to our problem. Essentially, trajectories are reweighted at a set of intermediate time points, with more weight assigned to trajectories that are consistent with the next observation. We consider two implementations of this approach, based on two continuous approximations of the MJP. We compare these constructs for a simple tractable jump process before using them to perform inference for a Lotka-Volterra system. The best performing construct is used to infer the parameters governing a simple model of motility regulation in Bacillus subtilis.

Suggested Citation

  • Golightly Andrew & Wilkinson Darren J., 2015. "Bayesian inference for Markov jump processes with informative observations," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 14(2), pages 169-188, April.
  • Handle: RePEc:bpj:sagmbi:v:14:y:2015:i:2:p:169-188:n:5
    DOI: 10.1515/sagmb-2014-0070
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/sagmb-2014-0070
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.

    File URL: https://libkey.io/10.1515/sagmb-2014-0070?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Delyon, Bernard & Hu, Ying, 2006. "Simulation of conditioned diffusion and application to parameter estimation," Stochastic Processes and their Applications, Elsevier, vol. 116(11), pages 1660-1675, November.
    2. A. Golightly & D. J. Wilkinson, 2005. "Bayesian Inference for Stochastic Kinetic Models Using a Diffusion Approximation," Biometrics, The International Biometric Society, vol. 61(3), pages 781-788, September.
    3. Durham, Garland B & Gallant, A Ronald, 2002. "Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 335-338, July.
    4. Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
    5. Durham, Garland B & Gallant, A Ronald, 2002. "Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 297-316, July.
    6. Paul Fearnhead & Vasilieos Giagos & Chris Sherlock, 2014. "Inference for reaction networks using the linear noise approximation," Biometrics, The International Biometric Society, vol. 70(2), pages 457-466, June.
    7. Pitt, Michael K. & Silva, Ralph dos Santos & Giordani, Paolo & Kohn, Robert, 2012. "On some properties of Markov chain Monte Carlo simulation methods based on the particle filter," Journal of Econometrics, Elsevier, vol. 171(2), pages 134-151.
    8. Osnat Stramer & Jun Yan, 2007. "Asymptotics of an Efficient Monte Carlo Estimation for the Transition Density of Diffusion Processes," Methodology and Computing in Applied Probability, Springer, vol. 9(4), pages 483-496, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Golightly, A. & Wilkinson, D.J., 2008. "Bayesian inference for nonlinear multivariate diffusion models observed with error," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1674-1693, January.
    2. Sun, Libo & Lee, Chihoon & Hoeting, Jennifer A., 2015. "A penalized simulated maximum likelihood approach in parameter estimation for stochastic differential equations," Computational Statistics & Data Analysis, Elsevier, vol. 84(C), pages 54-67.
    3. Golightly, Andrew & Bradley, Emma & Lowe, Tom & Gillespie, Colin S., 2019. "Correlated pseudo-marginal schemes for time-discretised stochastic kinetic models," Computational Statistics & Data Analysis, Elsevier, vol. 136(C), pages 92-107.
    4. Mogens Bladt & Samuel Finch & Michael Sørensen, 2016. "Simulation of multivariate diffusion bridges," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(2), pages 343-369, March.
    5. Marcin Mider & Paul A. Jenkins & Murray Pollock & Gareth O. Roberts, 2022. "The Computational Cost of Blocking for Sampling Discretely Observed Diffusions," Methodology and Computing in Applied Probability, Springer, vol. 24(4), pages 3007-3027, December.
    6. Libo Sun & Chihoon Lee & Jennifer A. Hoeting, 2019. "A penalized simulated maximum likelihood method to estimate parameters for SDEs with measurement error," Computational Statistics, Springer, vol. 34(2), pages 847-863, June.
    7. Wiqvist, Samuel & Golightly, Andrew & McLean, Ashleigh T. & Picchini, Umberto, 2021. "Efficient inference for stochastic differential equation mixed-effects models using correlated particle pseudo-marginal algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).
    8. Paul Fearnhead & Vasilieos Giagos & Chris Sherlock, 2014. "Inference for reaction networks using the linear noise approximation," Biometrics, The International Biometric Society, vol. 70(2), pages 457-466, June.
    9. Beskos, Alexandros & Kalogeropoulos, Konstantinos & Pazos, Erik, 2013. "Advanced MCMC methods for sampling on diffusion pathspace," Stochastic Processes and their Applications, Elsevier, vol. 123(4), pages 1415-1453.
    10. Pitt, Michael K. & Silva, Ralph dos Santos & Giordani, Paolo & Kohn, Robert, 2012. "On some properties of Markov chain Monte Carlo simulation methods based on the particle filter," Journal of Econometrics, Elsevier, vol. 171(2), pages 134-151.
    11. Chris Sherlock, 2021. "Direct statistical inference for finite Markov jump processes via the matrix exponential," Computational Statistics, Springer, vol. 36(4), pages 2863-2887, December.
    12. Theodore Simos & Mike Tsionas, 2018. "Bayesian inference of the fractional Ornstein–Uhlenbeck process under a flow sampling scheme," Computational Statistics, Springer, vol. 33(4), pages 1687-1713, December.
    13. Bu, Ruijun & Cheng, Jie & Hadri, Kaddour, 2016. "Reducible diffusions with time-varying transformations with application to short-term interest rates," Economic Modelling, Elsevier, vol. 52(PA), pages 266-277.
    14. Mengheng Li & Siem Jan (S.J.) Koopman, 2018. "Unobserved Components with Stochastic Volatility in U.S. Inflation: Estimation and Signal Extraction," Tinbergen Institute Discussion Papers 18-027/III, Tinbergen Institute.
    15. Lux, Thomas, 2020. "Bayesian estimation of agent-based models via adaptive particle Markov chain Monte Carlo," Economics Working Papers 2020-01, Christian-Albrechts-University of Kiel, Department of Economics.
    16. Kristensen, Dennis & Shin, Yongseok, 2012. "Estimation of dynamic models with nonparametric simulated maximum likelihood," Journal of Econometrics, Elsevier, vol. 167(1), pages 76-94.
    17. Varughese, Melvin M., 2013. "Parameter estimation for multivariate diffusion systems," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 417-428.
    18. Yan-Feng Wu & Xiangyu Yang & Jian-Qiang Hu, 2024. "Method of Moments Estimation for Affine Stochastic Volatility Models," Papers 2408.09185, arXiv.org.
    19. Delis, Manthos D. & Tsionas, Mike G., 2018. "Measuring management practices," International Journal of Production Economics, Elsevier, vol. 199(C), pages 65-77.
    20. Osnat Stramer & Jun Yan, 2007. "Asymptotics of an Efficient Monte Carlo Estimation for the Transition Density of Diffusion Processes," Methodology and Computing in Applied Probability, Springer, vol. 9(4), pages 483-496, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:sagmbi:v:14:y:2015:i:2:p:169-188:n:5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.