IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v98y2016icp79-90.html
   My bibliography  Save this article

Using hierarchical centering to facilitate a reversible jump MCMC algorithm for random effects models

Author

Listed:
  • Oedekoven, C.S.
  • King, R.
  • Buckland, S.T.
  • Mackenzie, M.L.
  • Evans, K.O.
  • Burger, L.W.

Abstract

Hierarchical centering has been described as a reparameterization method applicable to random effects models. It has been shown to improve mixing of models in the context of Markov chain Monte Carlo (MCMC) methods. A hierarchical centering approach is proposed for reversible jump MCMC (RJMCMC) chains which builds upon the hierarchical centering methods for MCMC chains and uses them to reparameterize models in an RJMCMC algorithm. Although these methods may be applicable to models with other error distributions, the case is described for a log-linear Poisson model where the expected value λ includes fixed effect covariates and a random effect for which normality is assumed with a zero-mean and unknown standard deviation. For the proposed RJMCMC algorithm including hierarchical centering, the models are reparameterized by modeling the mean of the random effect coefficients as a function of the intercept of the λ model and one or more of the available fixed effect covariates depending on the model. The method is appropriate when fixed-effect covariates are constant within random effect groups. This has an effect on the dynamics of the RJMCMC algorithm and improves model mixing. The methods are applied to a case study of point transects of indigo buntings where, without hierarchical centering, the RJMCMC algorithm had poor mixing and the estimated posterior distribution depended on the starting model. With hierarchical centering on the other hand, the chain moved freely over model and parameter space. These results are confirmed with a simulation study. Hence, the proposed methods should be considered as a regular strategy for implementing models with random effects in RJMCMC algorithms; they facilitate convergence of these algorithms and help avoid false inference on model parameters.

Suggested Citation

  • Oedekoven, C.S. & King, R. & Buckland, S.T. & Mackenzie, M.L. & Evans, K.O. & Burger, L.W., 2016. "Using hierarchical centering to facilitate a reversible jump MCMC algorithm for random effects models," Computational Statistics & Data Analysis, Elsevier, vol. 98(C), pages 79-90.
  • Handle: RePEc:eee:csdana:v:98:y:2016:i:c:p:79-90
    DOI: 10.1016/j.csda.2015.12.010
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947315003187
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2015.12.010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. S. P. Brooks & P. Giudici & G. O. Roberts, 2003. "Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(1), pages 3-39, January.
    2. M. Papathomas & P. Dellaportas & V. G. S. Vasdekis, 2011. "A novel reversible jump algorithm for generalized linear models," Biometrika, Biometrika Trust, vol. 98(1), pages 231-236.
    3. Al-Awadhi, Fahimah & Hurn, Merrilee & Jennison, Christopher, 2004. "Improving the acceptance rate of reversible jump MCMC proposals," Statistics & Probability Letters, Elsevier, vol. 69(2), pages 189-198, August.
    4. Komárek, Arnost & Lesaffre, Emmanuel, 2008. "Generalized linear mixed model with a penalized Gaussian mixture as a random effects distribution," Computational Statistics & Data Analysis, Elsevier, vol. 52(7), pages 3441-3458, March.
    5. William J. Browne & Fiona Steele & Mousa Golalizadeh & Martin J. Green, 2009. "The use of simple reparameterizations to improve the efficiency of Markov chain Monte Carlo estimation for multilevel models with applications to discrete time survival models," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(3), pages 579-598, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. AWLP Thilan & P Menéndez & JM McGree, 2023. "Assessing the ability of adaptive designs to capture trends in hard coral cover," Environmetrics, John Wiley & Sons, Ltd., vol. 34(6), September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Langnan & Luo, Jiawen & Liu, Hao, 2013. "The determinants of liquidity with G-RJMCMC-VS model: Evidence from China," Economic Modelling, Elsevier, vol. 35(C), pages 192-198.
    2. David I. Hastie & Peter J. Green, 2012. "Model choice using reversible jump Markov chain Monte Carlo," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 66(3), pages 309-338, August.
    3. Gagnon, Philippe & Bédard, Mylène & Desgagné, Alain, 2019. "Weak convergence and optimal tuning of the reversible jump algorithm," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 161(C), pages 32-51.
    4. Meyer-Gohde, Alexander & Neuhoff, Daniel, 2015. "Generalized exogenous processes in DSGE: A Bayesian approach," SFB 649 Discussion Papers 2015-014, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    5. Riccardo (Jack) Lucchetti & Luca Pedini, 2020. "ParMA: Parallelised Bayesian Model Averaging for Generalised Linear Models," Working Papers 2020:28, Department of Economics, University of Venice "Ca' Foscari".
    6. Bellelli, Francesco S. & Scarpa, Riccardo & Aftab, Ashar, 2023. "An empirical analysis of participation in international environmental agreements," Journal of Environmental Economics and Management, Elsevier, vol. 118(C).
    7. Leonardo Oliveira Martins & Hirohisa Kishino, 2010. "Distribution of distances between topologies and its effect on detection of phylogenetic recombination," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 62(1), pages 145-159, February.
    8. Zhang, Tonglin, 2019. "General Gaussian estimation," Journal of Multivariate Analysis, Elsevier, vol. 169(C), pages 234-247.
    9. Liqun Wang & James Fu, 2007. "A practical sampling approach for a Bayesian mixture model with unknown number of components," Statistical Papers, Springer, vol. 48(4), pages 631-653, October.
    10. Plewis Ian & Shlomo Natalie, 2017. "Using Response Propensity Models to Improve the Quality of Response Data in Longitudinal Studies," Journal of Official Statistics, Sciendo, vol. 33(3), pages 753-779, September.
    11. Tsung-I Lin & Hsiu Ho & Pao Shen, 2009. "Computationally efficient learning of multivariate t mixture models with missing information," Computational Statistics, Springer, vol. 24(3), pages 375-392, August.
    12. Sol Pía Juárez & Juan Merlo, 2013. "Revisiting the Effect of Maternal Smoking during Pregnancy on Offspring Birthweight: A Quasi-Experimental Sibling Analysis in Sweden," PLOS ONE, Public Library of Science, vol. 8(4), pages 1-7, April.
    13. Yinghui Wei & Peter Neal & Sandra Telfer & Mike Begon, 2012. "Statistical analysis of an endemic disease from a capture--recapture experiment," Journal of Applied Statistics, Taylor & Francis Journals, vol. 39(12), pages 2759-2773, August.
    14. Broström, Göran & Holmberg, Henrik, 2011. "Generalized linear models with clustered data: Fixed and random effects models," Computational Statistics & Data Analysis, Elsevier, vol. 55(12), pages 3123-3134, December.
    15. Rosineide Fernando da Paz & Jorge Luis Bazán & Luis Aparecido Milan, 2017. "Bayesian estimation for a mixture of simplex distributions with an unknown number of components: HDI analysis in Brazil," Journal of Applied Statistics, Taylor & Francis Journals, vol. 44(9), pages 1630-1643, July.
    16. Bagnara, Maurizio & Van Oijen, Marcel & Cameron, David & Gianelle, Damiano & Magnani, Federico & Sottocornola, Matteo, 2018. "Bayesian calibration of simple forest models with multiplicative mathematical structure: A case study with two Light Use Efficiency models in an alpine forest," Ecological Modelling, Elsevier, vol. 371(C), pages 90-100.
    17. Dalla Valle, Luciana & De Giuli, Maria Elena & Tarantola, Claudia & Manelli, Claudio, 2016. "Default probability estimation via pair copula constructions," European Journal of Operational Research, Elsevier, vol. 249(1), pages 298-311.
    18. McVinish, R. & Mengersen, K., 2008. "Semiparametric Bayesian circular statistics," Computational Statistics & Data Analysis, Elsevier, vol. 52(10), pages 4722-4730, June.
    19. Jaspers, Stijn & Aerts, Marc & Verbeke, Geert & Beloeil, Pierre-Alexandre, 2014. "A new semi-parametric mixture model for interval censored data, with applications in the field of antimicrobial resistance," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 30-42.
    20. Christian Schellhase & Göran Kauermann, 2012. "Density estimation and comparison with a penalized mixture approach," Computational Statistics, Springer, vol. 27(4), pages 757-777, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:98:y:2016:i:c:p:79-90. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.