IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v98y2016icp79-90.html
   My bibliography  Save this article

Using hierarchical centering to facilitate a reversible jump MCMC algorithm for random effects models

Author

Listed:
  • Oedekoven, C.S.
  • King, R.
  • Buckland, S.T.
  • Mackenzie, M.L.
  • Evans, K.O.
  • Burger, L.W.

Abstract

Hierarchical centering has been described as a reparameterization method applicable to random effects models. It has been shown to improve mixing of models in the context of Markov chain Monte Carlo (MCMC) methods. A hierarchical centering approach is proposed for reversible jump MCMC (RJMCMC) chains which builds upon the hierarchical centering methods for MCMC chains and uses them to reparameterize models in an RJMCMC algorithm. Although these methods may be applicable to models with other error distributions, the case is described for a log-linear Poisson model where the expected value λ includes fixed effect covariates and a random effect for which normality is assumed with a zero-mean and unknown standard deviation. For the proposed RJMCMC algorithm including hierarchical centering, the models are reparameterized by modeling the mean of the random effect coefficients as a function of the intercept of the λ model and one or more of the available fixed effect covariates depending on the model. The method is appropriate when fixed-effect covariates are constant within random effect groups. This has an effect on the dynamics of the RJMCMC algorithm and improves model mixing. The methods are applied to a case study of point transects of indigo buntings where, without hierarchical centering, the RJMCMC algorithm had poor mixing and the estimated posterior distribution depended on the starting model. With hierarchical centering on the other hand, the chain moved freely over model and parameter space. These results are confirmed with a simulation study. Hence, the proposed methods should be considered as a regular strategy for implementing models with random effects in RJMCMC algorithms; they facilitate convergence of these algorithms and help avoid false inference on model parameters.

Suggested Citation

  • Oedekoven, C.S. & King, R. & Buckland, S.T. & Mackenzie, M.L. & Evans, K.O. & Burger, L.W., 2016. "Using hierarchical centering to facilitate a reversible jump MCMC algorithm for random effects models," Computational Statistics & Data Analysis, Elsevier, vol. 98(C), pages 79-90.
  • Handle: RePEc:eee:csdana:v:98:y:2016:i:c:p:79-90
    DOI: 10.1016/j.csda.2015.12.010
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947315003187
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2015.12.010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. S. P. Brooks & P. Giudici & G. O. Roberts, 2003. "Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(1), pages 3-39, January.
    2. William J. Browne & Fiona Steele & Mousa Golalizadeh & Martin J. Green, 2009. "The use of simple reparameterizations to improve the efficiency of Markov chain Monte Carlo estimation for multilevel models with applications to discrete time survival models," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(3), pages 579-598, June.
    3. M. Papathomas & P. Dellaportas & V. G. S. Vasdekis, 2011. "A novel reversible jump algorithm for generalized linear models," Biometrika, Biometrika Trust, vol. 98(1), pages 231-236.
    4. Al-Awadhi, Fahimah & Hurn, Merrilee & Jennison, Christopher, 2004. "Improving the acceptance rate of reversible jump MCMC proposals," Statistics & Probability Letters, Elsevier, vol. 69(2), pages 189-198, August.
    5. Komárek, Arnost & Lesaffre, Emmanuel, 2008. "Generalized linear mixed model with a penalized Gaussian mixture as a random effects distribution," Computational Statistics & Data Analysis, Elsevier, vol. 52(7), pages 3441-3458, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. AWLP Thilan & P Menéndez & JM McGree, 2023. "Assessing the ability of adaptive designs to capture trends in hard coral cover," Environmetrics, John Wiley & Sons, Ltd., vol. 34(6), September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Langnan & Luo, Jiawen & Liu, Hao, 2013. "The determinants of liquidity with G-RJMCMC-VS model: Evidence from China," Economic Modelling, Elsevier, vol. 35(C), pages 192-198.
    2. David I. Hastie & Peter J. Green, 2012. "Model choice using reversible jump Markov chain Monte Carlo," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 66(3), pages 309-338, August.
    3. Alexander Meyer-Gohde & Daniel Neuhoff, 2015. "Generalized Exogenous Processes in DSGE: A Bayesian Approach," SFB 649 Discussion Papers SFB649DP2015-014, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    4. Gagnon, Philippe & Bédard, Mylène & Desgagné, Alain, 2019. "Weak convergence and optimal tuning of the reversible jump algorithm," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 161(C), pages 32-51.
    5. Riccardo (Jack) Lucchetti & Luca Pedini, 2020. "ParMA: Parallelised Bayesian Model Averaging for Generalised Linear Models," Working Papers 2020:28, Department of Economics, University of Venice "Ca' Foscari".
    6. Bellelli, Francesco S. & Scarpa, Riccardo & Aftab, Ashar, 2023. "An empirical analysis of participation in international environmental agreements," Journal of Environmental Economics and Management, Elsevier, vol. 118(C).
    7. Leonardo Oliveira Martins & Hirohisa Kishino, 2010. "Distribution of distances between topologies and its effect on detection of phylogenetic recombination," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 62(1), pages 145-159, February.
    8. Liqun Wang & James Fu, 2007. "A practical sampling approach for a Bayesian mixture model with unknown number of components," Statistical Papers, Springer, vol. 48(4), pages 631-653, October.
    9. Broström, Göran & Holmberg, Henrik, 2011. "Generalized linear models with clustered data: Fixed and random effects models," Computational Statistics & Data Analysis, Elsevier, vol. 55(12), pages 3123-3134, December.
    10. Dalla Valle, Luciana & De Giuli, Maria Elena & Tarantola, Claudia & Manelli, Claudio, 2016. "Default probability estimation via pair copula constructions," European Journal of Operational Research, Elsevier, vol. 249(1), pages 298-311.
    11. Christian Schellhase & Göran Kauermann, 2012. "Density estimation and comparison with a penalized mixture approach," Computational Statistics, Springer, vol. 27(4), pages 757-777, December.
    12. Giudici, Paolo, 2018. "Financial data science," Statistics & Probability Letters, Elsevier, vol. 136(C), pages 160-164.
    13. Víctor Enciso‐Mora & Peter Neal & T. Subba Rao, 2009. "Efficient order selection algorithms for integer‐valued ARMA processes," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(1), pages 1-18, January.
    14. Alzahrani, Naif & Neal, Peter & Spencer, Simon E.F. & McKinley, Trevelyan J. & Touloupou, Panayiota, 2018. "Model selection for time series of count data," Computational Statistics & Data Analysis, Elsevier, vol. 122(C), pages 33-44.
    15. Sridhar Narayanan, 2013. "Bayesian estimation of discrete games of complete information," Quantitative Marketing and Economics (QME), Springer, vol. 11(1), pages 39-81, March.
    16. George Leckie & Rebecca Pillinger & Kelvyn Jones & Harvey Goldstein, 2012. "Multilevel Modeling of Social Segregation," Journal of Educational and Behavioral Statistics, , vol. 37(1), pages 3-30, February.
    17. Leonardo Grilli & Carla Rampichini, 2015. "Specification of random effects in multilevel models: a review," Quality & Quantity: International Journal of Methodology, Springer, vol. 49(3), pages 967-976, May.
    18. Kobayashi, Genya, 2014. "A transdimensional approximate Bayesian computation using the pseudo-marginal approach for model choice," Computational Statistics & Data Analysis, Elsevier, vol. 80(C), pages 167-183.
    19. N. Friel & A. N. Pettitt, 2008. "Marginal likelihood estimation via power posteriors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(3), pages 589-607, July.
    20. Ronald W. Butler & Marc S. Paolella, 2017. "Autoregressive Lag—Order Selection Using Conditional Saddlepoint Approximations," Econometrics, MDPI, vol. 5(3), pages 1-33, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:98:y:2016:i:c:p:79-90. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.