IDEAS home Printed from https://ideas.repec.org/p/crs/wpaper/2010-29.html
   My bibliography  Save this paper

Improving the Convergence Properties of the Data Augmentation Algorithm with an Application to Bayesian Mixture Modelling

Author

Listed:
  • James P. Hobert

    (Crest)

  • Christian P. Robert

    (Crest)

  • Vivekanada Roy

    (Crest)

Abstract

Every reversible Markov chain defines an operator whose spectrum encodes the convergenceproperties of the chain. When the state space is finite, the spectrum is just the set ofeigenvalues of the corresponding Markov transition matrix. However, when the state space isinfinite, the spectrum may be uncountable, and is nearly always impossible to calculate. In mostapplications of the data augmentation (DA) algorithm, the state space of the DA Markov chainis infinite. However, we show that, under regularity conditions that include the finiteness of theaugmented space, the operators defined by the DA chain and Hobert and Marchev’s (2008) alternativechain are both compact, and the corresponding spectra are both finite subsets of [0; 1).Moreover, we prove that the spectrum of Hobert and Marchev’s (2008) chain dominates thespectrum of the DA chain in the sense that the ordered elements of the former are all less thanor equal to the corresponding elements of the latter. As a concrete example, we study a widelyused DA algorithm for the exploration of posterior densities associated with Bayesian mixturemodels (Diebolt and Robert, 1994). In particular, we compare this mixture DA algorithm withan alternative algorithm proposed by Fr¨uhwirth-Schnatter (2001) that is based on random labelswitching.

Suggested Citation

  • James P. Hobert & Christian P. Robert & Vivekanada Roy, 2010. "Improving the Convergence Properties of the Data Augmentation Algorithm with an Application to Bayesian Mixture Modelling," Working Papers 2010-29, Center for Research in Economics and Statistics.
  • Handle: RePEc:crs:wpaper:2010-29
    as

    Download full text from publisher

    File URL: http://crest.science/RePEc/wpstorage/2010-29.pdf
    File Function: Crest working paper version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Vivekananda Roy & James P. Hobert, 2007. "Convergence rates and asymptotic standard errors for Markov chain Monte Carlo algorithms for Bayesian probit regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(4), pages 607-623, September.
    2. Gareth O. Roberts & Jeffrey S. Rosenthal, 2001. "Markov Chains and De‐initializing Processes," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 28(3), pages 489-504, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Xin & Roy, Vivekananda, 2018. "Analysis of the Pólya-Gamma block Gibbs sampler for Bayesian logistic linear mixed models," Statistics & Probability Letters, Elsevier, vol. 137(C), pages 251-256.
    2. Johnson, Alicia A. & Jones, Galin L., 2015. "Geometric ergodicity of random scan Gibbs samplers for hierarchical one-way random effects models," Journal of Multivariate Analysis, Elsevier, vol. 140(C), pages 325-342.
    3. Higgs, Megan Dailey & Hoeting, Jennifer A., 2010. "A clipped latent variable model for spatially correlated ordered categorical data," Computational Statistics & Data Analysis, Elsevier, vol. 54(8), pages 1999-2011, August.
    4. Kshitij Khare & Malay Ghosh, 2022. "MCMC Convergence for Global-Local Shrinkage Priors," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 20(1), pages 211-234, September.
    5. Jin, Zhumengmeng & Hobert, James P., 2022. "On the convergence rate of the “out-of-order” block Gibbs sampler," Statistics & Probability Letters, Elsevier, vol. 188(C).
    6. Quan Zhou & Jun Yang & Dootika Vats & Gareth O. Roberts & Jeffrey S. Rosenthal, 2022. "Dimension‐free mixing for high‐dimensional Bayesian variable selection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(5), pages 1751-1784, November.
    7. Jin, Zhumengmeng & Hobert, James P., 2022. "Dimension free convergence rates for Gibbs samplers for Bayesian linear mixed models," Stochastic Processes and their Applications, Elsevier, vol. 148(C), pages 25-67.
    8. Bryant Davis & James P. Hobert, 2021. "On the Convergence Complexity of Gibbs Samplers for a Family of Simple Bayesian Random Effects Models," Methodology and Computing in Applied Probability, Springer, vol. 23(4), pages 1323-1351, December.
    9. Chakraborty, Saptarshi & Bhattacharya, Suman K. & Khare, Kshitij, 2022. "Estimating accuracy of the MCMC variance estimator: Asymptotic normality for batch means estimators," Statistics & Probability Letters, Elsevier, vol. 183(C).
    10. Mário de Castro & Ming‐Hui Chen & Yuanye Zhang, 2015. "Bayesian path specific frailty models for multi‐state survival data with applications," Biometrics, The International Biometric Society, vol. 71(3), pages 760-771, September.
    11. Chu, Amanda M.Y. & Omori, Yasuhiro & So, Hing-yu & So, Mike K.P., 2023. "A Multivariate Randomized Response Model for Sensitive Binary Data," Econometrics and Statistics, Elsevier, vol. 27(C), pages 16-35.
    12. Roy, Vivekananda, 2014. "Efficient estimation of the link function parameter in a robust Bayesian binary regression model," Computational Statistics & Data Analysis, Elsevier, vol. 73(C), pages 87-102.
    13. Chen, Ming-Hui & Ibrahim, Joseph G. & Shao, Qi-Man, 2009. "Maximum likelihood inference for the Cox regression model with applications to missing covariates," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 2018-2030, October.
    14. Román, Jorge Carlos & Hobert, James P. & Presnell, Brett, 2014. "On reparametrization and the Gibbs sampler," Statistics & Probability Letters, Elsevier, vol. 91(C), pages 110-116.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:crs:wpaper:2010-29. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Secretariat General (email available below). General contact details of provider: https://edirc.repec.org/data/crestfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.