IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v202y2024ics0047259x24000034.html
   My bibliography  Save this article

Convergence analysis of data augmentation algorithms for Bayesian robust multivariate linear regression with incomplete data

Author

Listed:
  • Li, Haoxiang
  • Qin, Qian
  • Jones, Galin L.

Abstract

Gaussian mixtures are commonly used for modeling heavy-tailed error distributions in robust linear regression. Combining the likelihood of a multivariate robust linear regression model with a standard improper prior distribution yields an analytically intractable posterior distribution that can be sampled using a data augmentation algorithm. When the response matrix has missing entries, there are unique challenges to the application and analysis of the convergence properties of the algorithm. Conditions for geometric ergodicity are provided when the incomplete data have a “monotone” structure. In the absence of a monotone structure, an intermediate imputation step is necessary for implementing the algorithm. In this case, we provide sufficient conditions for the algorithm to be Harris ergodic. Finally, we show that, when there is a monotone structure and intermediate imputation is unnecessary, intermediate imputation slows the convergence of the underlying Monte Carlo Markov chain, while post hoc imputation does not. An R package for the data augmentation algorithm is provided.

Suggested Citation

  • Li, Haoxiang & Qin, Qian & Jones, Galin L., 2024. "Convergence analysis of data augmentation algorithms for Bayesian robust multivariate linear regression with incomplete data," Journal of Multivariate Analysis, Elsevier, vol. 202(C).
  • Handle: RePEc:eee:jmvana:v:202:y:2024:i:c:s0047259x24000034
    DOI: 10.1016/j.jmva.2024.105296
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X24000034
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jmva.2024.105296?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Qin, Qian & Hobert, James P., 2018. "Trace-class Monte Carlo Markov chains for Bayesian multivariate linear regression with non-Gaussian errors," Journal of Multivariate Analysis, Elsevier, vol. 166(C), pages 335-345.
    2. Fernández, Carmen & Steel, Mark F.J., 2000. "Bayesian Regression Analysis With Scale Mixtures Of Normals," Econometric Theory, Cambridge University Press, vol. 16(1), pages 80-101, February.
    3. Roy, Vivekananda & Hobert, James P., 2010. "On Monte Carlo methods for Bayesian multivariate regression models with heavy-tailed errors," Journal of Multivariate Analysis, Elsevier, vol. 101(5), pages 1190-1202, May.
    4. James P. Hobert & Yeun Ji Jung & Kshitij Khare & Qian Qin, 2018. "Convergence Analysis of MCMC Algorithms for Bayesian Multivariate Linear Regression with Non‐Gaussian Errors," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 45(3), pages 513-533, September.
    5. Dootika Vats & James M Flegal & Galin L Jones, 2019. "Multivariate output analysis for Markov chain Monte Carlo," Biometrika, Biometrika Trust, vol. 106(2), pages 321-337.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chakraborty, Saptarshi & Bhattacharya, Suman K. & Khare, Kshitij, 2022. "Estimating accuracy of the MCMC variance estimator: Asymptotic normality for batch means estimators," Statistics & Probability Letters, Elsevier, vol. 183(C).
    2. Jung, Yeun Ji & Hobert, James P., 2014. "Spectral properties of MCMC algorithms for Bayesian linear regression with generalized hyperbolic errors," Statistics & Probability Letters, Elsevier, vol. 95(C), pages 92-100.
    3. Qin, Qian & Hobert, James P., 2018. "Trace-class Monte Carlo Markov chains for Bayesian multivariate linear regression with non-Gaussian errors," Journal of Multivariate Analysis, Elsevier, vol. 166(C), pages 335-345.
    4. Riccardo (Jack) Lucchetti & Luca Pedini, 2020. "ParMA: Parallelised Bayesian Model Averaging for Generalised Linear Models," Working Papers 2020:28, Department of Economics, University of Venice "Ca' Foscari".
    5. Ley, Eduardo & Steel, Mark F.J., 2012. "Mixtures of g-priors for Bayesian model averaging with economic applications," Journal of Econometrics, Elsevier, vol. 171(2), pages 251-266.
    6. Constandina Koki & Loukia Meligkotsidou & Ioannis Vrontos, 2020. "Forecasting under model uncertainty: Non‐homogeneous hidden Markov models with Pòlya‐Gamma data augmentation," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(4), pages 580-598, July.
    7. Laura Liu, 2017. "Density Forecasts in Panel Models: A semiparametric Bayesian Perspective," PIER Working Paper Archive 17-006, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 28 Apr 2017.
    8. Gernot Doppelhofer & Melvyn Weeks, 2011. "Robust Growth Determinants," CESifo Working Paper Series 3354, CESifo.
    9. Wilson Tsakane Mongwe & Rendani Mbuvha & Tshilidzi Marwala, 2021. "Bayesian inference of local government audit outcomes," PLOS ONE, Public Library of Science, vol. 16(12), pages 1-19, December.
    10. Mingchang Chih, 2019. "An Insight into the Data Structure of the Dynamic Batch Means Algorithm with Binary Tree Code," Mathematics, MDPI, vol. 7(9), pages 1-8, August.
    11. Rubio, Francisco Javier & Liseo, Brunero, 2014. "On the independence Jeffreys prior for skew-symmetric models," Statistics & Probability Letters, Elsevier, vol. 85(C), pages 91-97.
    12. Salas-Gonzalez, Diego & Kuruoglu, Ercan E. & Ruiz, Diego P., 2009. "A heavy-tailed empirical Bayes method for replicated microarray data," Computational Statistics & Data Analysis, Elsevier, vol. 53(5), pages 1535-1546, March.
    13. Ying Liu & Dootika Vats & James M. Flegal, 2022. "Batch Size Selection for Variance Estimators in MCMC," Methodology and Computing in Applied Probability, Springer, vol. 24(1), pages 65-93, March.
    14. Jian, Zhihong & Li, Xupei & Zhu, Zhican, 2020. "Sequential forecasting of downside extreme risk during overnight and daytime: Evidence from the Chinese Stock Market☆," Pacific-Basin Finance Journal, Elsevier, vol. 64(C).
    15. Yongho Ko & Seungwoo Han, 2017. "A Duration Prediction Using a Material-Based Progress Management Methodology for Construction Operation Plans," Sustainability, MDPI, vol. 9(4), pages 1-12, April.
    16. Kshitij Khare & Malay Ghosh, 2022. "MCMC Convergence for Global-Local Shrinkage Priors," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 20(1), pages 211-234, September.
    17. Sally Paganin & Christopher J. Paciorek & Claudia Wehrhahn & Abel Rodríguez & Sophia Rabe-Hesketh & Perry de Valpine, 2023. "Computational Strategies and Estimation Performance With Bayesian Semiparametric Item Response Theory Models," Journal of Educational and Behavioral Statistics, , vol. 48(2), pages 147-188, April.
    18. De la Cruz, Rolando, 2008. "Bayesian non-linear regression models with skew-elliptical errors: Applications to the classification of longitudinal profiles," Computational Statistics & Data Analysis, Elsevier, vol. 53(2), pages 436-449, December.
    19. Miguel A. Juárez & Mark F. J. Steel, 2010. "Non‐gaussian dynamic bayesian modelling for panel data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(7), pages 1128-1154, November/.
    20. Heinen, Andréas & Valdesogo, Alfonso, 2020. "Spearman rank correlation of the bivariate Student t and scale mixtures of normal distributions," Journal of Multivariate Analysis, Elsevier, vol. 179(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:202:y:2024:i:c:s0047259x24000034. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.