IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v202y2024ics0047259x24000034.html
   My bibliography  Save this article

Convergence analysis of data augmentation algorithms for Bayesian robust multivariate linear regression with incomplete data

Author

Listed:
  • Li, Haoxiang
  • Qin, Qian
  • Jones, Galin L.

Abstract

Gaussian mixtures are commonly used for modeling heavy-tailed error distributions in robust linear regression. Combining the likelihood of a multivariate robust linear regression model with a standard improper prior distribution yields an analytically intractable posterior distribution that can be sampled using a data augmentation algorithm. When the response matrix has missing entries, there are unique challenges to the application and analysis of the convergence properties of the algorithm. Conditions for geometric ergodicity are provided when the incomplete data have a “monotone” structure. In the absence of a monotone structure, an intermediate imputation step is necessary for implementing the algorithm. In this case, we provide sufficient conditions for the algorithm to be Harris ergodic. Finally, we show that, when there is a monotone structure and intermediate imputation is unnecessary, intermediate imputation slows the convergence of the underlying Monte Carlo Markov chain, while post hoc imputation does not. An R package for the data augmentation algorithm is provided.

Suggested Citation

  • Li, Haoxiang & Qin, Qian & Jones, Galin L., 2024. "Convergence analysis of data augmentation algorithms for Bayesian robust multivariate linear regression with incomplete data," Journal of Multivariate Analysis, Elsevier, vol. 202(C).
  • Handle: RePEc:eee:jmvana:v:202:y:2024:i:c:s0047259x24000034
    DOI: 10.1016/j.jmva.2024.105296
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X24000034
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jmva.2024.105296?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Qin, Qian & Hobert, James P., 2018. "Trace-class Monte Carlo Markov chains for Bayesian multivariate linear regression with non-Gaussian errors," Journal of Multivariate Analysis, Elsevier, vol. 166(C), pages 335-345.
    2. Fernández, Carmen & Steel, Mark F.J., 2000. "Bayesian Regression Analysis With Scale Mixtures Of Normals," Econometric Theory, Cambridge University Press, vol. 16(1), pages 80-101, February.
    3. Roy, Vivekananda & Hobert, James P., 2010. "On Monte Carlo methods for Bayesian multivariate regression models with heavy-tailed errors," Journal of Multivariate Analysis, Elsevier, vol. 101(5), pages 1190-1202, May.
    4. James P. Hobert & Yeun Ji Jung & Kshitij Khare & Qian Qin, 2018. "Convergence Analysis of MCMC Algorithms for Bayesian Multivariate Linear Regression with Non‐Gaussian Errors," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 45(3), pages 513-533, September.
    5. Dootika Vats & James M Flegal & Galin L Jones, 2019. "Multivariate output analysis for Markov chain Monte Carlo," Biometrika, Biometrika Trust, vol. 106(2), pages 321-337.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jung, Yeun Ji & Hobert, James P., 2014. "Spectral properties of MCMC algorithms for Bayesian linear regression with generalized hyperbolic errors," Statistics & Probability Letters, Elsevier, vol. 95(C), pages 92-100.
    2. Chakraborty, Saptarshi & Bhattacharya, Suman K. & Khare, Kshitij, 2022. "Estimating accuracy of the MCMC variance estimator: Asymptotic normality for batch means estimators," Statistics & Probability Letters, Elsevier, vol. 183(C).
    3. Qin, Qian & Hobert, James P., 2018. "Trace-class Monte Carlo Markov chains for Bayesian multivariate linear regression with non-Gaussian errors," Journal of Multivariate Analysis, Elsevier, vol. 166(C), pages 335-345.
    4. Riccardo (Jack) Lucchetti & Luca Pedini, 2020. "ParMA: Parallelised Bayesian Model Averaging for Generalised Linear Models," Working Papers 2020:28, Department of Economics, University of Venice "Ca' Foscari".
    5. Constandina Koki & Loukia Meligkotsidou & Ioannis Vrontos, 2020. "Forecasting under model uncertainty: Non‐homogeneous hidden Markov models with Pòlya‐Gamma data augmentation," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(4), pages 580-598, July.
    6. Laura Liu, 2017. "Density Forecasts in Panel Models: A semiparametric Bayesian Perspective," PIER Working Paper Archive 17-006, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 28 Apr 2017.
    7. Wilson Tsakane Mongwe & Rendani Mbuvha & Tshilidzi Marwala, 2021. "Bayesian inference of local government audit outcomes," PLOS ONE, Public Library of Science, vol. 16(12), pages 1-19, December.
    8. Mingchang Chih, 2019. "An Insight into the Data Structure of the Dynamic Batch Means Algorithm with Binary Tree Code," Mathematics, MDPI, vol. 7(9), pages 1-8, August.
    9. Yongho Ko & Seungwoo Han, 2017. "A Duration Prediction Using a Material-Based Progress Management Methodology for Construction Operation Plans," Sustainability, MDPI, vol. 9(4), pages 1-12, April.
    10. Kshitij Khare & Malay Ghosh, 2022. "MCMC Convergence for Global-Local Shrinkage Priors," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 20(1), pages 211-234, September.
    11. De la Cruz, Rolando, 2008. "Bayesian non-linear regression models with skew-elliptical errors: Applications to the classification of longitudinal profiles," Computational Statistics & Data Analysis, Elsevier, vol. 53(2), pages 436-449, December.
    12. Miguel A. Juárez & Mark F. J. Steel, 2010. "Non‐gaussian dynamic bayesian modelling for panel data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(7), pages 1128-1154, November/.
    13. Doppelhofer, Gernot & Weeks, Melvyn, 2011. "Robust Growth Determinants," Discussion Paper Series in Economics 3/2011, Norwegian School of Economics, Department of Economics.
    14. Fernandez, Carmen & Koop, Gary & Steel, Mark, 2000. "A Bayesian analysis of multiple-output production frontiers," Journal of Econometrics, Elsevier, vol. 98(1), pages 47-79, September.
    15. Rubio, Francisco Javier & Steel, Mark F. J., 2014. "Bayesian modelling of skewness and kurtosis with two-piece scale and shape transformations," MPRA Paper 57102, University Library of Munich, Germany.
    16. Quan Zhou & Jun Yang & Dootika Vats & Gareth O. Roberts & Jeffrey S. Rosenthal, 2022. "Dimension‐free mixing for high‐dimensional Bayesian variable selection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(5), pages 1751-1784, November.
    17. Jorge A. Barahona & Yolanda M. Gómez & Emilio Gómez-Déniz & Osvaldo Venegas & Héctor W. Gómez, 2024. "Scale Mixture of Exponential Distribution with an Application," Mathematics, MDPI, vol. 12(1), pages 1-17, January.
    18. Choi, Hee Min & Hobert, James P., 2013. "Analysis of MCMC algorithms for Bayesian linear regression with Laplace errors," Journal of Multivariate Analysis, Elsevier, vol. 117(C), pages 32-40.
    19. Juarez, Miguel A. & Steel, Mark F. J., 2006. "Model-based Clustering of non-Gaussian Panel Data," MPRA Paper 880, University Library of Munich, Germany.
    20. Xiang Lu & Yaoxiang Li & Tanzy Love, 2021. "On Bayesian Analysis of Parsimonious Gaussian Mixture Models," Journal of Classification, Springer;The Classification Society, vol. 38(3), pages 576-593, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:202:y:2024:i:c:s0047259x24000034. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.