IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v191y2022ics0047259x2200046x.html
   My bibliography  Save this article

Robust estimation in multivariate heteroscedastic regression models with autoregressive covariance structures using EM algorithm

Author

Listed:
  • Guney, Yesim
  • Arslan, Olcay
  • Yavuz, Fulya Gokalp

Abstract

In the analysis of repeated or clustered measurements, it is crucial to determine the dynamics that affect the mean, variance, and correlations of the data, which will be possible using appropriate models. One of these models is the joint mean–covariance model, which is a multivariate heteroscedastic regression model with autoregressive covariance structures. In these models, parameter estimation is usually carried on under normality assumption, but the resulting estimators will be very sensitive to the outliers or non-normality of data. In this study, we propose a robust alternative method and an EM algorithm for estimating the parameters of joint mean–covariance models. Robustification is achieved using a multivariate heavy-tailed distribution with the same number of parameters as the multivariate normal distribution. To simplify the estimation procedure, a modified Cholesky decomposition is adopted to factorize the dependence structure in terms of unconstrained autoregressive and scale innovation parameters. Also, the technique for the prediction of future responses is given. An intensive simulation study and a real data example are provided to demonstrate the performance of the proposed method.

Suggested Citation

  • Guney, Yesim & Arslan, Olcay & Yavuz, Fulya Gokalp, 2022. "Robust estimation in multivariate heteroscedastic regression models with autoregressive covariance structures using EM algorithm," Journal of Multivariate Analysis, Elsevier, vol. 191(C).
    • Handle: RePEc:eee:jmvana:v:191:y:2022:i:c:s0047259x2200046x
    DOI: 10.1016/j.jmva.2022.105026
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X2200046X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2022.105026?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xu, Lin & Xiang, Sijia & Yao, Weixin, 2019. "Robust maximum Lq-likelihood estimation of joint mean–covariance models for longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 397-411.
    2. Lv, Jing & Yang, Hu & Guo, Chaohui, 2015. "An efficient and robust variable selection method for longitudinal generalized linear models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 74-88.
    3. Olcay Arslan, 2010. "An alternative multivariate skew Laplace distribution: properties and estimation," Statistical Papers, Springer, vol. 51(4), pages 865-887, December.
    4. Rossi, E. & Spazzini, F., 2010. "Model and distribution uncertainty in multivariate GARCH estimation: A Monte Carlo analysis," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2786-2800, November.
    5. Thanakorn Nitithumbundit & Jennifer S. K. Chan, 2020. "ECM Algorithm for Auto-Regressive Multivariate Skewed Variance Gamma Model with Unbounded Density," Methodology and Computing in Applied Probability, Springer, vol. 22(3), pages 1169-1191, September.
    6. Weiping Zhang & Chenlei Leng & Cheng Yong Tang, 2015. "A joint modelling approach for longitudinal studies," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 77(1), pages 219-238, January.
    7. Hürlimann, Werner, 2013. "A moment method for the multivariate asymmetric Laplace distribution," Statistics & Probability Letters, Elsevier, vol. 83(4), pages 1247-1253.
    8. Lindsey, J.K. & Lindsey, P.J., 2006. "Multivariate distributions with correlation matrices for nonlinear repeated measurements," Computational Statistics & Data Analysis, Elsevier, vol. 50(3), pages 720-732, February.
    9. Fulya Gokalp Yavuz & Olcay Arslan, 2018. "Linear mixed model with Laplace distribution (LLMM)," Statistical Papers, Springer, vol. 59(1), pages 271-289, March.
    10. You-Gan Wang, 2003. "Working correlation structure misspecification, estimation and covariate design: Implications for generalised estimating equations performance," Biometrika, Biometrika Trust, vol. 90(1), pages 29-41, March.
    11. Christophe Croux & Irène Gijbels & Ilaria Prosdocimi, 2012. "Robust Estimation of Mean and Dispersion Functions in Extended Generalized Additive Models," Biometrics, The International Biometric Society, vol. 68(1), pages 31-44, March.
    12. Guoyou Qin & Zhongyi Zhu, 2015. "Robust estimation of mean and covariance for longitudinal data with dropouts," Journal of Applied Statistics, Taylor & Francis Journals, vol. 42(6), pages 1240-1254, June.
    13. Jianxin Pan, 2003. "On modelling mean-covariance structures in longitudinal studies," Biometrika, Biometrika Trust, vol. 90(1), pages 239-244, March.
    14. Anderson, Dale N., 1992. "A multivariate Linnik distribution," Statistics & Probability Letters, Elsevier, vol. 14(4), pages 333-336, July.
    15. Huajun Ye & Jianxin Pan, 2006. "Modelling of covariance structures in generalised estimating equations for longitudinal data," Biometrika, Biometrika Trust, vol. 93(4), pages 927-941, December.
    16. Daniels, M.J. & Pourahmadi, M., 2009. "Modeling covariance matrices via partial autocorrelations," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2352-2363, November.
    17. Mohsen Pourahmadi, 2007. "Cholesky Decompositions and Estimation of A Covariance Matrix: Orthogonality of Variance--Correlation Parameters," Biometrika, Biometrika Trust, vol. 94(4), pages 1006-1013.
    18. Xueqin Wang & Yunlu Jiang & Mian Huang & Heping Zhang, 2013. "Robust Variable Selection With Exponential Squared Loss," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(502), pages 632-643, June.
    19. Weiping Zhang & Chenlei Leng, 2012. "A moving average Cholesky factor model in covariance modelling for longitudinal data," Biometrika, Biometrika Trust, vol. 99(1), pages 141-150.
    20. Jianhua Z. Huang & Naiping Liu & Mohsen Pourahmadi & Linxu Liu, 2006. "Covariance matrix selection and estimation via penalised normal likelihood," Biometrika, Biometrika Trust, vol. 93(1), pages 85-98, March.
    21. Tomasz J. Kozubowski & Krzysztof Podgórski, 2000. "A Multivariate and Asymmetric Generalization of Laplace Distribution," Computational Statistics, Springer, vol. 15(4), pages 531-540, December.
    22. Fan, Yali & Qin, Guoyou & Zhu, Zhongyi, 2012. "Variable selection in robust regression models for longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 109(C), pages 156-167.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lee, Keunbaik & Baek, Changryong & Daniels, Michael J., 2017. "ARMA Cholesky factor models for the covariance matrix of linear models," Computational Statistics & Data Analysis, Elsevier, vol. 115(C), pages 267-280.
    2. Lu, Fei & Xue, Liugen & Cai, Xiong, 2020. "GEE analysis in joint mean-covariance model for longitudinal data," Statistics & Probability Letters, Elsevier, vol. 160(C).
    3. Luo, Renwen & Pan, Jianxin, 2022. "Conditional generalized estimating equations of mean-variance-correlation for clustered data," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    4. Xu, Lin & Xiang, Sijia & Yao, Weixin, 2019. "Robust maximum Lq-likelihood estimation of joint mean–covariance models for longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 397-411.
    5. Feng, Sanying & Lian, Heng & Xue, Liugen, 2016. "A new nested Cholesky decomposition and estimation for the covariance matrix of bivariate longitudinal data," Computational Statistics & Data Analysis, Elsevier, vol. 102(C), pages 98-109.
    6. Yixin Chen & Weixin Yao, 2017. "Unified Inference for Sparse and Dense Longitudinal Data in Time-varying Coefficient Models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 44(1), pages 268-284, March.
    7. Liya Fu & Zhuoran Yang & Fengjing Cai & You-Gan Wang, 2021. "Efficient and doubly-robust methods for variable selection and parameter estimation in longitudinal data analysis," Computational Statistics, Springer, vol. 36(2), pages 781-804, June.
    8. Lam, Clifford, 2020. "High-dimensional covariance matrix estimation," LSE Research Online Documents on Economics 101667, London School of Economics and Political Science, LSE Library.
    9. Yu, Jing & Nummi, Tapio & Pan, Jianxin, 2022. "Mixture regression for longitudinal data based on joint mean–covariance model," Journal of Multivariate Analysis, Elsevier, vol. 190(C).
    10. Kangning Wang & Lu Lin, 2019. "Robust and efficient estimator for simultaneous model structure identification and variable selection in generalized partial linear varying coefficient models with longitudinal data," Statistical Papers, Springer, vol. 60(5), pages 1649-1676, October.
    11. Shi, Jianhong & Bai, Xiuqin & Song, Weixing, 2022. "Tweedie-type formulae for a multivariate Laplace distribution," Statistics & Probability Letters, Elsevier, vol. 183(C).
    12. Weiping Zhang & Feiyue Xie & Jiaxin Tan, 2020. "A robust joint modeling approach for longitudinal data with informative dropouts," Computational Statistics, Springer, vol. 35(4), pages 1759-1783, December.
    13. Xueying Zheng & Wing Fung & Zhongyi Zhu, 2013. "Robust estimation in joint mean–covariance regression model for longitudinal data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 65(4), pages 617-638, August.
    14. Ziqi Chen & Man†Lai Tang & Wei Gao, 2018. "A profile likelihood approach for longitudinal data analysis," Biometrics, The International Biometric Society, vol. 74(1), pages 220-228, March.
    15. Zhang, Qiang & Ip, Edward H. & Pan, Junhao & Plemmons, Robert, 2017. "Individual-specific, sparse inverse covariance estimation in generalized estimating equations," Statistics & Probability Letters, Elsevier, vol. 122(C), pages 96-103.
    16. Jing Lv & Chaohui Guo, 2017. "Efficient parameter estimation via modified Cholesky decomposition for quantile regression with longitudinal data," Computational Statistics, Springer, vol. 32(3), pages 947-975, September.
    17. Wang, Kangning & Li, Shaomin & Sun, Xiaofei & Lin, Lu, 2019. "Modal regression statistical inference for longitudinal data semivarying coefficient models: Generalized estimating equations, empirical likelihood and variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 133(C), pages 257-276.
    18. Zhang, Yuexia & Qin, Guoyou & Zhu, Zhongyi & Xu, Wanghong, 2019. "A novel robust approach for analysis of longitudinal data," Computational Statistics & Data Analysis, Elsevier, vol. 138(C), pages 83-95.
    19. Lee, Keunbaik & Yoo, Jae Keun, 2014. "Bayesian Cholesky factor models in random effects covariance matrix for generalized linear mixed models," Computational Statistics & Data Analysis, Elsevier, vol. 80(C), pages 111-116.
    20. Jing Lv & Chaohui Guo & Jibo Wu, 2019. "Smoothed empirical likelihood inference via the modified Cholesky decomposition for quantile varying coefficient models with longitudinal data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(3), pages 999-1032, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:191:y:2022:i:c:s0047259x2200046x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.