IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v100y2009i10p2352-2363.html
   My bibliography  Save this article

Modeling covariance matrices via partial autocorrelations

Author

Listed:
  • Daniels, M.J.
  • Pourahmadi, M.

Abstract

We study the role of partial autocorrelations in the reparameterization and parsimonious modeling of a covariance matrix. The work is motivated by and tries to mimic the phenomenal success of the partial autocorrelations function (PACF) in model formulation, removing the positive-definiteness constraint on the autocorrelation function of a stationary time series and in reparameterizing the stationarity-invertibility domain of ARMA models. It turns out that once an order is fixed among the variables of a general random vector, then the above properties continue to hold and follow from establishing a one-to-one correspondence between a correlation matrix and its associated matrix of partial autocorrelations. Connections between the latter and the parameters of the modified Cholesky decomposition of a covariance matrix are discussed. Graphical tools similar to partial correlograms for model formulation and various priors based on the partial autocorrelations are proposed. We develop frequentist/Bayesian procedures for modelling correlation matrices, illustrate them using a real dataset, and explore their properties via simulations.

Suggested Citation

  • Daniels, M.J. & Pourahmadi, M., 2009. "Modeling covariance matrices via partial autocorrelations," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2352-2363, November.
    • Handle: RePEc:eee:jmvana:v:100:y:2009:i:10:p:2352-2363
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(09)00091-8
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. P. Damlen & J. Wakefield & S. Walker, 1999. "Gibbs sampling for Bayesian non‐conjugate and hierarchical models by using auxiliary variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(2), pages 331-344, April.
    2. Michael J. Daniels & Robert E. Kass, 2001. "Shrinkage Estimators for Covariance Matrices," Biometrics, The International Biometric Society, vol. 57(4), pages 1173-1184, December.
    3. Joe, Harry, 2006. "Generating random correlation matrices based on partial correlations," Journal of Multivariate Analysis, Elsevier, vol. 97(10), pages 2177-2189, November.
    4. Frederick Wong, 2003. "Efficient estimation of covariance selection models," Biometrika, Biometrika Trust, vol. 90(4), pages 809-830, December.
    5. Lu, Nelson & Zimmerman, Dale L., 2005. "The likelihood ratio test for a separable covariance matrix," Statistics & Probability Letters, Elsevier, vol. 73(4), pages 449-457, July.
    6. Michael G. Kenward, 1987. "A Method for Comparing Profiles of Repeated Measurements," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 36(3), pages 296-308, November.
    7. Michael Pitt & David Chan & Robert Kohn, 2006. "Efficient Bayesian inference for Gaussian copula regression models," Biometrika, Biometrika Trust, vol. 93(3), pages 537-554, September.
    8. Jianxin Pan, 2003. "On modelling mean-covariance structures in longitudinal studies," Biometrika, Biometrika Trust, vol. 90(1), pages 239-244, March.
    9. John C. Liechty, 2004. "Bayesian correlation estimation," Biometrika, Biometrika Trust, vol. 91(1), pages 1-14, March.
    10. Liu, Xuefeng & Daniels, Michael J. & Marcus, Bess, 2009. "Joint Models for the Association of Longitudinal Binary and Continuous Processes With Application to a Smoking Cessation Trial," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 429-438.
    11. Michael J. Daniels, 2002. "Bayesian analysis of covariance matrices and dynamic models for longitudinal data," Biometrika, Biometrika Trust, vol. 89(3), pages 553-566, August.
    12. Dégerine, Serge & Lambert-Lacroix, Sophie, 2003. "Characterization of the partial autocorrelation function of nonstationary time series," Journal of Multivariate Analysis, Elsevier, vol. 87(1), pages 46-59, October.
    13. Eaves, David & Chang, Ted, 1992. "Priors for ordered conditional variance and vector partial correlation," Journal of Multivariate Analysis, Elsevier, vol. 41(1), pages 43-55, April.
    14. Sanjay Chaudhuri & Mathias Drton & Thomas S. Richardson, 2007. "Estimation of a covariance matrix with zeros," Biometrika, Biometrika Trust, vol. 94(1), pages 199-216.
    15. Michael L. Stein & Zhiyi Chi & Leah J. Welty, 2004. "Approximating likelihoods for large spatial data sets," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(2), pages 275-296, May.
    16. Mohsen Pourahmadi, 2007. "Cholesky Decompositions and Estimation of A Covariance Matrix: Orthogonality of Variance--Correlation Parameters," Biometrika, Biometrika Trust, vol. 94(4), pages 1006-1013.
    17. M. C. Jones, 1987. "Randomly Choosing Parameters from the Stationarity and Invertibility Region of Autoregressive–Moving Average Models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 36(2), pages 134-138, June.
    18. Zhen Chen & David B. Dunson, 2003. "Random Effects Selection in Linear Mixed Models," Biometrics, The International Biometric Society, vol. 59(4), pages 762-769, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ng, Chi Tim & Joe, Harry, 2010. "Generating random AR(p) and MA(q) Toeplitz correlation matrices," Journal of Multivariate Analysis, Elsevier, vol. 101(6), pages 1532-1545, July.
    2. Peter J. Danaher & Michael S. Smith, 2011. "Rejoinder--Estimation Issues for Copulas Applied to Marketing Data," Marketing Science, INFORMS, vol. 30(1), pages 25-28, 01-02.
    3. Tommaso Proietti & Alessandro Giovannelli, 2018. "A Durbin–Levinson regularized estimator of high-dimensional autocovariance matrices," Biometrika, Biometrika Trust, vol. 105(4), pages 783-795.
    4. Davide Delle Monache & Ivan Petrella & Fabrizio Venditti, 2021. "Price Dividend Ratio and Long-Run Stock Returns: A Score-Driven State Space Model," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(4), pages 1054-1065, October.
    5. Michael S. Smith & Shaun P. Vahey, 2016. "Asymmetric Forecast Densities for U.S. Macroeconomic Variables from a Gaussian Copula Model of Cross-Sectional and Serial Dependence," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 416-434, July.
    6. Guney, Yesim & Arslan, Olcay & Yavuz, Fulya Gokalp, 2022. "Robust estimation in multivariate heteroscedastic regression models with autoregressive covariance structures using EM algorithm," Journal of Multivariate Analysis, Elsevier, vol. 191(C).
    7. Brown, Sarah & Ghosh, Pulak & Su, Li & Taylor, Karl, 2015. "Modelling household finances: A Bayesian approach to a multivariate two-part model," Journal of Empirical Finance, Elsevier, vol. 33(C), pages 190-207.
    8. Luigi Spezia, 2019. "Modelling covariance matrices by the trigonometric separation strategy with application to hidden Markov models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(2), pages 399-422, June.
    9. Smith, Michael Stanley, 2015. "Copula modelling of dependence in multivariate time series," International Journal of Forecasting, Elsevier, vol. 31(3), pages 815-833.
    10. repec:wrk:wrkemf:29 is not listed on IDEAS
    11. Hui Yao & Sungduk Kim & Ming-Hui Chen & Joseph G. Ibrahim & Arvind K. Shah & Jianxin Lin, 2015. "Bayesian Inference for Multivariate Meta-Regression With a Partially Observed Within-Study Sample Covariance Matrix," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(510), pages 528-544, June.
    12. Carter, Christopher K. & Wong, Frederick & Kohn, Robert, 2011. "Constructing priors based on model size for nondecomposable Gaussian graphical models: A simulation based approach," Journal of Multivariate Analysis, Elsevier, vol. 102(5), pages 871-883, May.
    13. Li Su & Sarah Brown & Pulak Ghosh & Karl Taylor, 2012. "Modelling Household Debt and Financial Assets: A Bayesian Approach to a Bivariate Two-Part Model," Working Papers 2012009, The University of Sheffield, Department of Economics.
    14. Wang, Y. & Daniels, M.J., 2013. "Bayesian modeling of the dependence in longitudinal data via partial autocorrelations and marginal variances," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 130-140.
    15. Lee, Keunbaik & Baek, Changryong & Daniels, Michael J., 2017. "ARMA Cholesky factor models for the covariance matrix of linear models," Computational Statistics & Data Analysis, Elsevier, vol. 115(C), pages 267-280.
    16. Daniel F. Schmidt & Enes Makalic, 2013. "Estimation of stationary autoregressive models with the Bayesian LASSO," Journal of Time Series Analysis, Wiley Blackwell, vol. 34(5), pages 517-531, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Y. & Daniels, M.J., 2013. "Bayesian modeling of the dependence in longitudinal data via partial autocorrelations and marginal variances," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 130-140.
    2. Bo Cai & David B. Dunson, 2006. "Bayesian Covariance Selection in Generalized Linear Mixed Models," Biometrics, The International Biometric Society, vol. 62(2), pages 446-457, June.
    3. Lam, Clifford, 2020. "High-dimensional covariance matrix estimation," LSE Research Online Documents on Economics 101667, London School of Economics and Political Science, LSE Library.
    4. Carter, Christopher K. & Wong, Frederick & Kohn, Robert, 2011. "Constructing priors based on model size for nondecomposable Gaussian graphical models: A simulation based approach," Journal of Multivariate Analysis, Elsevier, vol. 102(5), pages 871-883, May.
    5. Lee, Keunbaik & Baek, Changryong & Daniels, Michael J., 2017. "ARMA Cholesky factor models for the covariance matrix of linear models," Computational Statistics & Data Analysis, Elsevier, vol. 115(C), pages 267-280.
    6. Anindya Bhadra & Arvind Rao & Veerabhadran Baladandayuthapani, 2018. "Inferring network structure in non†normal and mixed discrete†continuous genomic data," Biometrics, The International Biometric Society, vol. 74(1), pages 185-195, March.
    7. Kohli, Priya & Garcia, Tanya P. & Pourahmadi, Mohsen, 2016. "Modeling the Cholesky factors of covariance matrices of multivariate longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 145(C), pages 87-100.
    8. Kim, Chulmin & Zimmerman, Dale L., 2012. "Unconstrained models for the covariance structure of multivariate longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 107(C), pages 104-118.
    9. Dengke Xu & Zhongzhan Zhang & Liucang Wu, 2014. "Bayesian analysis of joint mean and covariance models for longitudinal data," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(11), pages 2504-2514, November.
    10. Joseph G. Ibrahim & Hongtu Zhu & Ramon I. Garcia & Ruixin Guo, 2011. "Fixed and Random Effects Selection in Mixed Effects Models," Biometrics, The International Biometric Society, vol. 67(2), pages 495-503, June.
    11. Wang, Hao, 2010. "Sparse seemingly unrelated regression modelling: Applications in finance and econometrics," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2866-2877, November.
    12. Luigi Spezia, 2019. "Modelling covariance matrices by the trigonometric separation strategy with application to hidden Markov models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(2), pages 399-422, June.
    13. Manabu Asai & Michael McAleer & Jun Yu, 2006. "Multivariate Stochastic Volatility," Microeconomics Working Papers 22058, East Asian Bureau of Economic Research.
    14. Rabe Anasu & Shangodoyin D. K. & Thaga K., 2019. "Linear Cholesky Decomposition Of Covariance Matrices In Mixed Models With Correlated Random Effects," Statistics in Transition New Series, Statistics Poland, vol. 20(4), pages 59-70, December.
    15. Tsionas, Mike, 2012. "Simple techniques for likelihood analysis of univariate and multivariate stable distributions: with extensions to multivariate stochastic volatility and dynamic factor models," MPRA Paper 40966, University Library of Munich, Germany, revised 20 Aug 2012.
    16. Haydar Demirhan & Canan Hamurkaroglu, 2008. "Bayesian estimation of log odds ratios from R × C and 2 × 2 × K contingency tables," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 62(4), pages 405-424, November.
    17. Li, Erning & Pourahmadi, Mohsen, 2013. "An alternative REML estimation of covariance matrices in linear mixed models," Statistics & Probability Letters, Elsevier, vol. 83(4), pages 1071-1077.
    18. Mingan Yang & Min Wang & Guanghui Dong, 2020. "Bayesian variable selection for mixed effects model with shrinkage prior," Computational Statistics, Springer, vol. 35(1), pages 227-243, March.
    19. Demirhan, Haydar, 2013. "Bayesian estimation of order-restricted and unrestricted association models," Journal of Multivariate Analysis, Elsevier, vol. 121(C), pages 109-126.
    20. Anasu Rabe & D. K. Shangodoyin & K. Thaga, 2019. "Linear Cholesky Decomposition Of Covariance Matrices In Mixed Models With Correlated Random Effects," Statistics in Transition New Series, Polish Statistical Association, vol. 20(4), pages 59-70, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:100:y:2009:i:10:p:2352-2363. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.