IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v179y2020ics0047259x20302098.html
   My bibliography  Save this article

Consistent Bayesian sparsity selection for high-dimensional Gaussian DAG models with multiplicative and beta-mixture priors

Author

Listed:
  • Cao, Xuan
  • Khare, Kshitij
  • Ghosh, Malay

Abstract

Estimation of the covariance matrix for high-dimensional multivariate datasets is a challenging and important problem in modern statistics. In this paper, we focus on high-dimensional Gaussian DAG models where sparsity is induced on the Cholesky factor L of the inverse covariance matrix. In recent work, (Cao et al., 2019), we established high-dimensional sparsity selection consistency for a hierarchical Bayesian DAG model, where an Erdös–Renyi prior is placed on the sparsity pattern in the Cholesky factor L, and a DAG-Wishart prior is placed on the resulting non-zero Cholesky entries. In this paper we significantly improve and extend this work, by (a) considering more diverse and effective priors on the sparsity pattern in L, namely the beta-mixture prior and the multiplicative prior, and (b) establishing sparsity selection consistency under significantly relaxed conditions on p, and the sparsity pattern of the true model. We demonstrate the validity of our theoretical results via numerical simulations, and also use further simulations to demonstrate that our sparsity selection approach is competitive with existing state-of-the-art methods including both frequentist and Bayesian approaches in various settings.

Suggested Citation

  • Cao, Xuan & Khare, Kshitij & Ghosh, Malay, 2020. "Consistent Bayesian sparsity selection for high-dimensional Gaussian DAG models with multiplicative and beta-mixture priors," Journal of Multivariate Analysis, Elsevier, vol. 179(C).
  • Handle: RePEc:eee:jmvana:v:179:y:2020:i:c:s0047259x20302098
    DOI: 10.1016/j.jmva.2020.104628
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X20302098
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jmva.2020.104628?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Valen E. Johnson & David Rossell, 2012. "Bayesian Model Selection in High-Dimensional Settings," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 649-660, June.
    2. C. M. Carvalho & J. G. Scott, 2009. "Objective Bayesian model selection in Gaussian graphical models," Biometrika, Biometrika Trust, vol. 96(3), pages 497-512.
    3. Adam J. Rothman & Elizaveta Levina & Ji Zhu, 2010. "A new approach to Cholesky-based covariance regularization in high dimensions," Biometrika, Biometrika Trust, vol. 97(3), pages 539-550.
    4. Ali Shojaie & George Michailidis, 2010. "Penalized likelihood methods for estimation of sparse high-dimensional directed acyclic graphs," Biometrika, Biometrika Trust, vol. 97(3), pages 519-538.
    5. Banerjee, Sayantan & Ghosal, Subhashis, 2015. "Bayesian structure learning in graphical models," Journal of Multivariate Analysis, Elsevier, vol. 136(C), pages 147-162.
    6. Mohsen Pourahmadi, 2007. "Cholesky Decompositions and Estimation of A Covariance Matrix: Orthogonality of Variance--Correlation Parameters," Biometrika, Biometrika Trust, vol. 94(4), pages 1006-1013.
    7. Jianhua Z. Huang & Naiping Liu & Mohsen Pourahmadi & Linxu Liu, 2006. "Covariance matrix selection and estimation via penalised normal likelihood," Biometrika, Biometrika Trust, vol. 93(1), pages 85-98, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Hongmei & Huang, Xianzheng & Han, Shengtong & Rezwan, Faisal I. & Karmaus, Wilfried & Arshad, Hasan & Holloway, John W., 2021. "Gaussian Bayesian network comparisons with graph ordering unknown," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lam, Clifford, 2020. "High-dimensional covariance matrix estimation," LSE Research Online Documents on Economics 101667, London School of Economics and Political Science, LSE Library.
    2. Davide Altomare & Guido Consonni & Luca La Rocca, 2013. "Objective Bayesian Search of Gaussian Directed Acyclic Graphical Models for Ordered Variables with Non-Local Priors," Biometrics, The International Biometric Society, vol. 69(2), pages 478-487, June.
    3. Sung, Bongjung & Lee, Jaeyong, 2023. "Covariance structure estimation with Laplace approximation," Journal of Multivariate Analysis, Elsevier, vol. 198(C).
    4. Liang, Wanfeng & Wu, Yue & Ma, Xiaoyan, 2022. "Robust sparse precision matrix estimation for high-dimensional compositional data," Statistics & Probability Letters, Elsevier, vol. 184(C).
    5. Benjamin Poignard & Manabu Asai, 2023. "Estimation of high-dimensional vector autoregression via sparse precision matrix," The Econometrics Journal, Royal Economic Society, vol. 26(2), pages 307-326.
    6. Qiu, Yumou & Chen, Songxi, 2012. "Test for Bandedness of High Dimensional Covariance Matrices with Bandwidth Estimation," MPRA Paper 46242, University Library of Munich, Germany.
    7. Wang, Luheng & Chen, Zhao & Wang, Christina Dan & Li, Runze, 2020. "Ultrahigh dimensional precision matrix estimation via refitted cross validation," Journal of Econometrics, Elsevier, vol. 215(1), pages 118-130.
    8. Kang, Xiaoning & Wang, Mingqiu, 2021. "Ensemble sparse estimation of covariance structure for exploring genetic disease data," Computational Statistics & Data Analysis, Elsevier, vol. 159(C).
    9. Lopes, Hedibert F. & McCulloch, Robert E. & Tsay, Ruey S., 2022. "Parsimony inducing priors for large scale state–space models," Journal of Econometrics, Elsevier, vol. 230(1), pages 39-61.
    10. Guney, Yesim & Arslan, Olcay & Yavuz, Fulya Gokalp, 2022. "Robust estimation in multivariate heteroscedastic regression models with autoregressive covariance structures using EM algorithm," Journal of Multivariate Analysis, Elsevier, vol. 191(C).
    11. Daniel Felix Ahelegbey & Monica Billio & Roberto Casarin, 2016. "Sparse Graphical Vector Autoregression: A Bayesian Approach," Annals of Economics and Statistics, GENES, issue 123-124, pages 333-361.
    12. Yan Zhou & Peter X.‐K. Song & Xiaoquan Wen, 2021. "Structural factor equation models for causal network construction via directed acyclic mixed graphs," Biometrics, The International Biometric Society, vol. 77(2), pages 573-586, June.
    13. Fang, Qian & Yu, Chen & Weiping, Zhang, 2020. "Regularized estimation of precision matrix for high-dimensional multivariate longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 176(C).
    14. Fisher, Thomas J. & Sun, Xiaoqian, 2011. "Improved Stein-type shrinkage estimators for the high-dimensional multivariate normal covariance matrix," Computational Statistics & Data Analysis, Elsevier, vol. 55(5), pages 1909-1918, May.
    15. Yi, Feng & Zou, Hui, 2013. "SURE-tuned tapering estimation of large covariance matrices," Computational Statistics & Data Analysis, Elsevier, vol. 58(C), pages 339-351.
    16. Yumou Qiu & Song Xi Chen, 2015. "Bandwidth Selection for High-Dimensional Covariance Matrix Estimation," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(511), pages 1160-1174, September.
    17. Xue, Lingzhou & Zou, Hui, 2013. "Minimax optimal estimation of general bandable covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 45-51.
    18. Xingqi Du & Subhashis Ghosal, 2018. "Bayesian Discriminant Analysis Using a High Dimensional Predictor," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 80(1), pages 112-145, December.
    19. Chen, Songxi, 2012. "Two Sample Tests for High Dimensional Covariance Matrices," MPRA Paper 46026, University Library of Munich, Germany.
    20. Lee, Kyoungjae & Cao, Xuan, 2022. "Bayesian joint inference for multiple directed acyclic graphs," Journal of Multivariate Analysis, Elsevier, vol. 191(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:179:y:2020:i:c:s0047259x20302098. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.