IDEAS home Printed from https://ideas.repec.org/a/bla/anzsta/v62y2020i4p444-466.html
   My bibliography  Save this article

A loss‐based prior for Gaussian graphical models

Author

Listed:
  • Laurenţiu Cătălin Hinoveanu
  • Fabrizio Leisen
  • Cristiano Villa

Abstract

Gaussian graphical models play an important role in various areas such as genetics, finance, statistical physics and others. They are a powerful modelling tool, which allows one to describe the relationships among the variables of interest. From the Bayesian perspective, there are two sources of randomness: one is related to the multivariate distribution and the quantities that may parametrise the model, and the other has to do with the underlying graph, G, equivalent to describing the conditional independence structure of the model under consideration. In this paper, we propose a prior on G based on two loss components. One considers the loss in information one would incur in selecting the wrong graph, while the second penalises for large number of edges, favouring sparsity. We illustrate the prior on simulated data and on real datasets, and compare the results with other priors on G used in the literature. Moreover, we present a default choice of the prior as well as discuss how it can be calibrated so as to reflect available prior information.

Suggested Citation

  • Laurenţiu Cătălin Hinoveanu & Fabrizio Leisen & Cristiano Villa, 2020. "A loss‐based prior for Gaussian graphical models," Australian & New Zealand Journal of Statistics, Australian Statistical Publishing Association Inc., vol. 62(4), pages 444-466, December.
    • Handle: RePEc:bla:anzsta:v:62:y:2020:i:4:p:444-466
    DOI: 10.1111/anzs.12307
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/anzs.12307
    Download Restriction: no
    File URL: https://libkey.io/10.1111/anzs.12307?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hinoveanu, Laurentiu C. & Leisen, Fabrizio & Villa, Cristiano, 2019. "Bayesian loss-based approach to change point analysis," Computational Statistics & Data Analysis, Elsevier, vol. 129(C), pages 61-78.
    2. Guido Consonni & Luca La Rocca & Stefano Peluso, 2017. "Objective Bayes Covariate-Adjusted Sparse Graphical Model Selection," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 44(3), pages 741-764, September.
    3. Ting Wang & Zhao Ren & Ying Ding & Zhou Fang & Zhe Sun & Matthew L MacDonald & Robert A Sweet & Jieru Wang & Wei Chen, 2016. "FastGGM: An Efficient Algorithm for the Inference of Gaussian Graphical Model in Biological Networks," PLOS Computational Biology, Public Library of Science, vol. 12(2), pages 1-16, February.
    4. Aliye Atay-Kayis & Helène Massam, 2005. "A Monte Carlo method for computing the marginal likelihood in nondecomposable Gaussian graphical models," Biometrika, Biometrika Trust, vol. 92(2), pages 317-335, June.
    5. Abdolreza Mohammadi & Fentaw Abegaz & Edwin Heuvel & Ernst C. Wit, 2017. "Bayesian modelling of Dupuytren disease by using Gaussian copula graphical models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(3), pages 629-645, April.
    6. Cristiano Villa & Stephen Walker, 2015. "An Objective Bayesian Criterion to Determine Model Prior Probabilities," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(4), pages 947-966, December.
    7. C. M. Carvalho & J. G. Scott, 2009. "Objective Bayesian model selection in Gaussian graphical models," Biometrika, Biometrika Trust, vol. 96(3), pages 497-512.
    8. P. Giudici & A. Spelta, 2016. "Graphical Network Models for International Financial Flows," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(1), pages 128-138, January.
    9. Ming Yuan & Yi Lin, 2007. "Model selection and estimation in the Gaussian graphical model," Biometrika, Biometrika Trust, vol. 94(1), pages 19-35.
    10. Dobra, Adrian & Hans, Chris & Jones, Beatrix & Nevins, J.R.Joseph R. & Yao, Guang & West, Mike, 2004. "Sparse graphical models for exploring gene expression data," Journal of Multivariate Analysis, Elsevier, vol. 90(1), pages 196-212, July.
    11. Jacob Bien & Robert J. Tibshirani, 2011. "Sparse estimation of a covariance matrix," Biometrika, Biometrika Trust, vol. 98(4), pages 807-820.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nikolaos Petrakis & Stefano Peluso & Dimitris Fouskakis & Guido Consonni, 2020. "Objective methods for graphical structural learning," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 74(3), pages 420-438, August.
    2. Daniel Felix Ahelegbey & Luis Carvalho & Eric D. Kolaczyk, 2020. "A Bayesian Covariance Graph And Latent Position Model For Multivariate Financial Time Series," DEM Working Papers Series 181, University of Pavia, Department of Economics and Management.
    3. Banerjee, Sayantan & Ghosal, Subhashis, 2015. "Bayesian structure learning in graphical models," Journal of Multivariate Analysis, Elsevier, vol. 136(C), pages 147-162.
    4. Yang Ni & Veerabhadran Baladandayuthapani & Marina Vannucci & Francesco C. Stingo, 2022. "Bayesian graphical models for modern biological applications," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(2), pages 197-225, June.
    5. Sung, Bongjung & Lee, Jaeyong, 2023. "Covariance structure estimation with Laplace approximation," Journal of Multivariate Analysis, Elsevier, vol. 198(C).
    6. Giraud Christophe & Huet Sylvie & Verzelen Nicolas, 2012. "Graph Selection with GGMselect," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 11(3), pages 1-52, February.
    7. Paci, Lucia & Consonni, Guido, 2020. "Structural learning of contemporaneous dependencies in graphical VAR models," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    8. Benjamin Poignard & Manabu Asai, 2023. "Estimation of high-dimensional vector autoregression via sparse precision matrix," The Econometrics Journal, Royal Economic Society, vol. 26(2), pages 307-326.
    9. Byol Kim & Song Liu & Mladen Kolar, 2021. "Two‐sample inference for high‐dimensional Markov networks," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(5), pages 939-962, November.
    10. Wang, Hao, 2010. "Sparse seemingly unrelated regression modelling: Applications in finance and econometrics," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2866-2877, November.
    11. Kang, Xiaoning & Kang, Lulu & Chen, Wei & Deng, Xinwei, 2022. "A generative approach to modeling data with quantitative and qualitative responses," Journal of Multivariate Analysis, Elsevier, vol. 190(C).
    12. Dan J. Spitzner, 2023. "Calibrated Bayes factors under flexible priors," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(3), pages 733-767, September.
    13. Bailey, Natalia & Pesaran, M. Hashem & Smith, L. Vanessa, 2019. "A multiple testing approach to the regularisation of large sample correlation matrices," Journal of Econometrics, Elsevier, vol. 208(2), pages 507-534.
    14. Christine Peterson & Francesco C. Stingo & Marina Vannucci, 2015. "Bayesian Inference of Multiple Gaussian Graphical Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 159-174, March.
    15. Lam, Clifford, 2020. "High-dimensional covariance matrix estimation," LSE Research Online Documents on Economics 101667, London School of Economics and Political Science, LSE Library.
    16. Khai X. Chiong & Hyungsik Roger Moon, 2017. "Estimation of Graphical Models using the $L_{1,2}$ Norm," Papers 1709.10038, arXiv.org, revised Oct 2017.
    17. Chun, Hyonho & Lee, Myung Hee & Fleet, James C. & Oh, Ji Hwan, 2016. "Graphical models via joint quantile regression with component selection," Journal of Multivariate Analysis, Elsevier, vol. 152(C), pages 162-171.
    18. Lin Zhang & Andrew DiLernia & Karina Quevedo & Jazmin Camchong & Kelvin Lim & Wei Pan, 2021. "A random covariance model for bi‐level graphical modeling with application to resting‐state fMRI data," Biometrics, The International Biometric Society, vol. 77(4), pages 1385-1396, December.
    19. Bo Zhou & David E. Moorman & Sam Behseta & Hernando Ombao & Babak Shahbaba, 2016. "A Dynamic Bayesian Model for Characterizing Cross-Neuronal Interactions During Decision-Making," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(514), pages 459-471, April.
    20. Azam Kheyri & Andriette Bekker & Mohammad Arashi, 2022. "High-Dimensional Precision Matrix Estimation through GSOS with Application in the Foreign Exchange Market," Mathematics, MDPI, vol. 10(22), pages 1-19, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:anzsta:v:62:y:2020:i:4:p:444-466. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=1369-1473 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.