IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v178y2020ics0047259x19301095.html
   My bibliography  Save this article

An objective prior for hyperparameters in normal hierarchical models

Author

Listed:
  • Berger, James O.
  • Sun, Dongchu
  • Song, Chengyuan

Abstract

Hierarchical models are the workhorse of much of Bayesian analysis, yet there is uncertainty as to which priors to use for hyperparameters. Formal approaches to objective Bayesian analysis, such as the Jeffreys-rule approach or reference prior approach, are only implementable in simple hierarchical settings. It is thus common to use less formal approaches, such as utilizing formal priors from non-hierarchical models in hierarchical settings. This can be fraught with danger, however. For instance, non-hierarchical Jeffreys-rule priors for variances or covariance matrices result in improper posterior distributions if they are used at higher levels of a hierarchical model. Berger et al. (2005) approached the question of choice of hyperpriors in normal hierarchical models by looking at the frequentist notion of admissibility of resulting estimators. Hyperpriors that are ‘on the boundary of admissibility’ are sensible choices for objective priors, being as diffuse as possible without resulting in inadmissible procedures. The admissibility (and propriety) properties of a number of priors were considered in the paper, but no overall conclusion was reached as to a specific prior. In this paper, we complete the story and propose a particular objective prior for use in all normal hierarchical models, based on considerations of admissibility, ease of implementation and performance.

Suggested Citation

  • Berger, James O. & Sun, Dongchu & Song, Chengyuan, 2020. "An objective prior for hyperparameters in normal hierarchical models," Journal of Multivariate Analysis, Elsevier, vol. 178(C).
  • Handle: RePEc:eee:jmvana:v:178:y:2020:i:c:s0047259x19301095
    DOI: 10.1016/j.jmva.2020.104606
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X19301095
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jmva.2020.104606?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. P. J. Everson & C. N. Morris, 2000. "Inference for multivariate normal hierarchical models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(2), pages 399-412.
    2. Michael J. Daniels & Robert E. Kass, 2001. "Shrinkage Estimators for Covariance Matrices," Biometrics, The International Biometric Society, vol. 57(4), pages 1173-1184, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marco Di Zio & Brunero Liseo & Maria Giovanna Ranalli, 2024. "Bayesian Ideas in Survey Sampling: The Legacy of Basu," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 86(1), pages 71-94, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hannart, Alexis & Naveau, Philippe, 2014. "Estimating high dimensional covariance matrices: A new look at the Gaussian conjugate framework," Journal of Multivariate Analysis, Elsevier, vol. 131(C), pages 149-162.
    2. D. Gunzler & W. Tang & N. Lu & P. Wu & X. Tu, 2014. "A Class of Distribution-Free Models for Longitudinal Mediation Analysis," Psychometrika, Springer;The Psychometric Society, vol. 79(4), pages 543-568, October.
    3. Konno, Yoshihiko, 2009. "Shrinkage estimators for large covariance matrices in multivariate real and complex normal distributions under an invariant quadratic loss," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2237-2253, November.
    4. G. Brooke Anderson & Keith W. Oleson & Bryan Jones & Roger D. Peng, 2018. "Classifying heatwaves: developing health-based models to predict high-mortality versus moderate United States heatwaves," Climatic Change, Springer, vol. 146(3), pages 439-453, February.
    5. Lam, Clifford, 2020. "High-dimensional covariance matrix estimation," LSE Research Online Documents on Economics 101667, London School of Economics and Political Science, LSE Library.
    6. Brett Naul & Bala Rajaratnam & Dario Vincenzi, 2016. "The role of the isotonizing algorithm in Stein’s covariance matrix estimator," Computational Statistics, Springer, vol. 31(4), pages 1453-1476, December.
    7. Matthew J. Heaton & Stephan R. Sain & Andrew J. Monaghan & Olga V. Wilhelmi & Mary H. Hayden, 2015. "An Analysis of an Incomplete Marked Point Pattern of Heat-Related 911 Calls," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 123-135, March.
    8. Hautsch, Nikolaus & Kyj, Lada M. & Malec, Peter, 2011. "The merit of high-frequency data in portfolio allocation," CFS Working Paper Series 2011/24, Center for Financial Studies (CFS).
    9. Daniels, Michael J., 2006. "Bayesian modeling of several covariance matrices and some results on propriety of the posterior for linear regression with correlated and/or heterogeneous errors," Journal of Multivariate Analysis, Elsevier, vol. 97(5), pages 1185-1207, May.
    10. Chi, Eric C. & Lange, Kenneth, 2014. "Stable estimation of a covariance matrix guided by nuclear norm penalties," Computational Statistics & Data Analysis, Elsevier, vol. 80(C), pages 117-128.
    11. Roger D. Peng & Francesca Dominici & Thomas A. Louis, 2006. "Model choice in time series studies of air pollution and mortality," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(2), pages 179-203, March.
    12. Bailey, Natalia & Pesaran, M. Hashem & Smith, L. Vanessa, 2019. "A multiple testing approach to the regularisation of large sample correlation matrices," Journal of Econometrics, Elsevier, vol. 208(2), pages 507-534.
    13. Ikeda, Yuki & Kubokawa, Tatsuya & Srivastava, Muni S., 2016. "Comparison of linear shrinkage estimators of a large covariance matrix in normal and non-normal distributions," Computational Statistics & Data Analysis, Elsevier, vol. 95(C), pages 95-108.
    14. Stanislav Anatolyev & Vladimir Pyrlik, 2021. "Shrinkage for Gaussian and t Copulas in Ultra-High Dimensions," CERGE-EI Working Papers wp699, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    15. Kwon, Yongchan & Choi, Young-Geun & Park, Taesung & Ziegler, Andreas & Paik, Myunghee Cho, 2017. "Generalized estimating equations with stabilized working correlation structure," Computational Statistics & Data Analysis, Elsevier, vol. 106(C), pages 1-11.
    16. repec:hum:wpaper:sfb649dp2011-059 is not listed on IDEAS
    17. Caicedo-Llano, Juliana & Dionysopoulos, Thomas, 2008. "Market integration: A risk-budgeting guide for pure alpha investors," Journal of Multinational Financial Management, Elsevier, vol. 18(4), pages 313-327, October.
    18. Hahn, Lukas, 2017. "Multi-year non-life insurance risk of dependent lines of business in the multivariate additive loss reserving model," Insurance: Mathematics and Economics, Elsevier, vol. 75(C), pages 71-81.
    19. Carel F. W. Peeters & Mark A. Wiel & Wessel N. Wieringen, 2020. "The spectral condition number plot for regularization parameter evaluation," Computational Statistics, Springer, vol. 35(2), pages 629-646, June.
    20. Andrew Gelman, 2004. "Prior distributions for variance parameters in hierarchical models," EERI Research Paper Series EERI_RP_2004_06, Economics and Econometrics Research Institute (EERI), Brussels.
    21. Daniels, M.J. & Pourahmadi, M., 2009. "Modeling covariance matrices via partial autocorrelations," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2352-2363, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:178:y:2020:i:c:s0047259x19301095. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.