IDEAS home Printed from https://ideas.repec.org/p/wpa/wuwpem/0404001.html
   My bibliography  Save this paper

Prior distributions for variance parameters in hierarchical models

Author

Listed:
  • Andrew Gelman

    (Department of Statistics, Columbia University)

Abstract

Various noninformative prior distributions have been suggested for scale parameters in hierarchical models. We construct a new folded-noncentral- t family of conditionally conjugate priors for hierarchical standard deviation parameters, and then consider noninformative and weakly informative priors in this family. We use an example to illustrate serious problems with the inverse-gamma family of ``noninformative'' prior distributions. We suggest instead to use a uniform prior on the hierarchical standard deviation, using the half-t family when the number of groups is small and in other settings where a weakly informative prior is desired.

Suggested Citation

  • Andrew Gelman, 2004. "Prior distributions for variance parameters in hierarchical models," Econometrics 0404001, University Library of Munich, Germany.
    • Handle: RePEc:wpa:wuwpem:0404001
    Note: Type of Document - pdf; pages: 13
    as

    Download full text from publisher

    File URL: https://econwpa.ub.uni-muenchen.de/econ-wp/em/papers/0404/0404001.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gelman A., 2004. "Parameterization and Bayesian Modeling," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 537-545, January.
    2. Michael J. Daniels & Robert E. Kass, 2001. "Shrinkage Estimators for Covariance Matrices," Biometrics, The International Biometric Society, vol. 57(4), pages 1173-1184, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cabrini, Silvina M. & Irwin, Scott H. & Good, Darrel L., 2005. "Efficient Portfolios of Market Advisory Services: An Application of Shrinkage Estimators," 2005 Annual meeting, July 24-27, Providence, RI 19469, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    2. repec:jss:jstsof:14:i05 is not listed on IDEAS
    3. Di Zhang & Qiang Niu & Youzhou Zhou, 2022. "Modeling Randomly Walking Volatility with Chained Gamma Distributions," Papers 2207.01151, arXiv.org, revised Oct 2022.
    4. Junming Li & Xiulan Han & Xiao Li & Jianping Yang & Xuejiao Li, 2018. "Spatiotemporal Patterns of Ground Monitored PM 2.5 Concentrations in China in Recent Years," IJERPH, MDPI, vol. 15(1), pages 1-15, January.
    5. Crainiceanu, Ciprian M. & Ruppert, David & Wand, Matthew P., 2005. "Bayesian Analysis for Penalized Spline Regression Using WinBUGS," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 14(i14).
    6. Ciprian Crainiceanu & David Ruppert & Raymond Carroll, 2004. "Spatially Adaptive Bayesian P-Splines with Heteroscedastic Errors," Johns Hopkins University Dept. of Biostatistics Working Paper Series 1061, Berkeley Electronic Press.
    7. repec:jss:jstsof:14:i14 is not listed on IDEAS

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrew Gelman, 2004. "Prior distributions for variance parameters in hierarchical models," EERI Research Paper Series EERI_RP_2004_06, Economics and Econometrics Research Institute (EERI), Brussels.
    2. Hannart, Alexis & Naveau, Philippe, 2014. "Estimating high dimensional covariance matrices: A new look at the Gaussian conjugate framework," Journal of Multivariate Analysis, Elsevier, vol. 131(C), pages 149-162.
    3. D. Gunzler & W. Tang & N. Lu & P. Wu & X. Tu, 2014. "A Class of Distribution-Free Models for Longitudinal Mediation Analysis," Psychometrika, Springer;The Psychometric Society, vol. 79(4), pages 543-568, October.
    4. Olawale Awe O. & Adedayo Adepoju A., 2018. "Modified Recursive Bayesian Algorithm For Estimating Time-Varying Parameters In Dynamic Linear Models," Statistics in Transition New Series, Statistics Poland, vol. 19(2), pages 258-293, June.
    5. Miao-Yu Tsai & Chuhsing Hsiao, 2008. "Computation of reference Bayesian inference for variance components in longitudinal studies," Computational Statistics, Springer, vol. 23(4), pages 587-604, October.
    6. Leonardo Oliveira Martins & Hirohisa Kishino, 2010. "Distribution of distances between topologies and its effect on detection of phylogenetic recombination," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 62(1), pages 145-159, February.
    7. Vaughn Gambeta & Roy Kwon, 2020. "Risk Return Trade-Off in Relaxed Risk Parity Portfolio Optimization," JRFM, MDPI, vol. 13(10), pages 1-28, October.
    8. Konno, Yoshihiko, 2009. "Shrinkage estimators for large covariance matrices in multivariate real and complex normal distributions under an invariant quadratic loss," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2237-2253, November.
    9. Matthew Carli & Mary H. Ward & Catherine Metayer & David C. Wheeler, 2022. "Imputation of Below Detection Limit Missing Data in Chemical Mixture Analysis with Bayesian Group Index Regression," IJERPH, MDPI, vol. 19(3), pages 1-17, January.
    10. Joseph G. Ibrahim & Hongtu Zhu & Ramon I. Garcia & Ruixin Guo, 2011. "Fixed and Random Effects Selection in Mixed Effects Models," Biometrics, The International Biometric Society, vol. 67(2), pages 495-503, June.
    11. Tatsuya Kubokawa & Muni S. Srivastava, 2013. "Optimal Ridge-type Estimators of Covariance Matrix in High Dimension," CIRJE F-Series CIRJE-F-906, CIRJE, Faculty of Economics, University of Tokyo.
    12. Qian, Song S., 2012. "On model coefficient estimation using Markov chain Monte Carlo simulations: A potential problem and the solution," Ecological Modelling, Elsevier, vol. 247(C), pages 302-306.
    13. Champion, Colin J., 2003. "Empirical Bayesian estimation of normal variances and covariances," Journal of Multivariate Analysis, Elsevier, vol. 87(1), pages 60-79, October.
    14. Breitwieser, Anja & Wick, Katharina, 2016. "What We Miss By Missing Data: Aid Effectiveness Revisited," World Development, Elsevier, vol. 78(C), pages 554-571.
    15. Lam, Clifford, 2020. "High-dimensional covariance matrix estimation," LSE Research Online Documents on Economics 101667, London School of Economics and Political Science, LSE Library.
    16. Brett Naul & Bala Rajaratnam & Dario Vincenzi, 2016. "The role of the isotonizing algorithm in Stein’s covariance matrix estimator," Computational Statistics, Springer, vol. 31(4), pages 1453-1476, December.
    17. Berger, James O. & Sun, Dongchu & Song, Chengyuan, 2020. "An objective prior for hyperparameters in normal hierarchical models," Journal of Multivariate Analysis, Elsevier, vol. 178(C).
    18. Mingyuan Chen & Dakshina De Silva & Aurelie Slechten, 2021. "Director appointments, boardroom networks, and firm environmental performance," Working Papers 332157256, Lancaster University Management School, Economics Department.
    19. Matthew J. Heaton & Stephan R. Sain & Andrew J. Monaghan & Olga V. Wilhelmi & Mary H. Hayden, 2015. "An Analysis of an Incomplete Marked Point Pattern of Heat-Related 911 Calls," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 123-135, March.
    20. O. Olawale Awe & A. Adedayo Adepoju, 2018. "Modified Recursive Bayesian Algorithm For Estimating Time-Varying Parameters In Dynamic Linear Models," Statistics in Transition New Series, Polish Statistical Association, vol. 19(2), pages 239-258, June.

    More about this item

    Keywords

    Bayesian inference; conditional conjugacy; folded noncentral-t distribution; half-t distribution; hierarchical model; multilevel model; noninformative prior distribution; weakly informative prior distribution;
    All these keywords.

    JEL classification:

    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • C2 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables
    • C3 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables
    • C4 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics
    • C5 - Mathematical and Quantitative Methods - - Econometric Modeling
    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wpa:wuwpem:0404001. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: EconWPA (email available below). General contact details of provider: https://econwpa.ub.uni-muenchen.de .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.