IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v52y2008i7p3543-3559.html
   My bibliography  Save this article

Bayesian significance testing and multiple comparisons from MCMC outputs

Author

Listed:
  • Hoshino, Takahiro

Abstract

This article proposes a Bayesian method to directly evaluate and test hypotheses in multiple comparisons. Transformation and integration over the coordinates relevant to the hypothesis are shown to enable us to directly test the hypotheses expressed as a linear equation of a parameter vector, given a linear constraint. When the conditional posterior distribution of the parameter vector we are interested in is the multivariate normal distribution, the proposed method can be applied to calculate the p-value of hypotheses pertaining to the parameters in any complex model such as generalized linear mixed effect models with latent variables, by using outputs from Markov chain Monte Carlo (MCMC) methods. Further, the proposed testing can be implemented without prior information. Some applications are presented, and the simulation results are provided to compare the powers of this method with those of other methods of conventional multiple comparisons. Simulation studies have shown that the proposed method is valid for multiple comparisons under nonequivalent variances and mean comparisons in latent variable modeling with categorical variables.

Suggested Citation

  • Hoshino, Takahiro, 2008. "Bayesian significance testing and multiple comparisons from MCMC outputs," Computational Statistics & Data Analysis, Elsevier, vol. 52(7), pages 3543-3559, March.
    • Handle: RePEc:eee:csdana:v:52:y:2008:i:7:p:3543-3559
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-9473(07)00444-6
    Download Restriction: Full text for ScienceDirect subscribers only.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Andrews, Donald W K, 1994. "The Large Sample Correspondence between Classical Hypothesis Tests and Bayesian Posterior Odds Tests," Econometrica, Econometric Society, vol. 62(5), pages 1207-1232, September.
    2. Schotman, Peter & van Dijk, Herman K., 1991. "A Bayesian analysis of the unit root in real exchange rates," Journal of Econometrics, Elsevier, vol. 49(1-2), pages 195-238.
    3. Hogan J.W. & Tchernis R., 2004. "Bayesian Factor Analysis for Spatially Correlated Data, With Application to Summarizing Area-Level Material Deprivation From Census Data," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 314-324, January.
    4. P. Bentler, 1983. "Some contributions to efficient statistics in structural models: Specification and estimation of moment structures," Psychometrika, Springer;The Psychometric Society, vol. 48(4), pages 493-517, December.
    5. Hoshino, Takahiro, 2008. "A Bayesian propensity score adjustment for latent variable modeling and MCMC algorithm," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1413-1429, January.
    6. William Meredith, 1993. "Measurement invariance, factor analysis and factorial invariance," Psychometrika, Springer;The Psychometric Society, vol. 58(4), pages 525-543, December.
    7. Mary Dupuis Sammel & Louise M. Ryan & Julie M. Legler, 1997. "Latent Variable Models for Mixed Discrete and Continuous Outcomes," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 59(3), pages 667-678.
    8. K. Jöreskog, 1971. "Simultaneous factor analysis in several populations," Psychometrika, Springer;The Psychometric Society, vol. 36(4), pages 409-426, December.
    9. Welsch, Roy E., 1977. "Tables for stepwise multiple comparison procedures," Working papers 949-77., Massachusetts Institute of Technology (MIT), Sloan School of Management.
    10. D. B. Dunson, 2000. "Bayesian latent variable models for clustered mixed outcomes," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(2), pages 355-366.
    11. Takahiro Hoshino & Hiroshi Kurata & Kazuo Shigemasu, 2006. "A Propensity Score Adjustment for Multiple Group Structural Equation Modeling," Psychometrika, Springer;The Psychometric Society, vol. 71(4), pages 691-712, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marín, J.M. & Rodríguez-Bernal, M.T., 2012. "Multiple hypothesis testing and clustering with mixtures of non-central t-distributions applied in microarray data analysis," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 1898-1907.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hoshino, Takahiro, 2008. "A Bayesian propensity score adjustment for latent variable modeling and MCMC algorithm," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1413-1429, January.
    2. Takahiro Hoshino & Hiroshi Kurata & Kazuo Shigemasu, 2006. "A Propensity Score Adjustment for Multiple Group Structural Equation Modeling," Psychometrika, Springer;The Psychometric Society, vol. 71(4), pages 691-712, December.
    3. Takahiro Hoshino, 2007. "Doubly Robust-Type Estimation for Covariate Adjustment in Latent Variable Modeling," Psychometrika, Springer;The Psychometric Society, vol. 72(4), pages 535-549, December.
    4. Yang Lu, 2019. "Flexible (panel) regression models for bivariate count–continuous data with an insurance application," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 182(4), pages 1503-1521, October.
    5. Zhenzhen Zhang & Thomas M. Braun & Karen E. Peterson & Howard Hu & Martha M. Téllez-Rojo & Brisa N. Sánchez, 2018. "Extending Tests of Random Effects to Assess for Measurement Invariance in Factor Models," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 10(3), pages 634-650, December.
    6. Luo, Chongliang & Liang, Jian & Li, Gen & Wang, Fei & Zhang, Changshui & Dey, Dipak K. & Chen, Kun, 2018. "Leveraging mixed and incomplete outcomes via reduced-rank modeling," Journal of Multivariate Analysis, Elsevier, vol. 167(C), pages 378-394.
    7. Leila Amiri & Mojtaba Khazaei & Mojtaba Ganjali, 2018. "A mixture latent variable model for modeling mixed data in heterogeneous populations and its applications," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(1), pages 95-115, January.
    8. Zhang, Xiao & Boscardin, W. John & Belin, Thomas R. & Wan, Xiaohai & He, Yulei & Zhang, Kui, 2015. "A Bayesian method for analyzing combinations of continuous, ordinal, and nominal categorical data with missing values," Journal of Multivariate Analysis, Elsevier, vol. 135(C), pages 43-58.
    9. Adam Carle, 2010. "Interpreting the results of studies using latent variable models to assess data quality: an empirical example using confirmatory factor analysis," Quality & Quantity: International Journal of Methodology, Springer, vol. 44(3), pages 483-497, April.
    10. Takahiro Hoshino & Ryosuke Igari, 2017. "Quasi-Bayesian Inference for Latent Variable Models with External Information: Application to generalized linear mixed models for biased data," Keio-IES Discussion Paper Series 2017-014, Institute for Economics Studies, Keio University.
    11. Holger Steinmetz & Peter Schmidt & Andrea Tina-Booh & Siegrid Wieczorek & Shalom Schwartz, 2009. "Testing measurement invariance using multigroup CFA: differences between educational groups in human values measurement," Quality & Quantity: International Journal of Methodology, Springer, vol. 43(4), pages 599-616, July.
    12. Kei Miyazaki & Takahiro Hoshino & Shin-ichi Mayekawa & Kazuo Shigemasu, 2009. "A New Concurrent Calibration Method for Nonequivalent Group Design under Nonrandom Assignment," Psychometrika, Springer;The Psychometric Society, vol. 74(1), pages 1-19, March.
    13. Hao Sun & Emily Berg & Zhengyuan Zhu, 2022. "Bivariate small‐area estimation for binary and gaussian variables based on a conditionally specified model," Biometrics, The International Biometric Society, vol. 78(4), pages 1555-1565, December.
    14. Pilar Rivera & Albert Satorra, 2000. "Country effects in ISSP-1993 environmental data: Comparison of SEM approaches," Economics Working Papers 458, Department of Economics and Business, Universitat Pompeu Fabra.
    15. Hao Bai & Yuan Zhong & Xin Gao & Wei Xu, 2020. "Multivariate Mixed Response Model with Pairwise Composite-Likelihood Method," Stats, MDPI, vol. 3(3), pages 1-18, July.
    16. Martin Spieß, 2006. "On the Returns to Occupational Qualification in Terms of Subjective and Objective Variables: A GEE-type Approach to the Estimation of Two-Equation Panel Models," Discussion Papers of DIW Berlin 564, DIW Berlin, German Institute for Economic Research.
    17. Scholderer, Joachim & Grunert, Klaus G. & Brunso, Karen, 2005. "A procedure for eliminating additive bias from cross-cultural survey data," Journal of Business Research, Elsevier, vol. 58(1), pages 72-78, January.
    18. Eldad Davidov & Felix Depner, 2011. "Testing for measurement equivalence of human values across online and paper-and-pencil surveys," Quality & Quantity: International Journal of Methodology, Springer, vol. 45(2), pages 375-390, February.
    19. Frewer, Lynn & Scholderer, Joachim & Downs, Clive & Bredahl, Lone, 2000. "Communicating about the risks and benefits of genetically modified foods. Effects of different information strategies," MAPP Working Papers 71, University of Aarhus, Aarhus School of Business, The MAPP Centre.
    20. Bengt Muthén, 1989. "Latent variable modeling in heterogeneous populations," Psychometrika, Springer;The Psychometric Society, vol. 54(4), pages 557-585, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:52:y:2008:i:7:p:3543-3559. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.