IDEAS home Printed from https://ideas.repec.org/a/spr/testjl/v31y2022i1d10.1007_s11749-021-00778-8.html
   My bibliography  Save this article

Bayesian and frequentist evidence in one-sided hypothesis testing

Author

Listed:
  • Elías Moreno

    (University of Granada)

  • Carmen Martínez

    (University of Granada)

Abstract

In one-sided testing, Bayesians and frequentists differ on whether or not there is discrepancy between the inference based on the posterior model probability and that based on the p value. We add some arguments to this debate analyzing the discrepancy for moderate and large sample sizes. For small and moderate samples sizes, the discrepancy is measured by the probability of disagreement. Examples of the discrepancy on some basic sampling models indicate the somewhat unexpected result that the probability of disagreement is larger when sampling from models in the alternative hypothesis that are not located at the boundary of the hypotheses. For large sample sizes, we prove that the Bayesian one-sided testing is, under mild conditions, consistent, a property that is not shared by the frequentist procedure. Further, the rate of convergence is $$O(e^{nA})$$ O ( e nA ) , where A is a constant that depends on the model from which we are sampling. Consistency is also proved for an extension to multiple hypotheses.

Suggested Citation

  • Elías Moreno & Carmen Martínez, 2022. "Bayesian and frequentist evidence in one-sided hypothesis testing," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 31(1), pages 278-297, March.
    • Handle: RePEc:spr:testjl:v:31:y:2022:i:1:d:10.1007_s11749-021-00778-8
    DOI: 10.1007/s11749-021-00778-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11749-021-00778-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11749-021-00778-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. F. Javier Girón & M. Lina Martínez & Elías Moreno & Francisco Torres, 2006. "Objective Testing Procedures in Linear Models: Calibration of the p‐values," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 33(4), pages 765-784, December.
    2. Mulder, Joris, 2014. "Prior adjusted default Bayes factors for testing (in)equality constrained hypotheses," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 448-463.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido Consonni & Roberta Paroli, 2017. "Objective Bayesian Comparison of Constrained Analysis of Variance Models," Psychometrika, Springer;The Psychometric Society, vol. 82(3), pages 589-609, September.
    2. Jean-Paul Fox & Joris Mulder & Sandip Sinharay, 2017. "Bayes Factor Covariance Testing in Item Response Models," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 979-1006, December.
    3. Antonio Barrera & Patricia Román-Román & Juan José Serrano-Pérez & Francisco Torres-Ruiz, 2021. "Two Multi-Sigmoidal Diffusion Models for the Study of the Evolution of the COVID-19 Pandemic," Mathematics, MDPI, vol. 9(19), pages 1-29, September.
    4. Florian Böing-Messing & Joris Mulder, 2018. "Automatic Bayes Factors for Testing Equality- and Inequality-Constrained Hypotheses on Variances," Psychometrika, Springer;The Psychometric Society, vol. 83(3), pages 586-617, September.
    5. J. Cano & C. Carazo & D. Salmerón, 2013. "Bayesian model selection approach to the one way analysis of variance under homoscedasticity," Computational Statistics, Springer, vol. 28(3), pages 919-931, June.
    6. Rui Wang & Xingzhong Xu, 2021. "A Bayesian-motivated test for high-dimensional linear regression models with fixed design matrix," Statistical Papers, Springer, vol. 62(4), pages 1821-1852, August.
    7. Mulder, Joris & Leenders, Roger Th.A.J., 2019. "Modeling the evolution of interaction behavior in social networks: A dynamic relational event approach for real-time analysis," Chaos, Solitons & Fractals, Elsevier, vol. 119(C), pages 73-85.
    8. Sang Gil Kang & Woo Dong Lee & Yongku Kim, 2022. "Objective Bayesian group variable selection for linear model," Computational Statistics, Springer, vol. 37(3), pages 1287-1310, July.
    9. Cano, J.A. & Carazo, C. & Salmerón, D., 2016. "Linear contrasts for the one way analysis of variance: A Bayesian approach," Statistics & Probability Letters, Elsevier, vol. 109(C), pages 54-62.
    10. Pérez, María-Eglée & Pericchi, Luis Raúl, 2014. "Changing statistical significance with the amount of information: The adaptive α significance level," Statistics & Probability Letters, Elsevier, vol. 85(C), pages 20-24.
    11. Miguel A. Negrín & Francisco J. Vázquez-Polo & María Martel & Elías Moreno & Francisco J. Girón, 2010. "Bayesian Variable Selection in Cost-Effectiveness Analysis," IJERPH, MDPI, vol. 7(4), pages 1-20, April.
    12. Diego Salmeron & Juan Antonio Cano & Christian Robert, 2013. "Objective bayesian Hypothesis Testing in Binomial Regression Models with Integral Prior Distributions," Working Papers 2013-44, Center for Research in Economics and Statistics.
    13. Roberta Paroli & Guido Consonni, 2020. "Objective Bayesian comparison of order-constrained models in contingency tables," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 29(1), pages 139-165, March.
    14. T S Shively & S G Walker, 2018. "On Bayes factors for the linear model," Biometrika, Biometrika Trust, vol. 105(3), pages 739-744.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:testjl:v:31:y:2022:i:1:d:10.1007_s11749-021-00778-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.