IDEAS home Printed from https://ideas.repec.org/a/spr/aistmt/v73y2021i2d10.1007_s10463-020-00747-2.html
   My bibliography  Save this article

Valid p-values and expectations of p-values revisited

Author

Listed:
  • Albert Vexler

    (The State University of New York at Buffalo)

Abstract

We focus on valid definitions of p-values. A valid p-value (VpV) statistic can be used to make a prefixed level- $$ \alpha $$ α decision. In this context, Kolmogorov–Smirnov goodness-of-fit tests and the normal two-sample problem are considered. We examine an issue regarding the goodness-of-fit testability based on a single observation. We exemplify constructions of new test procedures, advocating practical reasons to implement VpV mechanisms. The VpV framework induces an extension of the conventional expected p-value (EPV) tool for measuring the performance of a test. Associating the EPV concept with the receiver operating characteristic (ROC) curve methodology, a well-established biostatistical approach, we propose a Youden’s index-based optimality to derive critical values of tests. In these terms, the significance level $$ \alpha = 0.05 $$ α = 0.05 is suggested. We introduce partial EPV’s to characterize properties of tests including their unbiasedness. We provide the intrinsic relationship between the Bayes Factor (BF) test statistic and the BF of test statistics.

Suggested Citation

  • Albert Vexler, 2021. "Valid p-values and expectations of p-values revisited," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(2), pages 227-248, April.
    • Handle: RePEc:spr:aistmt:v:73:y:2021:i:2:d:10.1007_s10463-020-00747-2
    DOI: 10.1007/s10463-020-00747-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10463-020-00747-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10463-020-00747-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Norbert Henze & Simos G. Meintanis, 2005. "Recent and classical tests for exponentiality: a partial review with comparisons," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 61(1), pages 29-45, February.
    2. Marsaglia, George & Tsang, Wai Wan & Wang, Jingbo, 2003. "Evaluating Kolmogorov's Distribution," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 8(i18).
    3. Stephen Portnoy, 2019. "Invariance, Optimality, and a 1-Observation Confidence Interval for a Normal Mean," The American Statistician, Taylor & Francis Journals, vol. 73(1), pages 10-15, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Warne, Anders, 2023. "DSGE model forecasting: rational expectations vs. adaptive learning," Working Paper Series 2768, European Central Bank.
    2. Fernández de Marcos Giménez de los Galanes, Alberto, 2022. "Data-driven stabilizations of goodness-of-fit tests," DES - Working Papers. Statistics and Econometrics. WS 35324, Universidad Carlos III de Madrid. Departamento de Estadística.
    3. Sloot Henrik, 2022. "Implementing Markovian models for extendible Marshall–Olkin distributions," Dependence Modeling, De Gruyter, vol. 10(1), pages 308-343, January.
    4. Tatjana Miljkovic & Saleem Shaik & Dragan Miljkovic, 2017. "Redefining standards for body mass index of the US population based on BRFSS data using mixtures," Journal of Applied Statistics, Taylor & Francis Journals, vol. 44(2), pages 197-211, January.
    5. Jovanović, Milan & Milošević, Bojana & Nikitin, Ya. Yu. & Obradović, Marko & Volkova, K. Yu., 2015. "Tests of exponentiality based on Arnold–Villasenor characterization and their efficiencies," Computational Statistics & Data Analysis, Elsevier, vol. 90(C), pages 100-113.
    6. Jos'e Miguel Flores-Contr'o, 2024. "The Gerber-Shiu Expected Discounted Penalty Function: An Application to Poverty Trapping," Papers 2402.11715, arXiv.org, revised Sep 2024.
    7. Steland, Ansgar, 2020. "Testing and estimating change-points in the covariance matrix of a high-dimensional time series," Journal of Multivariate Analysis, Elsevier, vol. 177(C).
    8. Sudheesh K. Kattumannil & P. Anisha, 2019. "A simple non-parametric test for decreasing mean time to failure," Statistical Papers, Springer, vol. 60(1), pages 73-87, February.
    9. Enrique Garcia Tejeda, 2022. "La concentracion espacial de los reportes de disparos al 911 en la Ciudad de Mexico: ¿Comportamiento racional en el uso de armas durante la pandemia Covid-19?," Sobre México. Revista de Economía, Sobre México. Temas en economía, vol. 3(5), pages 69-93.
    10. Carvalho, Luis, 2015. "An Improved Evaluation of Kolmogorovs Distribution," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 65(c03).
    11. Guillaume Coqueret, 2016. "Empirical properties of a heterogeneous agent model in large dimensions," Post-Print hal-02088097, HAL.
    12. Hui Xuan Tan & Ephrance Abu Ujum & Kwai Fatt Choong & Kuru Ratnavelu, 2015. "Impact analysis of domestic and international research collaborations: a Malaysian case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 885-904, January.
    13. Baringhaus, L. & Henze, N., 2008. "A new weighted integral goodness-of-fit statistic for exponentiality," Statistics & Probability Letters, Elsevier, vol. 78(8), pages 1006-1016, June.
    14. Fernández-de-Marcos, Alberto & García-Portugués, Eduardo, 2023. "Data-driven stabilizations of goodness-of-fit tests," Computational Statistics & Data Analysis, Elsevier, vol. 179(C).
    15. Ruhul Ali Khan & Dhrubasish Bhattacharyya & Murari Mitra, 2021. "Exact and asymptotic tests of exponentiality against nonmonotonic mean time to failure type alternatives," Statistical Papers, Springer, vol. 62(6), pages 3015-3045, December.
    16. Vladimir Klimchenko & Andrei Torgashov & Yuri A. W. Shardt & Fan Yang, 2021. "Multi-Output Soft Sensor with a Multivariate Filter That Predicts Errors Applied to an Industrial Reactive Distillation Process," Mathematics, MDPI, vol. 9(16), pages 1-14, August.
    17. Steven E. Pav, 2014. "Bounds on Portfolio Quality," Papers 1409.5936, arXiv.org.
    18. Ghosh, Sayantan & Manimaran, P. & Panigrahi, Prasanta K., 2011. "Characterizing multi-scale self-similar behavior and non-statistical properties of fluctuations in financial time series," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 390(23), pages 4304-4316.
    19. Bojana Milošević & Marko Obradović, 2016. "New class of exponentiality tests based on U-empirical Laplace transform," Statistical Papers, Springer, vol. 57(4), pages 977-990, December.
    20. Nayara Luiz Pires & Daphne Heloisa de Freitas Muniz & Tiago Borges Kisaka & Nathan De Castro Soares Simplicio & Lilian Bortoluzzi & Jorge Enoch Furquim Werneck Lima & Eduardo Cyrino Oliveira-Filho, 2015. "Impacts of the Urbanization Process on Water Quality of Brazilian Savanna Rivers: The Case of Preto River in Formosa, Goiás State, Brazil," IJERPH, MDPI, vol. 12(9), pages 1-16, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:aistmt:v:73:y:2021:i:2:d:10.1007_s10463-020-00747-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.