IDEAS home Printed from https://ideas.repec.org/a/taf/amstat/v70y2016i1p33-38.html
   My bibliography  Save this article

The p -Value You Can’t Buy

Author

Listed:
  • Eugene Demidenko

Abstract

There is growing frustration with the concept of the p -value. Besides having an ambiguous interpretation, the p- value can be made as small as desired by increasing the sample size, n . The p -value is outdated and does not make sense with big data: Everything becomes statistically significant. The root of the problem with the p- value is in the mean comparison. We argue that statistical uncertainty should be measured on the individual, not the group, level. Consequently, standard deviation (SD), not standard error (SE), error bars should be used to graphically present the data on two groups. We introduce a new measure based on the discrimination of individuals/objects from two groups, and call it the D -value. The D -value can be viewed as the n -of-1 p -value because it is computed in the same way as p while letting n equal 1. We show how the D -value is related to discrimination probability and the area above the receiver operating characteristic (ROC) curve. The D -value has a clear interpretation as the proportion of patients who get worse after the treatment, and as such facilitates to weigh up the likelihood of events under different scenarios.[Received January 2015. Revised June 2015.]

Suggested Citation

  • Eugene Demidenko, 2016. "The p -Value You Can’t Buy," The American Statistician, Taylor & Francis Journals, vol. 70(1), pages 33-38, February.
    • Handle: RePEc:taf:amstat:v:70:y:2016:i:1:p:33-38
    DOI: 10.1080/00031305.2015.1069760
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/00031305.2015.1069760
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/00031305.2015.1069760?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Regina Nuzzo, 2014. "Scientific method: Statistical errors," Nature, Nature, vol. 506(7487), pages 150-152, February.
    2. Eugene Demidenko, 2012. "Confidence intervals and bands for the binormal ROC curve revisited," Journal of Applied Statistics, Taylor & Francis Journals, vol. 39(1), pages 67-79, March.
    3. Gelman, Andrew & Stern, Hal, 2006. "The Difference Between," The American Statistician, American Statistical Association, vol. 60, pages 328-331, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Henry Penikas, 2022. "Pass-Through of the Bank of Russia Key Rate into Deposit Rates Between 2020 and 2022," Russian Journal of Money and Finance, Bank of Russia, vol. 81(2), pages 20-48, June.
    2. Marko Hofmann & Silja Meyer-Nieberg, 2018. "Time to dispense with the p-value in OR?," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 26(1), pages 193-214, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jyotirmoy Sarkar, 2018. "Will P†Value Triumph over Abuses and Attacks?," Biostatistics and Biometrics Open Access Journal, Juniper Publishers Inc., vol. 7(4), pages 66-71, July.
    2. Howley, P.; & Moro, M.; & Waqas, M.; & Delaney, L.; & Heron, T.;, 2018. "Immigration and self-reported well-being in the UK," Health, Econometrics and Data Group (HEDG) Working Papers 18/12, HEDG, c/o Department of Economics, University of York.
    3. Gunnarsson, Björn Rafn & vanden Broucke, Seppe & Baesens, Bart & Óskarsdóttir, María & Lemahieu, Wilfried, 2021. "Deep learning for credit scoring: Do or don’t?," European Journal of Operational Research, Elsevier, vol. 295(1), pages 292-305.
    4. Arthur Matsuo Yamashita Rios de Sousa & Hideki Takayasu & Misako Takayasu, 2017. "Detection of statistical asymmetries in non-stationary sign time series: Analysis of foreign exchange data," PLOS ONE, Public Library of Science, vol. 12(5), pages 1-18, May.
    5. Diana M. Hechavarría & Steven A. Brieger, 2022. "Practice rather than preach: cultural practices and female social entrepreneurship," Small Business Economics, Springer, vol. 58(2), pages 1131-1151, February.
    6. Thomas Neise & Franziska Sohns & Moritz Breul & Javier Revilla Diez, 2022. "The effect of natural disasters on FDI attraction: a sector-based analysis over time and space," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 110(2), pages 999-1023, January.
    7. Colin F. Camerer & Anna Dreber & Felix Holzmeister & Teck-Hua Ho & Jürgen Huber & Magnus Johannesson & Michael Kirchler & Gideon Nave & Brian A. Nosek & Thomas Pfeiffer & Adam Altmejd & Nick Buttrick , 2018. "Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015," Nature Human Behaviour, Nature, vol. 2(9), pages 637-644, September.
    8. Asongu, Simplice & Odhiambo, Nicholas, 2020. "The role of governance in quality education in sub-Saharan Africa," MPRA Paper 107497, University Library of Munich, Germany.
    9. Ruomeng Cui & Jun Li & Dennis J. Zhang, 2020. "Reducing Discrimination with Reviews in the Sharing Economy: Evidence from Field Experiments on Airbnb," Management Science, INFORMS, vol. 66(3), pages 1071-1094, March.
    10. Lukas Haffert, 2019. "War mobilization or war destruction? The unequal rise of progressive taxation revisited," The Review of International Organizations, Springer, vol. 14(1), pages 59-82, March.
    11. Michael A. Allen & Michael E. Flynn & Julie VanDusky-Allen, 2017. "Regions of Hierarchy and Security: US Troop Deployments, Spatial Relations, and Defense Burdens," International Interactions, Taylor & Francis Journals, vol. 43(3), pages 397-423, May.
    12. Maurizio Canavari & Andreas C. Drichoutis & Jayson L. Lusk & Rodolfo M. Nayga, Jr., 2018. "How to run an experimental auction: A review of recent advances," Working Papers 2018-5, Agricultural University of Athens, Department Of Agricultural Economics.
    13. Duxbury, Scott W, 2019. "Mediation and Moderation in Statistical Network Models," SocArXiv 9bs4u, Center for Open Science.
    14. Andrew Gelman & Christian Hennig, 2017. "Beyond subjective and objective in statistics," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(4), pages 967-1033, October.
    15. Roberta Rutigliano & Gøsta Esping-Andersen, 2018. "Partnership Choice and Childbearing in Norway and Spain," European Journal of Population, Springer;European Association for Population Studies, vol. 34(3), pages 367-386, August.
    16. David Spiegelhalter, 2017. "Trust in numbers," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(4), pages 948-965, October.
    17. Andrew P. Jaciw & Li Lin & Boya Ma, 2016. "An Empirical Study of Design Parameters for Assessing Differential Impacts for Students in Group Randomized Trials," Evaluation Review, , vol. 40(5), pages 410-443, October.
    18. Peter Howley & Muhammad Waqas & Mirko Moro & Liam Delaney & Tony Heron, 2020. "It’s Not All about the Economy Stupid! Immigration and Subjective Well-Being in England," Work, Employment & Society, British Sociological Association, vol. 34(5), pages 919-936, October.
    19. Melisa Bubonya & Deborah A. Cobb-Clark & Daniel Christensen & Sarah E. Johnson & Stephen R. Zubrick, 2019. "The Great Recession and Children’s Mental Health in Australia," IJERPH, MDPI, vol. 16(4), pages 1-19, February.
    20. Nassim Nicholas Taleb, 2016. "A Short Note on P-Value Hacking," Papers 1603.07532, arXiv.org, revised Jan 2018.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:amstat:v:70:y:2016:i:1:p:33-38. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/UTAS20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.