IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0114255.html
   My bibliography  Save this article

Excess Success for Psychology Articles in the Journal Science

Author

Listed:
  • Gregory Francis
  • Jay Tanzman
  • William J Matthews

Abstract

This article describes a systematic analysis of the relationship between empirical data and theoretical conclusions for a set of experimental psychology articles published in the journal Science between 2005–2012. When the success rate of a set of empirical studies is much higher than would be expected relative to the experiments' reported effects and sample sizes, it suggests that null findings have been suppressed, that the experiments or analyses were inappropriate, or that the theory does not properly follow from the data. The analyses herein indicate such excess success for 83% (15 out of 18) of the articles in Science that report four or more studies and contain sufficient information for the analysis. This result suggests a systematic pattern of excess success among psychology articles in the journal Science.

Suggested Citation

  • Gregory Francis & Jay Tanzman & William J Matthews, 2014. "Excess Success for Psychology Articles in the Journal Science," PLOS ONE, Public Library of Science, vol. 9(12), pages 1-15, December.
    • Handle: RePEc:plo:pone00:0114255
    DOI: 10.1371/journal.pone.0114255
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0114255
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0114255&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0114255?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David R Shanks & Ben R Newell & Eun Hee Lee & Divya Balakrishnan & Lisa Ekelund & Zarus Cenac & Fragkiski Kavvadia & Christopher Moore, 2013. "Priming Intelligent Behavior: An Elusive Phenomenon," PLOS ONE, Public Library of Science, vol. 8(4), pages 1-10, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. William J. Matthews & Ana I. Gheorghiu & Mitchell J. Callan, 2016. "Why do we overestimate others' willingness to pay?," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 11(1), pages 21-39, January.
    2. Fatma Ben Moussa & Mariem Talbi, 2019. "Stock Market Reaction to Terrorist Attacks and Political Uncertainty: Empirical Evidence from the Tunisian Stock Exchange," International Journal of Economics and Financial Issues, Econjournals, vol. 9(3), pages 48-64.
    3. Clinton Sanchez & Brian Sundermeier & Kenneth Gray & Robert J Calin-Jageman, 2017. "Direct replication of Gervais & Norenzayan (2012): No evidence that analytic thinking decreases religious belief," PLOS ONE, Public Library of Science, vol. 12(2), pages 1-8, February.
    4. repec:cup:judgdm:v:11:y:2016:i:1:p:21-39 is not listed on IDEAS

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Baer, Naomi & Barry, Erica & Smith, Gary, 2020. "The name game: The importance of resourcefulness, ruses, and recall in stock ticker symbols," The Quarterly Review of Economics and Finance, Elsevier, vol. 76(C), pages 410-413.
    2. Julija Michailova & Christoph Bühren, 2015. "Money priming and social behavior of natural groups in simple bargaining and dilemma experiments," MAGKS Papers on Economics 201530, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    3. Emily E Butler & Robert Ward & Richard Ramsey, 2015. "Investigating the Relationship between Stable Personality Characteristics and Automatic Imitation," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-18, June.
    4. Kristen D. Deppe & Frank J. Gonzalez & Jayme L. Neiman & Carly Jacobs & Jackson Pahlke & Kevin B. Smith & John R. Hibbing, 2015. "Reflective liberals and intuitive conservatives: A look at the Cognitive Reflection Test and ideology," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 10(4), pages 314-331, July.
    5. Christine R Harris & Noriko Coburn & Doug Rohrer & Harold Pashler, 2013. "Two Failures to Replicate High-Performance-Goal Priming Effects," PLOS ONE, Public Library of Science, vol. 8(8), pages 1-1, August.
    6. repec:cup:judgdm:v:10:y:2015:i:4:p:314-331 is not listed on IDEAS
    7. Santiago Sanchez-Pages & Claudia Rodriguez-Ruiz & Enrique Turiegano, 2014. "Facial Masculinity: How the Choice of Measurement Method Enables to Detect Its Influence on Behaviour," PLOS ONE, Public Library of Science, vol. 9(11), pages 1-10, November.
    8. Wörfel, Philipp, 2021. "Unravelling the intellectual discourse of implicit consumer cognition: A bibliometric review," Journal of Retailing and Consumer Services, Elsevier, vol. 61(C).
    9. Henning, Karla & Vollan, Björn & Balafoutas, Loukas, 2022. "Religious worship and discrimination," Journal of Economic Behavior & Organization, Elsevier, vol. 197(C), pages 91-102.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0114255. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.