IDEAS home Printed from https://ideas.repec.org/a/plo/pmed00/0040079.html
   My bibliography  Save this article

Selection in Reported Epidemiological Risks: An Empirical Assessment

Author

Listed:
  • Fotini K Kavvoura
  • George Liberopoulos
  • John P A Ioannidis

Abstract

Background: Epidemiological studies may be subject to selective reporting, but empirical evidence thereof is limited. We empirically evaluated the extent of selection of significant results and large effect sizes in a large sample of recent articles. Methods and Findings: We evaluated 389 articles of epidemiological studies that reported, in their respective abstracts, at least one relative risk for a continuous risk factor in contrasts based on median, tertile, quartile, or quintile categorizations. We examined the proportion and correlates of reporting statistically significant and nonsignificant results in the abstract and whether the magnitude of the relative risks presented (coined to be consistently ≥1.00) differs depending on the type of contrast used for the risk factor. In 342 articles (87.9%), ≥1 statistically significant relative risk was reported in the abstract, while only 169 articles (43.4%) reported ≥1 statistically nonsignificant relative risk in the abstract. Reporting of statistically significant results was more common with structured abstracts, and was less common in US-based studies and in cancer outcomes. Among 50 randomly selected articles in which the full text was examined, a median of nine (interquartile range 5–16) statistically significant and six (interquartile range 3–16) statistically nonsignificant relative risks were presented (p = 0.25). Paradoxically, the smallest presented relative risks were based on the contrasts of extreme quintiles; on average, the relative risk magnitude was 1.41-, 1.42-, and 1.36-fold larger in contrasts of extreme quartiles, extreme tertiles, and above-versus-below median values, respectively (p

Suggested Citation

  • Fotini K Kavvoura & George Liberopoulos & John P A Ioannidis, 2007. "Selection in Reported Epidemiological Risks: An Empirical Assessment," PLOS Medicine, Public Library of Science, vol. 4(3), pages 1-10, March.
  • Handle: RePEc:plo:pmed00:0040079
    DOI: 10.1371/journal.pmed.0040079
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.0040079
    Download Restriction: no

    File URL: https://journals.plos.org/plosmedicine/article/file?id=10.1371/journal.pmed.0040079&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pmed.0040079?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Zhenglun Pan & Thomas A Trikalinos & Fotini K Kavvoura & Joseph Lau & John PA Ioannidis, 2005. "Local Literature Bias in Genetic Epidemiology: An Empirical Evaluation of the Chinese Literature," PLOS Medicine, Public Library of Science, vol. 2(12), pages 1-1, November.
    2. Jan P Vandenbroucke & Erik von Elm & Douglas G Altman & Peter C Gøtzsche & Cynthia D Mulrow & Stuart J Pocock & Charles Poole & James J Schlesselman & Matthias Egger & for the STROBE Initiative, 2007. "Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration," PLOS Medicine, Public Library of Science, vol. 4(10), pages 1-27, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stuart H Ralston & André G Uitterlinden & Maria Luisa Brandi & Susana Balcells & Bente L Langdahl & Paul Lips & Roman Lorenc & Barbara Obermayer-Pietsch & Serena Scollen & Mariona Bustamante & Lise Bj, 2006. "Large-Scale Evidence for the Effect of the COLIA1 Sp1 Polymorphism on Osteoporosis Outcomes: The GENOMOS Study," PLOS Medicine, Public Library of Science, vol. 3(4), pages 1-1, February.
    2. Jon Gitz Holler & Camilla Nørgaard Bech & Daniel Pilsgaard Henriksen & Søren Mikkelsen & Court Pedersen & Annmarie Touborg Lassen, 2015. "Nontraumatic Hypotension and Shock in the Emergency Department and the Prehospital setting, Prevalence, Etiology, and Mortality: A Systematic Review," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-13, March.
    3. Martine Hendriksma & Michiel H M A Joosten & Jeroen P M Peters & Wilko Grolman & Inge Stegeman, 2017. "Evaluation of the Quality of Reporting of Observational Studies in Otorhinolaryngology - Based on the STROBE Statement," PLOS ONE, Public Library of Science, vol. 12(1), pages 1-13, January.
    4. Erik von Elm & Douglas G Altman & Matthias Egger & Stuart J Pocock & Peter C Gøtzsche & Jan P Vandenbroucke & for the STROBE Initiative, 2007. "The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies," PLOS Medicine, Public Library of Science, vol. 4(10), pages 1-5, October.
    5. Jessie A Morgan & Sarah Bombell & William McGuire, 2013. "Association of Plasminogen Activator Inhibitor-Type 1 (-675 4G/5G) Polymorphism with Pre-Eclampsia: Systematic Review," PLOS ONE, Public Library of Science, vol. 8(2), pages 1-9, February.
    6. Jiaxiang Ye & Li Jiang & Changliang Wu & Aiqun Liu & Sufei Mao & Lianying Ge, 2015. "Three ADIPOR1 Polymorphisms and Cancer Risk: A Meta-Analysis of Case-Control Studies," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-14, June.
    7. Bhushan Borotikar & Mathieu Lempereur & Mathieu Lelievre & Valérie Burdin & Douraied Ben Salem & Sylvain Brochard, 2017. "Dynamic MRI to quantify musculoskeletal motion: A systematic review of concurrent validity and reliability, and perspectives for evaluation of musculoskeletal disorders," PLOS ONE, Public Library of Science, vol. 12(12), pages 1-26, December.
    8. Genevieve Rocheleau & Conrado Franco-Villalobos & Natalia Oliveira & Zabrina L Brumme & Melanie Rusch & Jeannie Shoveller & Chanson J Brumme & P Richard Harrigan, 2017. "Sociodemographic correlates of HIV drug resistance and access to drug resistance testing in British Columbia, Canada," PLOS ONE, Public Library of Science, vol. 12(9), pages 1-15, September.
    9. Bo Xi & Giriraj R Chandak & Yue Shen & Qijuan Wang & Donghao Zhou, 2012. "Association between Common Polymorphism near the MC4R Gene and Obesity Risk: A Systematic Review and Meta-Analysis," PLOS ONE, Public Library of Science, vol. 7(9), pages 1-7, September.
    10. Paris B Lovett & J Akiva Kahn & Stuart E Greene & Matthew A Bloch & Daniel R Brandt & Michael R Minckler, 2014. "Early Quick Acuity Score Provides More Complete Data on Emergency Department Walkouts," PLOS ONE, Public Library of Science, vol. 9(1), pages 1-6, January.
    11. Takeshi Odajima & Minoko Takanashi & Hiroki Sugimori & Taiko Tanba & Kentaro Yoshinaga & Toshiko Motoji & Masaya Munakata & Kazunori Nakajima & Mutsuhiko Minami, 2016. "Impact of Elevated Hemoglobin and Serum Protein on Vasovagal Reaction from Blood Donation," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-11, February.
    12. Jian-Hong Zhong & Bang-De Xiang & Liang Ma & Xue-Mei You & Le-Qun Li & Gui-Sheng Xie, 2013. "Meta-Analysis of Microsomal Epoxide Hydrolase Gene Polymorphism and Risk of Hepatocellular Carcinoma," PLOS ONE, Public Library of Science, vol. 8(2), pages 1-8, February.
    13. Julian Little & Julian PT Higgins & John PA Ioannidis & David Moher & France Gagnon & Erik von Elm & Muin J Khoury & Barbara Cohen & George Davey-Smith & Jeremy Grimshaw & Paul Scheet & Marta Gwinn & , 2009. "STrengthening the REporting of Genetic Association Studies (STREGA)— An Extension of the STROBE Statement," PLOS Medicine, Public Library of Science, vol. 6(2), pages 1-13, February.
    14. Ping Liu & Jianwen Song & Hui Su & Linli Li & Ning Lu & Rongli Yang & Zhenhui Peng, 2013. "IL-10 Gene Polymorphisms and Susceptibility to Systemic Lupus Erythematosus: A Meta-Analysis," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-11, July.
    15. Lu Guo & Li-Li Zhang & Bo Zheng & Yun Liu & Xiao-Jie Cao & Yan Pi & Bing-Hu Li & Jing-Cheng Li, 2013. "The C825T Polymorphism of the G-Protein β3 Subunit Gene and Its Association with Hypertension and Stroke: An Updated Meta-Analysis," PLOS ONE, Public Library of Science, vol. 8(6), pages 1-13, June.
    16. Huadan Ye & Annan Zhou & Qiangxiao Hong & Linlin Tang & Xuting Xu & Yanfei Xin & Danjie Jiang & Dongjun Dai & Yirun Li & Dao Wen Wang & Shiwei Duan, 2015. "Positive Association between APOA5 rs662799 Polymorphism and Coronary Heart Disease: A Case-Control Study and Meta-Analysis," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-13, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pmed00:0040079. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosmedicine (email available below). General contact details of provider: https://journals.plos.org/plosmedicine/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.