IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0206570.html
   My bibliography  Save this article

Multi-institutional study of GRE scores as predictors of STEM PhD degree completion: GRE gets a low mark

Author

Listed:
  • Sandra L Petersen
  • Evelyn S Erenrich
  • Dovev L Levine
  • Jim Vigoreaux
  • Krista Gile

Abstract

The process of selecting students likely to complete science, technology, engineering and mathematics (STEM) doctoral programs has not changed greatly over the last few decades and still relies heavily on Graduate Record Examination (GRE) scores in most U.S. universities. It has been long debated whether the GRE is an appropriate selection tool and whether overreliance on GRE scores may compromise admission of students historically underrepresented in STEM. Despite many concerns about the test, there are few studies examining the efficacy of the GRE in predicting PhD completion and even fewer examining this question in STEM fields. For the present study, we took advantage of a long-lived collaboration among institutions in the Northeast Alliance for Graduate Education and the Professoriate (NEAGEP) to gather comparable data on GRE scores and PhD completion for 1805 U.S./Permanent Resident STEM doctoral students in four state flagship institutions. We found that GRE Verbal (GRE V) and GRE Quantitative (GRE Q) scores were similar for women who completed STEM PhD degrees and those who left programs. Remarkably, GRE scores were significantly higher for men who left than counterparts who completed STEM PhD degrees. In fact, men in the lower quartiles of GRE V or Q scores finished degrees more often than those in the highest quartile. This pattern held for each of the four institutions in the study and for the cohort of male engineering students across institutions. GRE scores also failed to predict time to degree or to identify students who would leave during the first year of their programs. Our results suggests that GRE scores are not an effective tool for identifying students who will be successful in completing STEM doctoral programs. Considering the high cost of attrition from PhD programs and its impact on future leadership for the U.S. STEM workforce, we suggest that it is time to develop more effective and inclusive admissions strategies.

Suggested Citation

  • Sandra L Petersen & Evelyn S Erenrich & Dovev L Levine & Jim Vigoreaux & Krista Gile, 2018. "Multi-institutional study of GRE scores as predictors of STEM PhD degree completion: GRE gets a low mark," PLOS ONE, Public Library of Science, vol. 13(10), pages 1-15, October.
    • Handle: RePEc:plo:pone00:0206570
    DOI: 10.1371/journal.pone.0206570
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0206570
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0206570&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0206570?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Liane Moneta-Koehler & Abigail M Brown & Kimberly A Petrie & Brent J Evans & Roger Chalkley, 2017. "The Limitations of the GRE in Predicting Success in Biomedical Graduate School," PLOS ONE, Public Library of Science, vol. 12(1), pages 1-17, January.
    2. Casey Miller & Keivan Stassun, 2014. "A test that fails," Nature, Nature, vol. 510(7504), pages 303-304, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Linda Sealy & Christina Saunders & Jeffrey Blume & Roger Chalkley, 2019. "The GRE over the entire range of scores lacks predictive ability for PhD outcomes in the biomedical sciences," PLOS ONE, Public Library of Science, vol. 14(3), pages 1-17, March.
    2. Michael B. Weissman, 2022. "Invalid Methods and False Answers: Physics Education Research and the Use of GREs," Econ Journal Watch, Econ Journal Watch, vol. 19(1), pages 1-4–29, March.
    3. Tim Maloney & Kamakshi Singh, 2017. "Using Validated Measures of High School Academic Achievement to Predict University Success," Working Papers 2017-10, Auckland University of Technology, Department of Economics.
    4. Vincent Chandler, 2019. "Identifying emerging scholars: seeing through the crystal ball of scholarship selection committees," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(1), pages 39-56, July.
    5. Natalia Maloshonok & Evgeniy Terentev, 2019. "Towards the New Model of Doctoral Education: The Experience of Enhancing Doctoral Programs in Russian Universities," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 3, pages 8-42.
    6. Ambika Mathur & Christine S Chow & Andrew L Feig & Heidi Kenaga & Judith A Moldenhauer & Nisansala S Muthunayake & Mathew L Ouellett & Laura E Pence & Victoria Straub, 2018. "Exposure to multiple career pathways by biomedical doctoral students at a public research university," PLOS ONE, Public Library of Science, vol. 13(6), pages 1-13, June.
    7. Liane Moneta-Koehler & Abigail M Brown & Kimberly A Petrie & Brent J Evans & Roger Chalkley, 2017. "The Limitations of the GRE in Predicting Success in Biomedical Graduate School," PLOS ONE, Public Library of Science, vol. 12(1), pages 1-17, January.
    8. Малошонок Н. Г. & Терентьев Е. А., 2019. "На Пути К Новой Модели Аспирантуры: Опыт Совершенствования Аспирантских Программ В Российских Вузах," Вопросы образования // Educational Studies Moscow, National Research University Higher School of Economics, issue 3, pages 8-42.
    9. Ambika Mathur & Annmarie Cano & Michael Kohl & Nisansala S Muthunayake & Prassanna Vaidyanathan & Mary E Wood & Mustafa Ziyad, 2018. "Visualization of gender, race, citizenship and academic performance in association with career outcomes of 15-year biomedical doctoral alumni at a public research university," PLOS ONE, Public Library of Science, vol. 13(5), pages 1-16, May.
    10. Dawayne Whittington & Latricia E. Wallace & Cherilynn R. Shadding, 2017. "Proxies for Success: How the Application Process Correlates to PhD Pursuit for a Small Diversity Research Program," SAGE Open, , vol. 7(3), pages 21582440177, August.
    11. Tal Baron & Robert I Grossman & Steven B Abramson & Martin V Pusic & Rafael Rivera & Marc M Triola & Itai Yanai, 2020. "Signatures of medical student applicants and academic success," PLOS ONE, Public Library of Science, vol. 15(1), pages 1-13, January.
    12. Andrew Hussey & Sheena Murray & Wendy Stock, 2022. "Gender, coauthorship, and academic outcomes in economics," Economic Inquiry, Western Economic Association International, vol. 60(2), pages 465-484, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0206570. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.