IDEAS home Printed from https://ideas.repec.org/a/spr/reihed/v63y2022i8d10.1007_s11162-022-09676-w.html
   My bibliography  Save this article

What is the Purpose of Academic Probation? Its Substantial Negative Effects on Four-Year Graduation

Author

Listed:
  • Nicholas A. Bowman

    (University of Iowa, N491 Lindquist Center)

  • Nayoung Jang

    (University of Iowa, N491 Lindquist Center)

Abstract

Placing students on academic probation is a pervasive practice at colleges and universities, but the lasting impact—and arguably even the purpose—of academic probation is unclear. The present study explored the influence of academic probation on four-year graduation using regression discontinuity analyses with a dataset of 9,777 undergraduates. The results frequently identified large or very large negative effects of probationary placement on four-year graduation, and these were greatest for probationary criteria based on either semester GPA or an overall GPA criterion in which students had accrued fewer than 30 total college credits. The findings were robust across analytic approaches and were observed regardless of students’ race, sex, first-generation status, high school GPA, and standardized test scores; the effects were sometimes larger among students who had higher high school GPAs and female students. Supplemental analyses suggest that the graduation effects based on cutoffs for college semester GPA and early overall GPA were predominantly or entirely driven by attrition that occurred soon after the probationary placement, whereas graduation effects based on the overall GPA cutoff with at least 30 college credits appeared to be driven mostly by delaying time to degree. These findings have critical implications for institutional policy and practice.

Suggested Citation

  • Nicholas A. Bowman & Nayoung Jang, 2022. "What is the Purpose of Academic Probation? Its Substantial Negative Effects on Four-Year Graduation," Research in Higher Education, Springer;Association for Institutional Research, vol. 63(8), pages 1285-1311, December.
    • Handle: RePEc:spr:reihed:v:63:y:2022:i:8:d:10.1007_s11162-022-09676-w
    DOI: 10.1007/s11162-022-09676-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11162-022-09676-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11162-022-09676-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust data-driven inference in the regression-discontinuity design," Stata Journal, StataCorp LP, vol. 14(4), pages 909-946, December.
    2. Peter Z. Schochet, "undated". "Technical Methods Report: Statistical Power for Regression Discontinuity Designs in Education Evaluations," Mathematica Policy Research Reports 61fb6c057561451a8a6074508, Mathematica Policy Research.
    3. Fletcher, Jason M. & Tokmouline, Mansur, 2017. "The Effects of Academic Probation on College Success: Regression Discontinuity Evidence from Four Texas Universities," IZA Discussion Papers 11232, Institute of Labor Economics (IZA).
    4. Jason M. Lindo & Nicholas J. Sanders & Philip Oreopoulos, 2010. "Ability, Gender, and Performance Standards: Evidence from Academic Probation," American Economic Journal: Applied Economics, American Economic Association, vol. 2(2), pages 95-117, April.
    5. Jasjeet S. Sekhon & Rocío Titiunik, 2017. "On Interpreting the Regression Discontinuity Design as a Local Experiment," Advances in Econometrics, in: Regression Discontinuity Designs, volume 38, pages 1-28, Emerald Group Publishing Limited.
    6. Lee, Myoung-jae, 2016. "Matching, Regression Discontinuity, Difference in Differences, and Beyond," OUP Catalogue, Oxford University Press, number 9780190258740.
    7. Ben Ost & Weixiang Pan & Douglas Webber, 2018. "The Returns to College Persistence for Marginal Students: Regression Discontinuity Evidence from University Dismissal Policies," Journal of Labor Economics, University of Chicago Press, vol. 36(3), pages 779-805.
    8. Lauren Schudde & Judith Scott-Clayton, 2016. "Pell Grants as Performance-Based Scholarships? An Examination of Satisfactory Academic Progress Requirements in the Nation’s Largest Need-Based Aid Program," Research in Higher Education, Springer;Association for Institutional Research, vol. 57(8), pages 943-967, December.
    9. Marcus D. Casey & Jeffrey Cline & Ben Ost & Javaeria A. Qureshi, 2018. "Academic Probation, Student Performance, And Strategic Course‐Taking," Economic Inquiry, Western Economic Association International, vol. 56(3), pages 1646-1677, July.
    10. Otávio Bartalotti & Quentin Brummet, 2017. "Regression Discontinuity Designs with Clustered Data," Advances in Econometrics, in: Regression Discontinuity Designs, volume 38, pages 383-420, Emerald Group Publishing Limited.
    11. Gonzalo Vazquez-Bare & Matias Cattaneo & Rocio Titiunik, 2016. "rdlocrand: a Stata Package for Inference in Regression Discontinuity Designs under Local Randomizati," 2016 Stata Conference 25, Stata Users Group.
    12. Yingying Dong, 2019. "Regression Discontinuity Designs With Sample Selection," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(1), pages 171-186, January.
    13. repec:mpr:mprres:6372 is not listed on IDEAS
    14. Wright, Nicholas A., 2020. "Perform better, or else: Academic probation, public praise, and students decision-making," Labour Economics, Elsevier, vol. 62(C).
    15. Yingying DONG & Ying-Ying LEE & Michael GOU, 2019. "Regression Discontinuity Designs with a Continuous Treatment," Discussion papers 19058, Research Institute of Economy, Trade and Industry (RIETI).
    16. Lee, David S., 2008. "Randomized experiments from non-random selection in U.S. House elections," Journal of Econometrics, Elsevier, vol. 142(2), pages 675-697, February.
    17. Matias D. Cattaneo & Roc ́ıo Titiunik & Gonzalo Vazquez-Bare, 2016. "Inference in regression discontinuity designs under local randomization," Stata Journal, StataCorp LP, vol. 16(2), pages 331-367, June.
    18. Joshua D. Angrist & Jörn-Steffen Pischke, 2015. "The path from cause to effect: mastering 'metrics," CentrePiece - The magazine for economic performance 442, Centre for Economic Performance, LSE.
    19. Sebastian Calonico & Matias D. Cattaneo & Max H. Farrell & Roc ́ıo Titiunik, 2017. "rdrobust: Software for regression-discontinuity designs," Stata Journal, StataCorp LP, vol. 17(2), pages 372-404, June.
    20. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    21. repec:mpr:mprres:7486 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicholas A. Bowman & Nayoung Jang & D. Martin Kivlighan & Nancy Schneider & Xiaomeng Ye, 2020. "The Impact of a Goal-Setting Intervention for Engineering Students on Academic Probation," Research in Higher Education, Springer;Association for Institutional Research, vol. 61(1), pages 142-166, February.
    2. Chu, Yu-Wei Luke & Cuffe, Harold E, 2020. "Do Struggling Students Benefit From Continued Student Loan Access? Evidence From University and Beyond," Working Paper Series 21067, Victoria University of Wellington, School of Economics and Finance.
    3. Aaron Albert & Nathan Wozny, 2024. "The Impact of Academic Probation: Do Intensive Interventions Help?," Journal of Human Resources, University of Wisconsin Press, vol. 59(3), pages 852-878.
    4. Atı̇la Abdulkadı̇roğlu & Joshua D. Angrist & Yusuke Narita & Parag Pathak, 2022. "Breaking Ties: Regression Discontinuity Design Meets Market Design," Econometrica, Econometric Society, vol. 90(1), pages 117-151, January.
    5. Ari Hyytinen & Jaakko Meriläinen & Tuukka Saarimaa & Otto Toivanen & Janne Tukiainen, 2018. "When does regression discontinuity design work? Evidence from random election outcomes," Quantitative Economics, Econometric Society, vol. 9(2), pages 1019-1051, July.
    6. Wright, Nicholas A., 2020. "Perform better, or else: Academic probation, public praise, and students decision-making," Labour Economics, Elsevier, vol. 62(C).
    7. Cappelletti, Giuseppe & Ponte Marques, Aurea & Varraso, Paolo & Budrys, Žymantas & Peeters, Jonas, 2019. "Impact of higher capital buffers on banks’ lending and risk-taking: evidence from the euro area experiments," Working Paper Series 2292, European Central Bank.
    8. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    9. Matias D. Cattaneo & Rocío Titiunik & Gonzalo Vazquez-Bare, 2020. "Analysis of regression-discontinuity designs with multiple cutoffs or multiple scores," Stata Journal, StataCorp LP, vol. 20(4), pages 866-891, December.
    10. Sebastian Calonico & Matias D. Cattaneo & Max H. Farrell & Rocío Titiunik, 2019. "Regression Discontinuity Designs Using Covariates," The Review of Economics and Statistics, MIT Press, vol. 101(3), pages 442-451, July.
    11. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    12. Bugni, Federico A. & Canay, Ivan A., 2021. "Testing continuity of a density via g-order statistics in the regression discontinuity design," Journal of Econometrics, Elsevier, vol. 221(1), pages 138-159.
    13. Bartalotti Otávio, 2019. "Regression Discontinuity and Heteroskedasticity Robust Standard Errors: Evidence from a Fixed-Bandwidth Approximation," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-26, January.
    14. Angelo D'Andrea, 2019. "Mayor’s wage and Public procurement," BAFFI CAREFIN Working Papers 19125, BAFFI CAREFIN, Centre for Applied Research on International Markets Banking Finance and Regulation, Universita' Bocconi, Milano, Italy.
    15. Lauren Schudde & Judith Scott-Clayton, 2016. "Pell Grants as Performance-Based Scholarships? An Examination of Satisfactory Academic Progress Requirements in the Nation’s Largest Need-Based Aid Program," Research in Higher Education, Springer;Association for Institutional Research, vol. 57(8), pages 943-967, December.
    16. Vanessa Cirulli & Giuliano Resce & Marco Ventura, 2024. "Co-payment exemption and healthcare consumption: quasi-experimental evidence from Italy," Empirical Economics, Springer, vol. 67(1), pages 355-380, July.
    17. Burgherr, David, 2022. "Behavioral Responses to a Pension Savings Mandate : Quasi-experimental Evidence from Swiss Tax Data," CAGE Online Working Paper Series 645, Competitive Advantage in the Global Economy (CAGE).
    18. Meier, Pascal Flurin & Flepp, Raphael & Meier, Philippe & Franck, Egon, 2022. "Outcome bias in self-evaluations: Quasi-experimental field evidence from Swiss driving license exams," Journal of Economic Behavior & Organization, Elsevier, vol. 201(C), pages 292-309.
    19. Crespo Cristian, 2020. "Beyond Manipulation: Administrative Sorting in Regression Discontinuity Designs," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 164-181, January.
    20. Keita, Sekou & Mandon, Pierre, 2018. "Give a fish or teach fishing? Partisan affiliation of U.S. governors and the poverty status of immigrants," European Journal of Political Economy, Elsevier, vol. 55(C), pages 65-96.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:reihed:v:63:y:2022:i:8:d:10.1007_s11162-022-09676-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.