IDEAS home Printed from https://ideas.repec.org/a/eee/soceps/v96y2024ics0038012124002799.html
   My bibliography  Save this article

A reassessment of graduation modeling for policy design

Author

Listed:
  • Corsi, Matteo
  • di Bella, Enrico
  • Persico, Luca

Abstract

A vast and diverse literature estimates graduation chances using logistic models set in an arbitrary timeframe, where a graduation indicator is checked at a conventional point in time and associated with covariates measured at some date. Survival models emerged over time as a robust alternative, for being able to estimate time-to-degree and time-varying effects of predictors. This paper reconsiders the effectiveness of both modeling approaches in addressing policy-relevant questions, particularly in light of the increasingly automated and algorithm-based educational policies. We find that both methods exhibit blind spots and limitations, but that adopting a simple pragmatic approach logistic models can achieve a comparable level of effectiveness at depicting graduation dynamics while also being capable of answering questions that are problematic for survival models. We exploit a unique dataset and the nature of discrete-time survival models as combinations of logistic regressions run at different times to illustrate how arbitrary timeframes impact the estimates of a logistic model of graduation. Conversely, we illustrate how separately running and analyzing all the distinct logistic regressions provides insights that are unlikely to come from a survival model.

Suggested Citation

  • Corsi, Matteo & di Bella, Enrico & Persico, Luca, 2024. "A reassessment of graduation modeling for policy design," Socio-Economic Planning Sciences, Elsevier, vol. 96(C).
  • Handle: RePEc:eee:soceps:v:96:y:2024:i:c:s0038012124002799
    DOI: 10.1016/j.seps.2024.102079
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0038012124002799
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.seps.2024.102079?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Peter Arcidiacono & Cory Koedel, 2014. "Race and College Success: Evidence from Missouri," American Economic Journal: Applied Economics, American Economic Association, vol. 6(3), pages 20-57, July.
    2. Giorgio Brunello & Lorenzo Rocco, 2008. "Educational Standards in Private and Public Schools," Economic Journal, Royal Economic Society, vol. 118(533), pages 1866-1887, November.
    3. Stephen L. DesJardins & Dennis A. Ahlburg & Brian P. McCall, 2002. "A Temporal Investigation of Factors Related to Timely Degree Completion," The Journal of Higher Education, Taylor & Francis Journals, vol. 73(5), pages 555-581, September.
    4. John Bound & Michael F. Lovenheim & Sarah Turner, 2012. "Increasing Time to Baccalaureate Degree in the United States," Education Finance and Policy, MIT Press, vol. 7(4), pages 375-424, September.
    5. Häkkinen, Iida & Uusitalo, Roope, 2003. "The Effect of a Student Aid Reform on Graduation: A Duration Analysis," Working Paper Series 2003:8, Uppsala University, Department of Economics.
    6. Catalina A. Vallejos & Mark F. J. Steel, 2017. "Bayesian survival modelling of university outcomes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(2), pages 613-631, February.
    7. Ellis, Jimmy R. & Gershenson, Seth, 2020. "Gender, peer advising, and college success," Labour Economics, Elsevier, vol. 62(C).
    8. Hongtao Yue & Xuanning Fu, 2017. "Rethinking Graduation and Time to Degree: A Fresh Perspective," Research in Higher Education, Springer;Association for Institutional Research, vol. 58(2), pages 184-213, March.
    9. Glocker, Daniela, 2011. "The effect of student aid on the duration of study," Economics of Education Review, Elsevier, vol. 30(1), pages 177-190, February.
    10. John M Aiken & Riccardo De Bin & Morten Hjorth-Jensen & Marcos D Caballero, 2020. "Predicting time to graduation at a large enrollment American university," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-28, November.
    11. Eric P. Bettinger & Brent J. Evans & Devin G. Pope, 2013. "Improving College Performance and Retention the Easy Way: Unpacking the ACT Exam," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 26-52, May.
    12. DesJardins, S. L. & Ahlburg, D. A. & McCall, B. P., 1999. "An event history model of student departure," Economics of Education Review, Elsevier, vol. 18(3), pages 375-390, June.
    13. Cyrenne, Philippe & Chan, Alan, 2012. "High school grades and university performance: A case study," Economics of Education Review, Elsevier, vol. 31(5), pages 524-542.
    14. Kurlaender, Michal & Jackson, Jacob & Howell, Jessica S. & Grodsky, Eric, 2014. "College course scarcity and time to degree," Economics of Education Review, Elsevier, vol. 41(C), pages 24-39.
    15. Sunny Niu & Marta Tienda, 2013. "Delayed Enrollment and College Plans: Is There a Postponement Penalty?," The Journal of Higher Education, Taylor & Francis Journals, vol. 84(1), pages 1-27, January.
    16. Kamila Danilowicz-Gösele & Katharina Lerche & Johannes Meya & Robert Schwager, 2017. "Determinants of students' success at university," Education Economics, Taylor & Francis Journals, vol. 25(5), pages 513-532, September.
    17. Jensen, Elizabeth J. & Wu, Stephen, 2010. "Early decision and college performance," Economics of Education Review, Elsevier, vol. 29(4), pages 517-525, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aina, Carmen & Baici, Eliana & Casalone, Giorgia & Pastore, Francesco, 2018. "The Economics of University Dropouts and Delayed Graduation: A Survey," IZA Discussion Papers 11421, Institute of Labor Economics (IZA).
    2. Aina, Carmen & Baici, Eliana & Casalone, Giorgia & Pastore, Francesco, 2022. "The determinants of university dropout: A review of the socio-economic literature," Socio-Economic Planning Sciences, Elsevier, vol. 79(C).
    3. Nick Huntington-Klein & Andrew Gill, 2021. "Semester Course Load and Student Performance," Research in Higher Education, Springer;Association for Institutional Research, vol. 62(5), pages 623-650, August.
    4. Serge Atherwood & Gabriela Sánchez-Soto, 2023. "Does Social Class Matter Equally for the Timely Transition Into and Out of College? Evidence from the NLSY97," Research in Higher Education, Springer;Association for Institutional Research, vol. 64(1), pages 95-128, February.
    5. Philippe Cyrenne & Alan Chan, 2019. "The Determinants of Student Success in University: A Generalized Ordered Logit Approach," Departmental Working Papers 2019-03, The University of Winnipeg, Department of Economics.
    6. Kurlaender, Michal & Jackson, Jacob & Howell, Jessica S. & Grodsky, Eric, 2014. "College course scarcity and time to degree," Economics of Education Review, Elsevier, vol. 41(C), pages 24-39.
    7. Carmen Aina & Eliana Baici & Giorgia Casalone, 2010. "Time-to-Degree: Students' Abilities, University Characteristics or What Else? Evidence from Italy," Working Papers 130, SEMEQ Department - Faculty of Economics - University of Eastern Piedmont.
    8. Phipps, Aaron & Amaya, Alexander, 2023. "Are students time constrained? Course load, GPA, and failing," Journal of Public Economics, Elsevier, vol. 225(C).
    9. Susanna Sten-Gahmberg, 2020. "Student Heterogeneity and Financial Incentives in Graduate Education: Evidence from a Student Aid Reform," Education Finance and Policy, MIT Press, vol. 15(3), pages 543-580, Summer.
    10. Black, Sandra E. & Lincove, Jane & Cullinane, Jennifer & Veron, Rachel, 2015. "Can you leave high school behind?," Economics of Education Review, Elsevier, vol. 46(C), pages 52-63.
    11. Diana Roxana Galos & Susanne Strauss & Thomas Hinz, 2024. "Discrimination or a Competitive Climate? Why Women Cannot Translate Their Better High School Grades into University Grades," Research in Higher Education, Springer;Association for Institutional Research, vol. 65(8), pages 1804-1825, December.
    12. Andrews, Rodney J. & Imberman, Scott A. & Lovenheim, Michael F., 2020. "Recruiting and supporting low-income, high-achieving students at flagship universities," Economics of Education Review, Elsevier, vol. 74(C).
    13. Stratton, Leslie S. & O'Toole, Dennis M. & Wetzel, James N., 2006. "Are the Factors Affecting Dropout Behavior Related to Initial Enrollment Intensity for College Undergraduates?," IZA Discussion Papers 1951, Institute of Labor Economics (IZA).
    14. Michel Grosz & Michal Kurlaender & Ann Stevens, 2022. "Capacity and Flexibility in Community College CTE Programs: Program Offerings and Student Success," Research in Higher Education, Springer;Association for Institutional Research, vol. 63(1), pages 140-188, February.
    15. Arcidiacono, Peter & Aucejo, Esteban & Coate, Patrick & Hotz, V. Joseph, 2012. "Affirmative Action and University Fit: Evidence from Proposition 209," IZA Discussion Papers 7000, Institute of Labor Economics (IZA).
    16. Glocker, Daniela, 2011. "The effect of student aid on the duration of study," Economics of Education Review, Elsevier, vol. 30(1), pages 177-190, February.
    17. Bai, Chong-en & Chi, Wei & Qian, Xiaoye, 2014. "Do college entrance examination scores predict undergraduate GPAs? A tale of two universities," China Economic Review, Elsevier, vol. 30(C), pages 632-647.
    18. Rodney J. Andrews & Scott A. Imberman & Michael F. Lovenheim, 2017. "Risky Business? The Effect of Majoring in Business on Earnings and Educational Attainment," NBER Working Papers 23575, National Bureau of Economic Research, Inc.
    19. DesJardins, Stephen L. & Ahlburg, Dennis A. & McCall, Brian P., 2006. "The effects of interrupted enrollment on graduation from college: Racial, income, and ability differences," Economics of Education Review, Elsevier, vol. 25(6), pages 575-590, December.
    20. Aina, Carmen & Aktaş, Koray & Casalone, Giorgia, 2024. "Effects of workload allocation per course on students’ academic outcomes: Evidence from STEM degrees," Labour Economics, Elsevier, vol. 90(C).

    More about this item

    Keywords

    Graduation; Logit; Survival;
    All these keywords.

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceps:v:96:y:2024:i:c:s0038012124002799. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/seps .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.