IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/22630.html
   My bibliography  Save this paper

Student Coaching: How Far Can Technology Go?

Author

Listed:
  • Philip Oreopoulos
  • Uros Petronijevic

Abstract

Recent studies show that programs offering structured, one-on-one coaching and tutoring tend to have large effects on the academic outcomes of both high school and college students. These programs are often costly to implement and difficult to scale, however, calling into question whether making them available to large student populations is feasible. In contrast, interventions that rely on technology to maintain low-touch contact with students can be implemented at large scale and minimal cost but with the risk of not being as effective as one-on-one, in-person assistance. In this paper, we test whether the effects of coaching programs can be replicated at scale by using technology to reach a larger population of students. We work with a sample of over four thousand undergraduate students from a large Canadian university, randomly assigning students into one of the following three interventions: (i) a one-time online exercise designed to affirm students’ values and goals; (ii) a text messaging campaign that provides students with academic advice, information, and motivation; and (iii) a personal coaching service, in which students are matched with upper-year undergraduate coaches. We find large positive effects from the coaching program, as coached students realize a 0.3 standard deviation increase in average grades and a 0.35 standard deviation increase in GPA. In contrast, we find no effects from either the online exercise or the text messaging campaign on any academic outcome, both in the general student population and across several student subgroups. A comparison of the key features of the text messaging campaign and the coaching service suggests that proactively and regularly initiating conversations with students and working to establish trust are important design features to incorporate in future interventions that use technology to reach large populations of students.

Suggested Citation

  • Philip Oreopoulos & Uros Petronijevic, 2016. "Student Coaching: How Far Can Technology Go?," NBER Working Papers 22630, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:22630
    Note: CH ED LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w22630.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Philip Oreopoulos & Daniel Lang & Joshua Angrist, 2009. "Incentives and Services for College Achievement: Evidence from a Randomized Trial," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 136-163, January.
    2. Philippe Belley & Lance Lochner, 2007. "The Changing Role of Family Income and Ability in Determining Educational Achievement," Journal of Human Capital, University of Chicago Press, vol. 1(1), pages 37-89.
    3. Kraft, Matthew A. & Rogers, Todd, 2015. "The underutilized potential of teacher-to-parent communication: Evidence from a field experiment," Economics of Education Review, Elsevier, vol. 47(C), pages 49-63.
    4. Caroline M. Hoxby, 2004. "College Choices: The Economics of Where to Go, When to Go, and How to Pay For It," NBER Books, National Bureau of Economic Research, Inc, number hoxb04-1.
    5. Judith Scott-Clayton, 2012. "What Explains Trends in Labor Supply Among U.S. Undergraduates, 1970-2009?," NBER Working Papers 17744, National Bureau of Economic Research, Inc.
    6. John Bound & Michael F. Lovenheim & Sarah Turner, 2012. "Increasing Time to Baccalaureate Degree in the United States," Education Finance and Policy, MIT Press, vol. 7(4), pages 375-424, September.
    7. Susan E. Mayer & Ariel Kalil & Philip Oreopoulos & Sebastian Gallegos, 2015. "Using Behavioral Insights to Increase Parental Engagement: The Parents and Children Together (PACT) Intervention," NBER Working Papers 21602, National Bureau of Economic Research, Inc.
    8. Benjamin L. Castleman & Lindsay C. Page, 2016. "Freshman Year Financial Aid Nudges: An Experiment to Increase FAFSA Renewal and College Persistence," Journal of Human Resources, University of Wisconsin Press, vol. 51(2), pages 389-415.
    9. Bound, John & Turner, Sarah, 2007. "Cohort crowding: How resources affect collegiate attainment," Journal of Public Economics, Elsevier, vol. 91(5-6), pages 877-899, June.
    10. Beattie, Graham & Laliberté, Jean-William P. & Oreopoulos, Philip, 2018. "Thrivers and divers: Using non-academic measures to predict college success and failure," Economics of Education Review, Elsevier, vol. 62(C), pages 170-182.
    11. Caroline Minter Hoxby, 2004. "Introduction to "College Choices: The Economics of Where to Go, When to Go, and How to Pay For It"," NBER Chapters, in: College Choices: The Economics of Where to Go, When to Go, and How to Pay For It, pages 1-12, National Bureau of Economic Research, Inc.
    12. Sarah Turner, 2004. "Going to College and Finishing College.Explaining Different Educational Outcomes," NBER Chapters, in: College Choices: The Economics of Where to Go, When to Go, and How to Pay For It, pages 13-62, National Bureau of Economic Research, Inc.
    13. Eric P. Bettinger & Bridget Terry Long & Philip Oreopoulos & Lisa Sanbonmatsu, 2012. "The Role of Application Assistance and Information in College Decisions: Results from the H&R Block Fafsa Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(3), pages 1205-1242.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    2. Lindsay C. Page & Judith Scott-Clayton, 2015. "Improving College Access in the United States: Barriers and Policy Responses," NBER Working Papers 21781, National Bureau of Economic Research, Inc.
    3. Darolia, Rajeev, 2014. "Working (and studying) day and night: Heterogeneous effects of working on the academic performance of full-time and part-time students," Economics of Education Review, Elsevier, vol. 38(C), pages 38-50.
    4. Judith Scott-Clayton, 2012. "What Explains Trends in Labor Supply Among U.S. Undergraduates, 1970-2009?," NBER Working Papers 17744, National Bureau of Economic Research, Inc.
    5. Scott Carrell & Bruce Sacerdote, 2017. "Why Do College-Going Interventions Work?," American Economic Journal: Applied Economics, American Economic Association, vol. 9(3), pages 124-151, July.
    6. Michael S. Kofoed, 2022. "Pell Grants and Labor Supply: Evidence from a Regression Kink," Upjohn Working Papers 22-363, W.E. Upjohn Institute for Employment Research.
    7. Andrews, Rodney J. & Imberman, Scott A. & Lovenheim, Michael F., 2020. "Recruiting and supporting low-income, high-achieving students at flagship universities," Economics of Education Review, Elsevier, vol. 74(C).
    8. Charles T. Clotfelter & Steven W. Hemelt & Helen F. Ladd, 2018. "Multifaceted Aid For Low‐Income Students And College Outcomes: Evidence From North Carolina," Economic Inquiry, Western Economic Association International, vol. 56(1), pages 278-303, January.
    9. Kalena E. Cortes & Hans D.U. Fricke & Susanna Loeb & David S. Song & Benjamin N. York, 2019. "When Behavioral Barriers are Too High or Low – How Timing Matters for Parenting Interventions," NBER Working Papers 25964, National Bureau of Economic Research, Inc.
    10. Christopher R. Dobronyi & Philip Oreopoulos & Uros Petronijevic, 2017. "Goal Setting, Academic Reminders, and College Success: A Large-Scale Field Experiment," NBER Working Papers 23738, National Bureau of Economic Research, Inc.
    11. Anderson, Drew M., 2020. "When financial aid is scarce: The challenge of allocating college aid where it is needed most," Journal of Public Economics, Elsevier, vol. 190(C).
    12. Page, Lindsay C. & Scott-Clayton, Judith, 2016. "Improving college access in the United States: Barriers and policy responses," Economics of Education Review, Elsevier, vol. 51(C), pages 4-22.
    13. Scott E. Carrell & Michal Kurlaender, 2023. "My Professor Cares: Experimental Evidence on the Role of Faculty Engagement," American Economic Journal: Economic Policy, American Economic Association, vol. 15(4), pages 113-141, November.
    14. Avery, Christopher & Castleman, Benjamin L. & Hurwitz, Michael & Long, Bridget Terry & Page, Lindsay C., 2021. "Digital messaging to improve college enrollment and success," Economics of Education Review, Elsevier, vol. 84(C).
    15. Nicole M. Fortin, 2006. "Higher-Education Policies and the College Wage Premium: Cross-State Evidence from the 1990s," American Economic Review, American Economic Association, vol. 96(4), pages 959-987, September.
    16. Iriti, Jennifer & Page, Lindsay C. & Bickel, William E., 2018. "Place-based scholarships: Catalysts for systems reform to improve postsecondary attainment," International Journal of Educational Development, Elsevier, vol. 58(C), pages 137-148.
    17. Paul Attewell & David Monaghan, 2016. "How Many Credits Should an Undergraduate Take?," Research in Higher Education, Springer;Association for Institutional Research, vol. 57(6), pages 682-713, September.
    18. Susan Dynarski, 2008. "Building the Stock of College-Educated Labor," Journal of Human Resources, University of Wisconsin Press, vol. 43(3), pages 576-610.
    19. Martha J. Bailey & Susan M. Dynarski, 2011. "Gains and Gaps: Changing Inequality in U.S. College Entry and Completion," NBER Working Papers 17633, National Bureau of Economic Research, Inc.
    20. Scott-Clayton, Judith, 2012. "What Explains Trends in Labor Supply Among U.S. Undergraduates?," National Tax Journal, National Tax Association;National Tax Journal, vol. 65(1), pages 181-210, March.

    More about this item

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • J38 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Public Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:22630. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.