IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/21986.html
   My bibliography  Save this paper

Learning Job Skills from Colleagues at Work: Evidence from a Field Experiment Using Teacher Performance Data

Author

Listed:
  • John P. Papay
  • Eric S. Taylor
  • John H. Tyler
  • Mary Laski

Abstract

We study on-the-job learning among classroom teachers, especially learning skills from coworkers. Using data from a new field experiment, we document meaningful improvements in teacher job performance when high- and low-performing teachers working at the same school are paired and asked to work together on improving the low-performer’s skills. In particular, pairs are asked to focus on specific skills identified in the low-performer’s prior performance evaluations. In the classrooms of low-performing teachers treated by the intervention, students scored 0.12 standard deviations higher than students in control classrooms. These improvements in teacher performance persisted, and perhaps grew, in the year after treatment. Empirical tests suggest the improvements are likely the result of low-performing teachers learning skills from their partner.

Suggested Citation

  • John P. Papay & Eric S. Taylor & John H. Tyler & Mary Laski, 2016. "Learning Job Skills from Colleagues at Work: Evidence from a Field Experiment Using Teacher Performance Data," NBER Working Papers 21986, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:21986
    Note: ED LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w21986.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), 2011. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 4, number 4, June.
    2. Sacerdote, Bruce, 2011. "Peer Effects in Education: How Might They Work, How Big Are They and How Much Do We Know Thus Far?," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 3, chapter 4, pages 249-277, Elsevier.
    3. Harris, Douglas N. & Sass, Tim R., 2011. "Teacher training, teacher quality and student achievement," Journal of Public Economics, Elsevier, vol. 95(7-8), pages 798-812, August.
    4. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2005. "Social Preferences and the Response to Incentives: Evidence from Personnel Data," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 120(3), pages 917-962.
    5. Papay, John P. & Kraft, Matthew A., 2015. "Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement," Journal of Public Economics, Elsevier, vol. 130(C), pages 105-119.
    6. Kalena E. Cortes & Joshua S. Goodman & Takako Nomi, 2015. "Intensive Math Instruction and Educational Attainment: Long-Run Impacts of Double-Dose Algebra," Journal of Human Resources, University of Wisconsin Press, vol. 50(1), pages 108-158.
    7. Jonah E. Rockoff, 2008. "Does Mentoring Reduce Turnover and Improve Skills of New Employees? Evidence from Teachers in New York City," NBER Working Papers 13868, National Bureau of Economic Research, Inc.
    8. Andrea Ichino & Giovanni Maggi, 2000. "Work Environment and Individual Background: Explaining Regional Shirking Differentials in a Large Italian Firm," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(3), pages 1057-1090.
    9. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    10. Alexandre Mas & Enrico Moretti, 2009. "Peers at Work," American Economic Review, American Economic Association, vol. 99(1), pages 112-145, March.
    11. Cameron, A. Colin & Gelbach, Jonah B. & Miller, Douglas L., 2011. "Robust Inference With Multiway Clustering," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(2), pages 238-249.
    12. Enrico Moretti, 2004. "Workers' Education, Spillovers, and Productivity: Evidence from Plant-Level Production Functions," American Economic Review, American Economic Association, vol. 94(3), pages 656-690, June.
    13. Wagner, Alfred, 1891. "Marshall's Principles of Economics," History of Economic Thought Articles, McMaster University Archive for the History of Economic Thought, vol. 5, pages 319-338.
    14. Thomas S. Dee & James Wyckoff, 2015. "Incentives, Selection, and Teacher Performance: Evidence from IMPACT," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 34(2), pages 267-297, March.
    15. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    16. C. Kirabo Jackson & Jonah E. Rockoff & Douglas O. Staiger, 2014. "Teacher Effects and Teacher-Related Policies," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 801-825, August.
    17. Alan B. Krueger, 1999. "Experimental Estimates of Education Production Functions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 497-532.
    18. C. Kirabo Jackson & Elias Bruegmann, 2009. "Teaching Students and Teaching Each Other: The Importance of Peer Learning for Teachers," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 85-108, October.
    19. Eric S. Taylor & John H. Tyler, 2012. "The Effect of Evaluation on Teacher Performance," American Economic Review, American Economic Association, vol. 102(7), pages 3628-3651, December.
    20. Pierre Azoulay & Joshua S. Graff Zivin & Jialan Wang, 2010. "Superstar Extinction," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(2), pages 549-589.
    21. repec:tpr:journl:edfpol:v:10:y:2015:i:4:p:535-572 is not listed on IDEAS
    22. Gary S. Becker, 1962. "Investment in Human Capital: A Theoretical Analysis," NBER Chapters, in: Investment in Human Beings, pages 9-49, National Bureau of Economic Research, Inc.
    23. Cortes, Kalena E. & Goodman, Joshua Samuel & Nomi, Takako, 2015. "Intensive Math Instruction and Educational Attainment," Scholarly Articles 34298862, Harvard Kennedy School of Government.
    24. Angrist, Joshua D & Lavy, Victor, 2001. "Does Teacher Training Affect Pupil Learning? Evidence from Matched Comparisons in Jerusalem Public Schools," Journal of Labor Economics, University of Chicago Press, vol. 19(2), pages 343-369, April.
    25. Taylor, Eric, 2014. "Spending more of the school day in math class: Evidence from a regression discontinuity in middle school," Journal of Public Economics, Elsevier, vol. 117(C), pages 162-181.
    26. Barton H. Hamilton & Jack A. Nickerson & Hideo Owan, 2003. "Team Incentives and Worker Heterogeneity: An Empirical Analysis of the Impact of Teams on Productivity and Participation," Journal of Political Economy, University of Chicago Press, vol. 111(3), pages 465-497, June.
    27. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    28. Eric A. Hanushek & Steven G. Rivkin, 2010. "Generalizations about Using Value-Added Measures of Teacher Quality," American Economic Review, American Economic Association, vol. 100(2), pages 267-271, May.
    29. Peter Leopold S. Bergman & Matthew J. Hill, 2015. "The Effects of Making Performance Information Public: Evidence from Los Angeles Teachers and a Regression Discontinuity Design," CESifo Working Paper Series 5383, CESifo.
    30. Harminder Battu & Clive R. Belfield & Peter J. Sloane, 2003. "Human Capital Spillovers within the Workplace: Evidence for Great Britain," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(5), pages 575-594, December.
    31. Matthew P. Steinberg & Lauren Sartain, 2015. "Does Teacher Evaluation Improve School Performance? Experimental Evidence from Chicago's Excellence in Teaching Project," Education Finance and Policy, MIT Press, vol. 10(4), pages 535-572, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Murphy, Richard & Weinhardt, Felix & Wyness, Gill, 2021. "Who teaches the teachers? A RCT of peer-to-peer observation and feedback in 181 schools," Economics of Education Review, Elsevier, vol. 82(C).
    2. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    3. Sarah R. Cohodes & Elizabeth M. Setren & Christopher R. Walters, 2021. "Can Successful Schools Replicate? Scaling Up Boston's Charter School Sector," American Economic Journal: Economic Policy, American Economic Association, vol. 13(1), pages 138-167, February.
    4. Aenneli Houkes-Hommes & Bas Weel & Karen Wiel, 2016. "Measuring the Contribution of Primary-School Teachers to Education Outcomes in The Netherlands," De Economist, Springer, vol. 164(4), pages 357-364, December.
    5. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    6. Papps, Kerry L. & Bryson, Alex, 2019. "Spillovers and Substitutability in Production," IZA Discussion Papers 12252, Institute of Labor Economics (IZA).
    7. Hugh Macartney & Robert McMillan & Uros Petronijevic, 2018. "Teacher Value-Added and Economic Agency," NBER Working Papers 24747, National Bureau of Economic Research, Inc.
    8. Cory Koedel & Jiaxi Li & Matthew G. Springer & Li Tan, 2016. "The Impact of Performance Ratings on Job Satisfaction for Public School Teachers," Working Papers 1617, Department of Economics, University of Missouri.
    9. Joseph Price, 2017. "Production spillovers: Are they valued?," IZA World of Labor, Institute of Labor Economics (IZA), pages 377-377, August.
    10. Gjefsen, Hege Marie, 2020. "Wages, teacher recruitment, and student achievement," Labour Economics, Elsevier, vol. 65(C).
    11. Cory Koedel & Jiaxi Li & Matthew G. Springer & Li Tan, 2018. "Teacher Performance Ratings and Professional Improvement," Working Papers 1808, Department of Economics, University of Missouri.
    12. David Blazar, 2018. "Validating Teacher Effects on Students’ Attitudes and Behaviors: Evidence from Random Assignment of Teachers to Students," Education Finance and Policy, MIT Press, vol. 13(3), pages 281-309, Summer.
    13. Jessica F. Harding & Emily Moiduddin & Lizabeth Malone & Judy Cannon & Louisa Tarullo & Nikki Aikens, "undated". "A Spotlight on Professional Development in Head Start: FACES Spring 2017," Mathematica Policy Research Reports 8133874deb9049d39d78de622, Mathematica Policy Research.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Murphy, Richard & Weinhardt, Felix & Wyness, Gill, 2021. "Who teaches the teachers? A RCT of peer-to-peer observation and feedback in 181 schools," Economics of Education Review, Elsevier, vol. 82(C).
    2. Dhushyanth Raju, 2017. "Public School Teacher Management in Sri Lanka," South Asia Economic Journal, Institute of Policy Studies of Sri Lanka, vol. 18(1), pages 39-63, March.
    3. Simon Briole, 2019. "From Teacher Quality to Teaching Quality: Instructional Productivity and Teaching Practices in the US," Working Papers halshs-01993616, HAL.
    4. Pope, Nolan G., 2019. "The effect of teacher ratings on teacher performance," Journal of Public Economics, Elsevier, vol. 172(C), pages 84-110.
    5. Gershenson, Seth & Lindsay, Constance A. & Papageorge, Nicholas W. & Campbell, Romaine & Rendon, Jessica H., 2023. "Spillover Effects of Black Teachers on White Teachers' Racial Competency: Mixed Methods Evidence from North Carolina," IZA Discussion Papers 16258, Institute of Labor Economics (IZA).
    6. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    7. Thomas Cornelissen & Christian Dustmann & Uta Schönberg, 2017. "Peer Effects in the Workplace," American Economic Review, American Economic Association, vol. 107(2), pages 425-456, February.
    8. Andrew Agopsowicz & Chris Robinson & Ralph Stinebrickner & Todd Stinebrickner, 2020. "Careers and Mismatch for College Graduates: College and Noncollege Jobs," Journal of Human Resources, University of Wisconsin Press, vol. 55(4), pages 1194-1221.
    9. Jose Maria Cabrera & Dinand Webbink, 2020. "Do Higher Salaries Yield Better Teachers and Better Student Outcomes?," Journal of Human Resources, University of Wisconsin Press, vol. 55(4), pages 1222-1257.
    10. Thompson, Paul N., 2021. "Is four less than five? Effects of four-day school weeks on student achievement in Oregon," Journal of Public Economics, Elsevier, vol. 193(C).
    11. Dinand Webbink & José María Cabrera, 2016. "Do higher salaries yield better teachers and better student outcomes?," Documentos de Trabajo/Working Papers 1604, Facultad de Ciencias Empresariales y Economia. Universidad de Montevideo..
    12. C. Kirabo Jackson & Elias Bruegmann, 2009. "Teaching Students and Teaching Each Other: The Importance of Peer Learning for Teachers," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 85-108, October.
    13. Gershenson, Seth, 2021. "Identifying and Producing Effective Teachers," IZA Discussion Papers 14096, Institute of Labor Economics (IZA).
    14. Marc Steeg & Sander Gerritsen, 2016. "Teacher Evaluations and Pupil Achievement Gains: Evidence from Classroom Observations," De Economist, Springer, vol. 164(4), pages 419-443, December.
    15. Jacob, Brian A. & Rockoff, Jonah E. & Taylor, Eric S. & Lindy, Benjamin & Rosen, Rachel, 2018. "Teacher applicant hiring and teacher performance: Evidence from DC public schools," Journal of Public Economics, Elsevier, vol. 166(C), pages 81-97.
    16. Matthew A. Kraft & John P. Papay & Olivia L. Chi, 2020. "Teacher Skill Development: Evidence from Performance Ratings by Principals," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 315-347, March.
    17. Michael Bates & Michael Dinerstein & Andrew C. Johnston & Isaac Sorkin, 2022. "Teacher Labor Market Equilibrium and Student Achievement," CESifo Working Paper Series 9551, CESifo.
    18. Papay, John P. & Kraft, Matthew A., 2015. "Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement," Journal of Public Economics, Elsevier, vol. 130(C), pages 105-119.
    19. Ingo E. Isphording & Ulf Zölitz, 2020. "The value of a peer," ECON - Working Papers 342, Department of Economics - University of Zurich.
    20. Jason J Sandvik & Richard E Saouma & Nathan T Seegert & Christopher T Stanton, 2020. "Workplace Knowledge Flows," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(3), pages 1635-1680.

    More about this item

    JEL classification:

    • I2 - Health, Education, and Welfare - - Education
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • M53 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Training

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:21986. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.