IDEAS home Printed from https://ideas.repec.org/a/tpr/edfpol/v8y2013i3p418-434.html
   My bibliography  Save this article

Value Added and Its Uses: Where You Stand Depends on Where You Sit

Author

Listed:
  • Sean Corcoran

    (Institute for Education and Social Policy, New York University)

  • Dan Goldhaber

    (Center for Education Data & Research, University of Washington)

Abstract

In this policy brief we argue that there is little debate about the statistical properties of value-added model (VAM) estimates of teacher performance, yet, despite this, there is little consensus about what the evidence about VAMs implies for their practical utility as part of high-stakes performance evaluation systems. A review of the evidence base that underlies the debate over VAM measures, followed by our subjective opinions about the value of using VAMs, illustrates how different policy conclusions can easily arise even given a high-level general agreement about an existing body of evidence. We conclude the brief by offering a few thoughts about the limits of our knowledge and what that means for those who do wish to integrate VAMs into their own teacher-evaluation strategy.

Suggested Citation

  • Sean Corcoran & Dan Goldhaber, 2013. "Value Added and Its Uses: Where You Stand Depends on Where You Sit," Education Finance and Policy, MIT Press, vol. 8(3), pages 418-434, July.
    • Handle: RePEc:tpr:edfpol:v:8:y:2013:i:3:p:418-434
    as

    Download full text from publisher

    File URL: http://www.mitpressjournals.org/doi/pdf/10.1162/EDFP_a_00104
    Download Restriction: Access to PDF is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Steven G. Rivkin & Eric A. Hanushek & John F. Kain, 2005. "Teachers, Schools, and Academic Achievement," Econometrica, Econometric Society, vol. 73(2), pages 417-458, March.
    2. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    3. Elizabeth U. Cascio & Douglas O. Staiger, 2012. "Knowledge, Tests, and Fadeout in Educational Interventions," NBER Working Papers 18038, National Bureau of Economic Research, Inc.
    4. Jesse Rothstein, 2015. "Teacher Quality Policy When Supply Matters," American Economic Review, American Economic Association, vol. 105(1), pages 100-130, January.
    5. Jesse Rothstein, 2009. "Student Sorting and Bias in Value-Added Estimation: Selection on Observables and Unobservables," Education Finance and Policy, MIT Press, vol. 4(4), pages 537-571, October.
    6. Josh Kinsler, 2012. "Beyond Levels and Growth: Estimating Teacher Value-Added and its Persistence," Journal of Human Resources, University of Wisconsin Press, vol. 47(3), pages 722-753.
    7. Daniel F. McCaffrey & Tim R. Sass & J. R. Lockwood & Kata Mihaly, 2009. "The Intertemporal Variability of Teacher Effect Estimates," Education Finance and Policy, MIT Press, vol. 4(4), pages 572-606, October.
    8. Roland Fryer & Steven Levitt & John List & Sally Sadoff, 2012. "Enhancing the Efficacy of Teacher Incentives through Loss Aversion: A Field Experiment," Framed Field Experiments 00591, The Field Experiments Website.
    9. Eric A. Hanushek & John F. Kain & Steven G. Rivkin & Daniel M. O'Brien, 2005. "The Market for Teacher Quality," Discussion Papers 04-025, Stanford Institute for Economic Policy Research.
    10. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    11. Dan Goldhaber & Betheny Gross & Daniel Player, 2011. "Teacher career paths, teacher quality, and persistence in the classroom: Are public schools keeping their best?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 30(1), pages 57-87, December.
    12. Dan Goldhader & Dominic Brewer & Deborah Anderson, 1999. "A Three-way Error Components Analysis of Educational Productivity," Education Economics, Taylor & Francis Journals, vol. 7(3), pages 199-208.
    13. Josh Kinsler, 2012. "Assessing Rothstein's critique of teacher value‐added models," Quantitative Economics, Econometric Society, vol. 3(2), pages 333-362, July.
    14. Dale Ballou & William Sanders & Paul Wright, 2004. "Controlling for Student Background in Value-Added Assessment of Teachers," Journal of Educational and Behavioral Statistics, , vol. 29(1), pages 37-65, March.
    15. Jesse Rothstein, 2015. "Teacher Quality Policy When Supply Matters," American Economic Review, American Economic Association, vol. 105(1), pages 100-130, January.
    16. Dan D. Goldhaber & Dominic J. Brewer, 1997. "Why Don't Schools and Teachers Seem to Matter? Assessing the Impact of Unobservables on Educational Productivity," Journal of Human Resources, University of Wisconsin Press, vol. 32(3), pages 505-523.
    17. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2011. "The Long-Term Impacts of Teachers: Teacher Value-Added and Student Outcomes in Adulthood," NBER Working Papers 17699, National Bureau of Economic Research, Inc.
    18. Hanushek, Eric A, 1992. "The Trade-Off between Child Quantity and Quality," Journal of Political Economy, University of Chicago Press, vol. 100(1), pages 84-117, February.
    19. Hanushek, Eric A., 2011. "The economic value of higher teacher quality," Economics of Education Review, Elsevier, vol. 30(3), pages 466-479, June.
    20. Jesse Rothstein, 2010. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(1), pages 175-214.
    21. Roland G. Fryer, 2011. "Teacher Incentives and Student Achievement: Evidence from New York City Public Schools," NBER Working Papers 16850, National Bureau of Economic Research, Inc.
    22. Matthew M. Chingos & Martin R. West, 2012. "Do More Effective Teachers Earn More Outside the Classroom?," Education Finance and Policy, MIT Press, vol. 7(1), pages 8-43, January.
    23. Brian A. Jacob & Lars Lefgren, 2008. "Can Principals Identify Effective Teachers? Evidence on Subjective Performance Evaluation in Education," Journal of Labor Economics, University of Chicago Press, vol. 26(1), pages 101-136.
    24. C. Kirabo Jackson & Elias Bruegmann, 2009. "Teaching Students and Teaching Each Other: The Importance of Peer Learning for Teachers," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 85-108, October.
    25. Todd R. Stinebrickner, 2002. "An Analysis of Occupational Change and Departure from the Labor Force: Evidence of the Reasons that Teachers Leave," Journal of Human Resources, University of Wisconsin Press, vol. 37(1), pages 192-216.
    26. Eric S. Taylor & John H. Tyler, 2012. "The Effect of Evaluation on Teacher Performance," American Economic Review, American Economic Association, vol. 102(7), pages 3628-3651, December.
    27. Peter Z. Schochet & Hanley S. Chiang, "undated". "Error Rates in Measuring Teacher and School Performance Based on Student Test Score Gains," Mathematica Policy Research Reports d415285f980b4d64b7e75f40b, Mathematica Policy Research.
    28. repec:mpr:mprres:6721 is not listed on IDEAS
    29. repec:mpr:mprres:6857 is not listed on IDEAS
    30. Dan Goldhaber & Michael Hansen, 2010. "Using Performance on the Job to Inform Teacher Tenure Decisions," American Economic Review, American Economic Association, vol. 100(2), pages 250-255, May.
    31. Brian A. Jacob & Lars Lefgren & David P. Sims, 2010. "The Persistence of Teacher-Induced Learning," Journal of Human Resources, University of Wisconsin Press, vol. 45(4), pages 915-943.
    32. John H. Tyler & Eric S. Taylor & Thomas J. Kane & Amy L. Wooten, 2010. "Using Student Performance Data to Identify Effective Classroom Practices," American Economic Review, American Economic Association, vol. 100(2), pages 256-260, May.
    33. Stinebrickner, Todd R, 2001. "A Dynamic Model of Teacher Labor Supply," Journal of Labor Economics, University of Chicago Press, vol. 19(1), pages 196-230, January.
    34. repec:mpr:mprres:7333 is not listed on IDEAS
    35. Donald Boyd & Pam Grossman & Hamilton Lankford & Susanna Loeb & James Wyckoff, 2008. "Who Leaves? Teacher Attrition and Student Achievement," NBER Working Papers 14022, National Bureau of Economic Research, Inc.
    36. Thomas J. Kane & Eric S. Taylor & John H. Tyler & Amy L. Wooten, 2010. "Identifying Effective Classroom Practices Using Student Achievement Data," NBER Working Papers 15803, National Bureau of Economic Research, Inc.
    37. Caroline M. Hoxby & Andrew Leigh, 2004. "Pulled Away or Pushed Out? Explaining the Decline of Teacher Aptitude in the United States," American Economic Review, American Economic Association, vol. 94(2), pages 236-240, May.
    38. Dan Goldhaber, 2007. "Everyone’s Doing It, But What Does Teacher Testing Tell Us About Teacher Effectiveness?," Journal of Human Resources, University of Wisconsin Press, vol. 42(4).
    39. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    40. repec:mpr:mprres:7330 is not listed on IDEAS
    41. Douglas O. Staiger & Jonah E. Rockoff, 2010. "Searching for Effective Teachers with Imperfect Information," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 97-118, Summer.
    42. Eric A. Hanushek & Steven G. Rivkin, 2010. "Generalizations about Using Value-Added Measures of Teacher Quality," American Economic Review, American Economic Association, vol. 100(2), pages 267-271, May.
    43. Podgursky, Michael & Monroe, Ryan & Watson, Donald, 2004. "The academic quality of public school teachers: an analysis of entry and exit behavior," Economics of Education Review, Elsevier, vol. 23(5), pages 507-518, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kevin C. Bastian & Gary T. Henry & Charles L. Thompson, 2013. "Incorporating Access to More Effective Teachers into Assessments of Educational Resource Equity," Education Finance and Policy, MIT Press, vol. 8(4), pages 560-580, October.
    2. Backes, Ben & Cowan, James & Goldhaber, Dan & Koedel, Cory & Miller, Luke C. & Xu, Zeyu, 2018. "The common core conundrum: To what extent should we worry that changes to assessments will affect test-based measures of teacher performance?," Economics of Education Review, Elsevier, vol. 62(C), pages 48-65.
    3. Dan Goldhaber, 2018. "Impact and Your Death Bed: Playing the Long Game," Education Finance and Policy, MIT Press, vol. 13(1), pages 1-18, Winter.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    2. Dan Goldhaber & Michael Hansen, 2013. "Is it Just a Bad Class? Assessing the Long-term Stability of Estimated Teacher Performance," Economica, London School of Economics and Political Science, vol. 80(319), pages 589-612, July.
    3. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    4. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    5. Allison Atteberry & Susanna Loeb & James Wyckoff, 2013. "Do First Impressions Matter? Improvement in Early Career Teacher Effectiveness," NBER Working Papers 19096, National Bureau of Economic Research, Inc.
    6. Dan Goldhaber & Roddy Theobald, 2013. "Managing the Teacher Workforce in Austere Times: The Determinants and Implications of Teacher Layoffs," Education Finance and Policy, MIT Press, vol. 8(4), pages 494-527, October.
    7. Goldhaber, Dan & Cowan, James & Walch, Joe, 2013. "Is a good elementary teacher always good? Assessing teacher performance estimates across subjects," Economics of Education Review, Elsevier, vol. 36(C), pages 216-228.
    8. Hinrichs, Peter, 2021. "What kind of teachers are schools looking for? Evidence from a randomized field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 395-411.
    9. Li Feng & Tim R. Sass, 2017. "Teacher Quality and Teacher Mobility," Education Finance and Policy, MIT Press, vol. 12(3), pages 396-418, Summer.
    10. Goldhaber, Dan & Krieg, John & Theobald, Roddy, 2020. "Effective like me? Does having a more productive mentor improve the productivity of mentees?," Labour Economics, Elsevier, vol. 63(C).
    11. Hanushek, Eric A., 2011. "The economic value of higher teacher quality," Economics of Education Review, Elsevier, vol. 30(3), pages 466-479, June.
    12. Naven, Matthew, 2019. "Human-Capital Formation During Childhood and Adolescence: Evidence from School Quality and Postsecondary Success in California," MPRA Paper 97716, University Library of Munich, Germany.
    13. Marine de Talancé, 2015. "Better Teachers, Better Results? Evidence from Rural Pakistan," Working Papers DT/2015/21, DIAL (Développement, Institutions et Mondialisation).
    14. Gershenson, Seth, 2021. "Identifying and Producing Effective Teachers," IZA Discussion Papers 14096, Institute of Labor Economics (IZA).
    15. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    16. Papay, John P. & Kraft, Matthew A., 2015. "Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement," Journal of Public Economics, Elsevier, vol. 130(C), pages 105-119.
    17. Dhushyanth Raju, 2017. "Public School Teacher Management in Sri Lanka," South Asia Economic Journal, Institute of Policy Studies of Sri Lanka, vol. 18(1), pages 39-63, March.
    18. Azam, Mehtabul & Kingdon, Geeta Gandhi, 2015. "Assessing teacher quality in India," Journal of Development Economics, Elsevier, vol. 117(C), pages 74-83.
    19. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," American Economic Review, American Economic Association, vol. 104(9), pages 2593-2632, September.
    20. Marc van der Steeg & Sander Gerritsen, 2013. "Teacher evaluations and pupil achievement: Evidence from classroom observations," CPB Discussion Paper 230, CPB Netherlands Bureau for Economic Policy Analysis.

    More about this item

    Keywords

    value-added model; teacher performance; teacher evaluation;
    All these keywords.

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I22 - Health, Education, and Welfare - - Education - - - Educational Finance; Financial Aid

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tpr:edfpol:v:8:y:2013:i:3:p:418-434. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kelly McDougall (email available below). General contact details of provider: https://direct.mit.edu/journals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.