IDEAS home Printed from https://ideas.repec.org/p/ecl/harjfk/rwp05-040.html
   My bibliography  Save this paper

Principals as Agents: Subjective Performance Measures in Education

Author

Listed:
  • Jacob, Brian A.

    (Harvard U)

  • Lefgren, Lars

    (Brigham Young U)

Abstract

In this paper, we compare subjective principal assessments of teachers to the traditional determinants of teacher compensation – education and experience – and another potential compensation mechanism -- value-added measures of teacher effectiveness based on student achievement gains. We find that subjective principal assessments of teachers predict future student achievement significantly better than teacher experience, education or actual compensation, though not as well as value-added teacher quality measures. In particular, principals appear quite good at identifying those teachers who produce the largest and smallest standardized achievement gains in their schools, but have far less ability to distinguish between teachers in the middle of this distribution and systematically discriminate against male and untenured faculty. Moreover, we find that a principal’s overall rating of a teacher is a substantially better predictor of future parent requests for that teacher than either the teacher’s experience, education and current compensation or the teacher’s value-added achievement measure. These findings not only inform education policy, but also shed light on subjective performance assessment more generally.

Suggested Citation

  • Jacob, Brian A. & Lefgren, Lars, 2005. "Principals as Agents: Subjective Performance Measures in Education," Working Paper Series rwp05-040, Harvard University, John F. Kennedy School of Government.
  • Handle: RePEc:ecl:harjfk:rwp05-040
    as

    Download full text from publisher

    File URL: https://research.hks.harvard.edu/publications/workingpapers/citation.aspx?PubId=3031&type=WPN
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Terrier, Camille, 2020. "Boys lag behind: How teachers’ gender biases affect student achievement," Economics of Education Review, Elsevier, vol. 77(C).
    2. Elizabeth Dhuey & Justin Smith, 2014. "How important are school principals in the production of student achievement?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 47(2), pages 634-663, May.
    3. Naven, Matthew, 2019. "Human-Capital Formation During Childhood and Adolescence: Evidence from School Quality and Postsecondary Success in California," MPRA Paper 97716, University Library of Munich, Germany.
    4. Bacher-Hicks, Andrew & Chin, Mark J. & Kane, Thomas J. & Staiger, Douglas O., 2019. "An experimental evaluation of three teacher quality measures: Value-added, classroom observations, and student surveys," Economics of Education Review, Elsevier, vol. 73(C).
    5. Jesse Rothstein, 2007. "Do Value-Added Models Add Value? Tracking, Fixed Effects, and Causal Inference," Working Papers 1036, Princeton University, Department of Economics, Center for Economic Policy Studies..
    6. Han Bing & McCaffrey Daniel & Springer Matthew G. & Gottfried Michael, 2012. "Teacher Effect Estimates and Decision Rules for Establishing Student-Teacher Linkages: What are the Implications for High-Stakes Personnel Policies in an Urban School District?," Statistics, Politics and Policy, De Gruyter, vol. 3(2), pages 1-24, July.
    7. Cassandra M. Guarino & Michelle Maxfield & Mark D. Reckase & Paul N. Thompson & Jeffrey M. Wooldridge, 2015. "An Evaluation of Empirical Bayes’s Estimation of Value-Added Teacher Performance Measures," Journal of Educational and Behavioral Statistics, , vol. 40(2), pages 190-222, April.
    8. Maria De Paola, 2009. "Does Teacher Quality Affect Student Performance? Evidence From An Italian University," Bulletin of Economic Research, Wiley Blackwell, vol. 61(4), pages 353-377, October.
    9. Jason A. Grissom & Susanna Loeb, 2017. "Assessing Principals’ Assessments: Subjective Evaluations of Teacher Effectiveness in Low- and High-Stakes Environments," Education Finance and Policy, MIT Press, vol. 12(3), pages 369-395, Summer.
    10. Goldhaber, Dan & Grout, Cyrus & Wolff, Malcolm & Martinková, Patrícia, 2021. "Evidence on the Dimensionality and Reliability of Professional References’ Ratings of Teacher Applicants," Economics of Education Review, Elsevier, vol. 83(C).
    11. Jenifer Ruiz-Valenzuela & Camille Terrier & Clémentine Van Effenterre, 2017. "Effectiveness of CEOs in the public sector: evidence from further education institutions," CVER Briefing Notes 005, Centre for Vocational Education Research.
    12. David Blazar, 2018. "Validating Teacher Effects on Students’ Attitudes and Behaviors: Evidence from Random Assignment of Teachers to Students," Education Finance and Policy, MIT Press, vol. 13(3), pages 281-309, Summer.
    13. Burgess, Simon & Greaves, Ellen & Murphy, Richard, 2022. "Deregulating Teacher Labor Markets," Economics of Education Review, Elsevier, vol. 88(C).
    14. Hanley Chiang & Stephen Lipscomb & Brian Gill, 2014. "Is School Value Added Indicative of Principal Quality?," Mathematica Policy Research Reports a11ab111ac3a497885e0a736f, Mathematica Policy Research.
    15. Hanley Chiang & Stephen Lipscomb & Brian Gill, 2016. "Is School Value Added Indicative of Principal Quality?," Education Finance and Policy, MIT Press, vol. 11(3), pages 283-309, Summer.
    16. Vegas, Emiliana & Ganimian, Alejandro, 2013. "Theory and Evidence on Teacher Policies in Developed and Developing Countries," IDB Publications (Working Papers) 4597, Inter-American Development Bank.
    17. Victor Lavy & Rigissa Megalokonomou, 2019. "Persistency in Teachers’ Grading Bias and Effects on Longer-Term Outcomes: University Admissions Exams and Choice of Field of Study," NBER Working Papers 26021, National Bureau of Economic Research, Inc.
    18. Eric Parsons, 2014. "Does Attending a Low-Achieving School Affect High-Performing Student Outcomes?," Working Papers 1407, Department of Economics, University of Missouri, revised 18 Feb 2015.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Murphy, Richard & Weinhardt, Felix & Wyness, Gill, 2021. "Who teaches the teachers? A RCT of peer-to-peer observation and feedback in 181 schools," Economics of Education Review, Elsevier, vol. 82(C).
    2. Michael Podgursky, 2006. "Is Teacher Pay Adequate?," Working Papers 0601, Department of Economics, University of Missouri.
    3. Dan Goldhaber & Roddy Theobald, 2013. "Managing the Teacher Workforce in Austere Times: The Determinants and Implications of Teacher Layoffs," Education Finance and Policy, MIT Press, vol. 8(4), pages 494-527, October.
    4. Kasper Brandt, 2018. "Private beats public: A flexible value-added model with Tanzanian school switchers," WIDER Working Paper Series 81, World Institute for Development Economic Research (UNU-WIDER).
    5. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    6. Gilpin, Gregory A., 2012. "Teacher salaries and teacher aptitude: An analysis using quantile regressions," Economics of Education Review, Elsevier, vol. 31(3), pages 15-29.
    7. Kevin C. Bastian & Gary T. Henry & Charles L. Thompson, 2013. "Incorporating Access to More Effective Teachers into Assessments of Educational Resource Equity," Education Finance and Policy, MIT Press, vol. 8(4), pages 560-580, October.
    8. Stacy, Brian, 2014. "Ranking Teachers when Teacher Value-Added is Heterogeneous Across Students," EconStor Preprints 104743, ZBW - Leibniz Information Centre for Economics.
    9. Eric A. Hanushek & John F. Kain & Steven G. Rivkin & Daniel M. O'Brien, 2005. "The Market for Teacher Quality," Discussion Papers 04-025, Stanford Institute for Economic Policy Research.
    10. Goel, Deepti & Barooah, Bidisha, 2018. "Drivers of Student Performance: Evidence from Higher Secondary Public Schools in Delhi," GLO Discussion Paper Series 231, Global Labor Organization (GLO).
    11. Bourdon, Jean & Frölich, Markus & Michaelowa, Katharina, 2007. "Teacher Shortages, Teacher Contracts and their Impact on Education in Africa," IZA Discussion Papers 2844, Institute of Labor Economics (IZA).
    12. Cordero, Jose M. & Gil-Izquierdo, María, 2018. "The effect of teaching strategies on student achievement: An analysis using TALIS-PISA-link," Journal of Policy Modeling, Elsevier, vol. 40(6), pages 1313-1331.
    13. Jesús M. Carro & Pedro Gallardo, 2024. "Effect of class size on student achievement in the COVID‐19 “new normal”," Bulletin of Economic Research, Wiley Blackwell, vol. 76(2), pages 303-318, April.
    14. Aslam, Monazza & Kingdon, Geeta, 2011. "What can teachers do to raise pupil achievement?," Economics of Education Review, Elsevier, vol. 30(3), pages 559-574, June.

    More about this item

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecl:harjfk:rwp05-040. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/ksharus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.