IDEAS home Printed from https://ideas.repec.org/a/eee/pubeco/v234y2024ics0047272724000513.html
   My bibliography  Save this article

Rethinking principal effects on student outcomes

Author

Listed:
  • Bartanen, Brendan
  • Husain, Aliza N.
  • Liebowitz, David D.

Abstract

School principals are viewed as critical actors to improve student outcomes, but there remain important methodological questions about how to measure principals’ effects. We propose a framework for measuring principals’ contributions to student outcomes and apply it empirically using data from Tennessee, New York City, and Oregon. As commonly implemented, value-added models misattribute to principals changes in student performance caused by unobserved time-varying factors over which principals exert minimal control, leading to biased estimates of individual principals’ effectiveness and an overstatement of the magnitude of principal effects. Based on our framework, which better accounts for bias from time-varying factors, we find that little of the variation in student test scores or attendance is explained by persistent effectiveness differences between principals. Across contexts, the estimated standard deviation of principal value-added is roughly 0.03 student-level standard deviations in math achievement and 0.01 standard deviations in reading.

Suggested Citation

  • Bartanen, Brendan & Husain, Aliza N. & Liebowitz, David D., 2024. "Rethinking principal effects on student outcomes," Journal of Public Economics, Elsevier, vol. 234(C).
  • Handle: RePEc:eee:pubeco:v:234:y:2024:i:c:s0047272724000513
    DOI: 10.1016/j.jpubeco.2024.105115
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047272724000513
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jpubeco.2024.105115?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Elizabeth Dhuey & Justin Smith, 2018. "How school principals influence student learning," Empirical Economics, Springer, vol. 54(2), pages 851-882, March.
    2. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," American Economic Review, American Economic Association, vol. 104(9), pages 2593-2632, September.
    3. Morgaen Donaldson & Madeline Mavrogordato & Shaun M. Dougherty & Reem Al Ghanem & Peter Youngs, 2021. "Principal Evaluation under the Elementary and Secondary Every Student Succeeds Act: A Comprehensive Policy Review," Education Finance and Policy, MIT Press, vol. 16(2), pages 347-361, Spring.
    4. Dan Goldhaber & Michael Hansen, 2013. "Is it Just a Bad Class? Assessing the Long-term Stability of Estimated Teacher Performance," Economica, London School of Economics and Political Science, vol. 80(319), pages 589-612, July.
    5. Elizabeth Dhuey & Justin Smith, 2014. "How important are school principals in the production of student achievement?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 47(2), pages 634-663, May.
    6. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    7. Jesse Rothstein, 2010. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(1), pages 175-214.
    8. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    9. Derek Laing & Steven G. Rivkin & Jeffrey C. Schiman & Jason Ward, 2016. "Decentralized Governance and the Quality of School Leadership," NBER Working Papers 22061, National Bureau of Economic Research, Inc.
    10. Brian A. Jacob & Lars Lefgren, 2007. "What Do Parents Value in Education? An Empirical Investigation of Parents' Revealed Preferences for Teachers," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(4), pages 1603-1637.
    11. Hanley Chiang & Stephen Lipscomb & Brian Gill, 2016. "Is School Value Added Indicative of Principal Quality?," Education Finance and Policy, MIT Press, vol. 11(3), pages 283-309, Summer.
    12. Hanushek, Eric, 1971. "Teacher Characteristics and Gains in Student Achievement: Estimation Using Micro Data," American Economic Review, American Economic Association, vol. 61(2), pages 280-288, May.
    13. Gregory F. Branch & Eric A. Hanushek & Steven G. Rivkin, 2012. "Estimating the Effect of Leaders on Public Sector Productivity: The Case of School Principals," NBER Working Papers 17803, National Bureau of Economic Research, Inc.
    14. Dale Ballou, 1996. "Do Public Schools Hire the Best Applicants?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 111(1), pages 97-133.
    15. Coelli, Michael & Green, David A., 2012. "Leadership effects: school principals and student outcomes," Economics of Education Review, Elsevier, vol. 31(1), pages 92-109.
    16. Bartanen, Brendan & Husain, Aliza N., 2022. "Connected networks in principal value-added models," Economics of Education Review, Elsevier, vol. 90(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ingo E. Isphording & Ulf Zölitz, 2020. "The value of a peer," ECON - Working Papers 342, Department of Economics - University of Zurich.
    2. Moira McCullough & Stephen Lipscomb & Hanley Chiang & Brian Gill, "undated". "Do Principals' Professional Practice Ratings Reflect Their Contributions to Student Achievement? Evidence from Pennsylvania's Framework for Leadership," Mathematica Policy Research Reports 23864abe140c4b658d1ba88d4, Mathematica Policy Research.
    3. Hanley Chiang & Stephen Lipscomb & Brian Gill, 2014. "Is School Value Added Indicative of Principal Quality?," Mathematica Policy Research Reports a11ab111ac3a497885e0a736f, Mathematica Policy Research.
    4. Hanley Chiang & Stephen Lipscomb & Brian Gill, 2016. "Is School Value Added Indicative of Principal Quality?," Education Finance and Policy, MIT Press, vol. 11(3), pages 283-309, Summer.
    5. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    6. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    7. Anand, Gautam & Atluri, Aishwarya & Crawfurd, Lee & Pugatch, Todd & Sheth, Ketki, 2023. "Improving school management in low and middle income countries: A systematic review," Economics of Education Review, Elsevier, vol. 97(C).
    8. Dan Goldhaber & Cyrus Grout & Nick Huntington-Klein, 2017. "Screen Twice, Cut Once: Assessing the Predictive Validity of Applicant Selection Tools," Education Finance and Policy, MIT Press, vol. 12(2), pages 197-223, Spring.
    9. Hinrichs, Peter, 2021. "What kind of teachers are schools looking for? Evidence from a randomized field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 395-411.
    10. Araujo P., Maria Daniela & Quis, Johanna Sophie, 2021. "Parents can tell! Evidence on classroom quality differences in German primary schools," BERG Working Paper Series 172, Bamberg University, Bamberg Economic Research Group.
    11. Elias Walsh & Dallas Dotter, 2020. "The Impact on Student Achievement of Replacing Principals in District of Columbia Public Schools," Education Finance and Policy, MIT Press, vol. 15(3), pages 518-542, Summer.
    12. Araujo P., María Daniela & Quis, Johanna Sophie, 2021. "Teacher Effects in Germany: Evidence from Elementary School," VfS Annual Conference 2021 (Virtual Conference): Climate Economics 242457, Verein für Socialpolitik / German Economic Association.
    13. Pope, Nolan G., 2019. "The effect of teacher ratings on teacher performance," Journal of Public Economics, Elsevier, vol. 172(C), pages 84-110.
    14. Dhushyanth Raju, 2017. "Public School Teacher Management in Sri Lanka," South Asia Economic Journal, Institute of Policy Studies of Sri Lanka, vol. 18(1), pages 39-63, March.
    15. Elizabeth Dhuey & Justin Smith, 2018. "How school principals influence student learning," Empirical Economics, Springer, vol. 54(2), pages 851-882, March.
    16. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    17. Mike Helal & Michael Coelli, 2016. "How Principals Affect Schools," Melbourne Institute Working Paper Series wp2016n18, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    18. Stacy, Brian, 2014. "Ranking Teachers when Teacher Value-Added is Heterogeneous Across Students," EconStor Preprints 104743, ZBW - Leibniz Information Centre for Economics.
    19. Stacy, Brian & Guarino, Cassandra & Wooldridge, Jeffrey, 2018. "Does the precision and stability of value-added estimates of teacher performance depend on the types of students they serve?," Economics of Education Review, Elsevier, vol. 64(C), pages 50-74.
    20. Imberman, Scott A. & Lovenheim, Michael F., 2016. "Does the market value value-added? Evidence from housing prices after a public release of school and teacher value-added," Journal of Urban Economics, Elsevier, vol. 91(C), pages 104-121.

    More about this item

    Keywords

    School principals; Value-added models; Economics of Education; Public sector leadership; Performance evaluation;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • J45 - Labor and Demographic Economics - - Particular Labor Markets - - - Public Sector Labor Markets

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:pubeco:v:234:y:2024:i:c:s0047272724000513. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/505578 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.