IDEAS home Printed from https://ideas.repec.org/a/uwp/jhriss/v50y2015i1p189-221.html
   My bibliography  Save this article

Subjective Performance Evaluation in the Public Sector: Evidence from School Inspections

Author

Listed:
  • Iftikhar Hussain

Abstract

This paper investigates the effects of being evaluated under a novel subjective assessment system where independent inspectors visit schools at short notice, disclose their findings, and sanction schools rated fail. I demonstrate that a fail inspection rating leads to test score gains for primary school students. I find no evidence to suggest that fail schools are able to inflate test score performance by gaming the system. Relative to purely test-based accountability systems, this finding is striking and suggests that oversight by evaluators who are charged with investigating what goes on inside the classroom may play an important role in mitigating such strategic behavior. There appear to be no effects on test scores following an inspection for schools rated highly by the inspectors. This suggests that any effects from the process of evaluation and feedback are negligible for nonfailing schools, at least in the short term.

Suggested Citation

  • Iftikhar Hussain, 2015. "Subjective Performance Evaluation in the Public Sector: Evidence from School Inspections," Journal of Human Resources, University of Wisconsin Press, vol. 50(1), pages 189-221.
  • Handle: RePEc:uwp:jhriss:v:50:y:2015:i:1:p:189-221
    as

    Download full text from publisher

    File URL: http://jhr.uwpress.org/cgi/reprint/50/1/189
    Download Restriction: A subscripton is required to access pdf files. Pay per article is available.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Rebecca Allen & Simon Burgess & Leigh McKenna, 2010. "How should we treat under-performing schools? A regression discontinuity analysis of school inspections in England," DoQSS Working Papers 10-20, Quantitative Social Science - UCL Social Research Institute, University College London.
    2. Rajashri Chakrabarti, 2013. "Vouchers, Public School Response, And The Role Of Incentives: Evidence From Florida," Economic Inquiry, Western Economic Association International, vol. 51(1), pages 500-526, January.
    3. James J. Heckman & Carolyn J. Heinrich & Pascal Courty & Gerald Marschke & Jeffrey Smith (ed.), 2011. "The Performance of Performance Standards," Books from Upjohn Press, W.E. Upjohn Institute for Employment Research, number tpps, December.
    4. Currie, Janet & Thomas, Duncan, 1995. "Does Head Start Make a Difference?," American Economic Review, American Economic Association, vol. 85(3), pages 341-364, June.
    5. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2007. "Incentives for Managers and Inequality among Workers: Evidence from a Firm-Level Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(2), pages 729-773.
    6. Julie Berry Cullen & Steven D. Levitt & Erin Robertson & Sally Sadoff, 2013. "What Can Be Done to Improve Struggling High Schools?," Journal of Economic Perspectives, American Economic Association, vol. 27(2), pages 133-152, Spring.
    7. Hanley Chiang, "undated". "How Accountability Pressure on Failing Schools Affects Student Achievement," Mathematica Policy Research Reports c58a3b537e324447b94a2bd41, Mathematica Policy Research.
    8. Avinash Dixit, 2002. "# Incentives and Organizations in the Public Sector: An Interpretative Review," Journal of Human Resources, University of Wisconsin Press, vol. 37(4), pages 696-727.
    9. Atila Abdulkadiroğlu & Joshua D. Angrist & Susan M. Dynarski & Thomas J. Kane & Parag A. Pathak, 2011. "Accountability and Flexibility in Public Schools: Evidence from Boston's Charters And Pilots," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(2), pages 699-748.
    10. repec:mpr:mprres:6364 is not listed on IDEAS
    11. Violaine Faubert, 2009. "School Evaluation: Current Practices in OECD Countries and a Literature Review," OECD Education Working Papers 42, OECD Publishing.
    12. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lee Crawfurd, 2017. "School Management and Public–Private Partnerships in Uganda," Journal of African Economies, Centre for the Study of African Economies, vol. 26(5), pages 539-560.
    2. Oskari Harjunen & Mika Kortelainen & Tuukka Saarimaa, 2018. "Best Education Money Can Buy? Capitalization of School Quality in Finland," CESifo Economic Studies, CESifo Group, vol. 64(2), pages 150-175.
    3. Hussain, Iftikhar, 2023. "Housing market and school choice response to school quality information shocks✰," Journal of Urban Economics, Elsevier, vol. 138(C).
    4. Cabrera Hernández, Francisco-Javier, 2016. "Essays on the impact evaluation of education policies in Mexico," Economics PhD Theses 0316, Department of Economics, University of Sussex Business School.
    5. Sergio Longobardi & Patrizia Falzetti & Margherita Maria Pagliuca, 2018. "Quis custiodet ipsos custodes? How to detect and correct teacher cheating in Italian student data," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(3), pages 515-543, August.
    6. Camille Terrier & Parag A. Pathak & Kevin Ren, 2021. "From Immediate Acceptance to Deferred Acceptance: Effects on School Admissions and Achievement in England," NBER Working Papers 29600, National Bureau of Economic Research, Inc.
    7. Francisco Cabrera-Hernandez, 2015. "Does lengthening the school day increase students’ academic achievement? Evidence from a natural experiment," Working Paper Series 7415, Department of Economics, University of Sussex Business School.
    8. Sam Sims, 2016. "High-Stakes Accountability and Teacher Turnover: how do different school inspection judgements affect teachers' decisions to leave their school?," DoQSS Working Papers 16-14, Quantitative Social Science - UCL Social Research Institute, University College London.
    9. Jones, Maria & Kondylis, Florence, 2018. "Does feedback matter? Evidence from agricultural services," Journal of Development Economics, Elsevier, vol. 131(C), pages 28-41.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David J. Deming & Sarah Cohodes & Jennifer Jennings & Christopher Jencks, 2016. "School Accountability, Postsecondary Attainment, and Earnings," The Review of Economics and Statistics, MIT Press, vol. 98(5), pages 848-862, December.
    2. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    3. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    4. Filer, Randall K. & Münich, Daniel, 2013. "Responses of private and public schools to voucher funding," Economics of Education Review, Elsevier, vol. 34(C), pages 269-285.
    5. Benedikt Siegler, 2013. "What triggers school improvement? Evidence from a court induced change in Florida's A+ accountability plan," Working Papers 135, Bavarian Graduate Program in Economics (BGPE).
    6. Jonah Rockoff & Lesley J. Turner, 2010. "Short-Run Impacts of Accountability on School Quality," American Economic Journal: Economic Policy, American Economic Association, vol. 2(4), pages 119-147, November.
    7. David Figlio & Cassandra M. D. Hart, 2014. "Competitive Effects of Means-Tested School Vouchers," American Economic Journal: Applied Economics, American Economic Association, vol. 6(1), pages 133-156, January.
    8. Thomas Dee & Elise Dizon-Ross, 2017. "School Performance, Accountability and Waiver Reforms: Evidence from Louisiana," NBER Working Papers 23463, National Bureau of Economic Research, Inc.
    9. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2015. "Do administrators respond to their accountability ratings? The response of school budgets to accountability grades," Economics of Education Review, Elsevier, vol. 49(C), pages 55-68.
    10. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2013. "Does it pay to get an A? School resource allocations in response to accountability ratings," Journal of Urban Economics, Elsevier, vol. 73(1), pages 30-42.
    11. Benedikt Siegler, 2015. "Microeconometric Evaluations of Education Policies," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 57.
    12. Rajashri Chakrabarti, 2013. "Accountability with Voucher Threats, Responses, and the Test-Taking Population: Regression Discontinuity Evidence from Florida," Education Finance and Policy, MIT Press, vol. 8(2), pages 121-167, April.
    13. Chakrabarti, Rajashri, 2014. "Incentives and responses under No Child Left Behind: Credible threats and the role of competition," Journal of Public Economics, Elsevier, vol. 110(C), pages 124-146.
    14. Tahir Andrabi & Jishnu Das & Asim Ijaz Khwaja, 2017. "Report Cards: The Impact of Providing School and Child Test Scores on Educational Markets," American Economic Review, American Economic Association, vol. 107(6), pages 1535-1563, June.
    15. Burt S. Barnow & Jeffrey Smith, 2015. "Employment and Training Programs," NBER Chapters, in: Economics of Means-Tested Transfer Programs in the United States, Volume 2, pages 127-234, National Bureau of Economic Research, Inc.
    16. Richardson, J.T., 2015. "Accountability incentives and academic achievement: Distributional impacts of accountability when standards are set low," Economics of Education Review, Elsevier, vol. 44(C), pages 1-16.
    17. Pierre Koning & Karen Wiel, 2012. "School Responsiveness to Quality Rankings: An Empirical Analysis of Secondary Education in the Netherlands," De Economist, Springer, vol. 160(4), pages 339-355, December.
    18. Simon Burgess & Carol Propper & Marisa Ratto & Emma Tominey, 2017. "Incentives in the Public Sector: Evidence from a Government Agency," Economic Journal, Royal Economic Society, vol. 127(605), pages 117-141, October.
    19. Friesen, Jane & Harris, Benjamin Cerf & Woodcock, Simon, 2013. "Open Enrolment and Student Achievement," CLSSRN working papers clsrn_admin-2013-46, Vancouver School of Economics, revised 22 Mar 2014.
    20. Helen Simpson, 2009. "Productivity In Public Services," Journal of Economic Surveys, Wiley Blackwell, vol. 23(2), pages 250-276, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:uwp:jhriss:v:50:y:2015:i:1:p:189-221. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://jhr.uwpress.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.