IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp6629.html
   My bibliography  Save this paper

When the Cat Is Near, the Mice Won't Play: The Effect of External Examiners in Italian Schools

Author

Listed:
  • Bertoni, Marco

    (University of Padova)

  • Brunello, Giorgio

    (University of Padova)

  • Rocco, Lorenzo

    (University of Padova)

Abstract

We use a natural experiment to show that the presence of an external examiner in standardized school tests reduces the proportion of correct answers in monitored classes by 5.5 to 8.5% – depending on the grade and the test – with respect to classes in schools with no external monitor. We find that the effect of external monitoring in a class spills over to other classes in the same school. We argue that the negative effect of external supervision is due to reduced cheating (by students and/or teachers) rather than to distraction from having a stranger in the class.

Suggested Citation

  • Bertoni, Marco & Brunello, Giorgio & Rocco, Lorenzo, 2012. "When the Cat Is Near, the Mice Won't Play: The Effect of External Examiners in Italian Schools," IZA Discussion Papers 6629, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp6629
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp6629.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Figlio, David N., 2006. "Testing, crime and punishment," Journal of Public Economics, Elsevier, vol. 90(4-5), pages 837-851, May.
    2. Andrea Ichino & Giovanni Maggi, 2000. "Work Environment and Individual Background: Explaining Regional Shirking Differentials in a Large Italian Firm," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(3), pages 1057-1090.
    3. Manuela Angelucci & Giacomo De Giorgi, 2009. "Indirect Effects of an Aid Program: How Do Cash Transfers Affect Ineligibles' Consumption?," American Economic Review, American Economic Association, vol. 99(1), pages 486-508, March.
    4. Luigi Guiso & Paola Sapienza & Luigi Zingales, 2004. "The Role of Social Capital in Financial Development," American Economic Review, American Economic Association, vol. 94(3), pages 526-556, June.
    5. Tommaso Nannicini & Andrea Stella & Guido Tabellini & Ugo Troiano, 2013. "Social Capital and Political Accountability," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 222-250, May.
    6. Jacob, Brian A., 2005. "Accountability, incentives and behavior: the impact of high-stakes testing in the Chicago Public Schools," Journal of Public Economics, Elsevier, vol. 89(5-6), pages 761-796, June.
    7. Bokhari, Farasat A.S. & Schneider, Helen, 2011. "School accountability laws and the consumption of psychostimulants," Journal of Health Economics, Elsevier, vol. 30(2), pages 355-372, March.
    8. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    9. Figlio, David N. & Winicki, Joshua, 2005. "Food for thought: the effects of school accountability plans on school nutrition," Journal of Public Economics, Elsevier, vol. 89(2-3), pages 381-394, February.
    10. Iftikhar Hussain, 2012. "Subjective Performance Evaluation in the Public Sector: Evidence from School Inspections," CEE Discussion Papers 0135, Centre for the Economics of Education, LSE.
    11. Randall Reback & Julie Berry Cullen, 2006. "Tinkering toward accolades: School gaming under a performance accountability system," Working Papers 0601, Barnard College, Department of Economics.
    12. Brian A. Jacob & Steven D. Levitt, 2003. "Rotten Apples: An Investigation of the Prevalence and Predictors of Teacher Cheating," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 843-877.
    13. Luigi Guiso & Paola Sapienza & Luigi Zingales, 2010. "Civic Capital as the Missing Link," NBER Working Papers 15845, National Bureau of Economic Research, Inc.
    14. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    15. Figlio, David & Loeb, Susanna, 2011. "School Accountability," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 3, chapter 8, pages 383-421, Elsevier.
    16. Papke, Leslie E & Wooldridge, Jeffrey M, 1996. "Econometric Methods for Fractional Response Variables with an Application to 401(K) Plan Participation Rates," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(6), pages 619-632, Nov.-Dec..
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Patricia M. Anderson & Kristin F. Butcher & Diane Whitmore Schanzenbach, 2017. "Adequate (or Adipose?) Yearly Progress: Assessing the Effect of “No Child Left Behind” on Children's Obesity," Education Finance and Policy, MIT Press, vol. 12(1), pages 54-76, Winter.
    2. Cuesta, José Ignacio & González, Felipe & Larroulet Philippi, Cristian, 2020. "Distorted quality signals in school markets," Journal of Development Economics, Elsevier, vol. 147(C).
    3. Seth Gershenson, 2016. "Performance Standards and Employee Effort: Evidence From Teacher Absences," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 35(3), pages 615-638, June.
    4. Rajashri Chakrabarti, 2013. "Vouchers, Public School Response, And The Role Of Incentives: Evidence From Florida," Economic Inquiry, Western Economic Association International, vol. 51(1), pages 500-526, January.
    5. Reback, Randall, 2008. "Teaching to the rating: School accountability and the distribution of student achievement," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1394-1415, June.
    6. Seth Gershenson & Stephen B. Holt & Nicholas Papageorge, 2015. "Who Believes in Me? The Effect of Student-Teacher Demographic Match on Teacher Expectations," Upjohn Working Papers 15-231, W.E. Upjohn Institute for Employment Research.
    7. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    8. Figlio, David N. & Rouse, Cecilia Elena, 2006. "Do accountability and voucher threats improve low-performing schools?," Journal of Public Economics, Elsevier, vol. 90(1-2), pages 239-255, January.
    9. Derek Neal, 2011. "The Design of Performance Pay in Education," NBER Working Papers 16710, National Bureau of Economic Research, Inc.
    10. Sarah C. Fuller & Helen F. Ladd, 2013. "School-Based Accountability and the Distribution of Teacher Quality Across Grades in Elementary School," Education Finance and Policy, MIT Press, vol. 8(4), pages 528-559, October.
    11. Chakrabarti, Rajashri, 2014. "Incentives and responses under No Child Left Behind: Credible threats and the role of competition," Journal of Public Economics, Elsevier, vol. 110(C), pages 124-146.
    12. Buerger, Christian & Lincove, Jane Arnold & Mata, Catherine, 2023. "How context shapes the relationship between school autonomy and test-scores. An explanatory analysis using PISA 2015," International Journal of Educational Development, Elsevier, vol. 99(C).
    13. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2015. "Do administrators respond to their accountability ratings? The response of school budgets to accountability grades," Economics of Education Review, Elsevier, vol. 49(C), pages 55-68.
    14. Battistin, Erich & De Nadai, Michele & Vuri, Daniela, 2017. "Counting rotten apples: Student achievement and score manipulation in Italian elementary Schools," Journal of Econometrics, Elsevier, vol. 200(2), pages 344-362.
    15. Barrera-Osorio, Felipe & Raju, Dhushyanth, 2017. "Teacher performance pay: Experimental evidence from Pakistan," Journal of Public Economics, Elsevier, vol. 148(C), pages 75-91.
    16. Brian A. Jacob, 2007. "Test-Based Accountability and Student Achievement: An Investigation of Differential Performance on NAEP and State Assessments," NBER Working Papers 12817, National Bureau of Economic Research, Inc.
    17. Bokhari, Farasat A.S. & Schneider, Helen, 2011. "School accountability laws and the consumption of psychostimulants," Journal of Health Economics, Elsevier, vol. 30(2), pages 355-372, March.
    18. Lucifora, Claudio & Tonello, Marco, 2015. "Cheating and social interactions. Evidence from a randomized experiment in a national evaluation program," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 45-66.
    19. Sergio Longobardi & Patrizia Falzetti & Margherita Maria Pagliuca, 2018. "Quis custiodet ipsos custodes? How to detect and correct teacher cheating in Italian student data," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(3), pages 515-543, August.
    20. Michael Coelli & Gigi Foster & Andrew Leigh, 2018. "Do School Principals Respond to Increased Public Scrutiny? New Survey Evidence from Australia," The Economic Record, The Economic Society of Australia, vol. 94(S1), pages 73-101, June.

    More about this item

    Keywords

    education; external monitoring; testing;
    All these keywords.

    JEL classification:

    • C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models
    • H52 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Education
    • I2 - Health, Education, and Welfare - - Education

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp6629. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.