IDEAS home Printed from https://ideas.repec.org/a/eee/ecoedu/v102y2024ics0272775724000694.html
   My bibliography  Save this article

Out of sight, out of mind? The gap between students’ test performance and teachers’ estimations in India and Bangladesh

Author

Listed:
  • Djaker, Sharnic
  • Ganimian, Alejandro J.
  • Sabarwal, Shwetlena

Abstract

This is one of the first studies of the mismatch between students’ test scores and teachers’ estimations of those scores in low- and middle-income countries. Prior studies in high-income countries have found strong correlations between these metrics. We leverage data on actual and estimated scores in math and language from India and Bangladesh and find that teachers misestimate their students’ scores and that their estimations reveal their misconceptions about students in most need of support and variability within their class. This pattern is partly explained by teachers’ propensity to overestimate the scores of low-achieving students and to overweight the importance of intelligence. Teachers seem unaware of their errors, expressing confidence in estimations and surprise about their students’ performance once revealed.

Suggested Citation

  • Djaker, Sharnic & Ganimian, Alejandro J. & Sabarwal, Shwetlena, 2024. "Out of sight, out of mind? The gap between students’ test performance and teachers’ estimations in India and Bangladesh," Economics of Education Review, Elsevier, vol. 102(C).
  • Handle: RePEc:eee:ecoedu:v:102:y:2024:i:c:s0272775724000694
    DOI: 10.1016/j.econedurev.2024.102575
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0272775724000694
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.econedurev.2024.102575?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Shwetlena Sabarwal & Malek Abu-Jawdeh & Radhika Kapoor, 2022. "Teacher Beliefs: Why They Matter and What They Are [Instructional Time Loss in Developing Countries: Concepts, Measurement, and Implications]," The World Bank Research Observer, World Bank, vol. 37(1), pages 73-106.
    2. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    3. Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1235-1264.
    4. Nazmul Chaudhury & Jeffrey Hammer & Michael Kremer & Karthik Muralidharan & F. Halsey Rogers, 2006. "Missing in Action: Teacher and Health Worker Absence in Developing Countries," Journal of Economic Perspectives, American Economic Association, vol. 20(1), pages 91-116, Winter.
    5. Abhijit Banerjee & Rukmini Banerji & James Berry & Esther Duflo & Harini Kannan & Shobhini Mukerji & Marc Shotland & Michael Walton, 2017. "From Proof of Concept to Scalable Policies: Challenges and Solutions, with an Application," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 73-102, Fall.
    6. Javier Luque & Barbara Bruns, 2014. "Great Teachers : How to Raise Student Learning in Latin America and the Caribbean--Overview," World Bank Publications - Reports 19507, The World Bank Group.
    7. Muralidharan, Karthik & Das, Jishnu & Holla, Alaka & Mohpal, Aakash, 2017. "The fiscal cost of weak governance: Evidence from teacher absence in India," Journal of Public Economics, Elsevier, vol. 145(C), pages 116-135.
    8. Azam, Mehtabul & Kingdon, Geeta Gandhi, 2015. "Assessing teacher quality in India," Journal of Development Economics, Elsevier, vol. 117(C), pages 74-83.
    9. Pritchett, Lant & Beatty, Amanda, 2015. "Slow down, you’re going too fast: Matching curricula to student skill levels," International Journal of Educational Development, Elsevier, vol. 40(C), pages 276-288.
    10. Esther Duflo & Pascaline Dupas & Michael Kremer, 2011. "Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya," American Economic Review, American Economic Association, vol. 101(5), pages 1739-1774, August.
    11. Farfan Bertran,Maria Gabriela & Holla,Alaka & Vakis,Renos, 2021. "Poor Expectations : Experimental Evidence on Teachers~^!!^ Stereotypes and Student Assessment: Poor Expectations : Experimental Evidence on Teachers' Stereotypes and Student Assessment," Policy Research Working Paper Series 9593, The World Bank.
    12. Metzler, Johannes & Woessmann, Ludger, 2012. "The impact of teacher subject knowledge on student achievement: Evidence from within-teacher within-student variation," Journal of Development Economics, Elsevier, vol. 99(2), pages 486-496.
    13. Abhijit V. Banerjee & Rukmini Banerji & Esther Duflo & Rachel Glennerster & Stuti Khemani, 2010. "Pitfalls of Participatory Programs: Evidence from a Randomized Evaluation in Education in India," American Economic Journal: Economic Policy, American Economic Association, vol. 2(1), pages 1-30, February.
    14. Annie Duflo & Jessica Kiessel & Adrienne Lucas, 2020. "Experimental Evidence on Alternative Policies to Increase Learning at Scale," NBER Working Papers 27298, National Bureau of Economic Research, Inc.
    15. Karthik Muralidharan & Abhijeet Singh & Alejandro J. Ganimian, 2019. "Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India," American Economic Review, American Economic Association, vol. 109(4), pages 1426-1460, April.
    16. Rafael de Hoyos & Alejandro J Ganimian & Peter A Holland, 2021. "Teaching with the Test: Experimental Evidence on Diagnostic Feedback and Capacity Building for Public Schools in Argentina," The World Bank Economic Review, World Bank, vol. 35(2), pages 499-520.
    17. Roland Bénabou & Jean Tirole, 2016. "Mindful Economics: The Production, Consumption, and Value of Beliefs," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 141-164, Summer.
    18. de Barros, Andreas & Ganimian, Alejandro J., 2023. "The foundational math skills of Indian children," Economics of Education Review, Elsevier, vol. 92(C).
    19. de Hoyos, Rafael & Garcia-Moreno, Vicente A. & Patrinos, Harry Anthony, 2017. "The impact of an accountability intervention with diagnostic feedback: Evidence from Mexico," Economics of Education Review, Elsevier, vol. 58(C), pages 123-140.
    20. Tessa Bold & Deon Filmer & Gayle Martin & Ezequiel Molina & Brian Stacy & Christophe Rockmore & Jakob Svensson & Waly Wane, 2017. "Enrollment without Learning: Teacher Effort, Knowledge, and Skill in Primary Schools in Africa," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 185-204, Fall.
    21. Reisinger, James, 2022. "Subjective well-being and social desirability," Journal of Public Economics, Elsevier, vol. 214(C).
    22. Rema N. Hanna & Leigh L. Linden, 2012. "Discrimination in Grading," American Economic Journal: Economic Policy, American Economic Association, vol. 4(4), pages 146-168, November.
    23. Barbara Bruns & Deon Filmer & Harry Anthony Patrinos, 2011. "Making Schools Work : New Evidence on Accountability Reforms," World Bank Publications - Books, The World Bank Group, number 2270.
    24. Bau,Natalie & Das,Jishnu, 2017. "The misallocation of pay and productivity in the public sector : evidence from the labor market for teachers," Policy Research Working Paper Series 8050, The World Bank.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maruyama, Takao & Kurosaki, Takashi, 2021. "Do remedial activities using math workbooks improve student learning? Empirical evidence from scaled-up interventions in Niger," World Development, Elsevier, vol. 148(C).
    2. Eduard Marinov, 2019. "The 2019 Nobel Prize in Economics," Economic Thought journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 6, pages 78-116.
    3. Angrist, Noam & Bergman, Peter & Matsheng, Moitshepi, 2020. "School's Out: Experimental Evidence on Limiting Learning Loss Using," IZA Discussion Papers 14009, Institute of Labor Economics (IZA).
    4. Committee, Nobel Prize, 2019. "Understanding development and poverty alleviation," Nobel Prize in Economics documents 2019-2, Nobel Prize Committee.
    5. Eble, Alex & Frost, Chris & Camara, Alpha & Bouy, Baboucarr & Bah, Momodou & Sivaraman, Maitri & Hsieh, Pei-Tseng Jenny & Jayanty, Chitra & Brady, Tony & Gawron, Piotr & Vansteelandt, Stijn & Boone, P, 2021. "How much can we remedy very low learning levels in rural parts of low-income countries? Impact and generalizability of a multi-pronged para-teacher intervention from a cluster-randomized trial in the ," Journal of Development Economics, Elsevier, vol. 148(C).
    6. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2020. "School’s Out: Experimental Evidence on Limiting Learning Loss Using “Low-Tech” in a Pandemic," NBER Working Papers 28205, National Bureau of Economic Research, Inc.
    7. Sabrin Beg & Waqas Halim & Adrienne M. Lucas & Umar Saif, 2022. "Engaging Teachers with Technology Increased Achievement, Bypassing Teachers Did Not," American Economic Journal: Economic Policy, American Economic Association, vol. 14(2), pages 61-90, May.
    8. Islam, Asad & Lee, Wang-Sheng & Nicholas, Aaron, 2021. "The Effects of Chess Instruction on Academic and Non-cognitive Outcomes: Field Experimental Evidence from a Developing Country," Journal of Development Economics, Elsevier, vol. 150(C).
    9. Hashibul Hassan & Asad Islam & Abu Siddique & Liang Choon Wang, 2024. "Telementoring and Homeschooling During School Closures: a Randomised Experiment in Rural Bangladesh," The Economic Journal, Royal Economic Society, vol. 134(662), pages 2418-2438.
    10. Johnston, Jamie & Ksoll, Christopher, 2022. "Effectiveness of interactive satellite-transmitted instruction: Experimental evidence from Ghanaian primary schools," Economics of Education Review, Elsevier, vol. 91(C).
    11. Aymo Brunetti & Konstantin Büchel & Martina Jakob & Ben Jann & Christoph Kühnhanss & Daniel Steffen, 2020. "Teacher Content Knowledge in Developing Countries: Evidence from a Math Assessment in El Salvador," University of Bern Social Sciences Working Papers 34, University of Bern, Department of Social Sciences.
    12. Islam, Asad, 2019. "Parent–teacher meetings and student outcomes: Evidence from a developing country," European Economic Review, Elsevier, vol. 111(C), pages 273-304.
    13. Asim,Salman & Chase,Robert S. & Dar,Amit & Schmillen,Achim Daniel, 2015. "Improving education outcomes in South Asia : findings from a decade of impact evaluations," Policy Research Working Paper Series 7362, The World Bank.
    14. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2022. "Experimental evidence on learning using low-tech when school is out," Nature Human Behaviour, Nature, vol. 6(7), pages 941-950, July.
    15. Angrist, Noam & de Barros, Andreas & Bhula, Radhika & Chakera, Shiraz & Cummiskey, Chris & DeStefano, Joseph & Floretta, John & Kaffenberger, Michelle & Piper, Benjamin & Stern, Jonathan, 2021. "Building back better to avert a learning catastrophe: Estimating learning loss from COVID-19 school shutdowns in Africa and facilitating short-term and long-term learning recovery," International Journal of Educational Development, Elsevier, vol. 84(C).
    16. Duflo, Esther & Dupas, Pascaline & Kremer, Michael, 2015. "School governance, teacher incentives, and pupil–teacher ratios: Experimental evidence from Kenyan primary schools," Journal of Public Economics, Elsevier, vol. 123(C), pages 92-110.
    17. Alejandro J. Ganimian & Richard J. Murnane, 2014. "Improving Educational Outcomes in Developing Countries: Lessons from Rigorous Impact Evaluations," NBER Working Papers 20284, National Bureau of Economic Research, Inc.
    18. Goel, Deepti & Barooah, Bidisha, 2018. "Drivers of Student Performance: Evidence from Higher Secondary Public Schools in Delhi," GLO Discussion Paper Series 231, Global Labor Organization (GLO).
    19. Mo, Di & Bai, Yu & Shi, Yaojiang & Abbey, Cody & Zhang, Linxiu & Rozelle, Scott & Loyalka, Prashant, 2020. "Institutions, implementation, and program effectiveness: Evidence from a randomized evaluation of computer-assisted learning in rural China," Journal of Development Economics, Elsevier, vol. 146(C).
    20. Rodriguez-Segura, Daniel & Campton, Cole & Crouch, Luis & Slade, Timothy S., 2021. "Looking beyond changes in averages in evaluating foundational learning: Some inequality measures," International Journal of Educational Development, Elsevier, vol. 84(C).

    More about this item

    Keywords

    Teachers’ estimations; Differentiated instruction; India; Bangladesh;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I22 - Health, Education, and Welfare - - Education - - - Educational Finance; Financial Aid
    • I25 - Health, Education, and Welfare - - Education - - - Education and Economic Development

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecoedu:v:102:y:2024:i:c:s0272775724000694. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/econedurev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.