IDEAS home Printed from https://ideas.repec.org/p/jgu/wpaper/2114.html
   My bibliography  Save this paper

Feedback in Homogeneous Ability Groups: A Field Experiment

Author

Listed:
  • Tim Klausmann

    (Johannes Gutenberg University Mainz)

Abstract

Relative performance feedback often increases effort and performance on average. However, in the context of education, learners with low ability often do not profit from relative performance feedback. Less is known on how learners react to feedback when changing the feedback group composition. In a randomized field experiment we allocated 7352 learners into (i) homogeneous ability feedbackgroups, (ii) heterogeneous ability feedbackgroups, and (iii) a control group. All learners were observed in an online learning enviroment with anonymity between them. We find that on average relative performance feedback increases learning effort by 0.11 standard deviations. However, we do not observe any difference between learners in homogeneous and heterogeneous feedback groups on average. Further, we analyze the differential treatment effect for different ability levels between homogeneous and heterogenous feedback groups.

Suggested Citation

  • Tim Klausmann, 2021. "Feedback in Homogeneous Ability Groups: A Field Experiment," Working Papers 2114, Gutenberg School of Management and Economics, Johannes Gutenberg-Universität Mainz.
    • Handle: RePEc:jgu:wpaper:2114
    as

    Download full text from publisher

    File URL: https://download.uni-mainz.de/RePEc/pdf/Discussion_Paper_2114.pdf
    File Function: First version, 2021
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Azmat, Ghazala & Iriberri, Nagore, 2010. "The importance of relative performance feedback information: Evidence from a natural experiment using high school students," Journal of Public Economics, Elsevier, vol. 94(7-8), pages 435-452, August.
    2. Hermes, Henning & Huschens, Martin & Rothlauf, Franz & Schunk, Daniel, 2021. "Motivating low-achievers—Relative performance feedback in primary schools," Journal of Economic Behavior & Organization, Elsevier, vol. 187(C), pages 45-59.
    3. James Heckman & Flavio Cunha, 2007. "The Technology of Skill Formation," American Economic Review, American Economic Association, vol. 97(2), pages 31-47, May.
    4. David Gill & Zdenka Kissová & Jaesun Lee & Victoria Prowse, 2019. "First-Place Loving and Last-Place Loathing: How Rank in the Distribution of Performance Affects Effort Provision," Management Science, INFORMS, vol. 65(2), pages 494-507, February.
    5. Jeffrey T. Denning & Richard Murphy & Felix Weinhardt, 2023. "Class Rank and Long-Run Outcomes," The Review of Economics and Statistics, MIT Press, vol. 105(6), pages 1426-1441, November.
    6. Abhijit Banerjee & Rukmini Banerji & James Berry & Esther Duflo & Harini Kannan & Shobhini Mukherji & Marc Shotland & Michael Walton, 2016. "Mainstreaming an Effective Intervention: Evidence from Randomized Evaluations of “Teaching at the Right Level” in India," NBER Working Papers 22746, National Bureau of Economic Research, Inc.
    7. Richard Murphy & Felix Weinhardt, 2020. "Top of the Class: The Importance of Ordinal Rank," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(6), pages 2777-2826.
    8. Tahir Andrabi & Jishnu Das & Asim Ijaz Khwaja, 2017. "Report Cards: The Impact of Providing School and Child Test Scores on Educational Markets," American Economic Review, American Economic Association, vol. 107(6), pages 1535-1563, June.
    9. Esther Duflo & Pascaline Dupas & Michael Kremer, 2011. "Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya," American Economic Review, American Economic Association, vol. 101(5), pages 1739-1774, August.
    10. Czibor, Eszter & Onderstal, Sander & Sloof, Randolph & van Praag, C. Mirjam, 2020. "Does relative grading help male students? Evidence from a field experiment in the classroom," Economics of Education Review, Elsevier, vol. 75(C).
    11. Ashraf, Nava & Bandiera, Oriana & Lee, Scott S., 2014. "Awards unbundled: Evidence from a natural field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 100(C), pages 44-63.
    12. Benjamin Elsner & Ingo E. Isphording, 2017. "A Big Fish in a Small Pond: Ability Rank and Human Capital Investment," Journal of Labor Economics, University of Chicago Press, vol. 35(3), pages 787-828.
    13. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    14. Axel Ockenfels & Gary E. Bolton, 2000. "ERC: A Theory of Equity, Reciprocity, and Competition," American Economic Review, American Economic Association, vol. 90(1), pages 166-193, March.
    15. Camelia M. Kuhnen & Agnieszka Tymula, 2012. "Feedback, Self-Esteem, and Performance in Organizations," Management Science, INFORMS, vol. 58(1), pages 94-113, January.
    16. Marie Claire Villeval, 2020. "Performance Feedback and Peer Effects," Post-Print halshs-02909726, HAL.
    17. Eric A. Hanushek & Ludger Wössmann, 2006. "Does Educational Tracking Affect Performance and Inequality? Differences- in-Differences Evidence Across Countries," Economic Journal, Royal Economic Society, vol. 116(510), pages 63-76, March.
    18. David Card & Laura Giuliano, 2016. "Can Tracking Raise the Test Scores of High-Ability Minority Students?," American Economic Review, American Economic Association, vol. 106(10), pages 2783-2816, October.
    19. Duflo, Esther & Banerjee, Abhijit & Banerji, Rukmini & Berry, James & Mukerji, Shobhini & Shotland, Marc & Walton, Michael & Kannan, Harini, 2016. "Mainstreaming an Effective Intervention: Evidence from Randomized Evaluations of “Teaching at the Right Level†in India," CEPR Discussion Papers 11530, C.E.P.R. Discussion Papers.
    20. Grewenig, Elisabeth & Lergetporer, Philipp & Werner, Katharina & Woessmann, Ludger & Zierow, Larissa, 2021. "COVID-19 and educational inequality: How school closures affect low- and high-achieving students," European Economic Review, Elsevier, vol. 140(C).
    21. Christian Dustmann & Patrick A. Puhani & Uta Schönberg, 2017. "The Long‐term Effects of Early Track Choice," Economic Journal, Royal Economic Society, vol. 127(603), pages 1348-1380, August.
    22. Betts, Julian R., 2011. "The Economics of Tracking in Education," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 3, chapter 7, pages 341-381, Elsevier.
    23. David Austen-Smith & Roland G. Fryer, 2005. "An Economic Analysis of "Acting White"," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 120(2), pages 551-583.
    24. Chaim Fershtman & Uri Gneezy, 2011. "The Tradeoff Between Performance And Quitting In High Power Tournaments," Journal of the European Economic Association, European Economic Association, vol. 9(2), pages 318-336, April.
    25. Jalava, Nina & Joensen, Juanna Schrøter & Pellas, Elin, 2015. "Grades and rank: Impacts of non-financial incentives on test performance," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 161-196.
    26. Goulas, Sofoklis & Megalokonomou, Rigissa, 2021. "Knowing who you actually are: The effect of feedback on short- and longer-term outcomes," Journal of Economic Behavior & Organization, Elsevier, vol. 183(C), pages 589-615.
    27. Christian Dustmann & Patrick A. Puhani & Uta Schönberg, 2017. "The Long‐term Effects of Early Track Choice," Economic Journal, Royal Economic Society, vol. 127(603), pages 1348-1380, August.
    28. L I Dobrescu & M Faravelli & R Megalokonomou & A Motta, 2021. "Relative Performance Feedback in Education: Evidence from a Randomised Controlled Trial [‘Teachers and student achievement in the Chicago public high schools’]," The Economic Journal, Royal Economic Society, vol. 131(640), pages 3145-3181.
    29. Florian Hett & Felix Schmidt, 2018. "Pushing Through or Slacking Off? Heterogeneity on the Reaction to Rank Feedback," Working Papers 1806, Gutenberg School of Management and Economics, Johannes Gutenberg-Universität Mainz.
    30. Haenni, Simon, 2019. "Ever tried. Ever failed. No matter? On the demotivational effect of losing in repeated competitions," Games and Economic Behavior, Elsevier, vol. 115(C), pages 346-362.
    31. David Austen-Smith & Ronald G. Fryer, 2005. "An Economic Analysis of 'Acting White'," Discussion Papers 1399, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
    32. Fischer, Mira & Wagner, Valentin, 2018. "Effects of timing and reference frame of feedback: Evidence from a field experiment," Discussion Papers, Research Unit: Market Behavior SP II 2018-206, WZB Berlin Social Science Center.
    33. Leonardo Bursztyn & Robert Jensen, 2015. "How Does Peer Pressure Affect Educational Investments?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(3), pages 1329-1367.
    34. Marie Claire Villeval, 2020. "Performance Feedback and Peer Effects," Working Papers 2009, Groupe d'Analyse et de Théorie Economique Lyon St-Étienne (GATE Lyon St-Étienne), Université de Lyon.
    35. Marie Claire Villeval, 2020. "Performance Feedback and Peer Effects," Working Papers halshs-02488913, HAL.
    36. Manuel Arellano & Stephen Bond, 1991. "Some Tests of Specification for Panel Data: Monte Carlo Evidence and an Application to Employment Equations," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(2), pages 277-297.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Klausmann, Tim & Wagner, Valentin & Zipperle, Isabell, 2021. "Rank response functions in an online learning environment," Economics Letters, Elsevier, vol. 209(C).
    2. Hermes, Henning & Huschens, Martin & Rothlauf, Franz & Schunk, Daniel, 2021. "Motivating low-achievers—Relative performance feedback in primary schools," Journal of Economic Behavior & Organization, Elsevier, vol. 187(C), pages 45-59.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gwen-Jiro Clochard & Guillaume Hollard & Julia Wirtz, 2022. "More effort or better technologies? On the effect of relative performance feedback," Bristol Economics Discussion Papers 22/767, School of Economics, University of Bristol, UK.
    2. Klausmann, Tim & Wagner, Valentin & Zipperle, Isabell, 2021. "Rank response functions in an online learning environment," Economics Letters, Elsevier, vol. 209(C).
    3. Brade, Raphael & Himmler, Oliver & Jäckle, Robert, 2022. "Relative performance feedback and the effects of being above average — field experiment and replication," Economics of Education Review, Elsevier, vol. 89(C).
    4. Collins, Matthew & Lundstedt, Jonas, 2024. "The effects of more informative grading on student outcomes," Journal of Economic Behavior & Organization, Elsevier, vol. 218(C), pages 514-549.
    5. de Roux, Nicolás & Riehl, Evan, 2022. "Do college students benefit from placement into higher-achieving classes?," Journal of Public Economics, Elsevier, vol. 210(C).
    6. Hermes, Henning & Huschens, Martin & Rothlauf, Franz & Schunk, Daniel, 2021. "Motivating low-achievers—Relative performance feedback in primary schools," Journal of Economic Behavior & Organization, Elsevier, vol. 187(C), pages 45-59.
    7. David Gill & Zdenka Kissová & Jaesun Lee & Victoria Prowse, 2019. "First-Place Loving and Last-Place Loathing: How Rank in the Distribution of Performance Affects Effort Provision," Management Science, INFORMS, vol. 65(2), pages 494-507, February.
    8. Canaan, Serena, 2020. "The long-run effects of reducing early school tracking," Journal of Public Economics, Elsevier, vol. 187(C).
    9. Dobrescu, Isabella & Faravelli, Marco & Megalokonomou, Rigissa & Motta, Alberto, 2019. "Rank Incentives and Social Learning: Evidence from a Randomized Controlled Trial," IZA Discussion Papers 12437, Institute of Labor Economics (IZA).
    10. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    11. Lukas Kiessling & Jonas Radbruch & Sebastian Schaube, 2022. "Self-Selection of Peers and Performance," Management Science, INFORMS, vol. 68(11), pages 8184-8201, November.
    12. Yu, Han, 2020. "Am I the big fish? The effect of ordinal rank on student academic performance in middle school," Journal of Economic Behavior & Organization, Elsevier, vol. 176(C), pages 18-41.
    13. Rigissa Megalokonomou & Yi Zhang, 2022. "How Good Am I? Effects and Mechanisms behind Salient Ranks," CESifo Working Paper Series 9991, CESifo.
    14. Falk, Armin & Kosse, Fabian & Pinger, Pia, 2020. "Mentoring and Schooling Decisions: Causal Evidence," IZA Discussion Papers 13387, Institute of Labor Economics (IZA).
    15. Rigissa Megalokonomou & Yi Zhang, 2023. "How Good Am I? Effects and Mechanisms Behind Salient Rank," Monash Economics Working Papers 2023-07, Monash University, Department of Economics.
    16. Matthewes, Sonke, 2020. "Better together? Heterogeneous effects of tracking on student achievement," LSE Research Online Documents on Economics 108478, London School of Economics and Political Science, LSE Library.
    17. ISOZUMI Koji & ITO Hirotake & NAKAMURO Makiko & YAMAGUCHI Shintaro, 2021. "Is Entering a Selective School the Ultimate Goal or Just a Start? The Effect of Ordinal Rank on Academic Achievement and College Quality in a Selective Secondary School," Discussion papers 21086, Research Institute of Economy, Trade and Industry (RIETI).
    18. Fischer, Mira & Wagner, Valentin, 2018. "Effects of Timing and Reference Frame of Feedback: Evidence from a Field Experiment," IZA Discussion Papers 11970, Institute of Labor Economics (IZA).
    19. Sönke Hendrik Matthewes, 2020. "Better together? Heterogeneous effects of tracking on student achievement," CEP Discussion Papers dp1706.pdf, Centre for Economic Performance, LSE.
    20. Raphael Brade & Oliver Himmler & Robert Jaeckle, 2023. "Relative Performance Feedback and Long-Term Tasks – Experimental Evidence from Higher Education," CESifo Working Paper Series 10346, CESifo.

    More about this item

    Keywords

    Feedback; Relative Performance; Heterogeneity; Education; Online Education; Peer Quality; Tracking; Learning Behavior; Gamification;
    All these keywords.

    JEL classification:

    • D31 - Microeconomics - - Distribution - - - Personal Income and Wealth Distribution
    • F12 - International Economics - - Trade - - - Models of Trade with Imperfect Competition and Scale Economies; Fragmentation
    • F16 - International Economics - - Trade - - - Trade and Labor Market Interactions
    • H24 - Public Economics - - Taxation, Subsidies, and Revenue - - - Personal Income and Other Nonbusiness Taxes and Subsidies

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jgu:wpaper:2114. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Research Unit IPP (email available below). General contact details of provider: https://edirc.repec.org/data/vlmaide.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.