IDEAS home Printed from https://ideas.repec.org/p/hal/spmain/hal-03574128.html
   My bibliography  Save this paper

What you don't know...Can't hurt you? A natural field experiment on relative performance feedback in higher education

Author

Listed:
  • Ghazala Azmat

    (ECON - Département d'économie (Sciences Po) - Sciences Po - Sciences Po - CNRS - Centre National de la Recherche Scientifique, CEPR - Center for Economic Policy Research, CEP - LSE - Centre for Economic Performance - LSE - London School of Economics and Political Science)

  • Manuel Bagues

    (Aalto University)

  • Antonio Cabrales

    (UCL - University College of London [London])

  • Nagore Iriberri

    (UPV / EHU - Universidad del País Vasco [Espainia] / Euskal Herriko Unibertsitatea [España] = University of the Basque Country [Spain] = Université du pays basque [Espagne])

Abstract

This paper studies the effect of providing feedback to college students on their position in the grade distribution by using a natural field experiment. This information was updated every six months during a three-year period. We find that greater grades transparency decreases educational performance, as measured by the number of exams passed and GPA. However self-reported satisfaction, as measured by surveys conducted after feedback is provided but before students take their exams, increases. We provide a theoretical framework to understand these results, focusing on the role of prior beliefs, and using out-of-trial surveys to test the model. In the absence of treatment, a majority of students underestimate their position in the grade distribution, suggesting that the updated information is "good news" for many students. Moreover, the negative effect on performance is driven by those students who underestimate their position in the absence of feedback. Students who overestimate initially their position, if anything, respond positively. The performance effects are short lived - by the time students graduate, they have similar accumulated GPA and graduation rates.

Suggested Citation

  • Ghazala Azmat & Manuel Bagues & Antonio Cabrales & Nagore Iriberri, 2019. "What you don't know...Can't hurt you? A natural field experiment on relative performance feedback in higher education," SciencePo Working papers Main hal-03574128, HAL.
  • Handle: RePEc:hal:spmain:hal-03574128
    DOI: 10.1287/mnsc.2018.3131
    Note: View the original document on HAL open archive server: https://sciencespo.hal.science/hal-03574128v1
    as

    Download full text from publisher

    File URL: https://sciencespo.hal.science/hal-03574128v1/document
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2018.3131?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Moore, Don A. & Cain, Daylian M., 2007. "Overconfidence and underconfidence: When and why people underestimate (and overestimate) the competition," Organizational Behavior and Human Decision Processes, Elsevier, vol. 103(2), pages 197-213, July.
    2. Bandiera, Oriana & Larcinese, Valentino & Rasul, Imran, 2015. "Blissful ignorance? A natural experiment on the effect of feedback on students' performance," Labour Economics, Elsevier, vol. 34(C), pages 13-25.
    3. Eriksson, Tor & Poulsen, Anders & Villeval, Marie Claire, 2009. "Feedback and incentives: Experimental evidence," Labour Economics, Elsevier, vol. 16(6), pages 679-688, December.
    4. Omar Al-Ubaydli & John List, 2015. "Do Natural Field Experiments Afford Researchers More or Less Control than Laboratory Experiments? A Simple Model," Artefactual Field Experiments 00458, The Field Experiments Website.
    5. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    6. Facundo Albornoz & Antonio Cabrales & Esther Hauk, 2019. "Occupational Choice with Endogenous Spillovers," The Economic Journal, Royal Economic Society, vol. 129(621), pages 1953-1970.
    7. Esther Duflo & Emmanuel Saez, 2003. "The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 815-842.
    8. Jordi Blanes i Vidal & Mareike Nossol, 2011. "Tournaments Without Prizes: Evidence from Personnel Records," Management Science, INFORMS, vol. 57(10), pages 1721-1736, October.
    9. Caroline M. Hoxby, 2009. "The Changing Selectivity of American Colleges," Journal of Economic Perspectives, American Economic Association, vol. 23(4), pages 95-118, Fall.
    10. Zahra Murad & Martin Sefton & Chris Starmer, 2016. "How do risk attitudes affect measured confidence?," Journal of Risk and Uncertainty, Springer, vol. 52(1), pages 21-46, February.
    11. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    12. Antoni Calvó-Armengol & Eleonora Patacchini & Yves Zenou, 2009. "Peer Effects and Social Networks in Education," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(4), pages 1239-1267.
    13. Andrew Caplin & John Leahy, 2001. "Psychological Expected Utility Theory and Anticipatory Feelings," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(1), pages 55-79.
    14. Azmat, Ghazala & Iriberri, Nagore, 2010. "The importance of relative performance feedback information: Evidence from a natural experiment using high school students," Journal of Public Economics, Elsevier, vol. 94(7-8), pages 435-452, August.
    15. Tisha L. N. Emerson & Beck A. Taylor, 2004. "Comparing Student Achievement across Experimental and Lecture-Oriented Sections of a Principles of Microeconomics Course," Southern Economic Journal, John Wiley & Sons, vol. 70(3), pages 672-693, January.
    16. Bruce Sacerdote, 2001. "Peer Effects with Random Assignment: Results for Dartmouth Roommates," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(2), pages 681-704.
    17. David Gill & Zdenka Kissová & Jaesun Lee & Victoria Prowse, 2019. "First-Place Loving and Last-Place Loathing: How Rank in the Distribution of Performance Affects Effort Provision," Management Science, INFORMS, vol. 65(2), pages 494-507, February.
    18. Roland Benabou, 1993. "Workings of a City: Location, Education, and Production," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(3), pages 619-652.
    19. Tran, Anh & Zeckhauser, Richard, 2012. "Rank as an inherent incentive: Evidence from a field experiment," Journal of Public Economics, Elsevier, vol. 96(9-10), pages 645-650.
    20. Alexandre Mas & Enrico Moretti, 2009. "Peers at Work," American Economic Review, American Economic Association, vol. 99(1), pages 112-145, March.
    21. Zacharias Maniadis & Fabio Tufano & John A. List, 2014. "One Swallow Doesn't Make a Summer: New Evidence on Anchoring Effects," American Economic Review, American Economic Association, vol. 104(1), pages 277-290, January.
    22. Bedard, Kelly & Kuhn, Peter, 2008. "Where class size really matters: Class size and student ratings of instructor effectiveness," Economics of Education Review, Elsevier, vol. 27(3), pages 253-265, June.
    23. Ghazala Azmat & Nagore Iriberri, 2016. "The Provision of Relative Performance Feedback: An Analysis of Performance and Satisfaction," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 25(1), pages 77-110, March.
    24. Diamond, Douglas W, 1985. "Optimal Release of Information by Firms," Journal of Finance, American Finance Association, vol. 40(4), pages 1071-1094, September.
    25. David Eil & Justin M. Rao, 2011. "The Good News-Bad News Effect: Asymmetric Processing of Objective Information about Yourself," American Economic Journal: Microeconomics, American Economic Association, vol. 3(2), pages 114-138, May.
    26. Omar Al-Ubaydli & John A. List, 2015. "Do Natural Field Experiments Afford Researchers More or Less Control Than Laboratory Experiments?," American Economic Review, American Economic Association, vol. 105(5), pages 462-466, May.
    27. Michael Spence, 1973. "Job Market Signaling," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 87(3), pages 355-374.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bobba, Matteo & Frisancho, Veronica, 2022. "Self-perceptions about academic achievement: Evidence from Mexico City," Journal of Econometrics, Elsevier, vol. 231(1), pages 58-73.
    2. Banerjee, Ritwik & Gupta, Nabanita Datta & Villeval, Marie Claire, 2020. "Feedback spillovers across tasks, self-confidence and competitiveness," Games and Economic Behavior, Elsevier, vol. 123(C), pages 127-170.
    3. Dohmen, Thomas & Shvartsman, Elena, 2023. "Overexertion of Effort under Working Time Autonomy and Feedback Provision," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 1255-1266.
    4. Emanuela Macrí & Giuseppe Migali, 2022. "The effect of test anxiety on high stakes exams," Working Papers 365237216, Lancaster University Management School, Economics Department.
    5. Zou, Wenbo & Gao, Wenzheng, 2023. "Measuring the welfare and spillover effects of rank information," Journal of Economic Behavior & Organization, Elsevier, vol. 216(C), pages 187-220.
    6. Megalokonomou, Rigissa & Zhang, Yi, 2022. "How Good Am I? Effects and Mechanisms behind Salient Ranks," IZA Discussion Papers 15604, Institute of Labor Economics (IZA).
    7. Marisa Hidalgo-Hidalgo & Dunia López-Pintado, 2023. "The uneven effects of peers on collaborative and individual tasks," Working Papers 23.07, Universidad Pablo de Olavide, Department of Economics.
    8. Lackner, Mario & Weichselbaumer, Michael, 2023. "Can barely winning lead to losing? Gender and past performance," Journal of Economic Behavior & Organization, Elsevier, vol. 208(C), pages 258-274.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:spo:wpmain:info:hdl:2441/5fhe3c1k6b8mu8jtd19s688u7s is not listed on IDEAS
    2. repec:hal:spmain:info:hdl:2441/5fhe3c1k6b8mu8jtd19s688u7s is not listed on IDEAS
    3. Ghazala Azmat & Manuel Bagues & Antonio Cabrales & Nagore Iriberri, 2018. "What you don’t know... Can’t hurt you? A natural field experiment on relative performance feedback in higher education," Sciences Po publications info:hdl:2441/5r0qo9lp3v9, Sciences Po.
    4. Ghazala Azmat & Manuel Bagues & Antonio Cabrales & Nagore Iriberri, 2019. "What You Don’t Know…Can’t Hurt You? A Natural Field Experiment on Relative Performance Feedback in Higher Education," Management Science, INFORMS, vol. 65(8), pages 3714-3736, August.
    5. Ghazala Azmat & Manuel Bagues & Antonio Cabrales & Nagore Iriberri, 2018. "What you don’t know... Can’t hurt you? A natural field experiment on relative performance feedback in higher education," Sciences Po publications info:hdl:2441/5r0qo9lp3v9, Sciences Po.
    6. Azmat, Ghazala & Iriberri, Nagore & Bagues, Manuel, 2016. "What you don't know... Can't hurt you? A field experiment on relative performance feedback in higher education," CEPR Discussion Papers 11201, C.E.P.R. Discussion Papers.
    7. Ghazala Azmat & Manuel Bagues & Antonio Cabrales & Nagore Iriberri, 2016. "What You Don’t Know... Can’t Hurt You? A Field Experiment on Relative Performance," Working Papers 788, Queen Mary University of London, School of Economics and Finance.
    8. Azmat, Ghazala & Bagues, Manuel & Cabrales, Antonio & Iriberri, Nagore, 2016. "What You Don't Know... Can't Hurt You? A Field Experiment on Relative Performance Feedback in Higher Education," IZA Discussion Papers 9853, Institute of Labor Economics (IZA).
    9. Dobrescu, Isabella & Faravelli, Marco & Megalokonomou, Rigissa & Motta, Alberto, 2019. "Rank Incentives and Social Learning: Evidence from a Randomized Controlled Trial," IZA Discussion Papers 12437, Institute of Labor Economics (IZA).
    10. Delavallade,Clara Anne, 2021. "Motivating Teams : Private Feedback and Public Recognition at Work," Policy Research Working Paper Series 9621, The World Bank.
    11. Fischer, Mira & Wagner, Valentin, 2018. "Effects of Timing and Reference Frame of Feedback: Evidence from a Field Experiment," IZA Discussion Papers 11970, Institute of Labor Economics (IZA).
    12. Fischer, Mira & Wagner, Valentin, 2019. "Effects of Timing and Reference Frame of Feedback," Rationality and Competition Discussion Paper Series 150, CRC TRR 190 Rationality and Competition.
    13. Delavallade, Clara, 2021. "Motivating teams: Private feedback and public recognition at work," Journal of Public Economics, Elsevier, vol. 197(C).
    14. Vanessa, Mertins & Jeworrek, Sabrina & Vlassopoulos, Michael, 2018. ""The Good News about Bad News": Feedback about Past Organisational Failure Bad ist Impact in Worker Productivity," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181644, Verein für Socialpolitik / German Economic Association.
    15. Brade, Raphael & Himmler, Oliver & Jäckle, Robert, 2018. "Normatively Framed Relative Performance Feedback – Field Experiment and Replication," MPRA Paper 88830, University Library of Munich, Germany.
    16. Ertac, Seda & Gümren, Mert & Koçkesen, Levent, 2019. "Strategic feedback in teams: Theory and experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 162(C), pages 1-23.
    17. Brade, Raphael & Himmler, Oliver & Jäckle, Robert, 2022. "Relative performance feedback and the effects of being above average — field experiment and replication," Economics of Education Review, Elsevier, vol. 89(C).
    18. Jeworrek, Sabrina & Mertins, Vanessa & Vlassopoulos, Michael, 2018. ""The good news about bad news": Feedback about past organisational failure and its impact on worker productivity," IWH Discussion Papers 1/2018, Halle Institute for Economic Research (IWH).
    19. Collins, Matthew & Lundstedt, Jonas, 2024. "The effects of more informative grading on student outcomes," Journal of Economic Behavior & Organization, Elsevier, vol. 218(C), pages 514-549.
    20. Gwen-Jiro Clochard & Guillaume Hollard & Julia Wirtz, 2022. "More effort or better technologies? On the effect of relative performance feedback," Bristol Economics Discussion Papers 22/767, School of Economics, University of Bristol, UK.
    21. Matthias Stefan & Jürgen Huber & Michael Kirchler & Matthias Sutter & Markus Walzl, 2020. "Monetary and Social Incentives in Multi-Tasking: The Ranking Substitution Effect," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2020_10, Max Planck Institute for Research on Collective Goods.
    22. Murphy, Richard & Weinhardt, Felix, 2020. "Top of the Class: The Importance of Ordinal Rank," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 87(6), pages 2777-2826.

    More about this item

    Keywords

    Relative performance feedback; Ranking; Natural field experiment; School performance;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:spmain:hal-03574128. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Contact - Sciences Po Departement of Economics (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.