IDEAS home Printed from https://ideas.repec.org/a/eee/ecoedu/v90y2022ics0272775722000619.html
   My bibliography  Save this article

The effects of exam frames on student effort and performance

Author

Listed:
  • Ballis, Briana
  • Lusher, Lester
  • Martorell, Paco

Abstract

We conduct an online experiment in which participants take a multiple-choice vocabulary exam with scores described using either a “loss frame” or a “gain frame” to examine how exam framing affects item skipping, overall performance, and effort. In the loss frame, participants begin with an “endowment” of points and lose a point for incorrect answers, receive no points for skipped items, and gain a point for correct answers. In the gain frame, participants do not lose points for incorrect answers, gain one point for skipped items, and gain two points for correct answers. Contrary to traditional choice theory, where students may choose to skip more questions if the framing induces loss averse preferences, we find that loss-framed exams lead to less skipping. We also find that the loss frame led to improved overall performance, which appears to be driven by increased effort on the exam among participants in the loss frame group. We find little evidence of a gender differential response to frames.

Suggested Citation

  • Ballis, Briana & Lusher, Lester & Martorell, Paco, 2022. "The effects of exam frames on student effort and performance," Economics of Education Review, Elsevier, vol. 90(C).
    • Handle: RePEc:eee:ecoedu:v:90:y:2022:i:c:s0272775722000619
    DOI: 10.1016/j.econedurev.2022.102286
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0272775722000619
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.econedurev.2022.102286?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Dobkin, Carlos & Gil, Ricard & Marion, Justin, 2010. "Skipping class in college and exam performance: Evidence from a regression discontinuity classroom experiment," Economics of Education Review, Elsevier, vol. 29(4), pages 566-575, August.
    2. John Horton & David Rand & Richard Zeckhauser, 2011. "The online laboratory: conducting experiments in a real labor market," Experimental Economics, Springer;Economic Science Association, vol. 14(3), pages 399-425, September.
    3. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    4. Jalava, Nina & Joensen, Juanna Schrøter & Pellas, Elin, 2015. "Grades and rank: Impacts of non-financial incentives on test performance," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 161-196.
    5. Roland Fryer & Steven Levitt & John List & Sally Sadoff, 2012. "Enhancing the Efficacy of Teacher Incentives through Loss Aversion: A Field Experiment," Framed Field Experiments 00591, The Field Experiments Website.
    6. Uri Gneezy & John A. List & Jeffrey A. Livingston & Xiangdong Qin & Sally Sadoff & Yang Xu, 2019. "Measuring Success in Education: The Role of Effort on the Test Itself," American Economic Review: Insights, American Economic Association, vol. 1(3), pages 291-308, December.
    7. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    8. Maria Apostolova‐Mihaylova & William Cooper & Gail Hoyt & Emily C. Marshall, 2015. "Heterogeneous gender effects under loss aversion in the economics classroom: A field experiment," Southern Economic Journal, John Wiley & Sons, vol. 81(4), pages 980-994, April.
    9. Matthew Rabin, 2000. "Risk Aversion and Expected-Utility Theory: A Calibration Theorem," Econometrica, Econometric Society, vol. 68(5), pages 1281-1292, September.
    10. Pekkarinen, Tuomas, 2015. "Gender differences in behaviour under competitive pressure: Evidence on omission patterns in university entrance examinations," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 94-110.
    11. Simon Gächter & Eric J. Johnson & Andreas Herrmann, 2022. "Individual-level loss aversion in riskless and risky choices," Theory and Decision, Springer, vol. 92(3), pages 599-624, April.
    12. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    13. David M McEvoy, 2016. "Loss Aversion and Student Achievement," Economics Bulletin, AccessEcon, vol. 36(3), pages 1762-1770.
    14. repec:cup:judgdm:v:5:y:2010:i:5:p:411-419 is not listed on IDEAS
    15. Katherine B. Coffman & David Klinowski, 2020. "The impact of penalties for wrong answers on the gender gap in test scores," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(16), pages 8794-8803, April.
    16. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    17. repec:wly:soecon:v:81:4:y:2015:p:980-994 is not listed on IDEAS
    18. Swinton, Omari H., 2010. "The effect of effort grading on learning," Economics of Education Review, Elsevier, vol. 29(6), pages 1176-1182, December.
    19. Paolacci, Gabriele & Chandler, Jesse & Ipeirotis, Panagiotis G., 2010. "Running experiments on Amazon Mechanical Turk," Judgment and Decision Making, Cambridge University Press, vol. 5(5), pages 411-419, August.
    20. Alex Imas & Sally Sadoff & Anya Samek, 2017. "Do People Anticipate Loss Aversion?," Management Science, INFORMS, vol. 63(5), pages 1271-1284, May.
    21. Iriberri, Nagore & Rey-Biel, Pedro, 2021. "Brave boys and play-it-safe girls: Gender differences in willingness to guess in a large scale natural field experiment," European Economic Review, Elsevier, vol. 131(C).
    22. Katherine Baldiga, 2014. "Gender Differences in Willingness to Guess," Management Science, INFORMS, vol. 60(2), pages 434-448, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pau Balart & Lara Ezquerra & Iñigo Hernandez-Arenaz, 2022. "Framing effects on risk-taking behavior: evidence from a field experiment in multiple-choice tests," Experimental Economics, Springer;Economic Science Association, vol. 25(4), pages 1268-1297, September.
    2. Brice Corgnet & Roberto Hernán-González, 2019. "Revisiting the Trade-off Between Risk and Incentives: The Shocking Effect of Random Shocks?," Management Science, INFORMS, vol. 65(3), pages 1096-1114, March.
    3. Wagner, Valentin, 2016. "Seeking risk or answering smart? Framing in elementary schools," DICE Discussion Papers 227, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    4. Wagner, Valentin, 2022. "Heterogeneous effects of grade framing," Labour Economics, Elsevier, vol. 74(C).
    5. Brice Corgnet & Simon Gaechter & Roberto Hernán González, 2020. "Working too much for too little: stochastic rewards cause work addiction," Working Papers 2007, Groupe d'Analyse et de Théorie Economique Lyon St-Étienne (GATE Lyon St-Étienne), Université de Lyon.
    6. Astrid Gamba & Luca Stanca, 2023. "Mis-judging merit: the effects of adjudication errors in contests," Experimental Economics, Springer;Economic Science Association, vol. 26(3), pages 550-587, July.
    7. Wagner, Valentin, 2016. "Seeking Risk or Answering Smart? Experimental Evidence on Framing Effects in Elementary Schools," VfS Annual Conference 2016 (Augsburg): Demographic Change 145678, Verein für Socialpolitik / German Economic Association.
    8. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    9. Anaya, Lina & Iriberri, Nagore & Rey-Biel, Pedro & Zamarro, Gema, 2022. "Understanding performance in test taking: The role of question difficulty order," Economics of Education Review, Elsevier, vol. 90(C).
    10. Iriberri, Nagore & Rey-Biel, Pedro, 2021. "Brave boys and play-it-safe girls: Gender differences in willingness to guess in a large scale natural field experiment," European Economic Review, Elsevier, vol. 131(C).
    11. Jonathan de Quidt, 2018. "Your Loss Is My Gain: A Recruitment Experiment with Framed Incentives," Journal of the European Economic Association, European Economic Association, vol. 16(2), pages 522-559.
    12. Paul J. Ferraro & J. Dustin Tracy, 2022. "A reassessment of the potential for loss-framed incentive contracts to increase productivity: a meta-analysis and a real-effort experiment," Experimental Economics, Springer;Economic Science Association, vol. 25(5), pages 1441-1466, November.
    13. de Quidt, Jonathan, 2014. "Your loss is my gain: a recruitment experiment with framed incentives," LSE Research Online Documents on Economics 58208, London School of Economics and Political Science, LSE Library.
    14. Jonathan Quidt & Francesco Fallucchi & Felix Kölle & Daniele Nosenzo & Simone Quercia, 2017. "Bonus versus penalty: How robust are the effects of contract framing?," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 3(2), pages 174-182, December.
    15. Yan Chen & Peter Cramton & John A. List & Axel Ockenfels, 2021. "Market Design, Human Behavior, and Management," Management Science, INFORMS, vol. 67(9), pages 5317-5348, September.
    16. Eszter Czibor & Danny Hsu & David Jimenez-Gomez & Susanne Neckermann & Burcu Subasi, 2022. "Loss-Framed Incentives and Employee (Mis-)Behavior," Management Science, INFORMS, vol. 68(10), pages 7518-7537, October.
    17. Devereux, Paul J. & Delaney, Judith, 2021. "Gender and Educational Achievement: Stylized Facts and Causal Evidence," CEPR Discussion Papers 15753, C.E.P.R. Discussion Papers.
    18. List, John A. & Momeni, Fatemeh, 2020. "Leveraging upfront payments to curb employee misbehavior: Evidence from a natural field experiment," European Economic Review, Elsevier, vol. 130(C).
    19. Heiko Karle & Dirk Engelmann & Martin Peitz, 2022. "Student performance and loss aversion," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(2), pages 420-456, April.
    20. Tatiana A. Homonoff, 2018. "Can Small Incentives Have Large Effects? The Impact of Taxes versus Bonuses on Disposable Bag Use," American Economic Journal: Economic Policy, American Economic Association, vol. 10(4), pages 177-210, November.

    More about this item

    Keywords

    Framing; Loss aversion; Test-taking; Field experiment;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • D01 - Microeconomics - - General - - - Microeconomic Behavior: Underlying Principles
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecoedu:v:90:y:2022:i:c:s0272775722000619. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/econedurev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.