IDEAS home Printed from https://ideas.repec.org/a/eee/ecoedu/v90y2022ics0272775722000619.html
   My bibliography  Save this article

The effects of exam frames on student effort and performance

Author

Listed:
  • Ballis, Briana
  • Lusher, Lester
  • Martorell, Paco

Abstract

We conduct an online experiment in which participants take a multiple-choice vocabulary exam with scores described using either a “loss frame” or a “gain frame” to examine how exam framing affects item skipping, overall performance, and effort. In the loss frame, participants begin with an “endowment” of points and lose a point for incorrect answers, receive no points for skipped items, and gain a point for correct answers. In the gain frame, participants do not lose points for incorrect answers, gain one point for skipped items, and gain two points for correct answers. Contrary to traditional choice theory, where students may choose to skip more questions if the framing induces loss averse preferences, we find that loss-framed exams lead to less skipping. We also find that the loss frame led to improved overall performance, which appears to be driven by increased effort on the exam among participants in the loss frame group. We find little evidence of a gender differential response to frames.

Suggested Citation

  • Ballis, Briana & Lusher, Lester & Martorell, Paco, 2022. "The effects of exam frames on student effort and performance," Economics of Education Review, Elsevier, vol. 90(C).
    • Handle: RePEc:eee:ecoedu:v:90:y:2022:i:c:s0272775722000619
    DOI: 10.1016/j.econedurev.2022.102286
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0272775722000619
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.econedurev.2022.102286?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Swinton, Omari H., 2010. "The effect of effort grading on learning," Economics of Education Review, Elsevier, vol. 29(6), pages 1176-1182, December.
    2. John Horton & David Rand & Richard Zeckhauser, 2011. "The online laboratory: conducting experiments in a real labor market," Experimental Economics, Springer;Economic Science Association, vol. 14(3), pages 399-425, September.
    3. Paolacci, Gabriele & Chandler, Jesse & Ipeirotis, Panagiotis G., 2010. "Running experiments on Amazon Mechanical Turk," Judgment and Decision Making, Cambridge University Press, vol. 5(5), pages 411-419, August.
    4. Dobkin, Carlos & Gil, Ricard & Marion, Justin, 2010. "Skipping class in college and exam performance: Evidence from a regression discontinuity classroom experiment," Economics of Education Review, Elsevier, vol. 29(4), pages 566-575, August.
    5. Alex Imas & Sally Sadoff & Anya Samek, 2017. "Do People Anticipate Loss Aversion?," Management Science, INFORMS, vol. 63(5), pages 1271-1284, May.
    6. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    7. Matthew Rabin, 2000. "Risk Aversion and Expected-Utility Theory: A Calibration Theorem," Econometrica, Econometric Society, vol. 68(5), pages 1281-1292, September.
    8. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    9. Iriberri, Nagore & Rey-Biel, Pedro, 2021. "Brave boys and play-it-safe girls: Gender differences in willingness to guess in a large scale natural field experiment," European Economic Review, Elsevier, vol. 131(C).
    10. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    11. Jalava, Nina & Joensen, Juanna Schrøter & Pellas, Elin, 2015. "Grades and rank: Impacts of non-financial incentives on test performance," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 161-196.
    12. Roland Fryer & Steven Levitt & John List & Sally Sadoff, 2012. "Enhancing the Efficacy of Teacher Incentives through Loss Aversion: A Field Experiment," Framed Field Experiments 00591, The Field Experiments Website.
    13. Uri Gneezy & John A. List & Jeffrey A. Livingston & Xiangdong Qin & Sally Sadoff & Yang Xu, 2019. "Measuring Success in Education: The Role of Effort on the Test Itself," American Economic Review: Insights, American Economic Association, vol. 1(3), pages 291-308, December.
    14. Maria Apostolova‐Mihaylova & William Cooper & Gail Hoyt & Emily C. Marshall, 2015. "Heterogeneous gender effects under loss aversion in the economics classroom: A field experiment," Southern Economic Journal, John Wiley & Sons, vol. 81(4), pages 980-994, April.
    15. Pekkarinen, Tuomas, 2015. "Gender differences in behaviour under competitive pressure: Evidence on omission patterns in university entrance examinations," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 94-110.
    16. Simon Gächter & Eric J. Johnson & Andreas Herrmann, 2022. "Individual-level loss aversion in riskless and risky choices," Theory and Decision, Springer, vol. 92(3), pages 599-624, April.
    17. Katherine Baldiga, 2014. "Gender Differences in Willingness to Guess," Management Science, INFORMS, vol. 60(2), pages 434-448, February.
    18. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    19. David M McEvoy, 2016. "Loss Aversion and Student Achievement," Economics Bulletin, AccessEcon, vol. 36(3), pages 1762-1770.
    20. repec:cup:judgdm:v:5:y:2010:i:5:p:411-419 is not listed on IDEAS
    21. Katherine B. Coffman & David Klinowski, 2020. "The impact of penalties for wrong answers on the gender gap in test scores," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(16), pages 8794-8803, April.
    22. repec:wly:soecon:v:81:4:y:2015:p:980-994 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pau Balart & Lara Ezquerra & Iñigo Hernandez-Arenaz, 2022. "Framing effects on risk-taking behavior: evidence from a field experiment in multiple-choice tests," Experimental Economics, Springer;Economic Science Association, vol. 25(4), pages 1268-1297, September.
    2. Brice Corgnet & Roberto Hernán-González, 2019. "Revisiting the Trade-off Between Risk and Incentives: The Shocking Effect of Random Shocks?," Management Science, INFORMS, vol. 65(3), pages 1096-1114, March.
    3. Wagner, Valentin, 2016. "Seeking risk or answering smart? Framing in elementary schools," DICE Discussion Papers 227, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    4. Wagner, Valentin, 2022. "Heterogeneous effects of grade framing," Labour Economics, Elsevier, vol. 74(C).
    5. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    6. Astrid Gamba & Luca Stanca, 2023. "Mis-judging merit: the effects of adjudication errors in contests," Experimental Economics, Springer;Economic Science Association, vol. 26(3), pages 550-587, July.
    7. Brice Corgnet & Simon Gaechter & Roberto Hernan Gonzalez, 2020. "Working Too Much for Too Little: Stochastic Rewards Cause Work Addiction," Discussion Papers 2020-03, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    8. Wagner, Valentin, 2016. "Seeking Risk or Answering Smart? Experimental Evidence on Framing Effects in Elementary Schools," VfS Annual Conference 2016 (Augsburg): Demographic Change 145678, Verein für Socialpolitik / German Economic Association.
    9. Anaya, Lina & Iriberri, Nagore & Rey-Biel, Pedro & Zamarro, Gema, 2022. "Understanding performance in test taking: The role of question difficulty order," Economics of Education Review, Elsevier, vol. 90(C).
    10. Elbæk, Christian T. & Lystbæk, Martin Nørhede & Mitkidis, Panagiotis, 2022. "On the psychology of bonuses: The effects of loss aversion and Yerkes-Dodson law on performance in cognitively and mechanically demanding tasks," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).
    11. Iriberri, Nagore & Rey-Biel, Pedro, 2021. "Brave boys and play-it-safe girls: Gender differences in willingness to guess in a large scale natural field experiment," European Economic Review, Elsevier, vol. 131(C).
    12. Beam, Emily A. & Masatioglu, Yusufcan & Watson, Tara & Yang, Dean, 2023. "Loss aversion or lack of trust: Why does loss framing work to encourage preventive health behaviors?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 104(C).
    13. Jonathan de Quidt, 2018. "Your Loss Is My Gain: A Recruitment Experiment with Framed Incentives," Journal of the European Economic Association, European Economic Association, vol. 16(2), pages 522-559.
    14. Alex Markle & George Wu & Rebecca White & Aaron Sackett, 2018. "Goals as reference points in marathon running: A novel test of reference dependence," Journal of Risk and Uncertainty, Springer, vol. 56(1), pages 19-50, February.
    15. Paul J. Ferraro & J. Dustin Tracy, 2022. "A reassessment of the potential for loss-framed incentive contracts to increase productivity: a meta-analysis and a real-effort experiment," Experimental Economics, Springer;Economic Science Association, vol. 25(5), pages 1441-1466, November.
    16. de Quidt, Jonathan, 2014. "Your loss is my gain: a recruitment experiment with framed incentives," LSE Research Online Documents on Economics 58208, London School of Economics and Political Science, LSE Library.
    17. Jonathan Quidt & Francesco Fallucchi & Felix Kölle & Daniele Nosenzo & Simone Quercia, 2017. "Bonus versus penalty: How robust are the effects of contract framing?," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 3(2), pages 174-182, December.
    18. Nicholas C. Barberis, 2013. "Thirty Years of Prospect Theory in Economics: A Review and Assessment," Journal of Economic Perspectives, American Economic Association, vol. 27(1), pages 173-196, Winter.
    19. Gong, Jie & Liu, Tracy Xiao & Tang, Jie, 2021. "How monetary incentives improve outcomes in MOOCs: Evidence from a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 905-921.
    20. Florian Englmaier & Stefan Grimm & Dominik Grothe & David Schindler & Simeon Schudy, 2024. "The Effect of Incentives in Nonroutine Analytical Team Tasks," Journal of Political Economy, University of Chicago Press, vol. 132(8), pages 2695-2747.

    More about this item

    Keywords

    Framing; Loss aversion; Test-taking; Field experiment;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • D01 - Microeconomics - - General - - - Microeconomic Behavior: Underlying Principles
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecoedu:v:90:y:2022:i:c:s0272775722000619. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/econedurev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.