IDEAS home Printed from https://ideas.repec.org/a/pal/easeco/v49y2023i1d10.1057_s41302-022-00232-z.html
   My bibliography  Save this article

The Effectiveness of Logical Distractors in an Online Module

Author

Listed:
  • Diego Mendez-Carbajo

    (Federal Reserve Bank of St. Louis)

Abstract

This article studies the differences in student learning outcomes associated with changes in the format of answer distractors in online learning resources. Employing a pre- and posttest quasi-experimental design, we compare degrees of student achievement across three versions of the same economic education online module produced by the Federal Reserve Bank of St. Louis: two versions employing the “Both option X and option Y are correct” type of distractor across definitional and analytical questions and another, baseline, version omitting it. This study documents no consistent gains in the assessment effectiveness of test items adding this particular type of logical distractor.

Suggested Citation

  • Diego Mendez-Carbajo, 2023. "The Effectiveness of Logical Distractors in an Online Module," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 49(1), pages 15-30, January.
    • Handle: RePEc:pal:easeco:v:49:y:2023:i:1:d:10.1057_s41302-022-00232-z
    DOI: 10.1057/s41302-022-00232-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41302-022-00232-z
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1057/s41302-022-00232-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Diego Mendez-Carbajo & Lucy C. Malakar, 2020. "Flipping the classroom with econlowdown.org," The Journal of Economic Education, Taylor & Francis Journals, vol. 51(1), pages 95-102, January.
    2. Stephen Buckles & John J. Siegfried, 2006. "Using Multiple-Choice Questions to Evaluate In-Depth Learning of Economics," The Journal of Economic Education, Taylor & Francis Journals, vol. 37(1), pages 48-57, January.
    3. Georg Schaur & Michael Watts & William E Becker, 2012. "School, Department, and Instructor Determinants of Assessment Methods in Undergraduate Economics Courses," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 38(3), pages 381-400.
    4. William B. Walstad & Jamie Wagner, 2016. "The disaggregation of value-added test scores to assess learning outcomes in economics courses," The Journal of Economic Education, Taylor & Francis Journals, vol. 47(2), pages 121-131, April.
    5. Cynthia Harter & Rebecca G. Chambers & Carlos J. Asarta, 2022. "Assessing Learning in College Economics: A Sixth National Quinquennial Survey," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 48(2), pages 251-266, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. W. Robert Reed & Stephen Hickson, 2011. "More Evidence on the Use of Constructed-Response Questions in Principles of Economics Classes," International Review of Economic Education, Economics Network, University of Bristol, vol. 10(2), pages 28-49.
    2. Kuhn, Christiane & Zlatkin-Troitschanskaia, Olga & Brückner, Sebastian & Saas, Hannes, 2018. "A new video-based tool to enhance teaching economics," International Review of Economics Education, Elsevier, vol. 27(C), pages 24-33.
    3. Emerson, Tisha L.N. & McGoldrick, KimMarie & Wagner, Jamie, 2023. "Decomposing a pre- post-test outcome to measure the effect of cooperative learning on student achievement," International Review of Economics Education, Elsevier, vol. 44(C).
    4. Steven B. Caudill & Franklin G. Mixon, 2023. "Guess for Success? Application of a Mixture Model to Test-Wiseness on Multiple-Choice Exams," Stats, MDPI, vol. 6(3), pages 1-6, June.
    5. Martin P. Shanahan & Gigi Foster & Jan H. F. Meyer, 2006. "Operationalising a Threshold Concept in Economics: A Pilot Study Using Multiple Choice Questions on Opportunity Cost," International Review of Economic Education, Economics Network, University of Bristol, vol. 5(2), pages 29-57.
    6. Ken Rebeck & Carlos Asarta, 2011. "Methods of Assessment in the College Economics Course," Chapters, in: Gail M. Hoyt & KimMarie McGoldrick (ed.), International Handbook on Teaching and Learning Economics, chapter 16, Edward Elgar Publishing.
    7. McKee, Douglas & Orlov, George, 2023. "The Economic Statistics Skills Assessment (ESSA)," International Review of Economics Education, Elsevier, vol. 44(C).
    8. Cynthia Harter & Georg Schaur & Michael Watts, 2015. "School, department, and instructor determinants of teaching methods in undergraduate economics courses," Southern Economic Journal, John Wiley & Sons, vol. 81(4), pages 1169-1188, April.
    9. Ambrose & Cheryl A. Kier, 2017. "On Students’ Perception of a Multi-Scheme Assessment Method," Journal for Economic Educators, Middle Tennessee State University, Business and Economic Research Center, vol. 17(1), pages 40-52, Spring.
    10. Diego Mendez-Carbajo, 2023. "Using Federal Reserve Economic Data® Data to Address Diversity and Inclusion in the Classroom," The American Economist, Sage Publications, vol. 68(1), pages 126-139, March.
    11. Justine Burns & Simon Halliday & Malcolm Keswell, 2012. "Gender and Risk Taking in the Classroom," SALDRU Working Papers 87, Southern Africa Labour and Development Research Unit, University of Cape Town.
    12. Carlos Asarta & Ken Rebeck, 2011. "Measurement Techniques of Student Performance and Literacy: College and High School," Chapters, in: Gail M. Hoyt & KimMarie McGoldrick (ed.), International Handbook on Teaching and Learning Economics, chapter 29, Edward Elgar Publishing.
    13. Cynthia Harter & Carlos J. Asarta, 2022. "Teaching Methods in Undergraduate Intermediate Theory, Statistics and Econometrics, and Other Upper-Division Economics Courses: Results From a Sixth National Quinquennial Survey," The American Economist, Sage Publications, vol. 67(1), pages 132-146, March.
    14. Peter Mikek, 2023. "A Flipped Classroom Experiment in Growth Theory," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 49(3), pages 433-456, June.
    15. Oskar Harmon & James Lambrinos & Judy Buffolino, 2008. "Is the Cheating Risk Always Higher in Online Instruction Compared to Face-to-Face Instruction?," Working papers 2008-14, University of Connecticut, Department of Economics, revised Sep 2010.
    16. Naser Yousef ALzoubi & Asma Shafe Assaf, 2017. "Suitability of Multiple-choice Questions in Evaluating the Objectives of Academic Educational Process of Accounting Specialization," International Business Research, Canadian Center of Science and Education, vol. 10(6), pages 46-61, June.
    17. Allgood, Sam & Bayer, Amanda, 2016. "Measuring College Learning in Economics," MPRA Paper 85104, University Library of Munich, Germany.
    18. Melanie A. Fennell & Irene R. Foster, 2021. "Test Format and Calculator Use in the Testing of Basic Math Skills for Principles of Economics: Experimental Evidence," The American Economist, Sage Publications, vol. 66(1), pages 29-45, March.

    More about this item

    Keywords

    Distractors; Instructional design; Online instruction; Assessment;
    All these keywords.

    JEL classification:

    • A2 - General Economics and Teaching - - Economic Education and Teaching of Economics
    • A20 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:easeco:v:49:y:2023:i:1:d:10.1057_s41302-022-00232-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave-journals.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.