IDEAS home Printed from https://ideas.repec.org/p/cbt/econwp/10-10.html
   My bibliography  Save this paper

The Impact of Question Format in Principle of Economics Classes: Evidence from New Zealand

Author

Listed:

Abstract

This study investigates whether question format disadvantages certain types of students. I use assessment data compiled from principles of economics classes at the University of Canterbury from 2002-2008. I combine these with administrative data on student characteristics to create a comprehensive dataset of over 20,000 observations. To control for student ability, I use a battery of measures of student performance in non-economics classes. In the absence of controls for student ability, I find that question format appears to have a significant impact on student performance. These mostly disappear when student ability variables are added. The major exception are student characteristics associated with language: I find that non-native English speakers are relatively disadvantaged by constructed response questions even after controlling for student ability.

Suggested Citation

  • Stephen Hickson, 2010. "The Impact of Question Format in Principle of Economics Classes: Evidence from New Zealand," Working Papers in Economics 10/10, University of Canterbury, Department of Economics and Finance.
    • Handle: RePEc:cbt:econwp:10/10
    as

    Download full text from publisher

    File URL: https://repec.canterbury.ac.nz/cbt/econwp/1010.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. William B. Walstad & Denise Robson, 1997. "Differential Item Functioning and Male-Female Differences on Multiple-Choice Tests in Economics," The Journal of Economic Education, Taylor & Francis Journals, vol. 28(2), pages 155-171, June.
    2. Andrea L. Ziegert, 2000. "The Role of Personality Temperament and Student Learning in Principles of Economics: Further Evidence," The Journal of Economic Education, Taylor & Francis Journals, vol. 31(4), pages 307-322, December.
    3. Bai Juhong & Tim Maloney, 2006. "Ethnicity and academic success at university," New Zealand Economic Papers, Taylor & Francis Journals, vol. 40(2), pages 181-213.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Paul McKeown & Gillis Maclean, 2013. "Is activity in online quizzes correlated with higher exam marks?," New Zealand Economic Papers, Taylor & Francis Journals, vol. 47(3), pages 276-287, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stephen Hickson, 2016. "Maybe the Boys Just Like Economics More - The Gender Gap and the Role of Personality Type in Economics Education," Working Papers in Economics 16/07, University of Canterbury, Department of Economics and Finance.
    2. Roger B. Butters & Carlos J. Asarta & Tammie J. Fischer, 2011. "Human Capital in The Classroom: The Role of Teacher Knowledge in Economic Literacy," The American Economist, Sage Publications, vol. 56(2), pages 47-57, November.
    3. Carlos J. Asarta & Roger B. Butters & Eric Thompson, 2013. "The Gender Question in Economic Education: Is it the Teacher or the Test?," Working Papers 13-12, University of Delaware, Department of Economics.
    4. Marianne Johnson & Denise Robson & Sarinda Taengnoi, 2014. "A Meta-analysis of the Gender Gap in Performance in Collegiate Economics Courses," Review of Social Economy, Taylor & Francis Journals, vol. 72(4), pages 436-459, October.
    5. Tim Kaiser & Luis Oberrauch & Günther Seeber, 2020. "Measuring economic competence of secondary school students in Germany," The Journal of Economic Education, Taylor & Francis Journals, vol. 51(3-4), pages 227-242, August.
    6. Cynthia L. Harter & John F.R. Harter, 2004. "Teaching with Technology: Does Access to Computer Technology Increase Student Achievement?," Eastern Economic Journal, Eastern Economic Association, vol. 30(4), pages 507-514, Fall.
    7. Delaney, Liam & Harmon, Colm & Ryan, Martin, 2013. "The role of noncognitive traits in undergraduate study behaviours," Economics of Education Review, Elsevier, vol. 32(C), pages 181-195.
    8. Edward M. Scahill, 2006. "Evaluation of the Training the Trainers Programme. What Did Trainers Know? What Did They Learn?," International Review of Economic Education, Economics Network, University of Bristol, vol. 5(2), pages 9-28.
    9. Paul Dalziel, 2011. "Schumpeter's 'Vision' and the Teaching of Principles of Economics to Resource Students," International Review of Economic Education, Economics Network, University of Bristol, vol. 10(2), pages 63-74.
    10. David Sabiston & Ambrose Leung & Gianfranco Terrazzano, 2017. "Learning styles and performance in principles of economics: does the gender gap exist?," Economics Bulletin, AccessEcon, vol. 37(4), pages 2935-2944.
    11. Leonard C. Smith, 2009. "An Analysis Of The Impact Of Pedagogic Interventions In First‐Year Academic Development And Mainstream Courses In Microeconomics," South African Journal of Economics, Economic Society of South Africa, vol. 77(1), pages 162-178, March.
    12. Marianne Johnson & Denise Robson, 2008. "Clickers, Student Engagement and Performance in an Introductory Economics Course: a Cautionary Tale," Computers in Higher Education Economics Review, Economics Network, University of Bristol, vol. 20(1), pages 4-12.
    13. Oberrauch, Luis & Kaiser, Tim, 2020. "Economic competence in early secondary school: Evidence from a large-scale assessment in Germany," International Review of Economics Education, Elsevier, vol. 35(C).
    14. Joshua D. Miller & Robert P. Rebelein, 2011. "Research on the Effectiveness of Non-Traditional Pedagogies," Chapters, in: Gail M. Hoyt & KimMarie McGoldrick (ed.), International Handbook on Teaching and Learning Economics, chapter 30, Edward Elgar Publishing.
    15. Jon Murphy & John Schuler & Jadrian Wooten, 2020. "Have Coase - Will Travel: New Ways to Teach Coase Using Old Media," Journal of Private Enterprise, The Association of Private Enterprise Education, vol. 35(Winter 20), pages 71-86.
    16. Carlos Asarta & Ken Rebeck, 2011. "Measurement Techniques of Student Performance and Literacy: College and High School," Chapters, in: Gail M. Hoyt & KimMarie McGoldrick (ed.), International Handbook on Teaching and Learning Economics, chapter 29, Edward Elgar Publishing.
    17. Elchanan Cohn & Sharon Cohn & Donald C. Balch & James Bradley Jr., 2004. "The Relation between Student Attitudes toward Graphs and Performance in Economics," The American Economist, Sage Publications, vol. 48(2), pages 41-52, October.
    18. Anthony Barilla & Darrell Parker & Chris Paul, 2005. "An Educational Note on Locus of Control and Personality Type in the Formation of Students' Attitudes Toward Economic Institutions," Journal of Private Enterprise, The Association of Private Enterprise Education, vol. 20(Spring 20), pages 192-202.
    19. Zhaoyi Cao & Tim Maloney, 2017. "Decomposing Ethnic Differences in University Academic Achievement in New Zealand," Working Papers 2017-02, Auckland University of Technology, Department of Economics.
    20. Ann L. Owen, 2011. "Student Characteristics, Behavior, and Performance in Economics Classes," Chapters, in: Gail M. Hoyt & KimMarie McGoldrick (ed.), International Handbook on Teaching and Learning Economics, chapter 32, Edward Elgar Publishing.

    More about this item

    Keywords

    Principles of Economics Assessment; Multiple Choice; Constructed Response; Free Response; Essay;
    All these keywords.

    JEL classification:

    • A22 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - Undergraduate

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cbt:econwp:10/10. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Albert Yee (email available below). General contact details of provider: https://edirc.repec.org/data/decannz.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.