IDEAS home Printed from https://ideas.repec.org/a/aes/amfeco/v11y2009i25p125-150.html
   My bibliography  Save this article

The student evaluation of teaching: its failure as a research program, and as an administrative guide

Author

Listed:
  • Robert Sproule

    (Bishop's University, Sherbrooke, Québec, J1M 0C8, Canada)

  • C?lin Vâlsan

    (Bishop's University, Sherbrooke, Québec, J1M 0C8, Canada)

Abstract

This paper points up the methodological inadequacy of the "student evaluation of teaching" as a research program. We do this by reference to three, interrelated arguments. The first is that the student evaluation of teaching cannot claim to capture the wisdom of a crowd because, as a research program, it fails to meet Surowiecki's conditions for the existence and articulation of the wisdom of a crowd. The second argument extends the first, by stating: (a) the "student evaluation of teaching" research program fails to provide the methodological controls needed to differentiate cause from effect, or put differently (b) the methodological underpinnings of this research program is tantamount to the misapplication of a closed-system paradigm to an open social system. The third argument has two parts. These are that this research program is predicated on: (a) a false analogy between the workings of a business and a university, and therefore (b) on a mischaracterization of the student-professor relationship. These three arguments, these three failures, suggest that the "student evaluation of teaching" research program is methodologically ill-conceived and incoherent, and therefore cannot, with any credulity, serve as a guide to the administration and governance of a university.

Suggested Citation

  • Robert Sproule & C?lin Vâlsan, 2009. "The student evaluation of teaching: its failure as a research program, and as an administrative guide," The AMFITEATRU ECONOMIC journal, Academy of Economic Studies - Bucharest, Romania, vol. 11(25), pages 125-150, February.
    • Handle: RePEc:aes:amfeco:v:11:y:2009:i:25:p:125-150
    as

    Download full text from publisher

    File URL: http://www.amfiteatrueconomic.ro/temp/Article_641.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sheila C. Dow & Victoria Chick, 2012. "The Meaning of Open Systems," Palgrave Macmillan Books, in: Foundations for New Economic Thinking, chapter 11, pages 178-196, Palgrave Macmillan.
    2. Hamermesh, Daniel S. & Parker, Amy, 2005. "Beauty in the classroom: instructors' pulchritude and putative pedagogical productivity," Economics of Education Review, Elsevier, vol. 24(4), pages 369-376, August.
    3. Lawson, Tony, 1989. "Realism and Instrumentalism in the Development of Econometrics," Oxford Economic Papers, Oxford University Press, vol. 41(1), pages 236-258, January.
    4. Dow, Sheila, 2002. "Economic Methodology: An Inquiry," OUP Catalogue, Oxford University Press, number 9780198776123.
    5. von Hayek, Friedrich August, 1989. "The Pretence of Knowledge," American Economic Review, American Economic Association, vol. 79(6), pages 3-7, December.
    6. Krautmann, Anthony C. & Sander, William, 1999. "Grades and student evaluations of teachers," Economics of Education Review, Elsevier, vol. 18(1), pages 59-63, February.
    7. Bunge, Mario, 2000. "Systemism: the alternative to individualism and holism," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 29(2), pages 147-157.
    8. Sproule, Robert, 2002. "The underdetermination of instructor performance by data from the student evaluation of teaching," Economics of Education Review, Elsevier, vol. 21(3), pages 287-294, June.
    9. Bruce Caldwell, 1997. "Hayek and Socialism," Journal of Economic Literature, American Economic Association, vol. 35(4), pages 1856-1890, December.
    10. Bradley A. Hansen & Mary Eschelbach Hansen, 2005. "Don't Put the Cart Before the Horse: Teaching the Economic Approach to Empirical Research," Working Papers 2005-12, American University, Department of Economics.
    11. Calin Valsan & Robert Sproule, 2008. "The Invisible Hands behind the Student Evaluation of Teaching: The Rise of the New Managerial Elite in the Governance of Higher Education," Journal of Economic Issues, Taylor & Francis Journals, vol. 42(4), pages 939-958, December.
    12. Denis, Andy, 2003. "Methodology and policy prescription in economic thought: a response to Mario Bunge," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 32(2), pages 219-226, May.
    13. Maxwell, Nan L & Lopus, Jane S, 1994. "The Lake Wobegon Effect in Student Self-Reported Data," American Economic Review, American Economic Association, vol. 84(2), pages 201-205, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nicoleta Dospinescu & Maria Tătăruşanu & Gina Ionela Butnaru & Lucian Berechet, 2011. "The Perception of Students from the Economic Area on the New Learning Methods in the Knowledge Society," The AMFITEATRU ECONOMIC journal, Academy of Economic Studies - Bucharest, Romania, vol. 13(30), pages 527-543, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wagner, N. & Rieger, M. & Voorvelt, K.J., 2016. "Gender, ethnicity and teaching evaluations : Evidence from mixed teaching teams," ISS Working Papers - General Series 617, International Institute of Social Studies of Erasmus University Rotterdam (ISS), The Hague.
    2. Annina Kaltenbrunner, 2018. "Financialised internationalisation and structural hierarchies: a mixed-method study of exchange rate determination in emerging economies," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 42(5), pages 1315-1341.
    3. Rieger, Matthias & Voorvelt, Katherine, 2016. "Gender, ethnicity and teaching evaluations: Evidence from mixed teaching teamsAuthor-Name: Wagner, Natascha," Economics of Education Review, Elsevier, vol. 54(C), pages 79-94.
    4. Mohammad Alauddin & Clem Tisdell, 2007. "Factors That Affect Teaching Scores in Economics Instruction: Analysis of Student Evaluation of Teaching (SET) Data," Discussion Papers Series 353, School of Economics, University of Queensland, Australia.
    5. Mark Nolan, 2013. "Hayek’s 1945 Finlay Memorial Lecture: Tracing the origins and evolution of his ‘true’ individualism," The Review of Austrian Economics, Springer;Society for the Development of Austrian Economics, vol. 26(1), pages 53-71, March.
    6. Mehrdad Vahabi, 1999. "From Walrasian General Equilibrium to Incomplete Contracts: Making Sense of Institutions," Cahiers de la Maison des Sciences Economiques j99008, Université Panthéon-Sorbonne (Paris 1).
    7. Bastian Gawellek & Bernd Süssmuth & Daniel Singh, 2016. "Tuition Fees and Instructional Quality," Economics Bulletin, AccessEcon, vol. 36(1), pages 84-91.
    8. Mohammad Alauddin & Temesgen Kifle, 2014. "Does the student evaluation of teaching instrument really measure instructorsù teaching effectiveness? An econometric analysis of studentsù perceptions in economics courses," Economic Analysis and Policy, Elsevier, vol. 44(2), pages 156-168.
    9. Victoria Chick, 2013. "The future is open: on open-system theorising in economics," Chapters, in: Jesper Jespersen & Mogens Ove Madsen (ed.), Teaching Post Keynesian Economics, chapter 3, pages 56-72, Edward Elgar Publishing.
    10. Anne Boring, 2015. "Gender Biases in student evaluations of teachers," Documents de Travail de l'OFCE 2015-13, Observatoire Francais des Conjonctures Economiques (OFCE).
    11. Radchenko, Natalia, 2020. "Biases in Student Evaluations of Teaching: An American Case Study," IZA Discussion Papers 13603, Institute of Labor Economics (IZA).
    12. repec:spo:wpmain:info:hdl:2441/1seuirq4ak9b9bouu1j29ebui7 is not listed on IDEAS
    13. repec:hal:spmain:info:hdl:2441/1seuirq4ak9b9bouu1j29ebui7 is not listed on IDEAS
    14. Cheng, Dorothy A., 2011. "Effects of class size on alternative educational outcomes across disciplines," Economics of Education Review, Elsevier, vol. 30(5), pages 980-990, October.
    15. Sheila C Dow, 2015. "The role of belief in the case for austerity policies," The Economic and Labour Relations Review, , vol. 26(1), pages 29-42, March.
    16. Richard Seymour, 2006. "Hermeneutic phenomenology and international entrepreneurship research," Journal of International Entrepreneurship, Springer, vol. 4(4), pages 137-155, December.
    17. Ewing, Andrew M., 2012. "Estimating the impact of relative expected grade on student evaluations of teachers," Economics of Education Review, Elsevier, vol. 31(1), pages 141-154.
    18. Carpio, Carlos E. & Harral, Bradi & Morales, Sarahi D. & Garcia, Manuel & Middleton, Marty R. & Boren-Alpizar, Amy, 2024. "Student evaluations of teaching and grades in university agricultural programs: A tale of two countries," 2024 Annual Meeting, July 28-30, New Orleans, LA 343854, Agricultural and Applied Economics Association.
    19. Langbein, Laura, 2008. "Management by results: Student evaluation of faculty teaching and the mis-measurement of performance," Economics of Education Review, Elsevier, vol. 27(4), pages 417-428, August.
    20. Fusari, Angelo, 2013. "Methodological Misconceptions in the Social Sciences. Rethinking social thought and social processes," MPRA Paper 60164, University Library of Munich, Germany, revised 2013.
    21. Barbara Grave, 2011. "The effect of student time allocation on academic achievement," Education Economics, Taylor & Francis Journals, vol. 19(3), pages 291-310.
    22. Moran, John & Morgan, John, 2003. "Employee recruiting and the Lake Wobegon effect," Journal of Economic Behavior & Organization, Elsevier, vol. 50(2), pages 165-182, February.

    More about this item

    Keywords

    Student evaluation of teaching; validity; biases; fallacies;
    All these keywords.

    JEL classification:

    • A2 - General Economics and Teaching - - Economic Education and Teaching of Economics
    • H83 - Public Economics - - Miscellaneous Issues - - - Public Administration
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • L3 - Industrial Organization - - Nonprofit Organizations and Public Enterprise

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aes:amfeco:v:11:y:2009:i:25:p:125-150. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Valentin Dumitru (email available below). General contact details of provider: https://edirc.repec.org/data/aseeero.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.