IDEAS home Printed from https://ideas.repec.org/a/eee/soceco/v107y2023ics221480432300112x.html
   My bibliography  Save this article

Changing perceptions about experimentation in economics: 50 years of evidence from principles textbooks

Author

Listed:
  • Gunessee, Saileshsingh
  • Lane, Tom

Abstract

Traditionally, economists often argued experiments play little or no useful role in our science. This paper employs a novel approach to track the historical evolution of this doctrine from 1970 to 2019, by constructing a dataset of 278 introductory economics textbooks. Quantitative and qualitative analysis shows that anti-experimental views were dominant and largely unchanged until 2000, but there has since been a trend towards textbooks making positive statements about experimentation. However, remarks that economic experiments are impossible have been (almost) eliminated only in the last decade, evidencing a sluggish change in perceptions. Supplementary interviews with key textbook authors confirm the historical trend of increased enthusiasm towards experiments, and suggest they are now accepted within the economic mainstream. Our findings hold important implications for how the empirical methodology of economics is understood by practitioners and students.

Suggested Citation

  • Gunessee, Saileshsingh & Lane, Tom, 2023. "Changing perceptions about experimentation in economics: 50 years of evidence from principles textbooks," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).
  • Handle: RePEc:eee:soceco:v:107:y:2023:i:c:s221480432300112x
    DOI: 10.1016/j.socec.2023.102086
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S221480432300112X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.socec.2023.102086?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Alan B. Krueger, 2001. "Teaching the Minimum Wage in Econ 101 in Light of the New Economics of the Minimum Wage," The Journal of Economic Education, Taylor & Francis Journals, vol. 32(3), pages 243-258, January.
    2. Theodore C. Bergstrom, 2003. "Vernon Smith's Insomnia and the Dawn of Economics as Experimental Science," Scandinavian Journal of Economics, Wiley Blackwell, vol. 105(2), pages 181-205, June.
    3. Robin L. Bartlett, 1996. "Discovering Diversity in Introductory Economics," Journal of Economic Perspectives, American Economic Association, vol. 10(2), pages 141-153, Spring.
    4. David Colander & Richard Holt & Barkley Rosser, 2004. "The changing face of mainstream economics," Review of Political Economy, Taylor & Francis Journals, vol. 16(4), pages 485-499.
    5. Mark Skousen, 1997. "The Perseverance of Paul Samuelson's Economics," Journal of Economic Perspectives, American Economic Association, vol. 11(2), pages 137-152, Spring.
    6. Denise Robson, 2001. "Women and Minorities in Economics Textbooks: Are They Being Adequately Represented?," The Journal of Economic Education, Taylor & Francis Journals, vol. 32(2), pages 186-191, January.
    7. Alexander Kovzik & Marianne Johnson, 2016. "Comparative economics systems in the undergraduate curriculum: An update," The Journal of Economic Education, Taylor & Francis Journals, vol. 47(2), pages 168-173, April.
    8. Tom L. Green, 2012. "Introductory economics textbooks: what do they teach about sustainability?," International Journal of Pluralism and Economics Education, Inderscience Enterprises Ltd, vol. 3(2), pages 189-223.
    9. Poul Thøis Madsen, 2013. "The Financial Crisis and Principles of Economics Textbooks," The Journal of Economic Education, Taylor & Francis Journals, vol. 44(3), pages 197-216, September.
    10. Gary Charness & Kay-Yut Chen, 2002. "Minimum Advertised-Price Policy Rules and Retailer Behavior: An Experiment by Hewlett-Packard," Interfaces, INFORMS, vol. 32(5), pages 62-73, October.
    11. Alexandre Truc, 2022. "Interdisciplinary influences in behavioral economics: a bibliometric analysis of cross-disciplinary citations," Journal of Economic Methodology, Taylor & Francis Journals, vol. 29(3), pages 217-251, July.
    12. Shaun P. Hargreaves Heap, 2013. "What is the meaning of behavioural economics?," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 37(5), pages 985-1000.
    13. Jacquemet,Nicolas & L'Haridon,Olivier, 2018. "Experimental Economics," Cambridge Books, Cambridge University Press, number 9781107060272, November.
    14. Dhami, Sanjit, 2016. "The Foundations of Behavioral Economic Analysis," OUP Catalogue, Oxford University Press, number 9780198715535.
    15. Daniel S. Hamermesh, 2013. "Six Decades of Top Economics Publishing: Who and How?," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 162-172, March.
    16. Chris Starmer, 1999. "Experiments in economics: should we trust the dismal scientists in white coats?," Journal of Economic Methodology, Taylor & Francis Journals, vol. 6(1), pages 1-30.
    17. Yvonne Durham & Thomas Mckinnon & Craig Schulman, 2007. "Classroom Experiments: Not Just Fun And Games," Economic Inquiry, Western Economic Association International, vol. 45(1), pages 162-178, January.
    18. Samuel Bowles & Wendy Carlin, 2020. "What Students Learn in Economics 101: Time for a Change," Journal of Economic Literature, American Economic Association, vol. 58(1), pages 176-214, March.
    19. Starmer, Chris, 1999. "Experimental Economics: Hard Science or Wasteful Tinkering?," Economic Journal, Royal Economic Society, vol. 109(453), pages 5-15, February.
    20. Francesco Guala, 2002. "On the scope of experiments in economics: comments on Siakantaris," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 26(2), pages 261-267, March.
    21. Ernesto Reuben & Sherry Xin Li & Sigrid Suetens & Andrej Svorenčík & Theodore Turocy & Vasileios Kotsidis, 2022. "Trends in the publication of experimental economics articles," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 8(1), pages 1-15, December.
    22. Peter-Wim Zuidhof, 2014. "Thinking Like an Economist: The Neoliberal Politics of the Economics Textbook," Review of Social Economy, Taylor & Francis Journals, vol. 72(2), pages 157-185, June.
    23. Giraud, Yann, 2020. "Addressing The Audience: Paul Samuelson, Radical Economics, And Textbook Making, 1967–1973," Journal of the History of Economic Thought, Cambridge University Press, vol. 42(2), pages 177-198, June.
    24. Andrew M. Colman & Briony D. Pulford, 2015. "Psychology of Game Playing: Introduction to a Special Issue," Games, MDPI, vol. 6(4), pages 1-8, December.
    25. Siakantaris, Nikos, 2000. "Experimental Economics under the Microscope," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 24(3), pages 267-281, May.
    26. Mario Cedrini & Magda Fontana, 2018. "Just another niche in the wall? How specialization is changing the face of mainstream economics [Multidisciplinarity, interdisciplinarity, transdisciplinarity, and the sciences]," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 42(2), pages 427-451.
    27. Duflo, Esther, 2017. "The Economist as Plumber," CEPR Discussion Papers 11881, C.E.P.R. Discussion Papers.
    28. John A. List, 2011. "Why Economists Should Conduct Field Experiments and 14 Tips for Pulling One Off," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 3-16, Summer.
    29. N. Gregory Mankiw, 2020. "Reflections of a Textbook Author," Journal of Economic Literature, American Economic Association, vol. 58(1), pages 215-228, March.
    30. Esther Duflo, 2017. "Richard T. Ely Lecture: The Economist as Plumber," American Economic Review, American Economic Association, vol. 107(5), pages 1-26, May.
    31. Sam Allgood & William B. Walstad & John J. Siegfried, 2015. "Research on Teaching Economics to Undergraduates," Journal of Economic Literature, American Economic Association, vol. 53(2), pages 285-325, June.
    32. Jane S. Lopus & Lynn Paringer, 2011. "The Principles of Economics Textbook: Content Coverage and Usage," Chapters, in: Gail M. Hoyt & KimMarie McGoldrick (ed.), International Handbook on Teaching and Learning Economics, chapter 28, Edward Elgar Publishing.
    33. Nikos Nikiforakis & Robert Slonim, 2019. "Editors’ Preface: Trends in experimental economics (1975–2018)," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 5(2), pages 143-148, December.
    34. Alexandre Truc, 2022. "Forty years of behavioral economics," The European Journal of the History of Economic Thought, Taylor & Francis Journals, vol. 29(3), pages 393-437, May.
    35. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    36. Christopher A. Sims, 2010. "But Economics Is Not an Experimental Science," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 59-68, Spring.
    37. Nikos Nikiforakis & Robert Slonim, 2015. "Editors’ preface: introducing JESA," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 1-7, July.
    38. Esther Duflo, 2017. "The Economist as Plumber," NBER Working Papers 23213, National Bureau of Economic Research, Inc.
    39. Roth, Alvin E, 1988. "Laboratory Experimentation in Economics: A Methodological Overview," Economic Journal, Royal Economic Society, vol. 98(393), pages 974-1031, December.
    40. Rita A. Balaban & Donna B. Gilleskie & Uyen Tran, 2016. "A quantitative evaluation of the flipped classroom in a large lecture principles of economics course," The Journal of Economic Education, Taylor & Francis Journals, vol. 47(4), pages 269-287, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Saileshsingh Gunessee & Tom Lane, 2020. "Is Economics An Experimental Science? A Textbook Perspective," Discussion Papers 2020-16, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    2. Urban, Janina & Rommel, Florian, 2020. "German economics: Its current form and content," Working Paper Series 56, Cusanus Hochschule für Gesellschaftsgestaltung, Institut für Ökonomie.
    3. John Gibson, 2021. "The micro‐geography of academic research: How distinctive is economics?," Scottish Journal of Political Economy, Scottish Economic Society, vol. 68(4), pages 467-484, September.
    4. Dorian Jullien & Nicolas Vallois, 2014. "A probabilistic ghost in the experimental machine," Journal of Economic Methodology, Taylor & Francis Journals, vol. 21(3), pages 232-250, September.
    5. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    6. Justman, Moshe, 2018. "Randomized controlled trials informing public policy: Lessons from project STAR and class size reduction," European Journal of Political Economy, Elsevier, vol. 54(C), pages 167-174.
    7. Fiore, Annamaria, 2009. "Experimental Economics: Some Methodological Notes," MPRA Paper 12498, University Library of Munich, Germany.
    8. Jane E. Ihrig & Scott A. Wolla, 2020. "Let's Close the Gap: Revising Teaching Materials to Reflect How the Federal Reserve Implements Monetary Policy," Finance and Economics Discussion Series 2020-092, Board of Governors of the Federal Reserve System (U.S.).
    9. Sergio Mariotti, 2022. "The economics–engineering nexus: response to the commentaries," Economia e Politica Industriale: Journal of Industrial and Business Economics, Springer;Associazione Amici di Economia e Politica Industriale, vol. 49(1), pages 1-29, March.
    10. List John A., 2007. "Field Experiments: A Bridge between Lab and Naturally Occurring Data," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 5(2), pages 1-47, April.
    11. Ingrid Harvold Kvangraven & Surbhi Kesar, 2021. "Standing in the Way of Rigor? Economics’ Meeting with the Decolonizing Agenda," Working Papers 2110, New School for Social Research, Department of Economics.
    12. Rommel, Florian & Urban, Janina, 2022. "A Survey of German Economics," VfS Annual Conference 2022 (Basel): Big Data in Economics 264131, Verein für Socialpolitik / German Economic Association.
    13. Maibom, Jonas, 2021. "The Danish Labor Market Experiments: Methods and Findings," Nationaløkonomisk tidsskrift, Nationaløkonomisk Forening, vol. 2021(1), pages 1-21.
    14. Dina Pomeranz & José Vila-Belda, 2019. "Taking State-Capacity Research to the Field: Insights from Collaborations with Tax Authorities," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 755-781, August.
    15. Krause, Philipp & Hernández Licona, Gonzalo, 2020. "From experimental findings to evidence-based policy," World Development, Elsevier, vol. 127(C).
    16. Pessali, Huascar & Berger, Bruno, 2010. "A teoria da perspectiva e as mudanças de preferência no mainstream: um prospecto lakatoseano [Prospect theory and preference change in the mainstream of economics: a Lakatosian prospect]," MPRA Paper 26104, University Library of Munich, Germany.
    17. Alice Nicole Sindzingre, 2021. "Truth vs justification: contrasting heterodox and mainstream thinking on development via the example of austerity in Africa," CEPN Working Papers hal-03139457, HAL.
    18. Yannick Gabuthy & Nicolas Jacquemet, 2013. "Analyse économique du droit et méthode expérimentale," PSE-Ecole d'économie de Paris (Postprint) halshs-00746617, HAL.
    19. Rehse, Dominik & Tremöhlen, Felix, 2020. "Fostering participation in digital public health interventions: The case of digital contact tracing," ZEW Discussion Papers 20-076, ZEW - Leibniz Centre for European Economic Research.
    20. Wei Yang Tham & Joseph Staudt & Elisabeth Ruth Perlman & Stephanie D. Cheng, 2024. "Scientific Talent Leaks Out of Funding Gaps," Working Papers 24-08, Center for Economic Studies, U.S. Census Bureau.

    More about this item

    Keywords

    Economic methodology; Experimental economics; Economics principles textbooks; History of economic thought;
    All these keywords.

    JEL classification:

    • A20 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - General
    • B29 - Schools of Economic Thought and Methodology - - History of Economic Thought since 1925 - - - Other
    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceco:v:107:y:2023:i:c:s221480432300112x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620175 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.