IDEAS home Printed from https://ideas.repec.org/a/eee/soceco/v107y2023ics2214804323001088.html
   My bibliography  Save this article

Editorial favoritism in the field of laboratory experimental economics

Author

Listed:
  • Cloos, Janis
  • Greiff, Matthias
  • Rusch, Hannes

Abstract

We examine scientific quality and editorial favoritism in the field of experimental economics. We use a novel data set containing all original research papers (N=569) that exclusively used laboratory experiments for data generation and were published in the American Economic Review (AER), Experimental Economics (EE), or the Journal of the European Economic Association (JEEA) between 1998 and 2018. Several quantifiable proxies for scientific quality indicate that experiments conducted in Europe trump experiments conducted in the US: European experiments rely on larger numbers of participants as well as participants per treatment and receive more citations. For the AER and the JEEA, but not for EE, we find that papers authored by economists with social ties to the editors receive significantly fewer citations in the years following publication. Detailed analyses using a novel dynamic and continuous measure of the co-authorship distance between editors and authors suggest that authors at longer distances to editors have to write papers of higher quality in order to get published in the AER and the JEEA. We find no evidence that this ‘uphill battle’ is associated with geographical distance.

Suggested Citation

  • Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2023. "Editorial favoritism in the field of laboratory experimental economics," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).
  • Handle: RePEc:eee:soceco:v:107:y:2023:i:c:s2214804323001088
    DOI: 10.1016/j.socec.2023.102082
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2214804323001088
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.socec.2023.102082?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Scott Carrell & David Figlio & Lester Lusher, 2024. "Clubs and Networks in Economics Reviewing," Journal of Political Economy, University of Chicago Press, vol. 132(9), pages 2999-3024.
    2. Charles Bellemare & Luc Bissonnette & Sabine Kröger, 2016. "Simulating power of economic experiments: the powerBBK package," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 2(2), pages 157-168, November.
    3. Angus, Simon D. & Atalay, Kadir & Newton, Jonathan & Ubilava, David, 2021. "Geographic diversity in economic publishing," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 255-262.
    4. Tommaso Colussi, 2018. "Social Ties in Academia: A Friend Is a Treasure," The Review of Economics and Statistics, MIT Press, vol. 100(1), pages 45-50, March.
    5. John P. A. Ioannidis & T. D. Stanley & Hristos Doucouliagos, 2017. "The Power of Bias in Economics Research," Economic Journal, Royal Economic Society, vol. 127(605), pages 236-265, October.
    6. John List & Sally Sadoff & Mathis Wagner, 2011. "So you want to run an experiment, now what? Some simple rules of thumb for optimal experimental design," Experimental Economics, Springer;Economic Science Association, vol. 14(4), pages 439-457, November.
    7. Laband, David N & Piette, Michael J, 1994. "Favoritism versus Search for Good Papers: Empirical Evidence Regarding the Behavior of Journal Editors," Journal of Political Economy, University of Chicago Press, vol. 102(1), pages 194-203, February.
    8. Pablo Brañas-Garza & Diego Jorrat & Antonio M. Espín & Angel Sánchez, 2023. "Paid and hypothetical time preferences are the same: lab, field and online evidence," Experimental Economics, Springer;Economic Science Association, vol. 26(2), pages 412-434, April.
    9. Lorenzo Ductor & Bauke Visser, 2023. "Concentration of power at the editorial boards of economics journals," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 189-238, April.
    10. Erin Hengel & Eunyoung Moon, 2020. "Gender and quality at top economics journals," Working Papers 202001, University of Liverpool, Department of Economics.
    11. Kathryn N. Vasilaky & J. Michelle Brock, 2020. "Power(ful) guidelines for experimental economists," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 6(2), pages 189-212, December.
    12. Laband, David N & Piette, Michael J, 1994. "The Relative Impacts of Economics Journals: 1970-1990," Journal of Economic Literature, American Economic Association, vol. 32(2), pages 640-666, June.
    13. Esther Duflo, 2020. "Report of the Editor: American Economic Review," AEA Papers and Proceedings, American Economic Association, vol. 110, pages 660-674, May.
    14. David Card & Stefano DellaVigna, 2020. "What Do Editors Maximize? Evidence from Four Economics Journals," The Review of Economics and Statistics, MIT Press, vol. 102(1), pages 195-217, March.
    15. repec:cup:judgdm:v:16:y:2021:i:5:p:1290-1313 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2021. "Editorial favoritism in the field of laboratory experimental economics (RM/20/014-revised-)," Research Memorandum 005, Maastricht University, Graduate School of Business and Economics (GSBE).
    2. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2020. "Geographical Concentration and Editorial Favoritism within the Field of Laboratory Experimental Economics (RM/19/029-revised-)," Research Memorandum 014, Maastricht University, Graduate School of Business and Economics (GSBE).
    3. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2019. "Geographical Concentration and Editorial Favoritism within the Field of Laboratory Experimental Economics," Research Memorandum 029, Maastricht University, Graduate School of Business and Economics (GSBE).
    4. Kyle Siler & Philippe Vincent-Lamarre & Cassidy R Sugimoto & Vincent Larivière, 2022. "Cumulative advantage and citation performance of repeat authors in scholarly journals," PLOS ONE, Public Library of Science, vol. 17(4), pages 1-17, April.
    5. Ann Mari May & Mary G. McGarvey & Yana Rodgers & Mark Killingsworth, 2021. "Critiques, Ethics, Prestige and Status: A Survey of Editors in Economics," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 47(2), pages 295-318, April.
    6. Javdani, Moshen & Chang, Ha-Joon, 2019. "Who Said or What Said? Estimating Ideological Bias in Views Among Economists," MPRA Paper 91958, University Library of Munich, Germany.
    7. Siganos, Antonios, 2021. "Guest editor networking in special issues," International Review of Financial Analysis, Elsevier, vol. 76(C).
    8. James J. Heckman & Sidharth Moktan, 2020. "Publishing and Promotion in Economics: The Tyranny of the Top Five," Journal of Economic Literature, American Economic Association, vol. 58(2), pages 419-470, June.
    9. Leah H. Palm-Forster & Paul J. Ferraro & Nicholas Janusch & Christian A. Vossler & Kent D. Messer, 2019. "Behavioral and Experimental Agri-Environmental Research: Methodological Challenges, Literature Gaps, and Recommendations," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(3), pages 719-742, July.
    10. Ductor, Lorenzo & Visser, Bauke, 2022. "When a coauthor joins an editorial board," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 576-595.
    11. Sebastian Jobjörnsson & Henning Schaak & Oliver Musshoff & Tim Friede, 2023. "Improving the statistical power of economic experiments using adaptive designs," Experimental Economics, Springer;Economic Science Association, vol. 26(2), pages 357-382, April.
    12. Ignacio Palacios-Huerta & Oscar Volij, 2004. "The Measurement of Intellectual Influence," Econometrica, Econometric Society, vol. 72(3), pages 963-977, May.
    13. Jishnu Das & Quy-Toan Do, 2020. "US and them - The geography of academic research," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 111-114, Centre for Economic Policy Research.
    14. Di Vaio, Gianfranco & Waldenström, Daniel & Weisdorf, Jacob, 2012. "Citation success: Evidence from economic history journal publications," Explorations in Economic History, Elsevier, vol. 49(1), pages 92-104.
    15. Syed Hasan & Robert Breunig, 2021. "Article length and citation outcomes," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7583-7608, September.
    16. Maurizio Canavari & Andreas C. Drichoutis & Jayson L. Lusk & Rodolfo M. Nayga, Jr., 2018. "How to run an experimental auction: A review of recent advances," Working Papers 2018-5, Agricultural University of Athens, Department Of Agricultural Economics.
    17. Glenn Ellison, 2002. "The Slowdown of the Economics Publishing Process," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 947-993, October.
    18. Erich Battistin & Marco Ovidi, 2022. "Rising Stars: Expert Reviews and Reputational Yardsticks in the Research Excellence Framework," Economica, London School of Economics and Political Science, vol. 89(356), pages 830-848, October.
    19. Lorenzo Ductor & Bauke Visser, 2023. "Concentration of power at the editorial boards of economics journals," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 189-238, April.
    20. Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023. "Unpacking P-hacking and Publication Bias," American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.

    More about this item

    Keywords

    Laboratory experiments; Favoritism; Methodological standards; Network effects;
    All these keywords.

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceco:v:107:y:2023:i:c:s2214804323001088. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620175 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.