IDEAS home Printed from https://ideas.repec.org/p/unm/umagsb/2021005.html
   My bibliography  Save this paper

Editorial favoritism in the field of laboratory experimental economics (RM/20/014-revised-)

Author

Listed:
  • Cloos, Janis
  • Greiff, Matthias
  • Rusch, Hannes

    (RS: GSBE other - not theme-related research, Microeconomics & Public Economics)

Abstract

We examine scientific quality and editorial favoritism in the field of experimental economics. We use a novel data set containing all original research papers (N=569) that exclusively used laboratory experiments for data generation and were published in the American Economic Review (AER), Experimental Economics (EE), or the Journal of the European Economic Association (JEEA) between 1998 and 2018. Several proxies for scientific quality indicate that experiments conducted in Europe are of higher quality than experiments conducted in the US: European experiments rely on larger numbers of participants as well as participants per treatment and receive more citations. For the AER and the JEEA, but not for EE, we find that papers authored by economists with social ties to the editors receive significantly fewer citations in the years following publication. Detailed analyses using a novel dynamic and continuous measure of the co-authorship distance between editors and authors imply that authors at longer distances to editors have to write papers of higher quality in order to get published in the AER and the JEEA. We find no evidence that this ‘uphill battle’ is associated with geographical distance.

Suggested Citation

  • Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2021. "Editorial favoritism in the field of laboratory experimental economics (RM/20/014-revised-)," Research Memorandum 005, Maastricht University, Graduate School of Business and Economics (GSBE).
  • Handle: RePEc:unm:umagsb:2021005
    DOI: 10.26481/umagsb.2021005
    as

    Download full text from publisher

    File URL: https://cris.maastrichtuniversity.nl/ws/files/63229114/RM21005.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.26481/umagsb.2021005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. John P. A. Ioannidis & T. D. Stanley & Hristos Doucouliagos, 2017. "The Power of Bias in Economics Research," Economic Journal, Royal Economic Society, vol. 127(605), pages 236-265, October.
    2. Charles Bellemare & Luc Bissonnette & Sabine Kröger, 2014. "Statistical Power of Within and Between-Subjects Designs in Economic Experiments," CESifo Working Paper Series 5055, CESifo.
    3. Erin Hengel & Eunyoung Moon, 2020. "Gender and quality at top economics journals," Working Papers 202001, University of Liverpool, Department of Economics.
    4. David Card & Stefano DellaVigna & Patricia Funk & Nagore Iriberri, 2020. "Are Referees and Editors in Economics Gender Neutral?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(1), pages 269-327.
    5. Kathryn N. Vasilaky & J. Michelle Brock, 2020. "Power(ful) guidelines for experimental economists," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 6(2), pages 189-212, December.
    6. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    7. John List & Sally Sadoff & Mathis Wagner, 2011. "So you want to run an experiment, now what? Some simple rules of thumb for optimal experimental design," Experimental Economics, Springer;Economic Science Association, vol. 14(4), pages 439-457, November.
    8. Daniel S. Hamermesh, 2018. "Citations in Economics: Measurement, Uses, and Impacts," Journal of Economic Literature, American Economic Association, vol. 56(1), pages 115-156, March.
    9. Daniel S. Hamermesh, 1994. "Facts and Myths about Refereeing," Journal of Economic Perspectives, American Economic Association, vol. 8(1), pages 153-163, Winter.
    10. Charles Bellemare & Luc Bissonnette & Sabine Kröger, 2016. "Simulating power of economic experiments: the powerBBK package," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 2(2), pages 157-168, November.
    11. Angus, Simon D. & Atalay, Kadir & Newton, Jonathan & Ubilava, David, 2021. "Geographic diversity in economic publishing," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 255-262.
    12. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    13. Andreas Ortman & Le Zhang, 2013. "Exploring the Meaning of Significance in Experimental Economics," Discussion Papers 2013-32, School of Economics, The University of New South Wales.
    14. Tommaso Colussi, 2018. "Social Ties in Academia: A Friend Is a Treasure," The Review of Economics and Statistics, MIT Press, vol. 100(1), pages 45-50, March.
    15. Laband, David N & Piette, Michael J, 1994. "Favoritism versus Search for Good Papers: Empirical Evidence Regarding the Behavior of Journal Editors," Journal of Political Economy, University of Chicago Press, vol. 102(1), pages 194-203, February.
    16. Laband, David N & Piette, Michael J, 1994. "The Relative Impacts of Economics Journals: 1970-1990," Journal of Economic Literature, American Economic Association, vol. 32(2), pages 640-666, June.
    17. Nikos Nikiforakis & Robert Slonim, 2019. "Editors’ Preface: Trends in experimental economics (1975–2018)," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 5(2), pages 143-148, December.
    18. Marshall H. Medoff, 2003. "Editorial Favoritism in Economics?," Southern Economic Journal, John Wiley & Sons, vol. 70(2), pages 425-434, October.
    19. David Card & Stefano DellaVigna, 2020. "What Do Editors Maximize? Evidence from Four Economics Journals," The Review of Economics and Statistics, MIT Press, vol. 102(1), pages 195-217, March.
    20. Brogaard, Jonathan & Engelberg, Joseph & Parsons, Christopher A., 2014. "Networks and productivity: Causal evidence from editor rotations," Journal of Financial Economics, Elsevier, vol. 111(1), pages 251-270.
    21. Colussi, Tommaso, 2015. "Social Ties in Academia: A Friend is a Treasure," IZA Discussion Papers 9414, Institute of Labor Economics (IZA).
    Full references (including those not matched with items on IDEAS)

    Citations

    RePEc Biblio mentions

    As found on the RePEc Biblio, the curated bibliography for Economics:
    1. > Economics Profession > Publishing in Economics > Discrimination

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2020. "Geographical Concentration and Editorial Favoritism within the Field of Laboratory Experimental Economics (RM/19/029-revised-)," Research Memorandum 014, Maastricht University, Graduate School of Business and Economics (GSBE).
    2. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2019. "Geographical Concentration and Editorial Favoritism within the Field of Laboratory Experimental Economics," Research Memorandum 029, Maastricht University, Graduate School of Business and Economics (GSBE).
    3. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2023. "Editorial favoritism in the field of laboratory experimental economics," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).
    4. Ann Mari May & Mary G. McGarvey & Yana Rodgers & Mark Killingsworth, 2021. "Critiques, Ethics, Prestige and Status: A Survey of Editors in Economics," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 47(2), pages 295-318, April.
    5. Bransch, Felix & Kvasnicka, Michael, 2022. "Male Gatekeepers: Gender Bias in the Publishing Process?," Journal of Economic Behavior & Organization, Elsevier, vol. 202(C), pages 714-732.
    6. Ductor, Lorenzo & Visser, Bauke, 2022. "When a coauthor joins an editorial board," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 576-595.
    7. Kathryn N. Vasilaky & J. Michelle Brock, 2020. "Power(ful) guidelines for experimental economists," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 6(2), pages 189-212, December.
    8. Koffi, Marlene, 2021. "Innovative ideas and gender inequality," CLEF Working Paper Series 35, Canadian Labour Economics Forum (CLEF), University of Waterloo.
    9. Siganos, Antonios, 2021. "Guest editor networking in special issues," International Review of Financial Analysis, Elsevier, vol. 76(C).
    10. James J. Heckman & Sidharth Moktan, 2020. "Publishing and promotion in economics - The tyranny of the Top Five," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 23-32, Centre for Economic Policy Research.
    11. Carmela Lutmar & Yaniv Reingewertz, 2021. "Academic in-group bias in the top five economics journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9543-9556, December.
    12. Shoshana Grossbard & Tansel Yilmazer & Lingrui Zhang, 2021. "The gender gap in citations of articles published in two demographic economics journals," Review of Economics of the Household, Springer, vol. 19(3), pages 677-697, September.
    13. Kyle Siler & Philippe Vincent-Lamarre & Cassidy R Sugimoto & Vincent Larivière, 2022. "Cumulative advantage and citation performance of repeat authors in scholarly journals," PLOS ONE, Public Library of Science, vol. 17(4), pages 1-17, April.
    14. Si, Kao & Li, Yiwei & Ma, Chao & Guo, Feng, 2023. "Affiliation bias in peer review and the gender gap," Research Policy, Elsevier, vol. 52(7).
    15. Lawson, Nicholas, 2023. "What citation tests really tell us about bias in academic publishing," European Economic Review, Elsevier, vol. 158(C).
    16. Syed Hasan & Robert Breunig, 2021. "Article length and citation outcomes," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7583-7608, September.
    17. Clément Bosquet & Pierre-Philippe Combes & Emeric Henry & Thierry Mayer, 2022. "Peer Effects in Academic Research: Senders and Receivers," The Economic Journal, Royal Economic Society, vol. 132(648), pages 2644-2673.
    18. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    19. David Card & Stefano DellaVigna, 2017. "What do Editors Maximize? Evidence from Four Leading Economics Journals," NBER Working Papers 23282, National Bureau of Economic Research, Inc.
    20. Amarante, Veronica & Zurbrigg, Julieta, 2022. "The marginalization of southern researchers in Development," World Development Perspectives, Elsevier, vol. 26(C).

    More about this item

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:unm:umagsb:2021005. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Andrea Willems or Leonne Portz (email available below). General contact details of provider: https://edirc.repec.org/data/meteonl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.