IDEAS home Printed from https://ideas.repec.org/p/pui/dpaper/63.html
   My bibliography  Save this paper

Impact of Lower Rated Journals on Economists' Judgments of Publication Lists: Evidence from a Survey Experiment

Author

Listed:
  • Nattavudh Powdthavee
  • Yohanes E. Riyanto
  • Jack L. Knetsch

Abstract

Publications in leading journals are widely known to have a positive impact on economists' judgments of the value of authors' contributions to the literature and on their professional reputations. Very little attention has been given, however, to the impacts of the addition of publications in lower rated journals on such judgments. In our main tests, we asked sub-samples of economist in 44 universities throughout the world to rate either a publication list with only higher rated journals or a list with all of these but with additional publications in nearly as many respected but lower rated journals. Our primary finding was that the inclusion of lower rated journals had a statistically significant negative impact on these economists' judgments of the value of the author's contribution. To the extent that such judgments may influence research and publication strategies our findings imply negative implications on social welfare.

Suggested Citation

  • Nattavudh Powdthavee & Yohanes E. Riyanto & Jack L. Knetsch, 2017. "Impact of Lower Rated Journals on Economists' Judgments of Publication Lists: Evidence from a Survey Experiment," PIER Discussion Papers 63, Puey Ungphakorn Institute for Economic Research.
    • Handle: RePEc:pui:dpaper:63
    as

    Download full text from publisher

    File URL: https://www.pier.or.th/files/dp/pier_dp_063.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. John P. Conley & Mario J. Crucini & Robert A. Driskill & Ali Sina Önder, 2013. "The Effects Of Publication Lags On Life-Cycle Research Productivity In Economics," Economic Inquiry, Western Economic Association International, vol. 51(2), pages 1251-1276, April.
    2. Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision‐Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, February.
    3. Combes, Pierre-Philippe & Linnemer, Laurent & Visser, Michael, 2008. "Publish or peer-rich? The role of skills and networks in hiring economics professors," Labour Economics, Elsevier, vol. 15(3), pages 423-441, June.
    4. David Card & Stefano DellaVigna, 2013. "Nine Facts about Top Journals in Economics," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 144-161, March.
    5. Daniel S. Hamermesh, 2018. "Citations in Economics: Measurement, Uses, and Impacts," Journal of Economic Literature, American Economic Association, vol. 56(1), pages 115-156, March.
    6. Arthur E. Attema & Werner B.F. Brouwer & Job Van Exel, 2014. "Your Right Arm For A Publication In Aer?," Economic Inquiry, Western Economic Association International, vol. 52(1), pages 495-502, January.
    7. Paul W. Grimes & Charles A. Register, 1997. "Career Publications and Academic Job Rank: Evidence from the Class of 1968," The Journal of Economic Education, Taylor & Francis Journals, vol. 28(1), pages 82-92, March.
    8. Pierre-Philippe Combes & Laurent Linnemer & Michael Visser, 2008. "Publish or Peer-rich," Post-Print hal-00558189, HAL.
    9. Kahn, Shulamit, 1993. "Gender Differences in Academic Career Paths of Economists," American Economic Review, American Economic Association, vol. 83(2), pages 52-56, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. How to Count Citations If You Must
      by noreply@blogger.com (David Stern) in Stochastic Trend on 2018-01-06 05:23:00

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Simon Ek & Magnus Henrekson, 2019. "The Geography and Concentration of Authorship in the Top Five: Implications For European Economics," Scottish Journal of Political Economy, Scottish Economic Society, vol. 66(2), pages 215-245, May.
    2. Corsi, Marcella & D’Ippoliti, Carlo & Zacchia, Giulia, 2019. "Diversity of backgrounds and ideas: The case of research evaluation in economics," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    3. Timothy Perri, 2018. "Economics of evaluation (with special reference to promotion and tenure committees)," Economics of Governance, Springer, vol. 19(1), pages 1-19, February.
    4. Payson Steven, 2019. "Cite This Economics Paper! It Is Time for the House of Cards to Fall Down," Open Economics, De Gruyter, vol. 2(1), pages 1-18, January.
    5. David I. Stern & Richard S.J. Tol, 2018. "How to Count Citations If You Must: Comment," Working Paper Series 0118, Department of Economics, University of Sussex Business School.
    6. Zarrina Juraqulova & Jill J. McCluskey & Ron C. Mittelhammer, 2022. "Promotional achievement of economists: Does being agricultural or female matter?," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 44(4), pages 2064-2086, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Simon Ek & Magnus Henrekson, 2019. "The Geography and Concentration of Authorship in the Top Five: Implications For European Economics," Scottish Journal of Political Economy, Scottish Economic Society, vol. 66(2), pages 215-245, May.
    2. Powdthavee, Nattavudh & Riyanto, Yohanes E. & Knetsch, Jack L., 2018. "Lower-rated publications do lower academics’ judgments of publication lists: Evidence from a survey experiment of economists," Journal of Economic Psychology, Elsevier, vol. 66(C), pages 33-44.
    3. J. Atsu Amegashie, 2020. "Citations And Incentives In Academic Contests," Economic Inquiry, Western Economic Association International, vol. 58(3), pages 1233-1244, July.
    4. Matthias Aistleitner & Jakob Kapeller & Stefan Steinerberger, 2018. "Citation Patterns in Economics and Beyond," Working Papers Series 85, Institute for New Economic Thinking.
    5. Anne Boring, 2015. "Gender Biases in Student Evaluations of Teachers," Working Papers hal-03470161, HAL.
    6. Jenny Bourne & Nathan Grawe & Nathan D. Grawe & Michael Hemesath & Maya Jensen, 2022. "Scholarly Activity among Economists at Liberal Arts Colleges: A Life Cycle Analysis," Working Papers 2022-01, Carleton College, Department of Economics.
    7. María Victoria Anauati & Sebastian Galiani & Ramiro H. Gálvez, 2020. "Differences In Citation Patterns Across Journal Tiers: The Case Of Economics," Economic Inquiry, Western Economic Association International, vol. 58(3), pages 1217-1232, July.
    8. José Alberto Molina & Alberto Alcolea & Alfredo Ferrer & Alberto Alcolea & David Iñiguez & Alejandro Rivero & Gonzalo Ruiz & Alfonso Tarancón, 2016. "Co-authorship and Academic Productivity in Economics: Interaction Maps from the Complex Networks Approach," Boston College Working Papers in Economics 914, Boston College Department of Economics.
    9. Aistleitner, Matthias & Kapeller, Jakob & Kronberger, Dominik, 2022. "The authors of economics journals revisited: Evidence from a large-scale replication of Hodgson & Rothman (1999)," ifso working paper series 20, University of Duisburg-Essen, Institute for Socioeconomics (ifso).
    10. James J. Heckman & Sidharth Moktan, 2020. "Publishing and Promotion in Economics: The Tyranny of the Top Five," Journal of Economic Literature, American Economic Association, vol. 58(2), pages 419-470, June.
    11. repec:hal:spmain:info:hdl:2441/1seuirq4ak9b9bouu1j29ebui7 is not listed on IDEAS
    12. José Alberto Molina & Alfredo Ferrer & David Iñiguez & Alejandro Rivero & Gonzalo Ruiz & Alfonso Tarancón, 2020. "Network analysis to measure academic performance in economics," Empirical Economics, Springer, vol. 58(3), pages 995-1018, March.
    13. Bransch, Felix & Kvasnicka, Michael, 2022. "Male Gatekeepers: Gender Bias in the Publishing Process?," Journal of Economic Behavior & Organization, Elsevier, vol. 202(C), pages 714-732.
    14. Besancenot, Damien & Huynh, Kim & Serranito, Francisco, 2017. "Co-authorship and research productivity in economics: Assessing the assortative matching hypothesis," Economic Modelling, Elsevier, vol. 66(C), pages 61-80.
    15. repec:spo:wpmain:info:hdl:2441/1seuirq4ak9b9bouu1j29ebui7 is not listed on IDEAS
    16. Damien Besancenot & Kim Van Huynh & Francisco Serranito, 2015. " Thou shalt not work alone ," Working Papers hal-01175758, HAL.
    17. María Victoria Anauati & Sebastian Galiani & Ramiro H. Gálvez, 2018. "Differences in citation patterns across journal tiers in economics," Documentos de Trabajo 16701, The Latin American and Caribbean Economic Association (LACEA).
    18. Franklin G. Mixon & Benno Torgler & Kamal P. Upadhyaya, 2022. "Committees or Markets? An Exploratory Analysis of Best Paper Awards in Economics," Economies, MDPI, vol. 10(5), pages 1-15, May.
    19. Payson Steven, 2019. "Cite This Economics Paper! It Is Time for the House of Cards to Fall Down," Open Economics, De Gruyter, vol. 2(1), pages 1-18, January.
    20. Stéphanie Combes & Pauline Givord, 2018. "Selective matching: gender gap and network formation in research," Working Papers 2018-07, Center for Research in Economics and Statistics.
    21. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2017. "Ein Meta-Ranking volkswirtschaftlicher Fachzeitschriften," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 70(16), pages 40-42, August.

    More about this item

    Keywords

    Lower Ranked Journals; Publication; Judgment Bias; Less-is-better Effect; Resume;
    All these keywords.

    JEL classification:

    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pui:dpaper:63. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/pierbth.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.