IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v74y2008i1d10.1007_s11192-008-0109-0.html
   My bibliography  Save this article

Policy impact of bibliometric rankings of research performance of departments and individuals in economics

Author

Listed:
  • Anton J. Nederhof

    (University of Leiden)

Abstract

This paper examines policy-relevant effects of a yearly public ranking of individual researchers and their institutes in economics by means of their publication output in international top journals. In 1980, a grassroots ranking (‘Top 40’) of researchers in the Netherlands by means of their publications in international top journals started a competition among economists. The objective was to improve economics research in the Netherlands to an internationally competitive level. The ranking lists did stimulate output in prestigious international journals. Netherlands universities tended to perform well compared to universities elsewhere in the EU concerning volume of output in ISI source journals, but their citation impact was average. Limitations of ranking studies and of bibliometric monitoring in the field of economics are discussed.

Suggested Citation

  • Anton J. Nederhof, 2008. "Policy impact of bibliometric rankings of research performance of departments and individuals in economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(1), pages 163-174, January.
    • Handle: RePEc:spr:scient:v:74:y:2008:i:1:d:10.1007_s11192-008-0109-0
    DOI: 10.1007/s11192-008-0109-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-008-0109-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-008-0109-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Johnes, Geraint, 1988. "Determinants of research output in economics departments in British universities," Research Policy, Elsevier, vol. 17(3), pages 171-178, June.
    2. Rolf Sternberg & Timo Litzenberger, 2005. "The publication and citation output of German Faculties of Economics and Social Sciences - a comparison of faculties and disciplines based upon SSCI data," Scientometrics, Springer;Akadémiai Kiadó, vol. 65(1), pages 29-53, October.
    3. Kalaitzidakis, P. & Mamuneas, T.P. & Stengos, T., 2003. "Rankings of Academic Journals and Institutions," Working Papers 2003-8, University of Guelph, Department of Economics and Finance.
    4. Peter Nijkamp, 1992. "Towards performance measurement of economics research in the Netherlands," Research Evaluation, Oxford University Press, vol. 2(2), pages 66-72, August.
    5. Joe Davis & John Huston & Debra Patterson, 2001. "The scholarly output of economists: A description of publishing patterns," Atlantic Economic Journal, Springer;International Atlantic Economic Society, vol. 29(3), pages 341-349, September.
    6. Anton J. Nederhof, 2006. "Bibliometric monitoring of research performance in the Social Sciences and the Humanities: A Review," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(1), pages 81-100, January.
    7. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
    8. Tombazos, Christis G., 2005. "A revisionist perspective of European research in economics," European Economic Review, Elsevier, vol. 49(2), pages 251-277, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anton J. Nederhof & Thed N. Leeuwen & Anthony F. J. Raan, 2010. "Highly cited non-journal publications in political science, economics and psychology: a first exploration," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(2), pages 363-374, May.
    2. Aistleitner, Matthias & Kapeller, Jakob & Kronberger, Dominik, 2022. "The authors of economics journals revisited: Evidence from a large-scale replication of Hodgson & Rothman (1999)," ifso working paper series 20, University of Duisburg-Essen, Institute for Socioeconomics (ifso).
    3. Ho Fai Chan & Bruno S. Frey & Jana Gallus & Markus Schaffner & Benno Torgler & Stephen Whyte, 2014. "Do the best scholars attract the highest speaking fees? An exploration of internal and external influence," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 793-817, October.
    4. Aistleitner, Matthias & Kapeller, Jakob & Kronberger, Dominik, 2023. "The authors of economics journals revisited: evidence from a large-scale replication of Hodgson and Rothman (1999)," Journal of Institutional Economics, Cambridge University Press, vol. 19(1), pages 86-101, February.
    5. Roula Inglesi-Lotz & Anastassios Pouris, 2011. "Scientometric impact assessment of a research policy instrument: the case of rating researchers on scientific outputs in South Africa," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(3), pages 747-760, September.
    6. Anne-Wil Harzing & Wilfred Mijnhardt, 2015. "Proof over promise: towards a more inclusive ranking of Dutch academics in Economics & Business," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 727-749, January.
    7. Frederic S. Lee & Therese C. Grijalva & Clifford Nowell, 2010. "Ranking Economics Departments in a Contested Discipline: A Bibliometric Approach to Quality Equality Between Theoretically Distinct Subdisciplines," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1345-1375, November.
    8. Richard S. J. Tol, 2012. "Shapley values for assessing research production and impact of schools and scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 763-780, March.
    9. Buehling, Kilian, 2021. "Changing research topic trends as an effect of publication rankings – The case of German economists and the Handelsblatt Ranking," Journal of Informetrics, Elsevier, vol. 15(3).
    10. João Claro & Carlos A. V. Costa, 2011. "A made-to-measure indicator for cross-disciplinary bibliometric ranking of researchers performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(1), pages 113-123, January.
    11. Frederic S. Lee & Bruce C. Cronin & Scott McConnell & Erik Dean, 2010. "Research Quality Rankings of Heterodox Economic Journals in a Contested Discipline," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1409-1452, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Raúl Ramos & Vicente Royuela & Jordi Suriñach, 2007. "An analysis of the determinants in Economics and Business publications by Spanish universities between 1994 and 2004," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(1), pages 117-144, April.
    2. Frederic S. Lee & Therese C. Grijalva & Clifford Nowell, 2010. "Ranking Economics Departments in a Contested Discipline: A Bibliometric Approach to Quality Equality Between Theoretically Distinct Subdisciplines," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1345-1375, November.
    3. Rolf Ketzler & Klaus F. Zimmermann, 2009. "Publications: German economic research institutes on track," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(1), pages 231-252, July.
    4. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.
    5. repec:cte:derepe:de060201 is not listed on IDEAS
    6. repec:cte:werepe:we063609 is not listed on IDEAS
    7. Jordi Pons-Novell & Daniel Tirado-Fabregat, 2010. "Is there life beyond the ISI Journal lists? The international impact of Spanish, Italian, French and German economics journals," Applied Economics, Taylor & Francis Journals, vol. 42(6), pages 689-699.
    8. Richard V. Adkisson, 2010. "Reptilian Economists of the World Unite: A Tolerance Manifesto," The American Economist, Sage Publications, vol. 55(2), pages 14-23, November.
    9. Tombazos, Christis G. & Dobra, Matthew, 2014. "Formulating research policy on expert advice," European Economic Review, Elsevier, vol. 72(C), pages 166-181.
    10. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.
    11. Javier Ruiz-Castillo, 2008. "Economics research in Spain during the 1990s: a literature review," Spanish Economic Review, Springer;Spanish Economic Association, vol. 10(3), pages 221-249, September.
    12. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2011. "An updated ranking of academic journals in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 44(4), pages 1525-1538, November.
    13. Melody Lo & M. C. Sunny Wong & Franklin G. Mixon, 2008. "Ranking Economics Journals, Economics Departments, and Economists Using Teaching‐Focused Research Productivity," Southern Economic Journal, John Wiley & Sons, vol. 74(3), pages 894-906, January.
    14. David L. Anderson & John Tressler, 2013. "The Relevance of the “h-” and “g-” Index to Economics in the Context of A Nation-Wide Research Evaluation Scheme: The New Zealand Case," Economic Papers, The Economic Society of Australia, vol. 32(1), pages 81-94, March.
    15. Magnus Henrekson & Daniel Waldenström, 2011. "How Should Research Performance Be Measured? A Study Of Swedish Economists," Manchester School, University of Manchester, vol. 79(6), pages 1139-1156, December.
    16. Chen, Jihui Susan & Liu, Qihong & Billger, Sherrilyn M., 2012. "Where Do New Ph.D. Economists Go? Evidence from Recent Initial Job Placements," IZA Discussion Papers 6990, Institute of Labor Economics (IZA).
    17. Giovanni Abramo & Ciriaco Andrea D’Angelo & Marco Solazzi, 2010. "National research assessment exercises: a measure of the distortion of performance rankings when labor input is treated as uniform," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 605-619, September.
    18. Timo Boppart & Kevin E. Staub, 2012. "Online accessibility of academic articles and the diversity of economics," ECON - Working Papers 075, Department of Economics - University of Zurich.
    19. Justus Haucap & Johannes Muck, 2015. "What drives the relevance and reputation of economics journals? An update from a survey among economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 849-877, June.
    20. Stephen Bazen & Patrick Moyes, 2012. "Elitism and stochastic dominance," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 39(1), pages 207-251, June.
    21. Önder, Ali Sina & Schweitzer, Sascha & Yilmazkuday, Hakan, 2021. "Specialization, field distance, and quality in economists’ collaborations," Journal of Informetrics, Elsevier, vol. 15(4).
    22. Jishnu Das & Quy-Toan Do, 2020. "US and them - The geography of academic research," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 111-114, Centre for Economic Policy Research.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:74:y:2008:i:1:d:10.1007_s11192-008-0109-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.