IDEAS home Printed from https://ideas.repec.org/a/bla/perwir/v11y2010i4p325-339.html
   My bibliography  Save this article

Messung der akademischen Forschungsleistung in den Wirtschaftswissenschaften: Reputation vs. Zitierhäufigkeiten

Author

Listed:
  • Felix Schläpfer
  • Friedrich Schneider

Abstract

Research output in economics is commonly measured based on the reputation of the journals in which an author has published. Using data from the 2010 Handelsblatt ranking of economists in German speaking countries and citation data from the Web of Science, we examine the relationship between reputation and citation frequency at the level of individual researchers. We find that the variation (variance) in individual researcher citations explains only a small fraction of the scores based on traditional measures of reputation. Our findings suggest that individual citation data are indispensable for a relevant measurement of individual research output and for providing more productive incentives in academic research.

Suggested Citation

  • Felix Schläpfer & Friedrich Schneider, 2010. "Messung der akademischen Forschungsleistung in den Wirtschaftswissenschaften: Reputation vs. Zitierhäufigkeiten," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 11(4), pages 325-339, November.
    • Handle: RePEc:bla:perwir:v:11:y:2010:i:4:p:325-339
    DOI: 10.1111/j.1468-2516.2010.00342.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1468-2516.2010.00342.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1468-2516.2010.00342.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision‐Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, February.
    2. William H. Starbuck, 2005. "How Much Better Are the Most-Prestigious Journals? The Statistics of Academic Publication," Organization Science, INFORMS, vol. 16(2), pages 180-200, April.
    3. Pierre-Philippe Combes & Laurent Linnemer, 2003. "Where are the Economists Who Publish? Publication Concentration and Rankings in Europe Based on Cumulative Publications," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1250-1308, December.
    4. Pierre-Philippe Combes & Laurent Linnemer, 2010. "Inferring Missing Citations: A Quantitative Multi-Criteria Ranking of all Journals in Economics," Working Papers halshs-00520325, HAL.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marcel Clermont & Alexander Dirksen & Barbara Scheidt & Dirk Tunger, 2017. "Citation metrics as an additional indicator for evaluating research performance? An analysis of their correlations and validity," Business Research, Springer;German Academic Association for Business Research, vol. 10(2), pages 249-279, October.
    2. KRAPF, Matthias & SCHLÄPFER, Jörg, 2012. "How Nobel Laureates Would Perform In The Handelsblatt Ranking," Regional and Sectoral Economic Studies, Euro-American Association of Economic Development, vol. 12(3).
    3. Haucap, Justus & Thomas, Tobias & Wohlrabe, Klaus, 2017. "Publication performance vs. influence: On the questionable value of quality weighted publication rankings," DICE Discussion Papers 277, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    4. Püttmann, Vitus & Thomsen, Stephan L. & Trunzer, Johannes, 2020. "Zur Relevanz von Ausstattungsunterschieden für Forschungsleistungsvergleiche: Ein Diskussionsbeitrag für die Wirtschaftswissenschaften in Deutschland," Hannover Economic Papers (HEP) dp-679, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät, revised Mar 2021.
    5. Rolf Sternberg, 2013. "Collision of lions and butterflies or mutual neglect - outside the Anglo-American domain, too? The publication and citation behaviour of economic geographers and geographical economists compared," Working Papers on Innovation and Space 2013-13, Philipps University Marburg, Department of Geography.
    6. Zharova, Alona & Mihoci, Andrija & Härdle, Wolfgang Karl, 2016. "Academic ranking scales in economics: Prediction and imputation," SFB 649 Discussion Papers 2016-020, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    7. repec:hum:wpaper:sfb649dp2016-020 is not listed on IDEAS
    8. Bräuninger, Michael & Haucap, Justus & Muck, Johannes, 2011. "Was lesen und schätzen Ökonomen im Jahr 2011?," DICE Ordnungspolitische Perspektiven 18, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    9. Rolf Ketzler & Klaus F. Zimmermann, 2013. "A citation-analysis of economic research institutes," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 1095-1112, June.
    10. Michael Bräuninger & Justus Haucap & Johannes Muck, 2011. "Was lesen und schätzen deutschsprachige Ökonomen heute?," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 12(4), pages 339-371, November.
    11. Klaus Wohlrabe, 2011. "Das Handelsblatt- und das RePEc-Ranking im Vergleich," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 64(17), pages 66-71, September.
    12. Buehling, Kilian, 2021. "Changing research topic trends as an effect of publication rankings – The case of German economists and the Handelsblatt Ranking," Journal of Informetrics, Elsevier, vol. 15(3).
    13. Klaus Wohlrabe, 2013. "Einige Anmerkungen zum Handelsblatt-Ranking 2013," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 66(23), pages 79-83, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jan Ours & Frederic Vermeulen, 2007. "Ranking Dutch Economists," De Economist, Springer, vol. 155(4), pages 469-487, December.
    2. John Gibson & David L. Anderson & John Tressler, 2014. "Which Journal Rankings Best Explain Academic Salaries? Evidence From The University Of California," Economic Inquiry, Western Economic Association International, vol. 52(4), pages 1322-1340, October.
    3. Buehling, Kilian, 2021. "Changing research topic trends as an effect of publication rankings – The case of German economists and the Handelsblatt Ranking," Journal of Informetrics, Elsevier, vol. 15(3).
    4. David L. Anderson & John Tressler, 2013. "The Relevance of the “h-” and “g-” Index to Economics in the Context of A Nation-Wide Research Evaluation Scheme: The New Zealand Case," Economic Papers, The Economic Society of Australia, vol. 32(1), pages 81-94, March.
    5. Matthias Krapf, 2015. "Age and complementarity in scientific collaboration," Empirical Economics, Springer, vol. 49(2), pages 751-781, September.
    6. John P. Conley & Mario J. Crucini & Robert A. Driskill & Ali Sina Onder, 2011. "Incentives and the Effects of Publication Lags on Life Cycle Research Productivity in Economics," Vanderbilt University Department of Economics Working Papers 1122, Vanderbilt University Department of Economics.
    7. John Gibson & David L. Anderson & John Tressler, 2017. "Citations Or Journal Quality: Which Is Rewarded More In The Academic Labor Market?," Economic Inquiry, Western Economic Association International, vol. 55(4), pages 1945-1965, October.
    8. John Tressler & David L. Anderson, 2012. "Citations as a Measure of the Research Outputs of New Zealand's Economics Departments: The Problem of 'Long and Variable Lags'," Agenda - A Journal of Policy Analysis and Reform, Australian National University, College of Business and Economics, School of Economics, vol. 19(1), pages 17-40.
    9. Eduardo A. Haddad & Jesus P. Mena-Chalco, Otávio J.G. Sidone, 2016. "Produção Científica e Redes de Colaboração dos Docentes Vinculados aos Programas de Pós-graduação em Economia no Brasil," Working Papers, Department of Economics 2016_10, University of São Paulo (FEA-USP).
    10. KRAPF, Matthias & SCHLÄPFER, Jörg, 2012. "How Nobel Laureates Would Perform In The Handelsblatt Ranking," Regional and Sectoral Economic Studies, Euro-American Association of Economic Development, vol. 12(3).
    11. Oswald, Andrew J., 2015. "The Objective Measurement of World-Leading Research," IZA Discussion Papers 8829, Institute of Labor Economics (IZA).
    12. Daniel Sgroi & Andrew J. Oswald, 2013. "How Should Peer‐review Panels Behave?," Economic Journal, Royal Economic Society, vol. 0, pages 255-278, August.
    13. Oswald, Andrew J., 2009. "World-Leading Research and its Measurement," Economic Research Papers 271312, University of Warwick - Department of Economics.
    14. Bertocchi, Graziella & Gambardella, Alfonso & Jappelli, Tullio & Nappi, Carmela A. & Peracchi, Franco, 2015. "Bibliometric evaluation vs. informed peer review: Evidence from Italy," Research Policy, Elsevier, vol. 44(2), pages 451-466.
    15. Bosquet, Clément & Combes, Pierre-Philippe, 2013. "Do large departments make academics more productive? agglomeration and peer effects in research," LSE Research Online Documents on Economics 58306, London School of Economics and Political Science, LSE Library.
    16. Rolf Ketzler & Klaus F. Zimmermann, 2013. "A citation-analysis of economic research institutes," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 1095-1112, June.
    17. Clément Bosquet & Pierre-Philippe Combes, 2015. "Do large departments make academics more productive? Sorting and agglomeration economies in research," THEMA Working Papers 2015-16, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
    18. Damien Besancenot & Abdelghani Maddi, 2019. "Should citations be weighted to assess the influence of an academic article?," Economics Bulletin, AccessEcon, vol. 435(1), pages 435-445.
    19. Haucap, Justus & Thomas, Tobias & Wohlrabe, Klaus, 2017. "Publication performance vs. influence: On the questionable value of quality weighted publication rankings," DICE Discussion Papers 277, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    20. Andrew J. Oswald, 2010. "A suggested method for the measurement of world-leading research (illustrated with data on economics)," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 99-113, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:perwir:v:11:y:2010:i:4:p:325-339. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/vfsocea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.