IDEAS home Printed from https://ideas.repec.org/a/jns/jbstat/v227y2007i2p187-208n5.html
   My bibliography  Save this article

Who is the ”Platz-Hirsch“ of the German Economics Profession?: A Citation Analysis

Author

Listed:
  • Ursprung Heinrich W.

    (Department of Economics, Box D-138, D-78457 Konstanz, Germany)

  • Zimmer Markus

    (Center for Economic Studies, University of Munich, Schackstrasse 4, D-80539 München, Germany)

Abstract

In this paper, we investigate the informational content of citation-based research evaluations. To illustrate our analysis we refer to the 2005 Handelsblatt ranking of German academic economists. We make extensive use of the recently developed Hirsch-index and relate citation incidence to publication success, career age, and the topicality of the individual researchers’ field of specialization. We arrive at the conclusion that citation-based indicators provide a very incomplete picture of research performance. To obtain acceptable bibliometric research evaluations, citation based indicators need to be complemented with indicators that measure publication success more directly.

Suggested Citation

  • Ursprung Heinrich W. & Zimmer Markus, 2007. "Who is the ”Platz-Hirsch“ of the German Economics Profession?: A Citation Analysis," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 227(2), pages 187-208, April.
    • Handle: RePEc:jns:jbstat:v:227:y:2007:i:2:p:187-208:n:5
    DOI: 10.1515/jbnst-2007-0205
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/jbnst-2007-0205
    Download Restriction: no
    File URL: https://libkey.io/10.1515/jbnst-2007-0205?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David N. Laband & Robert D. Tollison, 2000. "Intellectual Collaboration," Journal of Political Economy, University of Chicago Press, vol. 108(3), pages 632-661, June.
    2. Laband, David N, 1986. "Article Popularity," Economic Inquiry, Western Economic Association International, vol. 24(1), pages 173-180, January.
    3. Anthony F.J. van Raan, 2006. "Statistical properties of bibliometric indicators: Research group indicator distributions and correlations," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 57(3), pages 408-430, February.
    4. Medoff, Marshall H., 2003. "Collaboration and the quality of economics research," Labour Economics, Elsevier, vol. 10(5), pages 597-608, October.
    5. Robert B. Archibald & David H. Finifter, 1990. "Multivariate Citations Functions and Journal Rankings," Eastern Economic Journal, Eastern Economic Association, vol. 16(2), pages 151-158, Apr-Jun.
    6. David N. Laband, 1990. "Is There Value-Added from the Review Process in Economics?: Preliminary Evidence from Authors," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 105(2), pages 341-352.
    7. Alireza Tahai & G. Wayne Kelly, 1996. "An Alternative View of Citation Patterns of Quantitative Literature Cited by Business and Economic Researchers," The Journal of Economic Education, Taylor & Francis Journals, vol. 27(3), pages 263-275, July.
    8. Pierre-Philippe Combes & Laurent Linnemer, 2003. "Where are the Economists Who Publish? Publication Concentration and Rankings in Europe Based on Cumulative Publications," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1250-1308, December.
    9. Dan Johnson, 1997. "Getting Noticed in Economics: The Determinants of Academic Citations," The American Economist, Sage Publications, vol. 41(1), pages 43-52, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marcel Clermont & Alexander Dirksen & Barbara Scheidt & Dirk Tunger, 2017. "Citation metrics as an additional indicator for evaluating research performance? An analysis of their correlations and validity," Business Research, Springer;German Academic Association for Business Research, vol. 10(2), pages 249-279, October.
    2. Klaus Wohlrabe, 2014. "Das FAZ-Ökonomenranking 2013: Eine kritische Betrachtung," ifo Working Paper Series 183, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    3. Libman, A., 2011. "German Economics: Mechanisms of Transformation," Journal of the New Economic Association, New Economic Association, issue 9, pages 129-149.
    4. Di Vaio, Gianfranco & Waldenström, Daniel & Weisdorf, Jacob, 2012. "Citation success: Evidence from economic history journal publications," Explorations in Economic History, Elsevier, vol. 49(1), pages 92-104.
    5. Launov, Andrey & Graber, Michael & Wälde, Klaus, 2007. "How to get tenured (in Germany, in Economics)," W.E.P. - Würzburg Economic Papers 75, University of Würzburg, Department of Economics.
    6. Margit Osterloh & Bruno S. Frey, 2010. "Academic rankings and research governance," IEW - Working Papers 482, Institute for Empirical Research in Economics - University of Zurich.
    7. Klaus Wohlrabe, 2014. "Eine Kritik des FAZ-Ökonomenrankings 2013," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 67(13), pages 63-67, July.
    8. Ioana Alexandra Horodnic & Adriana Zaiţ, 2015. "Motivation and research productivity in a university system undergoing transition," Research Evaluation, Oxford University Press, vol. 24(3), pages 282-292.
    9. Ioana Alexandra HORODNIC, 2014. "Academic Performance: Measurement Methods Used In Socio - Economic Sciences," THE YEARBOOK OF THE "GH. ZANE" INSTITUTE OF ECONOMIC RESEARCHES, Gheorghe Zane Institute for Economic and Social Research ( from THE ROMANIAN ACADEMY, JASSY BRANCH), vol. 23(1), pages 5-17.
    10. Rolf Ketzler & Klaus F. Zimmermann, 2009. "Publications: German economic research institutes on track," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(1), pages 231-252, July.
    11. Hofmeister Robert & Krapf Matthias, 2011. "How Do Editors Select Papers, and How Good are They at Doing It?," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 11(1), pages 1-23, October.
    12. Schulze Günther G. & Wiermann Christian & Warning Susanne, 2008. "What and How Long Does It Take to Get Tenure? The Case of Economics and Business Administration in Austria, Germany and Switzerland," German Economic Review, De Gruyter, vol. 9(4), pages 473-505, December.
    13. Jean-Michel Courtault & Naïla Hayek, 2008. "On the Robustness of the h-index: a mathematical approach," Economics Bulletin, AccessEcon, vol. 3(78), pages 1-9.
    14. Sturm Jan-Egbert & Ursprung Heinrich W., 2017. "The Handelsblatt Rankings 2.0: Research Rankings for the Economics Profession in Austria, Germany, and Switzerland," German Economic Review, De Gruyter, vol. 18(4), pages 492-515, December.
    15. Margit Osterloh & Bruno S. Frey, 2009. "Research governance in academia: are there alternatives to academic rankings?," IEW - Working Papers 423, Institute for Empirical Research in Economics - University of Zurich.
    16. Schulze Günther G. & Warning Susanne, 2009. "Misleading Rankings of Research in Business: A Reply," German Economic Review, De Gruyter, vol. 10(3), pages 368-371, August.
    17. Klaus Gründler & Niklas Potrafke, 2019. "Ideologically-charged terminology: austerity, fiscal consolidation, and sustainable governance," CESifo Working Paper Series 7613, CESifo.
    18. repec:bla:germec:v:9:y:2008:i::p:457-472 is not listed on IDEAS
    19. Rolf Ketzler & Klaus F. Zimmermann, 2013. "A citation-analysis of economic research institutes," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 1095-1112, June.
    20. Michael Graber & Andrey Launov & Klaus Wälde, 2008. "Publish or Perish? The Increasing Importance of Publications for Prospective Economics Professors in Austria, Germany and Switzerland," German Economic Review, Verein für Socialpolitik, vol. 9(4), pages 457-472, November.
    21. repec:bla:germec:v:9:y:2008:i::p:473-505 is not listed on IDEAS
    22. Michael Graber & Andrey Launov & Klaus Waelde, 2007. "How to get tenured," Working Papers 030, Bavarian Graduate Program in Economics (BGPE).
    23. repec:bla:germec:v:10:y:2009:i::p:368-371 is not listed on IDEAS

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:jns:jbstat:v:227:y:2007:i:2:p:187-208 is not listed on IDEAS
    2. Jang C. Jin & E. Kwan Choi, 2014. "Citations of Most Often Cited Economists: Do Scholarly Books Matter More than Quality Journals?," Pacific Economic Review, Wiley Blackwell, vol. 19(1), pages 8-24, February.
    3. Eduardo A. Haddad & Jesus P. Mena-Chalco, Otávio J.G. Sidone, 2016. "Produção Científica e Redes de Colaboração dos Docentes Vinculados aos Programas de Pós-graduação em Economia no Brasil," Working Papers, Department of Economics 2016_10, University of São Paulo (FEA-USP).
    4. Damien Besancenot & Kim Van Huynh & Francisco Serranito, 2015. " Thou shalt not work alone ," Working Papers hal-01175758, HAL.
    5. Bosquet, Clément & Combes, Pierre-Philippe, 2013. "Do large departments make academics more productive? agglomeration and peer effects in research," LSE Research Online Documents on Economics 58306, London School of Economics and Political Science, LSE Library.
    6. Rolf Ketzler & Klaus F. Zimmermann, 2013. "A citation-analysis of economic research institutes," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 1095-1112, June.
    7. Clément Bosquet & Pierre-Philippe Combes, 2015. "Do large departments make academics more productive? Sorting and agglomeration economies in research," THEMA Working Papers 2015-16, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
    8. repec:spo:wpmain:info:hdl:2441/5f4gqlbaf382ua75f8et967s6a is not listed on IDEAS
    9. repec:hal:journl:hal-01292851 is not listed on IDEAS
    10. repec:hal:spmain:info:hdl:2441/4jn6cjcel9913942jpruv3pju6 is not listed on IDEAS
    11. Bosquet, Clément & Combes, Pierre-Philippe, 2017. "Sorting and agglomeration economies in French economics departments," Journal of Urban Economics, Elsevier, vol. 101(C), pages 27-44.
    12. Glenn Ellison, 2011. "Is Peer Review In Decline?," Economic Inquiry, Western Economic Association International, vol. 49(3), pages 635-657, July.
    13. repec:hal:spmain:info:hdl:2441/6hol1fq95j9pqofr3i7rv5bssq is not listed on IDEAS
    14. repec:spo:wpmain:info:hdl:2441/4jn6cjcel9913942jpruv3pju6 is not listed on IDEAS
    15. Besancenot, Damien & Huynh, Kim & Serranito, Francisco, 2017. "Co-authorship and research productivity in economics: Assessing the assortative matching hypothesis," Economic Modelling, Elsevier, vol. 66(C), pages 61-80.
    16. repec:hal:spmain:info:hdl:2441/5f4gqlbaf382ua75f8et967s6a is not listed on IDEAS
    17. repec:spo:wpmain:info:hdl:2441/6hol1fq95j9pqofr3i7rv5bssq is not listed on IDEAS
    18. Clément Bosquet & Pierre-Philippe Combes, 2015. "Do large departments make academics more productive? Sorting and agglomeration economies in research," THEMA Working Papers 2015-16, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
    19. Medoff, Marshall H., 2003. "Collaboration and the quality of economics research," Labour Economics, Elsevier, vol. 10(5), pages 597-608, October.
    20. Önder, Ali Sina & Schweitzer, Sascha & Yilmazkuday, Hakan, 2021. "Specialization, field distance, and quality in economists’ collaborations," Journal of Informetrics, Elsevier, vol. 15(4).
    21. Di Vaio, Gianfranco & Waldenström, Daniel & Weisdorf, Jacob, 2012. "Citation success: Evidence from economic history journal publications," Explorations in Economic History, Elsevier, vol. 49(1), pages 92-104.
    22. J. Paul Elhorst & Katarina Zigova, 2011. "Evidence of Competition in Research Activity among Economic Department using Spatial Econometric Techniques," Working Paper Series of the Department of Economics, University of Konstanz 2011-04, Department of Economics, University of Konstanz.
    23. Pierre Dubois & Jean-Charles Rochet & Jean-Marc Schlenker, 2014. "Productivity and mobility in academic research: evidence from mathematicians," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 1669-1701, March.
    24. Ana Rute Cardoso & Paulo Guimarães & Klaus F. Zimmermann, 2010. "Trends in Economic Research: An International Perspective," Kyklos, Wiley Blackwell, vol. 63(4), pages 479-494, November.
    25. Maria Rosaria Carillo & Erasmo Papagni & Alessandro Sapio, 2012. "Do collaborations enhance the high-quality output of scientific institutions? Evidence from the Italian Research Assessment Exercise (2001-2003)," Discussion Papers 4_2012, CRISEI, University of Naples "Parthenope", Italy.
    26. Glenn Ellison, 2013. "How Does the Market Use Citation Data? The Hirsch Index in Economics," American Economic Journal: Applied Economics, American Economic Association, vol. 5(3), pages 63-90, July.
    27. Conan Mukherjee & Ranojoy Basu & Aftab Alam, 2020. "A measure of authorship by publications," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 41(3), pages 354-361, April.
    28. Rose, Michael E. & Georg, Co-Pierre, 2021. "What 5,000 acknowledgements tell us about informal collaboration in financial economics," Research Policy, Elsevier, vol. 50(6).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jns:jbstat:v:227:y:2007:i:2:p:187-208:n:5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.