IDEAS home Printed from https://ideas.repec.org/a/bpj/germec/v10y2009i3p352-363.html
   My bibliography  Save this article

Misleading Rankings of Research in Business

Author

Listed:
  • Albers Sönke

    (Christian-Albrechts-University at Kiel,Kiel, Germany)

Abstract

The attempts by Schulze and colleagues and Ritzberger to develop a joint ranking of journals for economics and business research are critically evaluated. Their lists suggest that the quality of top business journals is substantially lower than that of many economics journals. If, however, the authors of these lists do not want to claim a general superiority of one discipline (economics) over another one (business), they should give a clear indication that these lists are only applicable for economists. This warning appears to be necessary because Fabel and colleagues derive a ranking of universities and departments with respect to research productivity in business from the business research discriminating list RbR_IMP by Schulze and colleagues. While Diamantopoulos and Wagner already show a lack of face validity of these results, this article explains that the reason for this lies not only in the downgrading and also biased weighting of the business journals across subfields, but even more importantly, in a remarkable incompleteness of the database.

Suggested Citation

  • Albers Sönke, 2009. "Misleading Rankings of Research in Business," German Economic Review, De Gruyter, vol. 10(3), pages 352-363, August.
    • Handle: RePEc:bpj:germec:v:10:y:2009:i:3:p:352-363
    DOI: 10.1111/j.1468-0475.2009.00483.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1468-0475.2009.00483.x
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.
    File URL: https://libkey.io/10.1111/j.1468-0475.2009.00483.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Roberto Serrano, 2004. "The Measurement of Intellectual Influence: the Views of a Sceptic," Economics Bulletin, AccessEcon, vol. 1(3), pages 1-6.
    2. Bruno S. Frey & Katja Rost, 2010. "Do rankings reflect research quality?," Journal of Applied Economics, Universidad del CEMA, vol. 13, pages 1-38, May.
    3. Heinrich W. Ursprung, 2003. "Schneewittchen im Land der Klapperschlangen: Evaluation eines Evaluators," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 4(2), pages 177-190, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Margit Osterloh & Bruno S. Frey, 2015. "Ranking Games," Evaluation Review, , vol. 39(1), pages 102-129, February.
    2. Bielecki, Andre & Albers, Sönke, 2012. "Eine Analyse der Forschungseffizienz deutscher betriebswirtschaftlicher Fachbereiche basierend auf den Daten des Centrums für Hochschulentwicklung (CHE)," EconStor Preprints 57429, ZBW - Leibniz Information Centre for Economics.
    3. Müller, Harry & Dilger, Alexander, 2013. "Der Einfluss des Forschungsschwerpunkts auf den Zitationserfolg: Eine empirische Untersuchung anhand der Gesamtpublikationen deutschsprachiger Hochschullehrer für BWL," Discussion Papers of the Institute for Organisational Economics 1/2013, University of Münster, Institute for Organisational Economics.
    4. Margit Osterloh & Bruno S. Frey, 2009. "Research Governance in Academia: Are there Alternatives to Academic Rankings?," CREMA Working Paper Series 2009-17, Center for Research in Economics, Management and the Arts (CREMA).
    5. Margit Osterloh & Bruno S. Frey, 2010. "Academic Rankings and Research Governance," CREMA Working Paper Series 2010-04, Center for Research in Economics, Management and the Arts (CREMA).
    6. Justus Haucap & Johannes Muck, 2015. "What drives the relevance and reputation of economics journals? An update from a survey among economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 849-877, June.
    7. Albers, Sönke & Bielecki, Andre, 2012. "Wovon hängt die Leistung in Forschung und Lehre ab? Eine Analyse deutscher betriebswirtschaftlicher Fachbereiche basierend auf den Daten des Centrums für Hochschulentwicklung," EconStor Preprints 57428, ZBW - Leibniz Information Centre for Economics.
    8. Dilger, Alexander & Müller, Harry, 2011. "Ein Forschungsleistungsranking auf der Grundlage von Google Scholar," Discussion Papers of the Institute for Organisational Economics 12/2011, University of Münster, Institute for Organisational Economics.
    9. Matthias Meyer & Rüdiger W. Waldkirch & Michael A. Zaggl, 2012. "Relative Performance Measurement of Researchers: The Impact of Data Source Selection," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 64(4), pages 308-330, October.
    10. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2015. "Towards a consolidation of worldwide journal rankings – A classification using random forests and aggregate rating via data envelopment analysis," Omega, Elsevier, vol. 51(C), pages 11-23.
    11. Müller, Harry, 2012. "Die Zitationshäufigkeit als Qualitätsindikator im Rahmen der Forschungsleistungsmessung," Discussion Papers of the Institute for Organisational Economics 1/2012, University of Münster, Institute for Organisational Economics.
    12. Christian-Albrechts-Universität zu Kiel, Institut für Betriebswirtschaftslehre (Ed.), 2010. "Jahresbericht 2009," Manuskripte aus den Instituten für Betriebswirtschaftslehre der Universität Kiel 650, Christian-Albrechts-Universität zu Kiel, Institut für Betriebswirtschaftslehre.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Albers, Sönke, 2008. "Three Failed Attempts of Joint Rankings of Research in Economics and Business," MPRA Paper 12868, University Library of Munich, Germany, revised 16 Jan 2009.
    2. Albers, Sönke, 2009. "Discriminating Rankings of Research in Business," EconStor Preprints 24827, ZBW - Leibniz Information Centre for Economics.
    3. repec:bla:germec:v:10:y:2009:i::p:352-363 is not listed on IDEAS
    4. Silvia Sacchetti, 2013. "Motivational resilience in the university system," Chapters, in: Roger Sugden & Marcela Valania & James R. Wilson (ed.), Leadership and Cooperation in Academia, chapter 8, pages 107-127, Edward Elgar Publishing.
    5. Klaus Wohlrabe, 2018. "Einige Anmerkungen zum FAZ-Ökonomenranking 2018," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 71(20), pages 29-33, October.
    6. Müller, Harry, 2012. "Die Zitationshäufigkeit als Qualitätsindikator im Rahmen der Forschungsleistungsmessung," Discussion Papers of the Institute for Organisational Economics 1/2012, University of Münster, Institute for Organisational Economics.
    7. Guironnet, Jean-Pascal & Peypoch, Nicolas, 2018. "The geographical efficiency of education and research: The ranking of U.S. universities," Socio-Economic Planning Sciences, Elsevier, vol. 62(C), pages 44-55.
    8. Alexander Butz & Klaus Wohlrabe, 2016. "Die Ökonomen-Rankings 2015 von Handelsblatt, FAZ und RePEc: Methodik, Ergebnisse, Kritik und Vergleich," ifo Working Paper Series 212, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    9. Klaus Wohlrabe, 2014. "Eine Kritik des FAZ-Ökonomenrankings 2013," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 67(13), pages 63-67, July.
    10. Gebhard Kirchgässner, 2011. "Kaderschmieden der Wirtschaft und/oder Universitäten? Der Auftrag der Wirtschaftsuniversitäten und –fakultäten im 21. Jahrhundert," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 12(3), pages 317-337, August.
    11. Justus Haucap & Johannes Muck, 2015. "What drives the relevance and reputation of economics journals? An update from a survey among economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 849-877, June.
    12. Mikko Packalen & Jay Bhattacharya, 2017. "Neophilia ranking of scientific journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 43-64, January.
    13. Alexander Butz & Klaus Wohlrabe, 2016. "Anmerkungen und Kritik zu den Ökonomen-Rankings 2015 von Handelsblatt, FAZ und RePEc," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 69(10), pages 37-44, May.
    14. Daraio, Cinzia & Bonaccorsi, Andrea & Geuna, Aldo & Lepori, Benedetto & Bach, Laurent & Bogetoft, Peter & F. Cardoso, Margarida & Castro-Martinez, Elena & Crespi, Gustavo & de Lucio, Ignacio Fernandez, 2011. "The European university landscape: A micro characterization based on evidence from the Aquameth project," Research Policy, Elsevier, vol. 40(1), pages 148-164, February.
    15. Martin Steininger & Bernd Süssmuth, 2005. "Elfenbeinligen und ihre Erfassung: Ein Kommentar und eine neuerliche Messung der Publikationstätigkeit der Wirtschaftsforschungsinstitute im deutschsprachigen Raum: 1989–2003," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 6(3), pages 409-420, August.
    16. Sahoo, Biresh & Singh, Ramadhar & Mishra, Bineet & Sankaran, Krithiga, 2015. "Research Productivity in Management Schools of India: A Directional Benefit-of-Doubt Model Analysis," MPRA Paper 67046, University Library of Munich, Germany.
    17. Huang, Ding-wei, 2016. "Positive correlation between quality and quantity in academic journals," Journal of Informetrics, Elsevier, vol. 10(2), pages 329-335.
    18. Agasisti, Tommaso & Barra, Cristian & Zotti, Roberto, 2016. "Evaluating the efficiency of Italian public universities (2008–2011) in presence of (unobserved) heterogeneity," Socio-Economic Planning Sciences, Elsevier, vol. 55(C), pages 47-58.
    19. Dessauer, Benedict & Emrich, Eike & Klein, Markus & Pierdzioch, Christian, 2013. "Zur Evaluation wissenschaftlicher Publikationsleistungen in der Sportwissenschaft," Working Papers of the European Institute for Socioeconomics 3, European Institute for Socioeconomics (EIS), Saarbrücken.
    20. Xie, Yundong & Wu, Qiang & Zhang, Peng & Li, Xingchen, 2020. "Information Science and Library Science (IS-LS) journal subject categorisation and comparison based on editorship information," Journal of Informetrics, Elsevier, vol. 14(4).
    21. Raffaele Miniaci & Michele Pezzoni, 2015. "Is Publication in the Hands of Outstanding Scientists? A Study on the Determinants of Editorial Boards Membership in Economics," GREDEG Working Papers 2015-17, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.

    More about this item

    Keywords

    Journal ranking; university ranking;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:germec:v:10:y:2009:i:3:p:352-363. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.