IDEAS home Printed from https://ideas.repec.org/a/bla/germec/v10y2009i3p352-363.html
   My bibliography  Save this article

Misleading Rankings of Research in Business

Author

Listed:
  • Sönke Albers

Abstract

. The attempts by Schulze and colleagues and Ritzberger to develop a joint ranking of journals for economics and business research are critically evaluated. Their lists suggest that the quality of top business journals is substantially lower than that of many economics journals. If, however, the authors of these lists do not want to claim a general superiority of one discipline (economics) over another one (business), they should give a clear indication that these lists are only applicable for economists. This warning appears to be necessary because Fabel and colleagues derive a ranking of universities and departments with respect to research productivity in business from the business research discriminating list RbR_IMP by Schulze and colleagues. While Diamantopoulos and Wagner already show a lack of face validity of these results, this article explains that the reason for this lies not only in the downgrading and also biased weighting of the business journals across subfields, but even more importantly, in a remarkable incompleteness of the database.

Suggested Citation

  • Sönke Albers, 2009. "Misleading Rankings of Research in Business," German Economic Review, Verein für Socialpolitik, vol. 10(3), pages 352-363, August.
    • Handle: RePEc:bla:germec:v:10:y:2009:i:3:p:352-363
    DOI: 10.1111/j.1468-0475.2009.00483.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1468-0475.2009.00483.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1468-0475.2009.00483.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Roberto Serrano, 2004. "The Measurement of Intellectual Influence: the Views of a Sceptic," Economics Bulletin, AccessEcon, vol. 1(3), pages 1-6.
    2. Heinrich W. Ursprung, 2003. "Schneewittchen im Land der Klapperschlangen: Evaluation eines Evaluators," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 4(2), pages 177-190, May.
    3. Bruno S. Frey & Katja Rost, 2010. "Do rankings reflect research quality?," Journal of Applied Economics, Universidad del CEMA, vol. 13, pages 1-38, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dilger, Alexander & Müller, Harry, 2011. "Ein Forschungsleistungsranking auf der Grundlage von Google Scholar," Discussion Papers of the Institute for Organisational Economics 12/2011, University of Münster, Institute for Organisational Economics.
    2. Margit Osterloh & Bruno S. Frey, 2015. "Ranking Games," Evaluation Review, , vol. 39(1), pages 102-129, February.
    3. Müller, Harry, 2012. "Die Zitationshäufigkeit als Qualitätsindikator im Rahmen der Forschungsleistungsmessung," Discussion Papers of the Institute for Organisational Economics 1/2012, University of Münster, Institute for Organisational Economics.
    4. Bielecki, Andre & Albers, Sönke, 2012. "Eine Analyse der Forschungseffizienz deutscher betriebswirtschaftlicher Fachbereiche basierend auf den Daten des Centrums für Hochschulentwicklung (CHE)," EconStor Preprints 57429, ZBW - Leibniz Information Centre for Economics.
    5. Margit Osterloh & Bruno S. Frey, 2009. "Research Governance in Academia: Are there Alternatives to Academic Rankings?," CREMA Working Paper Series 2009-17, Center for Research in Economics, Management and the Arts (CREMA).
    6. Justus Haucap & Johannes Muck, 2015. "What drives the relevance and reputation of economics journals? An update from a survey among economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 849-877, June.
    7. Matthias Meyer & Rüdiger W. Waldkirch & Michael A. Zaggl, 2012. "Relative Performance Measurement of Researchers: The Impact of Data Source Selection," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 64(4), pages 308-330, October.
    8. Christian-Albrechts-Universität zu Kiel, Institut für Betriebswirtschaftslehre (Ed.), 2010. "Jahresbericht 2009," Manuskripte aus den Instituten für Betriebswirtschaftslehre der Universität Kiel 650, Christian-Albrechts-Universität zu Kiel, Institut für Betriebswirtschaftslehre.
    9. Müller, Harry & Dilger, Alexander, 2013. "Der Einfluss des Forschungsschwerpunkts auf den Zitationserfolg: Eine empirische Untersuchung anhand der Gesamtpublikationen deutschsprachiger Hochschullehrer für BWL," Discussion Papers of the Institute for Organisational Economics 1/2013, University of Münster, Institute for Organisational Economics.
    10. Margit Osterloh & Bruno S. Frey, 2010. "Academic Rankings and Research Governance," CREMA Working Paper Series 2010-04, Center for Research in Economics, Management and the Arts (CREMA).
    11. Albers, Sönke & Bielecki, Andre, 2012. "Wovon hängt die Leistung in Forschung und Lehre ab? Eine Analyse deutscher betriebswirtschaftlicher Fachbereiche basierend auf den Daten des Centrums für Hochschulentwicklung," EconStor Preprints 57428, ZBW - Leibniz Information Centre for Economics.
    12. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2015. "Towards a consolidation of worldwide journal rankings – A classification using random forests and aggregate rating via data envelopment analysis," Omega, Elsevier, vol. 51(C), pages 11-23.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Albers, Sönke, 2008. "Three Failed Attempts of Joint Rankings of Research in Economics and Business," MPRA Paper 12868, University Library of Munich, Germany, revised 16 Jan 2009.
    2. Albers, Sönke, 2009. "Discriminating Rankings of Research in Business," EconStor Preprints 24827, ZBW - Leibniz Information Centre for Economics.
    3. repec:bla:germec:v:10:y:2009:i::p:352-363 is not listed on IDEAS
    4. Silvia Sacchetti, 2013. "Motivational resilience in the university system," Chapters, in: Roger Sugden & Marcela Valania & James R. Wilson (ed.), Leadership and Cooperation in Academia, chapter 8, pages 107-127, Edward Elgar Publishing.
    5. Klaus Wohlrabe, 2018. "Einige Anmerkungen zum FAZ-Ökonomenranking 2018," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 71(20), pages 29-33, October.
    6. Müller, Harry, 2012. "Die Zitationshäufigkeit als Qualitätsindikator im Rahmen der Forschungsleistungsmessung," Discussion Papers of the Institute for Organisational Economics 1/2012, University of Münster, Institute for Organisational Economics.
    7. Klaus Wohlrabe, 2014. "Eine Kritik des FAZ-Ökonomenrankings 2013," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 67(13), pages 63-67, July.
    8. Gebhard Kirchgässner, 2011. "Kaderschmieden der Wirtschaft und/oder Universitäten? Der Auftrag der Wirtschaftsuniversitäten und –fakultäten im 21. Jahrhundert," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 12(3), pages 317-337, August.
    9. Justus Haucap & Johannes Muck, 2015. "What drives the relevance and reputation of economics journals? An update from a survey among economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 849-877, June.
    10. Daraio, Cinzia & Bonaccorsi, Andrea & Geuna, Aldo & Lepori, Benedetto & Bach, Laurent & Bogetoft, Peter & F. Cardoso, Margarida & Castro-Martinez, Elena & Crespi, Gustavo & de Lucio, Ignacio Fernandez, 2011. "The European university landscape: A micro characterization based on evidence from the Aquameth project," Research Policy, Elsevier, vol. 40(1), pages 148-164, February.
    11. Martin Steininger & Bernd Süssmuth, 2005. "Elfenbeinligen und ihre Erfassung: Ein Kommentar und eine neuerliche Messung der Publikationstätigkeit der Wirtschaftsforschungsinstitute im deutschsprachigen Raum: 1989–2003," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 6(3), pages 409-420, August.
    12. Xie, Yundong & Wu, Qiang & Zhang, Peng & Li, Xingchen, 2020. "Information Science and Library Science (IS-LS) journal subject categorisation and comparison based on editorship information," Journal of Informetrics, Elsevier, vol. 14(4).
    13. Lenger Alexander & Goldschmidt Nils, 2011. "Ordnungsökonomik als angewandte Wissenschaft. Zur notwendigen Zusammenführung von Theorie und Praxis / Constitutional Economics as an Applied Social Science. About the Essential Combination of Theory ," ORDO. Jahrbuch für die Ordnung von Wirtschaft und Gesellschaft, De Gruyter, vol. 62(1), pages 343-364, January.
    14. Wildgaard, Lorna, 2016. "A critical cluster analysis of 44 indicators of author-level performance," Journal of Informetrics, Elsevier, vol. 10(4), pages 1055-1078.
    15. Klaus Ritzberger, 2008. "A Ranking of Journals in Economics and Related Fields," German Economic Review, Verein für Socialpolitik, vol. 9(4), pages 402-430, November.
    16. Muhammad Adnan Waseem & Bahaudin G Mujtaba & Huma Shakir, 2013. "Suggested Mechanism for Producing Quality Research at Higher Educational Institutes in Pakistan; System, Structure, Culture and Leadership Issues," International Journal of Learning and Development, Macrothink Institute, vol. 3(1), pages 191-202, December.
    17. Carmen Herrero & Antonio Villar, 2013. "On the Comparison of Group Performance with Categorical Data," PLOS ONE, Public Library of Science, vol. 8(12), pages 1-7, December.
    18. Klaus Wohlrabe, 2020. "Einige Anmerkungen zum FAZ-Ökonomenranking 2020," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 73(11), pages 53-57, November.
    19. Klaus Ritzberger, 2008. "Eine invariante Bewertung wirtschaftswissenschaftlicher Fachzeitschriften," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 9(3), pages 267-285, August.
    20. Roger Fouquet, 2012. "Economics of Energy and Climate Change: Origins, Developments and Growth," Working Papers 2012-08, BC3.
    21. Jörg Heining & Jürgen Jerger & Jörg Lingens, 2008. "Deutsche Hochschulkarrieren im Fach Volkswirtschaftslehre. Eine deskriptive Analyse von Lebenslaufdaten," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 9(3), pages 306-328, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:germec:v:10:y:2009:i:3:p:352-363. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/vfsocea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.