IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/69144.html
   My bibliography  Save this paper

Ordinal ranking aggregation in bibliometric analysis

Author

Listed:
  • Wohlrabe, Klaus
  • Friedrich, Elisabeth

Abstract

This paper reviews standard ranking aggregation approaches in bibliometric analysis. These include the arithmetic and the harmonic mean. We also present two less-well known aggregation schemes, lexicographic and graphicolexic, which are based on the order of the rankings. Finally, we introduce two recently proposed ranking aggregation approaches which are based on stochastic aggregation. We describe all approaches and give a small illustrative and an empirical example to highlight the differences.

Suggested Citation

  • Wohlrabe, Klaus & Friedrich, Elisabeth, 2016. "Ordinal ranking aggregation in bibliometric analysis," MPRA Paper 69144, University Library of Munich, Germany.
    • Handle: RePEc:pra:mprapa:69144
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/69144/1/MPRA_paper_69144.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Christian Zimmermann, 2013. "Academic Rankings with RePEc," Econometrics, MDPI, vol. 1(3), pages 1-32, December.
    2. Klaus Wohlrabe, 2016. "Taking the Temperature: A Meta-Ranking of Economics Journals," CESifo Working Paper Series 5726, CESifo.
    3. Wade D. Cook & Tal Raviv & Alan J. Richardson, 2010. "Aggregating Incomplete Lists of Journal Rankings: An Application to Academic Accounting Journals," Accounting Perspectives, John Wiley & Sons, vol. 9(3), pages 217-235, September.
    4. Philip Hans Franses, 2014. "Trends in three decades of rankings of Dutch economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1257-1268, February.
    5. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.
    6. Anne‐Wil Harzing & Ron van der Wal, 2009. "A Google Scholar h‐index for journals: An alternative metric to measure journal impact in economics and business," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(1), pages 41-46, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    2. Klaus Wohlrabe, 2014. "Eine Kritik des FAZ-Ökonomenrankings 2013," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 67(13), pages 63-67, July.
    3. Ferda, HALICIOGLU, 2014. "Research Ranking Place of Turkish Economists in the World," MPRA Paper 54058, University Library of Munich, Germany.
    4. Gnewuch, Matthias & Wohlrabe, Klaus, 2018. "Super-efficiency of education institutions: an application to economics departments," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 26, pages 610-623.
    5. Anne-Wil Harzing & Wilfred Mijnhardt, 2015. "Proof over promise: towards a more inclusive ranking of Dutch academics in Economics & Business," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 727-749, January.
    6. Klaus Wohlrabe & Lutz Bornmann, 2022. "Alphabetized co-authorship in economics reconsidered," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2173-2193, May.
    7. Klaus Wohlrabe & Elisabeth Friedrich, 2017. "The efficiency of economics departments reconsidered," Economics Bulletin, AccessEcon, vol. 37(3), pages 1602-1611.
    8. Matthias Gnewuch & Klaus Wohlrabe, 2018. "Die (Super-)Effizienz von volkswirtschaftlichen Fakultäten," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 71(15), pages 30-34, August.
    9. Katharina Rath & Klaus Wohlrabe, 2016. "Trends in economics publications represented by JEL categories between 2007 and 2013," Applied Economics Letters, Taylor & Francis Journals, vol. 23(9), pages 660-663, June.
    10. Püttmann, Vitus & Thomsen, Stephan L. & Trunzer, Johannes, 2020. "Zur Relevanz von Ausstattungsunterschieden für Forschungsleistungsvergleiche: Ein Diskussionsbeitrag für die Wirtschaftswissenschaften in Deutschland," Hannover Economic Papers (HEP) dp-679, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät, revised Mar 2021.
    11. Katharina Rath & Klaus Wohlrabe, 2016. "Recent trends in co-authorship in economics: evidence from RePEc," Applied Economics Letters, Taylor & Francis Journals, vol. 23(12), pages 897-902, August.
    12. Tol, Richard S.J., 2013. "The Matthew effect for cohorts of economists," Journal of Informetrics, Elsevier, vol. 7(2), pages 522-527.
    13. Krapf, Matthias & Ursprung, Heinrich W. & Zimmermann, Christian, 2017. "Parenthood and productivity of highly skilled labor: Evidence from the groves of academe," Journal of Economic Behavior & Organization, Elsevier, vol. 140(C), pages 147-175.
    14. Chiara Zanardello, 2023. "Market forces in Italian academia today (and yesterday)," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 651-698, January.
    15. Karol Paludkiewicz & Klaus Wohlrabe, 2010. "Qualitätsanalyse von Zeitschriften in den Wirtschaftswissenschaften – über Zitationsdatenbanken und Impaktfaktoren im Online-Zeitalter," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 63(21), pages 18-28, November.
    16. Vera Sommer & Klaus Wohlrabe, 2017. "Citations, journal ranking and multiple authorships reconsidered: evidence from almost one million articles," Applied Economics Letters, Taylor & Francis Journals, vol. 24(11), pages 809-814, June.
    17. Alexander Butz & Klaus Wohlrabe, 2016. "Die Ökonomen-Rankings 2015 von Handelsblatt, FAZ und RePEc: Methodik, Ergebnisse, Kritik und Vergleich," ifo Working Paper Series 212, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    18. David L. Anderson & John Tressler, 2017. "Researcher rank stability across alternative output measurement schemes in the context of a time limited research evaluation: the New Zealand case," Applied Economics, Taylor & Francis Journals, vol. 49(45), pages 4542-4553, September.
    19. Raphael Auer & Christian Zimmermann, 2020. "A journal ranking based on central bank citations," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 57-63, Centre for Economic Policy Research.
    20. Klaus Wohlrabe & Constantin Bürgi, 2021. "What is the benefit from publishing a working paper in a journal in terms of citations? Evidence from economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4701-4714, June.

    More about this item

    Keywords

    ranking aggregation; stochastic aggregation; RePEc;
    All these keywords.

    JEL classification:

    • A12 - General Economics and Teaching - - General Economics - - - Relation of Economics to Other Disciplines
    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:69144. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.