IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/11098.html
   My bibliography  Save this paper

On the optimality of academic rankings of regions with RePEc data

Author

Abstract

Based on the bibliographical data available with the RePEc (Research Papers in Economics), the Internet Documents in Economics Access Service (IDEAS) publishes every month the up-dated academic rankings of different geographic regions (countries/states in the US). This paper raises the question whether the method used by the IDEAS/RePEc to obtain academic rankings of different regions in terms of the academic performance of economists associated with them can be considered optimal. It devises five different types of ranking procedure based on the principles of representation of numerically large and varied types of ranking criteria by a single index of overall ranking scores. Empirically, it uses the data published by the IDEAS for the month of September 2008. It is found that the overall ranking scores obtained by the IDEAS are almost optimal on the four (of the five) principles of representation. However, it is not so when the principle of representation is maximization of the minimal squared correlation of overall ranking scores with the constituent individual ranking scores. The overall ranking scores based on maximization of minimal squared correlation beget larger impact (weight) of a select few scientometric criteria such as h-index, download counts, and certain specific (co-authorship discounted) measures of impact-weighted citation and productivity of authors affiliated to the regions under consideration. As a consequence, it has some bias in favour of economically developed regions, while the overall ranking scores obtained by the IDEAS are slightly biased in favour of the economically less developed regions. The IDEAS rankings, therefore, have a tendency to discount for the disadvantages faced by the economists associated with the less privileged regions.

Suggested Citation

  • Mishra, SK, 2008. "On the optimality of academic rankings of regions with RePEc data," MPRA Paper 11098, University Library of Munich, Germany.
    • Handle: RePEc:pra:mprapa:11098
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/11098/1/MPRA_paper_11098.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Tol, Richard S.J., 2008. "A rational, successive g-index applied to economics departments in Ireland," Journal of Informetrics, Elsevier, vol. 2(2), pages 149-155.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ferda, HALICIOGLU, 2014. "Research Ranking Place of Turkish Economists in the World," MPRA Paper 54058, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David L. Anderson & John Tressler, 2013. "The Relevance of the “h-” and “g-” Index to Economics in the Context of A Nation-Wide Research Evaluation Scheme: The New Zealand Case," Economic Papers, The Economic Society of Australia, vol. 32(1), pages 81-94, March.
    2. Lathabai, Hiran H., 2020. "ψ-index: A new overall productivity index for actors of science and technology," Journal of Informetrics, Elsevier, vol. 14(4).
    3. Parul Khurana & Kiran Sharma, 2022. "Impact of h-index on author’s rankings: an improvement to the h-index for lower-ranked authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4483-4498, August.
    4. Woeginger, Gerhard J., 2008. "An axiomatic analysis of Egghe’s g-index," Journal of Informetrics, Elsevier, vol. 2(4), pages 364-368.
    5. Damien Besancenot & Kim Huynh & Francisco Serranito, 2015. "Co-Authorship And Individual Research Productivity In Economics: Assessing The Assortative Matching Hypothesis," Working Papers halshs-01252373, HAL.
    6. Dritan Osmani, "undated". "A note on optimal transfer schemes, stable coalition for environmental protection and joint maximization assumption," Working Papers FNU-176, Research unit Sustainability and Global Change, Hamburg University.
    7. Stelios Katranidis & Theodore Panagiotidis & Costas Zontanos, 2014. "An Evaluation Of The Greek Universities’ Economics Departments," Bulletin of Economic Research, Wiley Blackwell, vol. 66(2), pages 173-182, April.
    8. van Eck, Nees Jan & Waltman, Ludo, 2008. "Generalizing the h- and g-indices," Journal of Informetrics, Elsevier, vol. 2(4), pages 263-271.
    9. Vivek Kumar Singh & Satya Swarup Srichandan & Hiran H. Lathabai, 2022. "ResearchGate and Google Scholar: how much do they differ in publications, citations and different metrics and why?," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1515-1542, March.
    10. Stelios Katranidis & Theodore Panagiotidis & Costas Zontanos, 2017. "Economists, Research Performance and National Inbreeding: North Versus South," Economic Notes, Banca Monte dei Paschi di Siena SpA, vol. 46(1), pages 145-163, February.
    11. Damien Besancenot & Kim V. Huynh & Francisco Serranito, 2015. "Determinant of Co-authorship in economics: the French case," Economics Bulletin, AccessEcon, vol. 35(1), pages 680-693.
    12. Abbasi, Alireza & Altmann, Jörn & Hossain, Liaquat, 2011. "Identifying the effects of co-authorship networks on the performance of scholars: A correlation and regression analysis of performance measures and social network analysis measures," Journal of Informetrics, Elsevier, vol. 5(4), pages 594-607.
    13. Eleni Fragkiadaki & Georgios Evangelidis, 2014. "Review of the indirect citations paradigm: theory and practice of the assessment of papers, authors and journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 261-288, May.
    14. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.
    15. Jingda Ding & Chao Liu & Goodluck Asobenie Kandonga, 2020. "Exploring the limitations of the h-index and h-type indexes in measuring the research performance of authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1303-1322, March.
    16. Besancenot, Damien & Huynh, Kim & Serranito, Francisco, 2017. "Co-authorship and research productivity in economics: Assessing the assortative matching hypothesis," Economic Modelling, Elsevier, vol. 66(C), pages 61-80.
    17. Alireza Abbasi & Jorn Altmann & Junseok Hwang, 2009. "Evaluating Scholars Based on their Academic Collaboration Activities: The RC-Index and CC-Index for Quantifying Collaboration Activities of Researchers and Scientific Communities," TEMEP Discussion Papers 200915, Seoul National University; Technology Management, Economics, and Policy Program (TEMEP), revised Sep 2009.
    18. Leo Egghe, 2009. "Performance and its relation with productivity in Lotkaian systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(2), pages 567-585, November.
    19. Lucio Bertoli-Barsotti, 2016. "Normalizing the g-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(2), pages 645-655, February.
    20. Christine Schleupner & P. Michael Link, 2008. "Eiderstedt im Spannungsfeld zwischen Naturschutz- und Agrarpolitik - Entwicklung eines methodischen Ansatzes für ein nachhaltiges Ressourcenmanagement," Working Papers FNU-168, Research unit Sustainability and Global Change, Hamburg University, revised Aug 2008.

    More about this item

    Keywords

    IDEAS; RePEc; Bibliometric; Scientometric; principles of representation; academic rankings; economics; impact factors; h-index; citation index; journal pages; global optimality; differential evolution; Principal Components Analysis;
    All these keywords.

    JEL classification:

    • C43 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Index Numbers and Aggregation
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. Papers using RePEc data

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:11098. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.