IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v110y2017i1d10.1007_s11192-016-2165-1.html
   My bibliography  Save this article

The size and impact of the elite set of publications in scientometric assessments

Author

Listed:
  • Péter Vinkler

    (Hungarian Academy of Sciences)

Abstract

Several scientometric impact indicators [total citations, h, g, and π-index, percentage rank position (PRP), weighted citation share (WCS)] of 190 elite papers of 15 members of the Hungarian Academy of Sciences active in three different fields were calculated. From the indices the PRP indicator proved to be independent of the citation practices in the fields. The PRP index of a journal paper can be calculated in per cent as unity minus (the rank number of the paper by citation frequency within the publishing journal minus one divided with the total number of papers in the journal) times hundred. The sum of the PRP index of the elite papers of a scientist may characterize his or her total publication performance. The size of the elite set of journal papers within the total was calculated by different methods. The h-index and g-index corresponds to the size of the elite, i.e. number of the elite papers according to the h-statistics and g-statistics, respectively. The number of papers in the π-set is equal to the square root of total papers. The π-index equals to one hundredth of citations to the π-set papers. In the present paper the size of the elite set is determined as the number of papers in the h-set, g-set, or π-set, and as 10 % of total papers, or number of papers cited 2, 3, or 5 times the mean citation rate (MCR) of the publishing journal. The π-citation threshold model is presented for demonstrating how MCR and the distribution of citations over the papers may influence the size of the elite set and the corresponding π-index. It was found that the scientific performances concluded from the π-index obtained from elite sets of different size are in good agreement.

Suggested Citation

  • Péter Vinkler, 2017. "The size and impact of the elite set of publications in scientometric assessments," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 163-177, January.
    • Handle: RePEc:spr:scient:v:110:y:2017:i:1:d:10.1007_s11192-016-2165-1
    DOI: 10.1007/s11192-016-2165-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-016-2165-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-016-2165-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bornmann, Lutz & Leydesdorff, Loet & Mutz, Rüdiger, 2013. "The use of percentiles and percentile rank classes in the analysis of bibliometric data: Opportunities and limits," Journal of Informetrics, Elsevier, vol. 7(1), pages 158-165.
    2. Juan E. Iglesias & Carlos Pecharromán, 2007. "Scaling the h-index for different scientific ISI fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(3), pages 303-320, December.
    3. Vinkler, Péter, 2012. "The case of scientometricians with the “absolute relative” impact indicator," Journal of Informetrics, Elsevier, vol. 6(2), pages 254-264.
    4. Loet Leydesdorff, 2012. "Alternatives to the journal impact factor: I3 and the top-10% (or top-25%?) of the most-highly cited papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 355-365, August.
    5. Vinkler, Péter, 2014. "The use of the Percentage Rank Position index for comparative evaluation of journals," Journal of Informetrics, Elsevier, vol. 8(2), pages 340-348.
    6. Péter Vinkler, 2011. "Application of the distribution of citations among publications in scientometric evaluations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(10), pages 1963-1978, October.
    7. Vinkler, Péter, 2013. "Comparative rank assessment of journal articles," Journal of Informetrics, Elsevier, vol. 7(3), pages 712-717.
    8. Lorna Wildgaard & Jesper W. Schneider & Birger Larsen, 2014. "A review of the characteristics of 108 author-level bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 125-158, October.
    9. Bornmann, Lutz & Mutz, Rüdiger & Hug, Sven E. & Daniel, Hans-Dieter, 2011. "A multilevel meta-analysis of studies reporting correlations between the h index and 37 different h index variants," Journal of Informetrics, Elsevier, vol. 5(3), pages 346-359.
    10. Péter Vinkler, 2011. "Application of the distribution of citations among publications in scientometric evaluations," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(10), pages 1963-1978, October.
    11. Lutz Bornmann & Werner Marx, 2014. "How to evaluate individual researchers working in the natural and life sciences meaningfully? A proposal of methods based on percentiles of citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 487-509, January.
    12. Schreiber, M. & Malesios, C.C. & Psarakis, S., 2012. "Exploratory factor analysis for the Hirsch index, 17 h-type variants, and some traditional bibliometric indicators," Journal of Informetrics, Elsevier, vol. 6(3), pages 347-358.
    13. Dag W Aksnes, 2003. "Characteristics of highly cited papers," Research Evaluation, Oxford University Press, vol. 12(3), pages 159-170, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Péter Vinkler, 2021. "Evaluation of publications by the part-set method," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 2737-2757, April.
    2. Peter Vinkler, 2018. "Structure of the scientific research and science policy," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 737-756, February.
    3. Péter Vinkler, 2019. "Core journals and elite subsets in scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 241-259, October.
    4. Mingyang Wang & Shijia Jiao & Kah-Hin Chai & Guangsheng Chen, 2019. "Building journal’s long-term impact: using indicators detected from the sustained active articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 261-283, October.
    5. Péter Vinkler, 2023. "Impact of the number and rank of coauthors on h-index and π-index. The part-impact method," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2349-2369, April.
    6. Petr Praus, 2020. "HCR for assessment of scientific journals in chemistry," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1237-1242, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Péter Vinkler, 2019. "Core journals and elite subsets in scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 241-259, October.
    2. Péter Vinkler, 2023. "Impact of the number and rank of coauthors on h-index and π-index. The part-impact method," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2349-2369, April.
    3. Péter Vinkler, 2021. "Evaluation of publications by the part-set method," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 2737-2757, April.
    4. Péter Vinkler, 2012. "The Garfield impact factor, one of the fundamental indicators in scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 471-483, August.
    5. Vinkler, Péter, 2014. "The use of the Percentage Rank Position index for comparative evaluation of journals," Journal of Informetrics, Elsevier, vol. 8(2), pages 340-348.
    6. Sidiropoulos, A. & Gogoglou, A. & Katsaros, D. & Manolopoulos, Y., 2016. "Gazing at the skyline for star scientists," Journal of Informetrics, Elsevier, vol. 10(3), pages 789-813.
    7. Loet Leydesdorff, 2013. "An evaluation of impacts in “Nanoscience & nanotechnology”: steps towards standards for citation analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 35-55, January.
    8. Vinkler, Péter, 2012. "The case of scientometricians with the “absolute relative” impact indicator," Journal of Informetrics, Elsevier, vol. 6(2), pages 254-264.
    9. Vinkler, Péter, 2013. "Would it be possible to increase the Hirsch-index, π-index or CDS-index by increasing the number of publications or citations only by unity?," Journal of Informetrics, Elsevier, vol. 7(1), pages 72-83.
    10. Schreiber, Michael, 2013. "A case study of the arbitrariness of the h-index and the highly-cited-publications indicator," Journal of Informetrics, Elsevier, vol. 7(2), pages 379-387.
    11. Kuan, Chung-Huei & Huang, Mu-Hsuan & Chen, Dar-Zen, 2013. "Cross-field evaluation of publications of research institutes using their contributions to the fields’ MVPs determined by h-index," Journal of Informetrics, Elsevier, vol. 7(2), pages 455-468.
    12. Petr Praus, 2019. "High-ranked citations percentage as an indicator of publications quality," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(1), pages 319-329, July.
    13. Loet Leydesdorff & Paul Wouters & Lutz Bornmann, 2016. "Professional and citizen bibliometrics: complementarities and ambivalences in the development and use of indicators—a state-of-the-art report," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2129-2150, December.
    14. Lutz Bornmann & Robin Haunschild, 2018. "Plots for visualizing paper impact and journal impact of single researchers in a single graph," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 385-394, April.
    15. Georgios Stoupas & Antonis Sidiropoulos & Antonia Gogoglou & Dimitrios Katsaros & Yannis Manolopoulos, 2018. "Rainbow ranking: an adaptable, multidimensional ranking method for publication sets," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 147-160, July.
    16. Lorna Wildgaard & Jesper W. Schneider & Birger Larsen, 2014. "A review of the characteristics of 108 author-level bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 125-158, October.
    17. Vîiu, Gabriel-Alexandru, 2017. "Disaggregated research evaluation through median-based characteristic scores and scales: a comparison with the mean-based approach," Journal of Informetrics, Elsevier, vol. 11(3), pages 748-765.
    18. Vinkler, Péter, 2013. "Comparative rank assessment of journal articles," Journal of Informetrics, Elsevier, vol. 7(3), pages 712-717.
    19. Chen, Dar-zen & Huang, Mu-hsuan & Ye, Fred Y., 2013. "A probe into dynamic measures for h-core and h-tail," Journal of Informetrics, Elsevier, vol. 7(1), pages 129-137.
    20. Zhenbin Yan & Qiang Wu & Xingchen Li, 2016. "Do Hirsch-type indices behave the same in assessing single publications? An empirical study of 29 bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1815-1833, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:110:y:2017:i:1:d:10.1007_s11192-016-2165-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.