IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v16y2022i2s1751157722000190.html
   My bibliography  Save this article

Validating citation models by proxy indices

Author

Listed:
  • Cena, Anna
  • Gagolewski, Marek
  • Siudem, Grzegorz
  • Żogała-Siudem, Barbara

Abstract

There are many approaches to the modelling of citation vectors of individual authors. Models may serve different purposes, but usually they are evaluated with regards to how well they align to citation distributions in large networks of papers. Here we compare a few leading models in terms of their ability to correctly reproduce the values of selected bibliometric indices of individual authors. Our recently-proposed three-dimensional model of scientific impact serves this purpose equally well as the discrete generalised beta distribution and the log-normal models, but has fewer parameters which additionally are all easy to interpret. We also indicate which indices can be predicted with high accuracy and which are more difficult to model.

Suggested Citation

  • Cena, Anna & Gagolewski, Marek & Siudem, Grzegorz & Żogała-Siudem, Barbara, 2022. "Validating citation models by proxy indices," Journal of Informetrics, Elsevier, vol. 16(2).
    • Handle: RePEc:eee:infome:v:16:y:2022:i:2:s1751157722000190
    DOI: 10.1016/j.joi.2022.101267
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157722000190
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2022.101267?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Thelwall, Mike, 2016. "The discretised lognormal and hooked power law distributions for complete citation data: Best options for modelling and regression," Journal of Informetrics, Elsevier, vol. 10(2), pages 336-346.
    2. Chen, P. & Redner, S., 2010. "Community structure of the physical review citation network," Journal of Informetrics, Elsevier, vol. 4(3), pages 278-290.
    3. Ghosh, Abhik & Shreya, Preety & Basu, Banasri, 2021. "Maximum entropy framework for a universal rank order distribution with socio-economic applications," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 563(C).
    4. Barbara Żogała-Siudem & Grzegorz Siudem & Anna Cena & Marek Gagolewski, 2016. "Agent-based model for the h-index – exact solution," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 89(1), pages 1-9, January.
    5. Sziklai, Balázs R., 2021. "Ranking institutions within a discipline: The steep mountain of academic excellence," Journal of Informetrics, Elsevier, vol. 15(2).
    6. Leo Egghe, 2006. "Theory and practise of the g-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 131-152, October.
    7. Leo Egghe & Liming Liang & Ronald Rousseau, 2009. "A relation between h‐index and impact factor in the power‐law model," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(11), pages 2362-2365, November.
    8. Chrisovalantis Malesios, 2015. "Some variations on the standard theoretical models for the h-index: A comparative analysis," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(11), pages 2384-2388, November.
    9. Zoltán Néda & Levente Varga & Tamás S Biró, 2017. "Science and Facebook: The same popularity law!," PLOS ONE, Public Library of Science, vol. 12(7), pages 1-11, July.
    10. Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
    11. Leo Egghe & Ronald Rousseau, 2006. "An informetric model for the Hirsch-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 121-129, October.
    12. Lutz Bornmann & Rüdiger Mutz & Hans‐Dieter Daniel, 2008. "Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(5), pages 830-837, March.
    13. Mark Herrera & David C Roberts & Natali Gulbahce, 2010. "Mapping the Evolution of Scientific Fields," PLOS ONE, Public Library of Science, vol. 5(5), pages 1-6, May.
    14. Burrell, Quentin L., 2007. "On the h-index, the size of the Hirsch core and Jin's A-index," Journal of Informetrics, Elsevier, vol. 1(2), pages 170-177.
    15. Frank Havemann & Birger Larsen, 2015. "Bibliometric indicators of young authors in astrophysics: Can later stars be predicted?," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1413-1434, February.
    16. Marek Gągolewski & Przemysław Grzegorzewski, 2009. "A geometric approach to the construction of scientific impact indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 617-634, December.
    17. Young-Ho Eom & Santo Fortunato, 2011. "Characterizing and Modeling Citation Dynamics," PLOS ONE, Public Library of Science, vol. 6(9), pages 1-7, September.
    18. Grzegorz Siudem & Barbara Żogała-Siudem & Anna Cena & Marek Gagolewski, 2020. "Three dimensions of scientific impact," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(25), pages 13896-13900, June.
    19. Quentin L. Burrell, 2014. "The individual author’s publication–citation process: theory and practice," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 725-742, January.
    20. Leo Egghe & Ronald Rousseau, 2021. "The h-index formalism," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6137-6145, July.
    21. Naumis, G.G. & Cocho, G., 2008. "Tail universalities in rank distributions as an algebraic problem: The beta-like function," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 387(1), pages 84-96.
    22. Miguel R. Guevara & Dominik Hartmann & Manuel Aristarán & Marcelo Mendoza & César A. Hidalgo, 2016. "The research space: using career paths to predict the evolution of the research output of individuals, institutions, and nations," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1695-1709, December.
    23. Leo Egghe & Ronald Rousseau, 2012. "Theory and practice of the shifted Lotka function," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(1), pages 295-301, April.
    24. S. Alonso & F. J. Cabrerizo & E. Herrera-Viedma & F. Herrera, 2010. "hg-index: a new index to characterize the scientific output of researchers based on the h- and g-indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(2), pages 391-400, February.
    25. Woeginger, Gerhard J., 2008. "An axiomatic characterization of the Hirsch-index," Mathematical Social Sciences, Elsevier, vol. 56(2), pages 224-232, September.
    26. Alonso, S. & Cabrerizo, F.J. & Herrera-Viedma, E. & Herrera, F., 2009. "h-Index: A review focused in its variants, computation and standardization for different scientific fields," Journal of Informetrics, Elsevier, vol. 3(4), pages 273-289.
    27. Barbara Żogała-Siudem & Grzegorz Siudem & Anna Cena & Marek Gagolewski, 2016. "Agent-based model for the h-index – exact solution," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 89(1), pages 1-9, January.
    28. Thelwall, Mike, 2016. "Are the discretised lognormal and hooked power law distributions plausible for citation data?," Journal of Informetrics, Elsevier, vol. 10(2), pages 454-470.
    29. Brito, Ricardo & Navarro, Alonso Rodríguez, 2021. "The inconsistency of h-index: A mathematical analysis," Journal of Informetrics, Elsevier, vol. 15(1).
    30. Thelwall, Mike & Wilson, Paul, 2014. "Distributions for cited articles from individual subjects and years," Journal of Informetrics, Elsevier, vol. 8(4), pages 824-839.
    31. Egghe, Leo & Rousseau, Ronald, 2020. "Polar coordinates and generalized h-type indices," Journal of Informetrics, Elsevier, vol. 14(2).
    32. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lucio Bertoli-Barsotti & Marek Gagolewski & Grzegorz Siudem & Barbara .Zoga{l}a-Siudem, 2023. "Equivalence of inequality indices: Three dimensions of impact revisited," Papers 2304.07479, arXiv.org.
    2. Lucio Bertoli-Barsotti & Marek Gagolewski & Grzegorz Siudem & Barbara .Zoga{l}a-Siudem, 2023. "Gini-stable Lorenz curves and their relation to the generalised Pareto distribution," Papers 2304.07480, arXiv.org, revised Jan 2024.
    3. Żogała-Siudem, Barbara & Cena, Anna & Siudem, Grzegorz & Gagolewski, Marek, 2023. "Interpretable reparameterisations of citation models," Journal of Informetrics, Elsevier, vol. 17(1).
    4. Lucio Bertoli-Barsotti, 2023. "Equivalent Gini coefficient, not shape parameter!," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 867-870, January.
    5. Marek Gagolewski & Barbara Żogała-Siudem & Grzegorz Siudem & Anna Cena, 2022. "Ockham’s index of citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2829-2845, May.
    6. Bertoli-Barsotti, Lucio & Gagolewski, Marek & Siudem, Grzegorz & Żogała-Siudem, Barbara, 2024. "Gini-stable Lorenz curves and their relation to the generalised Pareto distribution," Journal of Informetrics, Elsevier, vol. 18(2).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Żogała-Siudem, Barbara & Cena, Anna & Siudem, Grzegorz & Gagolewski, Marek, 2023. "Interpretable reparameterisations of citation models," Journal of Informetrics, Elsevier, vol. 17(1).
    2. Marek Gagolewski & Barbara Żogała-Siudem & Grzegorz Siudem & Anna Cena, 2022. "Ockham’s index of citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2829-2845, May.
    3. Mrowinski, Maciej J. & Gagolewski, Marek & Siudem, Grzegorz, 2022. "Accidentality in journal citation patterns," Journal of Informetrics, Elsevier, vol. 16(4).
    4. Yan, Xiangbin & Zhai, Li & Fan, Weiguo, 2013. "C-index: A weighted network node centrality measure for collaboration competence," Journal of Informetrics, Elsevier, vol. 7(1), pages 223-239.
    5. Biró, Tamás S. & Telcs, András & Józsa, Máté & Néda, Zoltán, 2023. "Gintropic scaling of scientometric indexes," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 618(C).
    6. Bouyssou, Denis & Marchant, Thierry, 2014. "An axiomatic approach to bibliometric rankings and indices," Journal of Informetrics, Elsevier, vol. 8(3), pages 449-477.
    7. Chen, Meiqian & Guo, Zhaoxia & Dong, Yucheng & Chiclana, Francisco & Herrera-Viedma, Enrique, 2021. "Citations optimal growth path: A tool to analyze sensitivity to citations of h-like indexes," Journal of Informetrics, Elsevier, vol. 15(4).
    8. Wei, Shelia X. & Tong, Tong & Rousseau, Ronald & Wang, Wanru & Ye, Fred Y., 2022. "Relations among the h-, g-, ψ-, and p-index and offset-ability," Journal of Informetrics, Elsevier, vol. 16(4).
    9. Franceschini, Fiorenzo & Maisano, Domenico, 2010. "The citation triad: An overview of a scientist's publication output based on Ferrers diagrams," Journal of Informetrics, Elsevier, vol. 4(4), pages 503-511.
    10. Brandão, Luana Carneiro & Soares de Mello, João Carlos Correia Baptista, 2019. "A multi-criteria approach to the h-index," European Journal of Operational Research, Elsevier, vol. 276(1), pages 357-363.
    11. Sidiropoulos, A. & Gogoglou, A. & Katsaros, D. & Manolopoulos, Y., 2016. "Gazing at the skyline for star scientists," Journal of Informetrics, Elsevier, vol. 10(3), pages 789-813.
    12. Vîiu, Gabriel-Alexandru, 2016. "A theoretical evaluation of Hirsch-type bibliometric indicators confronted with extreme self-citation," Journal of Informetrics, Elsevier, vol. 10(2), pages 552-566.
    13. Zhenbin Yan & Qiang Wu & Xingchen Li, 2016. "Do Hirsch-type indices behave the same in assessing single publications? An empirical study of 29 bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1815-1833, December.
    14. Maziar Montazerian & Edgar Dutra Zanotto & Hellmut Eckert, 2019. "A new parameter for (normalized) evaluation of H-index: countries as a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1065-1078, March.
    15. Parul Khurana & Kiran Sharma, 2022. "Impact of h-index on author’s rankings: an improvement to the h-index for lower-ranked authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4483-4498, August.
    16. Yang, Alex Jie & Wu, Linwei & Zhang, Qi & Wang, Hao & Deng, Sanhong, 2023. "The k-step h-index in citation networks at the paper, author, and institution levels," Journal of Informetrics, Elsevier, vol. 17(4).
    17. Yu Liu & Wei Zuo & Ying Gao & Yanhong Qiao, 2013. "Comprehensive geometrical interpretation of h-type indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(2), pages 605-615, August.
    18. Kuan, Chung-Huei & Huang, Mu-Hsuan & Chen, Dar-Zen, 2011. "Ranking patent assignee performance by h-index and shape descriptors," Journal of Informetrics, Elsevier, vol. 5(2), pages 303-312.
    19. Tóth, István & Lázár, Zsolt I. & Varga, Levente & Járai-Szabó, Ferenc & Papp, István & Florian, Răzvan V. & Ercsey-Ravasz, Mária, 2021. "Mitigating ageing bias in article level metrics using citation network analysis," Journal of Informetrics, Elsevier, vol. 15(1).
    20. Li Zhai & Xiangbin Yan & Bin Zhu, 2014. "The H l -index: improvement of H-index based on quality of citing papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1021-1031, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:16:y:2022:i:2:s1751157722000190. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.