IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v17y2023i2s1751157723000160.html
   My bibliography  Save this article

Uncited papers in the structure of scientific communication

Author

Listed:
  • Katchanov, Yurij L.
  • Markova, Yulia V.
  • Shmatko, Natalia A.

Abstract

The paper presents an in-depth study of uncited papers. For that, we explore the documents indexed in the INSPIRE database from 1970 to 2015. Uncited articles represent a complex bibliometric environment in which references are generated. The reference lists of uncited papers form a dynamic system partially responsible for the redistribution of scientific impact. Our task is to quantify the detailed structure of citations and references directly in terms of quantiles. We also study the entropy and the statistical complexity measure of references and citations of papers’ quantiles. We introduce a theoretical framework in which citation distribution is considered an asymptotic distribution of the largest values in a sequence of independent identically distributed random variables. We show that this asymptotic distribution is the generalized extreme-value distribution. Furthermore, we empirically demonstrate that the asymptotic behavior of citation distribution is close to (but not quite) the generalized extreme-value distribution.

Suggested Citation

  • Katchanov, Yurij L. & Markova, Yulia V. & Shmatko, Natalia A., 2023. "Uncited papers in the structure of scientific communication," Journal of Informetrics, Elsevier, vol. 17(2).
    • Handle: RePEc:eee:infome:v:17:y:2023:i:2:s1751157723000160
    DOI: 10.1016/j.joi.2023.101391
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157723000160
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2023.101391?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jeppe Nicolaisen & Tove Faber Frandsen, 2019. "Zero impact: a large-scale study of uncitedness," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1227-1254, May.
    2. Leo Egghe & Raf Guns & Ronald Rousseau, 2011. "Thoughts on uncitedness: Nobel laureates and Fields medalists as case studies," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(8), pages 1637-1644, August.
    3. Can Dai & Quan Chen & Tao Wan & Fan Liu & Yanbing Gong & Qingfeng Wang, 2021. "Literary runaway: Increasingly more references cited per academic research article from 1980 to 2019," PLOS ONE, Public Library of Science, vol. 16(8), pages 1-13, August.
    4. Pablo Dorta-González & Rafael Suárez-Vega & María Isabel Dorta-González, 2020. "Open access effect on uncitedness: a large-scale study controlling by discipline, source type and visibility," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2619-2644, September.
    5. Pedro Albarrán & Juan A. Crespo & Ignacio Ortuño & Javier Ruiz-Castillo, 2011. "The skewness of science in 219 sub-fields and a number of aggregates," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(2), pages 385-397, August.
    6. Thed N. van Leeuwen & Henk F. Moed, 2005. "Characteristics of journal impact factors: The effects of uncitedness and citation distribution on the understanding of journal impact factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 63(2), pages 357-371, April.
    7. Petr Heneberg, 2013. "Supposedly uncited articles of Nobel laureates and Fields medalists can be prevalently attributed to the errors of omission and commission," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(3), pages 448-454, March.
    8. Bianchi, Federico & García-Costa, Daniel & Grimaldo, Francisco & Squazzoni, Flaminio, 2022. "Measuring the effect of reviewers on manuscript change: A study on a sample of submissions to Royal Society journals (2006–2017)," Journal of Informetrics, Elsevier, vol. 16(3).
    9. Jianhua Hou & Jiantao Ye, 2020. "Are uncited papers necessarily all nonimpact papers? A quantitative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1631-1662, August.
    10. Pislyakov, Vladimir, 2022. "On some properties of medians, percentiles, baselines, and thresholds in empirical bibliometric analysis," Journal of Informetrics, Elsevier, vol. 16(4).
    11. Thed N. Van Leeuwen & Henk F. Moed & Robert J. W. Tijssen & Martijn S. Visser & Anthony F. J. Van Raan, 2001. "Language biases in the coverage of the Science Citation Index and its consequencesfor international comparisons of national research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(1), pages 335-346, April.
    12. Katherine W. McCain, 2015. "Mining full-text journal articles to assess obliteration by incorporation: Herbert A. Simon's concepts of bounded rationality and satisficing in economics, management, and psychology," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(11), pages 2187-2201, November.
    13. Lutz Bornmann & Rüdiger Mutz, 2015. "Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(11), pages 2215-2222, November.
    14. S. Redner, 1998. "How popular is your paper? An empirical study of the citation distribution," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 4(2), pages 131-134, July.
    15. Leo Egghe & Raf Guns & Ronald Rousseau, 2011. "Thoughts on uncitedness: Nobel laureates and Fields medalists as case studies," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(8), pages 1637-1644, August.
    16. Shalabh, 2021. "Statistical inference via data science," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(3), pages 1155-1155, July.
    17. Katchanov, Yurij L. & Markova, Yulia V., 2022. "Dynamics of senses of new physics discourse: Co-keywords analysis," Journal of Informetrics, Elsevier, vol. 16(1).
    18. Kayvan Kousha & Mike Thelwall & Somayeh Rezaie, 2011. "Assessing the citation impact of books: The role of Google Books, Google Scholar, and Scopus," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(11), pages 2147-2164, November.
    19. Marzieh Shahmandi & Paul Wilson & Mike Thelwall, 2020. "A new algorithm for zero-modified models applied to citation counts," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 993-1010, November.
    20. Parolo, Pietro Della Briotta & Pan, Raj Kumar & Ghosh, Rumi & Huberman, Bernardo A. & Kaski, Kimmo & Fortunato, Santo, 2015. "Attention decay in science," Journal of Informetrics, Elsevier, vol. 9(4), pages 734-745.
    21. Ruben Miranda & Esther Garcia-Carpintero, 2019. "Comparison of the share of documents and citations from different quartile journals in 25 research areas," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 479-501, October.
    22. Diana Hicks & Paul Wouters & Ludo Waltman & Sarah de Rijcke & Ismael Rafols, 2015. "Bibliometrics: The Leiden Manifesto for research metrics," Nature, Nature, vol. 520(7548), pages 429-431, April.
    23. Andrea Fronzetti Colladon & Ciriaco Andrea D’Angelo & Peter A. Gloor, 2020. "Predicting the future success of scientific publications through social network and semantic analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 357-377, July.
    24. Franceschini, Fiorenzo & Maisano, Domenico & Mastrogiacomo, Luca, 2016. "Empirical analysis and classification of database errors in Scopus and Web of Science," Journal of Informetrics, Elsevier, vol. 10(4), pages 933-953.
    25. Higham, K.W. & Governale, M. & Jaffe, A.B. & Zülicke, U., 2017. "Unraveling the dynamics of growth, aging and inflation for citations to scientific articles from specific research fields," Journal of Informetrics, Elsevier, vol. 11(4), pages 1190-1200.
    26. Miguel-Angel Vera-Baceta & Michael Thelwall & Kayvan Kousha, 2019. "Web of Science and Scopus language coverage," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1803-1813, December.
    27. Dongqing Lyu & Xuanmin Ruan & Juan Xie & Ying Cheng, 2021. "The classification of citing motivations: a meta-synthesis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3243-3264, April.
    28. Bornmann, Lutz & Leydesdorff, Loet, 2017. "Skewness of citation impact data and covariates of citation distributions: A large-scale empirical analysis based on Web of Science data," Journal of Informetrics, Elsevier, vol. 11(1), pages 164-175.
    29. Shouhuai Xu & Moti Yung & Jingguo Wang, 2021. "Seeking Foundations for the Science of Cyber Security," Information Systems Frontiers, Springer, vol. 23(2), pages 263-267, April.
    30. Petr Heneberg, 2013. "Supposedly uncited articles of Nobel laureates and Fields medalists can be prevalently attributed to the errors of omission and commission," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(3), pages 448-454, March.
    31. Pan, Raj K. & Petersen, Alexander M. & Pammolli, Fabio & Fortunato, Santo, 2018. "The memory of science: Inflation, myopia, and the knowledge network," Journal of Informetrics, Elsevier, vol. 12(3), pages 656-678.
    32. Abhay S. D. Rajput & Sangeeta Sharma, 2021. "India: draft science policy calls for public engagement," Nature, Nature, vol. 592(7852), pages 26-26, April.
    33. Thelwall, Mike, 2016. "Citation count distributions for large monodisciplinary journals," Journal of Informetrics, Elsevier, vol. 10(3), pages 863-874.
    34. Thelwall, Mike, 2016. "Are there too many uncited articles? Zero inflated variants of the discretised lognormal and hooked power law distributions," Journal of Informetrics, Elsevier, vol. 10(2), pages 622-633.
    35. Lutz Bornmann & Richard Williams, 2020. "An evaluation of percentile measures of citation impact, and a proposal for making them better," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1457-1478, August.
    36. Lisa Mandle & Analisa Shields-Estrada & Rebecca Chaplin-Kramer & Matthew G. E. Mitchell & Leah L. Bremer & Jesse D. Gourevitch & Peter Hawthorne & Justin A. Johnson & Brian E. Robinson & Jeffrey R. Sm, 2021. "Increasing decision relevance of ecosystem service science," Nature Sustainability, Nature, vol. 4(2), pages 161-169, February.
    37. Burrell, Quentin L., 2013. "A stochastic approach to the relation between the impact factor and the uncitedness factor," Journal of Informetrics, Elsevier, vol. 7(3), pages 676-682.
    38. Iman Tahamtan & Askar Safipour Afshar & Khadijeh Ahamdzadeh, 2016. "Factors affecting number of citations: a comprehensive review of the literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1195-1225, June.
    39. Hsu, Jiann-wien & Huang, Ding-wei, 2012. "A scaling between Impact Factor and uncitedness," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(5), pages 2129-2134.
    40. Jeppe Nicolaisen & Tove Faber Frandsen, 2021. "Number of references: a large-scale study of interval ratios," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 259-285, January.
    41. Jean J. Wang & Sarah X. Shao & Fred Y. Ye, 2021. "Identifying 'seed' papers in sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6001-6011, July.
    42. Kayvan Kousha & Mike Thelwall & Somayeh Rezaie, 2011. "Assessing the citation impact of books: The role of Google Books, Google Scholar, and Scopus," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(11), pages 2147-2164, November.
    43. Gerson Pech & Catarina Delgado, 2020. "Assessing the publication impact using citation data from both Scopus and WoS databases: an approach validated in 15 research fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 909-924, November.
    44. Wallace, Matthew L. & Larivière, Vincent & Gingras, Yves, 2009. "Modeling a century of citation distributions," Journal of Informetrics, Elsevier, vol. 3(4), pages 296-303.
    45. Henry Small, 2004. "On the shoulders of Robert Merton: Towards a normative theory of citation," Scientometrics, Springer;Akadémiai Kiadó, vol. 60(1), pages 71-79, May.
    46. Brito, Ricardo & Navarro, Alonso Rodríguez, 2021. "The inconsistency of h-index: A mathematical analysis," Journal of Informetrics, Elsevier, vol. 15(1).
    47. Liu, Jialin & Chen, Hongkan & Liu, Zhibo & Bu, Yi & Gu, Weiye, 2022. "Non-linearity between referencing behavior and citation impact: A large-scale, discipline-level analysis," Journal of Informetrics, Elsevier, vol. 16(3).
    48. Zewen Hu & Yishan Wu & Jianjun Sun, 2018. "A quantitative analysis of determinants of non-citation using a panel data model," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(2), pages 843-861, August.
    49. Johan S. G. Chu & James A. Evans, 2021. "Slowed canonical progress in large fields of science," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 118(41), pages 2021636118-, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rodríguez-Navarro, Alonso & Brito, Ricardo, 2024. "Rank analysis of most cited publications, a new approach for research assessments," Journal of Informetrics, Elsevier, vol. 18(2).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pablo Dorta-González & Rafael Suárez-Vega & María Isabel Dorta-González, 2020. "Open access effect on uncitedness: a large-scale study controlling by discipline, source type and visibility," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2619-2644, September.
    2. Jeppe Nicolaisen & Tove Faber Frandsen, 2019. "Zero impact: a large-scale study of uncitedness," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1227-1254, May.
    3. Zewen Hu & Yishan Wu & Jianjun Sun, 2018. "A quantitative analysis of determinants of non-citation using a panel data model," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(2), pages 843-861, August.
    4. Zhuanlan Sun & C. Clark Cao & Sheng Liu & Yiwei Li & Chao Ma, 2024. "Behavioral consequences of second-person pronouns in written communications between authors and reviewers of scientific papers," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    5. Thomas, Duncan Andrew & Ramos-Vielba, Irene, 2022. "Reframing study of research(er) funding towards configurations and trails," SocArXiv uty2v, Center for Open Science.
    6. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    7. Liyin Zhang & Yuchen Qian & Chao Ma & Jiang Li, 2023. "Continued collaboration shortens the transition period of scientists who move to another institution," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1765-1784, March.
    8. Cinzia Daraio & Simone Di Leo & Loet Leydesdorff, 2023. "A heuristic approach based on Leiden rankings to identify outliers: evidence from Italian universities in the European landscape," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 483-510, January.
    9. Michael Färber & Melissa Coutinho & Shuzhou Yuan, 2023. "Biases in scholarly recommender systems: impact, prevalence, and mitigation," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2703-2736, May.
    10. Eitan Frachtenberg, 2022. "Multifactor Citation Analysis over Five Years: A Case Study of SIGMETRICS Papers," Publications, MDPI, vol. 10(4), pages 1-16, December.
    11. Marek Kwiek & Wojciech Roszka, 2022. "Academic vs. biological age in research on academic careers: a large-scale study with implications for scientifically developing systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3543-3575, June.
    12. Malte Hückstädt, 2023. "Ten reasons why research collaborations succeed—a random forest approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1923-1950, March.
    13. Cinzia Daraio & Simone Di Leo & Loet Leydesdorff, 2022. "Using the Leiden Rankings as a Heuristics: Evidence from Italian universities in the European landscape," LEM Papers Series 2022/08, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    14. Wu, Lingfei & Kittur, Aniket & Youn, Hyejin & Milojević, Staša & Leahey, Erin & Fiore, Stephen M. & Ahn, Yong-Yeol, 2022. "Metrics and mechanisms: Measuring the unmeasurable in the science of science," Journal of Informetrics, Elsevier, vol. 16(2).
    15. Yang, Alex Jie & Wu, Linwei & Zhang, Qi & Wang, Hao & Deng, Sanhong, 2023. "The k-step h-index in citation networks at the paper, author, and institution levels," Journal of Informetrics, Elsevier, vol. 17(4).
    16. Hu, Zewen & Wu, Yishan, 2014. "Regularity in the time-dependent distribution of the percentage of never-cited papers: An empirical pilot study based on the six journals," Journal of Informetrics, Elsevier, vol. 8(1), pages 136-146.
    17. Jianhua Hou & Jiantao Ye, 2020. "Are uncited papers necessarily all nonimpact papers? A quantitative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1631-1662, August.
    18. Weihua Li & Sam Zhang & Zhiming Zheng & Skyler J. Cranmer & Aaron Clauset, 2022. "Untangling the network effects of productivity and prominence among scientists," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    19. Liang, Zhentao & Ba, Zhichao & Mao, Jin & Li, Gang, 2023. "Research complexity increases with scientists’ academic age: Evidence from library and information science," Journal of Informetrics, Elsevier, vol. 17(1).
    20. Manuel Goyanes & Márton Demeter & Aurea Grané & Tamás Tóth & Homero Gil Zúñiga, 2023. "Research patterns in communication (2009–2019): testing female representation and productivity differences, within the most cited authors and the field," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 137-156, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:17:y:2023:i:2:s1751157723000160. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.