IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v42y2013i4p886-894.html
   My bibliography  Save this article

Effects of the durability of scientific literature at the group level: Case study of chemistry research groups in the Netherlands

Author

Listed:
  • Costas, Rodrigo
  • van Leeuwen, Thed N.
  • van Raan, Anthony F.J.

Abstract

In this study an analysis of the effects of the different types of durability on the bibliometric performance at the group level is presented. The scientific production during the period of 1991–2000 of a set of 158 Dutch research groups in chemistry is studied considering several bibliometric indicators in the perspective of the durability of the publications in terms of the citations received. Two citation windows have been considered for the analysis of the effect of the enlargement of the citation period, one including the citations received in the same period of publications (1991–2000) and a second one including eight years more (1991–2008). In addition, qualitative indicators provided by a committee of experts who evaluated the research groups have been analyzed in order to study the relationship between qualitative indicators and quantitative measures, in particular these of durability. Results show that production with “normal” durability is the most rewarded both according to bibliometric indicators and qualitative assessments given by experts. We also find that publications with a delayed pattern do not represent a major problem in the assessment of research groups, as those groups with a higher share of this type of publications do not improve their assessment when the citation window is substantially enlarged. Several discussions are presented regarding the importance of durability analysis in the framework of research assessment situations.

Suggested Citation

  • Costas, Rodrigo & van Leeuwen, Thed N. & van Raan, Anthony F.J., 2013. "Effects of the durability of scientific literature at the group level: Case study of chemistry research groups in the Netherlands," Research Policy, Elsevier, vol. 42(4), pages 886-894.
    • Handle: RePEc:eee:respol:v:42:y:2013:i:4:p:886-894
    DOI: 10.1016/j.respol.2012.11.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733312002612
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.respol.2012.11.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Clara Calero & Renald Buter & Cecilia Cabello Valdés & Ed Noyons, 2006. "How to identify research groups using publication analysis: an example in the field of nanotechnology," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(2), pages 365-376, February.
    2. Rodrigo Costas & Thed N. van Leeuwen & Anthony F.J. van Raan, 2010. "Is scientific literature subject to a ‘Sell-By-Date’? A general methodology to analyze the ‘durability’ of scientific documents," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(2), pages 329-339, February.
    3. Nederhof, A. J. & van Raan, A. F. J., 1993. "A bibliometric analysis of six economics research groups: A comparison with peer review," Research Policy, Elsevier, vol. 22(4), pages 353-368, August.
    4. Ed J. Rinia & Thed. N. Van Leeuwen & Eppo E.W. Bruins & Hendrik G. Van Vuren & Anthony F.J. Van Raan, 2001. "Citation delay in interdisciplinary knowledge exchange," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(1), pages 293-309, April.
    5. Fernanda Morillo & María Bordons & Isabel Gómez, 2001. "An approach to interdisciplinarity through bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(1), pages 203-222, April.
    6. Hendrik P. van Dalen & K?ne Henkens, 2005. "Signals in science - On the importance of signaling in gaining attention in science," Scientometrics, Springer;Akadémiai Kiadó, vol. 64(2), pages 209-233, August.
    7. Rodrigo Costas & Thed N. Leeuwen & María Bordons, 2010. "Self-citations at the meso and individual levels: effects of different calculation methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(3), pages 517-537, March.
    8. Allan D. Pratt, 1977. "A measure of class concentration in bibliometrics," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 28(5), pages 285-292, September.
    9. Wolfgang Glänzel & Balázs Schlemmer & Bart Thijs, 2003. "Better late than never? On the chance to become highly cited only beyond the standard bibliometric time horizon," Scientometrics, Springer;Akadémiai Kiadó, vol. 58(3), pages 571-586, November.
    10. Anthony F. J. van Raan, 2004. "Sleeping Beauties in science," Scientometrics, Springer;Akadémiai Kiadó, vol. 59(3), pages 467-472, March.
    11. M Bordons & M A Zulueta & A Cabrero & S Barrigón, 1995. "Research performance at the micro level: analysis of structure and dynamics of pharmacological research teams," Research Evaluation, Oxford University Press, vol. 5(2), pages 137-142, August.
    12. Alan L. Porter & Ismael Rafols, 2009. "Is science becoming more interdisciplinary? Measuring and mapping six research fields over time," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 719-745, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wang, Jian & Veugelers, Reinhilde & Stephan, Paula, 2017. "Bias against novelty in science: A cautionary tale for users of bibliometric indicators," Research Policy, Elsevier, vol. 46(8), pages 1416-1436.
    2. Lachance, Christian & Larivière, Vincent, 2014. "On the citation lifecycle of papers with delayed recognition," Journal of Informetrics, Elsevier, vol. 8(4), pages 863-872.
    3. Pengfei Jia & Weixi Xie & Guangyao Zhang & Xianwen Wang, 2023. "Do reviewers get their deserved acknowledgments from the authors of manuscripts?," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5687-5703, October.
    4. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    5. Min Song & Keun Young Kang & Tatsawan Timakum & Xinyuan Zhang, 2020. "Examining influential factors for acknowledgements classification using supervised learning," PLOS ONE, Public Library of Science, vol. 15(2), pages 1-21, February.
    6. Wang, Xing & Zhang, Zhihui, 2020. "Improving the reliability of short-term citation impact indicators by taking into account the correlation between short- and long-term citation impact," Journal of Informetrics, Elsevier, vol. 14(2).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Jiang & Shi, Dongbo & Zhao, Star X. & Ye, Fred Y., 2014. "A study of the “heartbeat spectra” for “sleeping beauties”," Journal of Informetrics, Elsevier, vol. 8(3), pages 493-502.
    2. Rodrigo Costas & Thed N. Leeuwen & Anthony F. J. Raan, 2011. "The “Mendel syndrome” in science: durability of scientific literature and its effects on bibliometric analysis of individual scientists," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(1), pages 177-205, October.
    3. You Song & Fangling Situ & Hongjun Zhu & Jinzhi Lei, 2018. "To be the Prince to wake up Sleeping Beauty: the rediscovery of the delayed recognition studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 9-24, October.
    4. Mund, Carolin & Neuhäusler, Peter, 2015. "Towards an early-stage identification of emerging topics in science—The usability of bibliometric characteristics," Journal of Informetrics, Elsevier, vol. 9(4), pages 1018-1033.
    5. Jianhua Hou & Xiucai Yang, 2019. "Patent sleeping beauties: evolutionary trajectories and identification methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(1), pages 187-215, July.
    6. Jian Wang & Bart Thijs & Wolfgang Glänzel, 2015. "Interdisciplinarity and Impact: Distinct Effects of Variety, Balance, and Disparity," PLOS ONE, Public Library of Science, vol. 10(5), pages 1-18, May.
    7. Lachance, Christian & Larivière, Vincent, 2014. "On the citation lifecycle of papers with delayed recognition," Journal of Informetrics, Elsevier, vol. 8(4), pages 863-872.
    8. Hou, Jianhua & Yang, Xiucai, 2020. "Social media-based sleeping beauties: Defining, identifying and features," Journal of Informetrics, Elsevier, vol. 14(2).
    9. Onodera, Natsuo, 2016. "Properties of an index of citation durability of an article," Journal of Informetrics, Elsevier, vol. 10(4), pages 981-1004.
    10. Jiang Li, 2014. "Citation curves of “all-elements-sleeping-beauties”: “flash in the pan” first and then “delayed recognition”," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(2), pages 595-601, August.
    11. Jianhua Hou & Xiucai Yang & Yang Zhang, 2023. "The effect of social media knowledge cascade: an analysis of scientific papers diffusion," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(9), pages 5169-5195, September.
    12. Hui Fang, 2019. "A transition stage co-citation criterion for identifying the awakeners of sleeping beauty publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 307-322, October.
    13. Min, Chao & Sun, Jianjun & Pei, Lei & Ding, Ying, 2016. "Measuring delayed recognition for papers: Uneven weighted summation and total citations," Journal of Informetrics, Elsevier, vol. 10(4), pages 1153-1165.
    14. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    15. Colavizza, Giovanni & Franceschet, Massimo, 2016. "Clustering citation histories in the Physical Review," Journal of Informetrics, Elsevier, vol. 10(4), pages 1037-1051.
    16. Cristina López-Duarte & Marta M. Vidal-Suárez & Belén González-Díaz, 2019. "Cross-national distance and international business: an analysis of the most influential recent models," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 173-208, October.
    17. Jianjun Sun & Chao Min & Jiang Li, 2016. "A vector for measuring obsolescence of scientific articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 745-757, May.
    18. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    19. Jiang Li & Fred Y. Ye, 2016. "Distinguishing sleeping beauties in science," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 821-828, August.
    20. Hui Fang, 2018. "Analysing the variation tendencies of the numbers of yearly citations for sleeping beauties in science by using derivative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 1051-1070, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:42:y:2013:i:4:p:886-894. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.