IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v113y2017i1d10.1007_s11192-017-2483-y.html
   My bibliography  Save this article

Document type assignment accuracy in the journal citation index data of Web of Science

Author

Listed:
  • Paul Donner

    (Deutsches Zentrum für Wissenschafts- und Hochschulforschung)

Abstract

This article reports the results of a study of the correctness of document type assignments in the commercial citation index database Web of Science (SCIE, SSCI, AHCI collections). The document type assignments for publication records are compared to those given on the official journal websites or in the publication full-texts for a random sample of 791 Web of Science records across the four document type categories articles, letters, reviews and others, according to the definitions of WoS. The proportion of incorrect assignments across document types and its influence on document specific normalized citations scores are analysed. It is found that document type data is correct in 94% of records. Further analyses show that within records of one document type as assigned in the data source, the records assigned to the type correctly and incorrectly have different average page counts and reference counts.

Suggested Citation

  • Paul Donner, 2017. "Document type assignment accuracy in the journal citation index data of Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 219-236, October.
    • Handle: RePEc:spr:scient:v:113:y:2017:i:1:d:10.1007_s11192-017-2483-y
    DOI: 10.1007/s11192-017-2483-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-017-2483-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-017-2483-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lumley, Thomas, 2004. "Analysis of Complex Survey Samples," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 9(i08).
    2. Fiorenzo Franceschini & Domenico Maisano & Luca Mastrogiacomo, 2015. "Influence of omitted citations on the bibliometric statistics of the major Manufacturing journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 1083-1122, June.
    3. Barrios, Maite & Guilera, Georgina & Gómez-Benito, Juana, 2013. "Impact and structural features of meta-analytical studies, standard articles and reviews in psychology: Similarities and differences," Journal of Informetrics, Elsevier, vol. 7(2), pages 478-486.
    4. Fiorenzo Franceschini & Domenico Maisano & Luca Mastrogiacomo, 2015. "Errors in DOI indexing by bibliometric databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2181-2186, March.
    5. Alesia Zuccala & Thed van Leeuwen, 2011. "Book reviews in humanities research evaluations," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(10), pages 1979-1991, October.
    6. Antonio García Romero & José Navarrete Cortés & Cristina Escudero & Juan Antonio Fernández López & Juan Antonio Chaichío Moreno, 2009. "Measuring the influence of clinical trials citations on several bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(3), pages 747-760, September.
    7. Anne-Wil Harzing, 2013. "Document categories in the ISI Web of Knowledge: Misunderstanding the Social Sciences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 23-34, January.
    8. Lundberg, Jonas, 2007. "Lifting the crown—citation z-score," Journal of Informetrics, Elsevier, vol. 1(2), pages 145-154.
    9. Valderrama-Zurián, Juan-Carlos & Aguilar-Moya, Remedios & Melero-Fuentes, David & Aleixandre-Benavent, Rafael, 2015. "A systematic analysis of duplicate records in Scopus," Journal of Informetrics, Elsevier, vol. 9(3), pages 570-576.
    10. Anne Sigogneau, 2000. "An Analysis of Document Types Published in Journals Related to Physics: Proceeding Papers Recorded in the Science Citation Index Database," Scientometrics, Springer;Akadémiai Kiadó, vol. 47(3), pages 589-604, March.
    11. Jian Wang, 2013. "Citation time window choice for research impact evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 851-872, March.
    12. Alesia Zuccala & Thed van Leeuwen, 2011. "Book reviews in humanities research evaluations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(10), pages 1979-1991, October.
    13. Thed Leeuwen & Rodrigo Costas & Clara Calero-Medina & Martijn Visser, 2013. "The role of editorial material in bibliometric research performance assessments," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 817-828, May.
    14. T N van Leeuwen & L J van der Wurff & A J M de Craen, 2007. "Classification of “research letters” in general medical journals and its consequences in bibliometric research evaluation processes," Research Evaluation, Oxford University Press, vol. 16(1), pages 59-63, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Abdelghani Maddi & Lesya Baudoin, 2022. "The quality of the web of science data: a longitudinal study on the completeness of authors-addresses links," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6279-6292, November.
    2. J. Antonio Río & J. M. Russell & Daniela Juárez, 2020. "Applied physics in Mexico: mining the past to predict the future," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 187-212, October.
    3. Alexander Schniedermann, 2021. "A comparison of systematic reviews and guideline-based systematic reviews in medical studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9829-9846, December.
    4. Hou, Jianhua & Yang, Xiucai, 2020. "Social media-based sleeping beauties: Defining, identifying and features," Journal of Informetrics, Elsevier, vol. 14(2).
    5. Miranda, Ruben & Garcia-Carpintero, Esther, 2018. "Overcitation and overrepresentation of review papers in the most cited papers," Journal of Informetrics, Elsevier, vol. 12(4), pages 1015-1030.
    6. Mike Thelwall, 2019. "The influence of highly cited papers on field normalised indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(2), pages 519-537, February.
    7. Haoran Zhu & Lei Lei, 2022. "The Research Trends of Text Classification Studies (2000–2020): A Bibliometric Analysis," SAGE Open, , vol. 12(2), pages 21582440221, April.
    8. Stephan Stahlschmidt & Dimity Stephen, 2022. "From indexation policies through citation networks to normalized citation impacts: Web of Science, Scopus, and Dimensions as varying resonance chambers," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2413-2431, May.
    9. Romero-Silva, Rodrigo & de Leeuw, Sander, 2021. "Learning from the past to shape the future: A comprehensive text mining analysis of OR/MS reviews," Omega, Elsevier, vol. 100(C).
    10. Shirley Ainsworth & Jane M. Russell, 2018. "Has hosting on science direct improved the visibility of Latin American scholarly journals? A preliminary analysis of data quality," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1463-1484, June.
    11. Clemens Blümel & Alexander Schniedermann, 2020. "Studying review articles in scientometrics and beyond: a research agenda," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 711-728, July.
    12. Gerson Pech & Catarina Delgado, 2020. "Assessing the publication impact using citation data from both Scopus and WoS databases: an approach validated in 15 research fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 909-924, November.
    13. Houqiang Yu & Xueting Cao & Tingting Xiao & Zhenyi Yang, 2020. "How accurate are policy document mentions? A first look at the role of altmetrics database," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1517-1540, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    2. Thed Leeuwen & Rodrigo Costas & Clara Calero-Medina & Martijn Visser, 2013. "The role of editorial material in bibliometric research performance assessments," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 817-828, May.
    3. Olesia Iefremova & Kamil Wais & Marcin Kozak, 2018. "Biographical articles in scientific literature: analysis of articles indexed in Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1695-1719, December.
    4. Shirley Ainsworth & Jane M. Russell, 2018. "Has hosting on science direct improved the visibility of Latin American scholarly journals? A preliminary analysis of data quality," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1463-1484, June.
    5. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    6. Tove Faber Frandsen & Jeppe Nicolaisen, 2023. "Defining the unscholarly publication: a bibliometric study of uncited and barely cited publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(2), pages 1337-1350, February.
    7. Franceschini, Fiorenzo & Maisano, Domenico & Mastrogiacomo, Luca, 2016. "Empirical analysis and classification of database errors in Scopus and Web of Science," Journal of Informetrics, Elsevier, vol. 10(4), pages 933-953.
    8. Franceschini, Fiorenzo & Maisano, Domenico & Mastrogiacomo, Luca, 2016. "The museum of errors/horrors in Scopus," Journal of Informetrics, Elsevier, vol. 10(1), pages 174-182.
    9. Alexander Schniedermann, 2021. "A comparison of systematic reviews and guideline-based systematic reviews in medical studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9829-9846, December.
    10. Daniel Torres-Salinas & Nicolás Robinson-García & Álvaro Cabezas-Clavijo & Evaristo Jiménez-Contreras, 2014. "Analyzing the citation characteristics of books: edited books, book series and publisher types in the book citation index," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 2113-2127, March.
    11. David I Stern, 2014. "High-Ranked Social Science Journal Articles Can Be Identified from Early Citation Information," PLOS ONE, Public Library of Science, vol. 9(11), pages 1-11, November.
    12. Thelwall, Mike, 2018. "Microsoft Academic automatic document searches: Accuracy for journal articles and suitability for citation analysis," Journal of Informetrics, Elsevier, vol. 12(1), pages 1-9.
    13. Juan Gorraiz & Christian Gumpenberger & Philip J. Purnell, 2014. "The power of book reviews: a simple and transparent enhancement approach for book citation indexes," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 841-852, February.
    14. Daniel Torres-Salinas & Nicolás Robinson-Garcia & Juan Gorraiz, 2017. "Filling the citation gap: measuring the multidimensional impact of the academic book at institutional level with PlumX," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1371-1384, December.
    15. Julian Hamann & Wolfgang Kaltenbrunner, 2022. "Biographical representation, from narrative to list: The evolution of curricula vitae in the humanities, 1950 to 2010," Research Evaluation, Oxford University Press, vol. 31(4), pages 438-451.
    16. Weishu Liu & Yishan Ding & Mengdi Gu, 2017. "Book reviews in academic journals: patterns and dynamics," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 355-364, January.
    17. Gerson Pech & Catarina Delgado, 2020. "Percentile and stochastic-based approach to the comparison of the number of citations of articles indexed in different bibliographic databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 223-252, April.
    18. Barrios, Maite & Guilera, Georgina & Gómez-Benito, Juana, 2013. "Impact and structural features of meta-analytical studies, standard articles and reviews in psychology: Similarities and differences," Journal of Informetrics, Elsevier, vol. 7(2), pages 478-486.
    19. Carolin Michels & Jun-Ying Fu, 2014. "Systematic analysis of coverage and usage of conference proceedings in web of science," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(2), pages 307-327, August.
    20. Igor Savchenko & Denis Kosyakov, 2022. "Lost in affiliation: apatride publications in international databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3471-3487, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:113:y:2017:i:1:d:10.1007_s11192-017-2483-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.