IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v114y2018i3d10.1007_s11192-017-2587-4.html
   My bibliography  Save this article

A novel method for depicting academic disciplines through Google Scholar Citations: The case of Bibliometrics

Author

Listed:
  • Alberto Martín-Martín

    (Universidad de Granada)

  • Enrique Orduna-Malea

    (Universitat Politècnica de València)

  • Emilio Delgado López-Cózar

    (Universidad de Granada)

Abstract

This article describes a procedure to generate a snapshot of the structure of a specific scientific community and their outputs based on the information available in Google Scholar Citations (GSC). We call this method multifaceted analysis of disciplines through academic profiles (MADAP). The international community of researchers working in Bibliometrics, Scientometrics, Informetrics, Webometrics, and Altmetrics was selected as a case study. The records of the top 1000 most cited documents by these authors according to GSC were manually processed to fill any missing information and deduplicate fields like the journal titles and book publishers. The results suggest that it is feasible to use GSC and the MADAP method to produce an accurate depiction of the community of researchers working in Bibliometrics (both specialists and occasional researchers) and their publication habits (main publication venues such as journals and book publishers). Additionally, the wide document coverage of Google Scholar (specially books and book chapters) enables more comprehensive analyses of the documents published in a specific discipline than were previously possible with other citation indexes, finally shedding light on what until now had been a blind spot in most citation analyses.

Suggested Citation

  • Alberto Martín-Martín & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2018. "A novel method for depicting academic disciplines through Google Scholar Citations: The case of Bibliometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1251-1273, March.
    • Handle: RePEc:spr:scient:v:114:y:2018:i:3:d:10.1007_s11192-017-2587-4
    DOI: 10.1007/s11192-017-2587-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-017-2587-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-017-2587-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Martin-Martin, Alberto & Orduna-Malea, Enrique & Harzing, Anne-Wil & Delgado López-Cózar, Emilio, 2017. "Can we use Google Scholar to identify highly-cited documents?," Journal of Informetrics, Elsevier, vol. 11(1), pages 152-163.
    2. Emilio Delgado López-Cózar & Nicolás Robinson-García & Daniel Torres-Salinas, 2014. "The Google scholar experiment: How to index false papers and manipulate bibliometric indicators," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(3), pages 446-454, March.
    3. John Mingers & Martin Meyer, 2017. "Normalizing Google Scholar data for use in research evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 1111-1121, August.
    4. Vincent Larivière & Cassidy R. Sugimoto & Blaise Cronin, 2012. "A bibliometric chronicling of library and information science's first hundred years," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(5), pages 997-1016, May.
    5. José Luis Ortega & Isidro F. Aguillo, 2014. "Microsoft academic search and Google scholar citations: Comparative analysis of author profiles," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(6), pages 1149-1156, June.
    6. Ortega, José Luis & Aguillo, Isidro F., 2013. "Institutional and country collaboration in an online service of scientific profiles: Google Scholar Citations," Journal of Informetrics, Elsevier, vol. 7(2), pages 394-403.
    7. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    8. Isidro F. Aguillo, 2012. "Is Google Scholar useful for bibliometrics? A webometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 343-351, May.
    9. Fred R. Shapiro, 1992. "Origins of bibliometrics, citation indexing, and citation analysis: The neglected legal literature," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 43(5), pages 337-339, June.
    10. Lokman I. Meho & Kiduk Yang, 2007. "Impact of data sources on citation counts and rankings of LIS faculty: Web of science versus scopus and google scholar," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(13), pages 2105-2125, November.
    11. Lutz Bornmann & Andreas Thor & Werner Marx & Hermann Schier, 2016. "The application of bibliometrics to research evaluation in the humanities and social sciences: An exploratory study using normalized Google Scholar data for the publications of a research institute," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(11), pages 2778-2789, November.
    12. Stefanie Haustein & Isabella Peters & Judit Bar-Ilan & Jason Priem & Hadas Shema & Jens Terliesner, 2014. "Coverage and adoption of altmetrics sources in the bibliometric community," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1145-1163, November.
    13. John Mingers & Jesse R. O’Hanley & Musbaudeen Okunola, 2017. "Using Google Scholar institutional level data to evaluate the quality of university research," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1627-1643, December.
    14. Benoît Godin, 2006. "On the origins of bibliometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 68(1), pages 109-133, July.
    15. Ortega, José Luis, 2015. "Relationship between altmetric and bibliometric indicators across academic social sites: The case of CSIC's members," Journal of Informetrics, Elsevier, vol. 9(1), pages 39-49.
    16. John Mingers & Martin Meyer, 2017. "Erratum to: Normalizing Google Scholar data for use in research evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 1123-1124, August.
    17. Ad A.M. Prins & Rodrigo Costas & Thed N. van Leeuwen & Paul F. Wouters, 2016. "Using Google Scholar in research evaluation of humanities and social science programs: A comparison with Web of Science data," Research Evaluation, Oxford University Press, vol. 25(3), pages 264-270.
    18. William W. Hood & Concepción S. Wilson, 2001. "The Literature of Bibliometrics, Scientometrics, and Informetrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 52(2), pages 291-314, October.
    19. Staša Milojević & Loet Leydesdorff, 2013. "Information metrics (iMetrics): a research specialty with a socio-cognitive identity?," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 141-157, April.
    20. Jeppe Nicolaisen & Tove Faber Frandsen, 2015. "Bibliometric evolution: Is the journal of the association for information science and technology transforming into a specialty Journal?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(5), pages 1082-1085, May.
    21. José Luis Ortega & Isidro F. Aguillo, 2012. "Science is all in the eye of the beholder: Keyword maps in Google scholar citations," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(12), pages 2370-2377, December.
    22. José Luis Ortega & Isidro F. Aguillo, 2012. "Science is all in the eye of the beholder: Keyword maps in Google scholar citations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2370-2377, December.
    23. Enrique Orduna-Malea & Juan M. Ayllón & Alberto Martín-Martín & Emilio Delgado López-Cózar, 2015. "Methods for estimating the size of Google Scholar," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 931-949, September.
    24. Vincent Larivière & Cassidy R. Sugimoto & Blaise Cronin, 2012. "A bibliometric chronicling of library and information science's first hundred years," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(5), pages 997-1016, May.
    25. José Luis Ortega, 2015. "How is an academic social site populated? A demographic study of Google Scholar Citations population," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(1), pages 1-18, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Martín-Martín, Alberto & Orduna-Malea, Enrique & Delgado López-Cózar, Emilio, 2018. "Author-level metrics in the new academic profile platforms: The online behaviour of the Bibliometrics community," Journal of Informetrics, Elsevier, vol. 12(2), pages 494-509.
    2. Montecchi, Matteo & Plangger, Kirk & West, Douglas C., 2021. "Supply chain transparency: A bibliometric review and research agenda," International Journal of Production Economics, Elsevier, vol. 238(C).
    3. Gössling, Stefan & Moyle, Brent D. & Weaver, David, 2021. "Academic entrepreneurship: A bibliometric engagement model," Annals of Tourism Research, Elsevier, vol. 90(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. José Luis Ortega, 2015. "How is an academic social site populated? A demographic study of Google Scholar Citations population," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(1), pages 1-18, July.
    2. Michael Gusenbauer, 2019. "Google Scholar to overshadow them all? Comparing the sizes of 12 academic search engines and bibliographic databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 177-214, January.
    3. Martín-Martín, Alberto & Orduna-Malea, Enrique & Delgado López-Cózar, Emilio, 2018. "Author-level metrics in the new academic profile platforms: The online behaviour of the Bibliometrics community," Journal of Informetrics, Elsevier, vol. 12(2), pages 494-509.
    4. Martín-Martín, Alberto & Orduna-Malea, Enrique & Thelwall, Mike & Delgado López-Cózar, Emilio, 2018. "Google Scholar, Web of Science, and Scopus: A systematic comparison of citations in 252 subject categories," Journal of Informetrics, Elsevier, vol. 12(4), pages 1160-1177.
    5. Luis Miguel Pérez & Raul Oltra-Badenes & Juan Vicente Oltra Gutiérrez & Hermenegildo Gil-Gómez, 2020. "A Bibliometric Diagnosis and Analysis about Smart Cities," Sustainability, MDPI, vol. 12(16), pages 1-43, August.
    6. Ortega, José Luis, 2015. "Relationship between altmetric and bibliometric indicators across academic social sites: The case of CSIC's members," Journal of Informetrics, Elsevier, vol. 9(1), pages 39-49.
    7. Halevi, Gali & Moed, Henk & Bar-Ilan, Judit, 2017. "Suitability of Google Scholar as a source of scientific information and as a source of data for scientific evaluation—Review of the Literature," Journal of Informetrics, Elsevier, vol. 11(3), pages 823-834.
    8. Alberto Martín-Martín & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2018. "Coverage of highly-cited documents in Google Scholar, Web of Science, and Scopus: a multidisciplinary comparison," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2175-2188, September.
    9. Enrique Orduna-Malea & Selenay Aytac & Clara Y. Tran, 2019. "Universities through the eyes of bibliographic databases: a retroactive growth comparison of Google Scholar, Scopus and Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 433-450, October.
    10. Ying Guo & Xiantao Xiao, 2022. "Author-level altmetrics for the evaluation of Chinese scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 973-990, February.
    11. Yongjun Zhu & Erjia Yan, 2015. "Dynamic subfield analysis of disciplines: an examination of the trading impact and knowledge diffusion patterns of computer science," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(1), pages 335-359, July.
    12. Thelwall, Mike, 2018. "Dimensions: A competitor to Scopus and the Web of Science?," Journal of Informetrics, Elsevier, vol. 12(2), pages 430-435.
    13. Sergio Copiello, 2019. "The open access citation premium may depend on the openness and inclusiveness of the indexing database, but the relationship is controversial because it is ambiguous where the open access boundary lie," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 995-1018, November.
    14. Danielle H. Lee, 2019. "Predictive power of conference-related factors on citation rates of conference papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 281-304, January.
    15. Dragan Ivanović & Dušan Surla & Miloš Racković, 2011. "A CERIF data model extension for evaluation and quantitative expression of scientific research results," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(1), pages 155-172, January.
    16. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    17. Margaret K. Merga & Sayidi Mat Roni & Shannon Mason, 2020. "Should Google Scholar be used for benchmarking against the professoriate in education?," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2505-2522, December.
    18. Anne K. Krüger, 2020. "Quantification 2.0? Bibliometric Infrastructures in Academic Evaluation," Politics and Governance, Cogitatio Press, vol. 8(2), pages 58-67.
    19. Siviwe Bangani, 2018. "The impact of electronic theses and dissertations: a study of the institutional repository of a university in South Africa," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 131-151, April.
    20. Daria Maltseva & Vladimir Batagelj, 2020. "iMetrics: the development of the discipline with many names," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 313-359, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:114:y:2018:i:3:d:10.1007_s11192-017-2587-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.