IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v126y2021i12d10.1007_s11192-021-04173-w.html
   My bibliography  Save this article

Citation analysis of Ph.D. theses with data from Scopus and Google Books

Author

Listed:
  • Paul Donner

    (Deutsches Zentrum für Hochschul- und Wissenschaftsforschung)

Abstract

This study investigates the potential of citation analysis of Ph.D. theses to obtain valid and useful early career performance indicators at the level of university departments. For German theses from 1996 to 2018 the suitability of citation data from Scopus and Google Books is studied and found to be sufficient to obtain quantitative estimates of early career researchers’ performance at departmental level in terms of scientific recognition and use of their dissertations as reflected in citations. Scopus and Google Books citations complement each other and have little overlap. Individual theses’ citation counts are much higher for those awarded a dissertation award than others. Departmental level estimates of citation impact agree reasonably well with panel committee peer review ratings of early career researcher support.

Suggested Citation

  • Paul Donner, 2021. "Citation analysis of Ph.D. theses with data from Scopus and Google Books," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9431-9456, December.
    • Handle: RePEc:spr:scient:v:126:y:2021:i:12:d:10.1007_s11192-021-04173-w
    DOI: 10.1007/s11192-021-04173-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-021-04173-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-021-04173-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kayvan Kousha & Mike Thelwall, 2015. "An automatic method for extracting citations from Google Books," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(2), pages 309-320, February.
    2. Hilmer, Christiana E. & Hilmer, Michael J., 2007. "AJAE Appendix: On the Relationship Between the Student Advisor Match and Early Research Productivity for Agricultural and Resource Economics Ph.D.s'," American Journal of Agricultural Economics APPENDICES, Agricultural and Applied Economics Association, vol. 89(1), pages 1-10, February.
    3. Dag W. Aksnes & Liv Langfeldt & Paul Wouters, 2019. "Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories," SAGE Open, , vol. 9(1), pages 21582440198, February.
    4. Christiana E. Hilmer & Michael J. Hilmer, 2007. "On the Relationship between the Student-Advisor Match and Early Career Research Productivity for Agricultural and Resource Economics Ph.D.s," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 89(1), pages 162-175.
    5. Martin, Ben R. & Irvine, John, 1993. "Assessing basic research : Some partial indicators of scientific progress in radio astronomy," Research Policy, Elsevier, vol. 22(2), pages 106-106, April.
    6. Wolfgang Glänzel & Bart Thijs, 2004. "Does co-authorship inflate the share of self-citations?," Scientometrics, Springer;Akadémiai Kiadó, vol. 61(3), pages 395-404, November.
    7. Dominik P. Heinisch & Guido Buenstorf, 2018. "The next generation (plus one): an analysis of doctoral students’ academic fecundity based on a novel approach to advisor identification," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 351-380, October.
    8. Paul Donner, 2016. "Enhanced self-citation detection by fuzzy author name matching and complementary error estimates," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(3), pages 662-670, March.
    9. Kousha, Kayvan & Thelwall, Mike, 2019. "Can Google Scholar and Mendeley help to assess the scholarly impacts of dissertations?," Journal of Informetrics, Elsevier, vol. 13(2), pages 467-484.
    10. Vincent Larivière & Alesia Zuccala & Éric Archambault, 2008. "The declining scientific impact of theses: Implications for electronic thesis and dissertation repositories and graduate studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(1), pages 109-121, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Paul Donner, 2022. "Algorithmic identification of Ph.D. thesis-related publications: a proof-of-concept study," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(10), pages 5863-5877, October.
    2. Meijun Liu & Sijie Yang & Yi Bu & Ning Zhang, 2023. "Female early-career scientists have conducted less interdisciplinary research in the past six decades: evidence from doctoral theses," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-16, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Grijalva, Therese C. & Nowell, Clifford, 2014. "What Interests Environmental and Resource Economists? A Comparison of Research Output in Agricultural Economics versus Environmental Economics," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 43(2), pages 1-18, August.
    2. Matthew S. Bickley & Kayvan Kousha & Michael Thelwall, 2020. "Can the impact of grey literature be assessed? An investigation of UK government publications cited by articles and books," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1425-1444, November.
    3. Giovanni Abramo & Ciriaco Andrea D’Angelo & Emanuela Reale, 2019. "Peer review versus bibliometrics: Which method better predicts the scholarly impact of publications?," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 537-554, October.
    4. Rodríguez-Navarro, Alonso & Brito, Ricardo, 2024. "Rank analysis of most cited publications, a new approach for research assessments," Journal of Informetrics, Elsevier, vol. 18(2).
    5. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    6. Penn, Jerrod & Sandberg, H. Mikael, 2013. "Agricultural and Resource Economics Ph.D. Students: Who are They and What Do They Want?," 2013 Annual Meeting, August 4-6, 2013, Washington, D.C. 151138, Agricultural and Applied Economics Association.
    7. Van Fleet, David D. & Hutt, Roger W., 2016. "Journal Lists: A Theoretical and Empirical Analysis," International Food and Agribusiness Management Review, International Food and Agribusiness Management Association, vol. 19(3), pages 1-20, August.
    8. Andrés García-Suaza & Jesús Otero & Rainer Winkelmann, 2020. "Predicting early career productivity of PhD economists: Does advisor-match matter?," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 429-449, January.
    9. Martin Szomszor & David A. Pendlebury & Jonathan Adams, 2020. "How much is too much? The difference between research influence and self-citation excess," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 1119-1147, May.
    10. Lucy Semerjian & Kunle Okaiyeto & Mike O. Ojemaye & Temitope Cyrus Ekundayo & Aboi Igwaran & Anthony I. Okoh, 2021. "Global Systematic Mapping of Road Dust Research from 1906 to 2020: Research Gaps and Future Direction," Sustainability, MDPI, vol. 13(20), pages 1-21, October.
    11. Alberto Saracco, 2022. "Dr. Strangelove: Or How I Learned to Stop Worrying and Love the Citations," The Mathematical Intelligencer, Springer, vol. 44(4), pages 326-330, December.
    12. Tom Coupé & W. Robert Reed, 2021. "Do Negative Replications Affect Citations?," Working Papers in Economics 21/14, University of Canterbury, Department of Economics and Finance.
    13. Henk F. Moed, 2000. "Bibliometric Indicators Reflect Publication and Management Strategies," Scientometrics, Springer;Akadémiai Kiadó, vol. 47(2), pages 323-346, February.
    14. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Di Costa, Flavia, 2021. "The scholarly impact of private sector research: A multivariate analysis," Journal of Informetrics, Elsevier, vol. 15(3).
    15. Fuentes, Agustín & Espinoza, Ulises J. & Cobbs, Virginia, 2024. "Follow the citations: Tracing pathways of “race as biology” assumptions in medical algorithms in eGFR and spirometry," Social Science & Medicine, Elsevier, vol. 346(C).
    16. Zhichao Wang & Valentin Zelenyuk, 2021. "Performance Analysis of Hospitals in Australia and its Peers: A Systematic Review," CEPA Working Papers Series WP012021, School of Economics, University of Queensland, Australia.
    17. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    18. T. J. Phelan, 1999. "A compendium of issues for citation analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 45(1), pages 117-136, May.
    19. Giovanni Abramo & Ciriaco Andrea D'Angelo & Flavia Di Costa, 2020. "The relative impact of private research on scientific advancement," Papers 2012.04908, arXiv.org.
    20. Antonio Fernández-Cano & Manuel Torralbo & Mónica Vallejo, 2012. "Time series of scientific growth in Spanish doctoral theses (1848–2009)," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(1), pages 15-36, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:126:y:2021:i:12:d:10.1007_s11192-021-04173-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.