IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v124y2020i2d10.1007_s11192-020-03489-3.html
   My bibliography  Save this article

Assessing and predicting the quality of research master’s theses: an application of scientometrics

Author

Listed:
  • Zheng Xie

    (National University of Defense Technology)

  • Yanwu Li

    (National University of Defense Technology)

  • Zhemin Li

    (National University of Defense Technology)

Abstract

The educational quality of research master’s degree can be in part reflected by the examiner score of the thesis. This study focuses on finding positive predictors of this score with the aim of developing assessment and prediction methods for the educational quality of postgraduates. This study is based on regression analysis of the characteristics extracted from publications and references involving 1038 research master’s theses written at three universities in China. The analysis indicates that for a thesis, the number and the integrated impact factor of its references in Science Citation Index Expanded (SCIE) journals are significantly positive predictors of having publications in such journals. Additionally, the number and the integrated impact factor of a thesis’ representative publications, defined as the publications authored by the master’s student as a first author or second author with tutors in lead position, in SCIE journals, are significantly positive predictors of its examiner score. Based on these predictors, a range of indicators is provided to assess thesis quality, to measure the contributions of disciplines to postgraduate education, to predict postgraduates’ research outcomes, and to provide benchmarks regarding the quality and quantity of their reading work.

Suggested Citation

  • Zheng Xie & Yanwu Li & Zhemin Li, 2020. "Assessing and predicting the quality of research master’s theses: an application of scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 953-972, August.
    • Handle: RePEc:spr:scient:v:124:y:2020:i:2:d:10.1007_s11192-020-03489-3
    DOI: 10.1007/s11192-020-03489-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-020-03489-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-020-03489-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chang-Ping Hu & Ji-Ming Hu & Sheng-Li Deng & Yong Liu, 2013. "A co-word analysis of library and information science in China," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 369-382, November.
    2. Bouyssou, Denis & Marchant, Thierry, 2011. "Bibliometric rankings of journals based on Impact Factors: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 5(1), pages 75-86.
    3. Cynthia Lisée & Vincent Larivière & Éric Archambault, 2008. "Conference proceedings as a source of scientific information: A bibliometric analysis," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(11), pages 1776-1784, September.
    4. Helmut A. Abt, 2000. "Do Important Papers Produce High Citation Counts?," Scientometrics, Springer;Akadémiai Kiadó, vol. 48(1), pages 65-70, June.
    5. Denis Bouyssou & Thierry Marchant, 2011. "Ranking scientists and departments in a consistent manner," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(9), pages 1761-1769, September.
    6. Michael H. MacRoberts & Barbara R. MacRoberts, 1989. "Problems of citation analysis: A critical review," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 40(5), pages 342-349, September.
    7. Loet Leydesdorff & Lutz Bornmann, 2011. "Integrated impact indicators compared with impact factors: An alternative research design with policy implications," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(11), pages 2133-2146, November.
    8. R E de Bruin & A Kint & M Luwel & H F Moed, 1993. "A study of research evaluation and planning: the University of Ghent," Research Evaluation, Oxford University Press, vol. 3(1), pages 25-41, April.
    9. Michael H. MacRoberts & Barbara R. MacRoberts, 2018. "The mismeasure of science: Citation analysis," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 69(3), pages 474-482, March.
    10. Xie, Zheng, 2020. "Predicting the number of coauthors for researchers: A learning model," Journal of Informetrics, Elsevier, vol. 14(2).
    11. Denis Bouyssou & Thierry Marchant, 2011. "Ranking scientists and departments in a consistent manner," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(9), pages 1761-1769, September.
    12. Qian-Jin Zong & Hong-Zhou Shen & Qin-Jian Yuan & Xiao-Wei Hu & Zhi-Ping Hou & Shun-Guo Deng, 2013. "Doctoral dissertations of Library and Information Science in China: A co-word analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 781-799, February.
    13. A. Fernández-Cano & A. Bueno, 1999. "Synthesizing scientometric paterns in Spanish educational research," Scientometrics, Springer;Akadémiai Kiadó, vol. 46(2), pages 349-367, October.
    14. Nils T. Hagen, 2010. "Deconstructing doctoral dissertations: how many papers does it take to make a PhD?," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 567-579, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xie, Zheng, 2020. "Predicting publication productivity for researchers: A piecewise Poisson model," Journal of Informetrics, Elsevier, vol. 14(3).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Juan A Crespo & Ignacio Ortuño-Ortín & Javier Ruiz-Castillo, 2012. "The Citation Merit of Scientific Publications," PLOS ONE, Public Library of Science, vol. 7(11), pages 1-9, November.
    2. Albarrán, Pedro & Herrero, Carmen & Ruiz-Castillo, Javier & Villar, Antonio, 2017. "The Herrero-Villar approach to citation impact," Journal of Informetrics, Elsevier, vol. 11(2), pages 625-640.
    3. Rousseau, Ronald & García-Zorita, Carlos & Sanz-Casado, Elias, 2013. "The h-bubble," Journal of Informetrics, Elsevier, vol. 7(2), pages 294-300.
    4. Bouyssou, Denis & Marchant, Thierry, 2014. "An axiomatic approach to bibliometric rankings and indices," Journal of Informetrics, Elsevier, vol. 8(3), pages 449-477.
    5. Antonio Abatemarco & Roberto Dell’Anno, 2013. "Certainty equivalent citation: generalized classes of citation indexes," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 263-271, January.
    6. Ronald Rousseau, 2012. "Updating the journal impact factor or total overhaul?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 413-417, August.
    7. Bouyssou, Denis & Marchant, Thierry, 2016. "Ranking authors using fractional counting of citations: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 10(1), pages 183-199.
    8. Yves Fassin, 2020. "The HF-rating as a universal complement to the h-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 965-990, November.
    9. Рубинштейн Александр Яковлевич, "undated". "Ранжирование Российских Экономических Журналов: Научный Метод Или «Игра В Цыфирь»? [Ran Ranking of Russian Economic Journals: The Scientific Method or “Numbers Game”?]," Working papers a:pru175:ye:2016:1, Institute of Economics.
    10. Gema Albort-Morant & Jörg Henseler & Antonio Leal-Millán & Gabriel Cepeda-Carrión, 2017. "Mapping the Field: A Bibliometric Analysis of Green Innovation," Sustainability, MDPI, vol. 9(6), pages 1-15, June.
    11. Hao Wang & Sanhong Deng & Xinning Su, 2016. "A study on construction and analysis of discipline knowledge structure of Chinese LIS based on CSSCI," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1725-1759, December.
    12. Josep Freixas & Roger Hoerl & William S. Zwicker, 2023. "Nash's bargaining problem and the scale-invariant Hirsch citation index," Papers 2309.01192, arXiv.org.
    13. Sung Kim & Derek Hansen & Richard Helps, 2018. "Computing research in the academy: insights from theses and dissertations," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(1), pages 135-158, January.
    14. Jia-Yen Huang & Rong-Chang Chen, 2019. "Exploring the intellectual structure of cloud patents using non-exhaustive overlaps," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 739-769, November.
    15. Ford, John B. & Bezbaruah, Subhalakshmi & Mukherji, Prokriti & Jain, Varsha & Merchant, Altaf, 2021. "A decade (2008–2019) of advertising research productivity: A bibliometric review," Journal of Business Research, Elsevier, vol. 136(C), pages 137-163.
    16. Abd Hadi Mustaffa & Nur Zahidah Bahrudin & Zahariah Sahudin & Hasni Abdullah & Muhammad Ridzuan Abdul Aziz, 2023. "What have we Learned from Firm Efficiency Research for the Past 35 Years? A Bibliometric Analysis," Information Management and Business Review, AMH International, vol. 15(1), pages 216-227.
    17. Muzammil Tahira & Rose Alinda Alias & Aryati Bakri, 2013. "Scientometric assessment of engineering in Malaysians universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(3), pages 865-879, September.
    18. Marta Cardin & Marco Corazza & Stefania Funari & Silvio Giove, 2011. "A fuzzy-based scoring rule for author ranking," Working Papers 2011_11, Department of Economics, University of Venice "Ca' Foscari".
    19. Egghe, Leo & Rousseau, Ronald, 2019. "Infinite sequences and their h-type indices," Journal of Informetrics, Elsevier, vol. 13(1), pages 291-298.
    20. José Luis Ruiz-Real & Juan Uribe-Toril & Jaime De Pablo Valenciano & Juan Carlos Gázquez-Abad, 2018. "Worldwide Research on Circular Economy and Environment: A Bibliometric Analysis," IJERPH, MDPI, vol. 15(12), pages 1-14, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:124:y:2020:i:2:d:10.1007_s11192-020-03489-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.