IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v118y2019i1d10.1007_s11192-018-2956-7.html
   My bibliography  Save this article

Taking scholarly books into account, part II: a comparison of 19 European countries in evaluation and funding

Author

Listed:
  • Elea Giménez-Toledo

    (Spanish National Research Council (CSIC))

  • Jorge Mañana-Rodríguez

    (Spanish National Research Council (CSIC))

  • Tim C. E. Engels

    (University of Antwerp)

  • Raf Guns

    (University of Antwerp)

  • Emanuel Kulczycki

    (Adam Mickiewicz University in Poznań)

  • Michael Ochsner

    (University of Lausanne
    ETH Zurich)

  • Janne Pölönen

    (Federation of Finnish Learned Societies)

  • Gunnar Sivertsen

    (Nordic Institute for Studies in Innovation, Research and Education)

  • Alesia A. Zuccala

    (University of Copenhagen)

Abstract

In May 2016, an article published in Scientometrics, titled ‘Taking scholarly books into account: current developments in five European countries’, introduced a comparison of book evaluation schemes implemented within five European countries. The present article expands upon this work by including a broader and more heterogeneous set of countries (19 European countries in total) and adding new variables for comparison. Two complementary classification models were used to point out the commonalities and differences between each country’s evaluation scheme. First, we employed a double-axis classification to highlight the degree of ‘formalization’ for each scheme, second, we classified each country according to the presence or absence of a bibliographic database. Each country’s evaluation scheme possesses its own unique merits and details; however the result of this study was the identification of four main types of book evaluation systems, leading to the following main conclusions. First, countries may be differentiated on the basis of those that use a formalized evaluation system and those that do not. Also, countries that do use a formalized evaluation system either have a supra-institutional database, quality labels for publishers and/or publisher rankings in place to harmonize the evaluations. Countries that do not use a formalized system tend to rely less on quantitative evaluation procedures. Each evaluation type has its advantages and disadvantages; therefore an exchange between countries might help to generate future improvements.

Suggested Citation

  • Elea Giménez-Toledo & Jorge Mañana-Rodríguez & Tim C. E. Engels & Raf Guns & Emanuel Kulczycki & Michael Ochsner & Janne Pölönen & Gunnar Sivertsen & Alesia A. Zuccala, 2019. "Taking scholarly books into account, part II: a comparison of 19 European countries in evaluation and funding," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 233-251, January.
  • Handle: RePEc:spr:scient:v:118:y:2019:i:1:d:10.1007_s11192-018-2956-7
    DOI: 10.1007/s11192-018-2956-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-018-2956-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-018-2956-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Elea Giménez-Toledo & Jorge Mañana-Rodríguez & Tim C. E. Engels & Peter Ingwersen & Janne Pölönen & Gunnar Sivertsen & Frederik T. Verleysen & Alesia A. Zuccala, 2016. "Taking scholarly books into account: current developments in five European countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 685-699, May.
    2. Kayvan Kousha & Mike Thelwall & Somayeh Rezaie, 2011. "Assessing the citation impact of books: The role of Google Books, Google Scholar, and Scopus," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(11), pages 2147-2164, November.
    3. Kate Williams & Jonathan Grant, 2018. "A comparative review of how the policy and procedures to assess research impact evolved in Australia and the UK," Research Evaluation, Oxford University Press, vol. 27(2), pages 93-105.
    4. Juan Gorraiz & Philip J. Purnell & Wolfgang Glänzel, 2013. "Opportunities for and limitations of the Book Citation Index," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(7), pages 1388-1398, July.
    5. Kayvan Kousha & Mike Thelwall & Somayeh Rezaie, 2011. "Assessing the citation impact of books: The role of Google Books, Google Scholar, and Scopus," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(11), pages 2147-2164, November.
    6. Juan Gorraiz & Philip J. Purnell & Wolfgang Glänzel, 2013. "Opportunities for and limitations of the Book Citation Index," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(7), pages 1388-1398, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maja Jokić & Andrea Mervar & Stjepan Mateljan, 2019. "Comparative analysis of book citations in social science journals by Central and Eastern European authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1005-1029, September.
    2. Raf Vanderstraeten & Frédéric Vandermoere, 2021. "Inequalities in the growth of Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8635-8651, October.
    3. Iva Melinščak Zlodi, 2023. "The Landscape of Scholarly Book Publishing in Croatia: Finding Pathways for Viable Open Access Models," Publications, MDPI, vol. 11(1), pages 1-11, March.
    4. Emanuel Kulczycki & Przemysław Korytkowski, 2020. "Researchers publishing monographs are more productive and more local-oriented," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1371-1387, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniel Torres-Salinas & Nicolás Robinson-Garcia & Juan Gorraiz, 2017. "Filling the citation gap: measuring the multidimensional impact of the academic book at institutional level with PlumX," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1371-1384, December.
    2. Jorge Mannana-Rodriguez & Elea Giménez-Toledo, 2018. "Specialization and multidisciplinarity of scholarly book publishers: differences between Spanish University Presses and other scholarly publishers," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(1), pages 19-30, January.
    3. Frederik T. Verleysen & Truyken L. B. Ossenblok, 2017. "Profiles of monograph authors in the social sciences and humanities: an analysis of productivity, career stage, co-authorship, disciplinary affiliation and gender, based on a regional bibliographic da," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1673-1686, June.
    4. Kousha, Kayvan & Thelwall, Mike, 2018. "Can Microsoft Academic help to assess the citation impact of academic books?," Journal of Informetrics, Elsevier, vol. 12(3), pages 972-984.
    5. Daniel Torres-Salinas & Nicolás Robinson-García & Álvaro Cabezas-Clavijo & Evaristo Jiménez-Contreras, 2014. "Analyzing the citation characteristics of books: edited books, book series and publisher types in the book citation index," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 2113-2127, March.
    6. Alesia Zuccala & Roberto Cornacchia, 2016. "Data matching, integration, and interoperability for a metric assessment of monographs," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(1), pages 465-484, July.
    7. Mohammadamin Erfanmanesh & A. Noorhidawati & A. Abrizah, 2019. "What can Bookmetrix tell us about the impact of Springer Nature’s books," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 521-536, October.
    8. Siluo Yang & Xin Xing & Fan Qi & Maria Cláudia Cabrini Grácio, 2021. "Comparison of academic book impact from a disciplinary perspective: an analysis of citations and altmetric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1101-1123, February.
    9. Mingkun Wei & Abdolreza Noroozi Chakoli, 2020. "Evaluating the relationship between the academic and social impact of open access books based on citation behaviors and social media attention," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2401-2420, December.
    10. Cristina López-Duarte & Marta M. Vidal-Suárez & Belén González-Díaz, 2019. "Cross-national distance and international business: an analysis of the most influential recent models," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 173-208, October.
    11. Eleonora Dagienė, 2024. "Mapping scholarly books: library metadata and research assessment," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(9), pages 5689-5714, September.
    12. Zhang, Chengzhi & Zhou, Qingqing, 2020. "Assessing books’ depth and breadth via multi-level mining on tables of contents," Journal of Informetrics, Elsevier, vol. 14(2).
    13. Yongjun Zhu & Erjia Yan & Silvio Peroni & Chao Che, 2020. "Nine million book items and eleven million citations: a study of book-based scholarly communication using OpenCitations," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1097-1112, February.
    14. Qingqing Zhou & Chengzhi Zhang & Star X. Zhao & Bikun Chen, 2016. "Measuring book impact based on the multi-granularity online review mining," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1435-1455, June.
    15. Chi, Pei-Shan, 2016. "Differing disciplinary citation concentration patterns of book and journal literature?," Journal of Informetrics, Elsevier, vol. 10(3), pages 814-829.
    16. Elea Giménez-Toledo & Jorge Mañana-Rodríguez & Tim C. E. Engels & Peter Ingwersen & Janne Pölönen & Gunnar Sivertsen & Frederik T. Verleysen & Alesia A. Zuccala, 2016. "Taking scholarly books into account: current developments in five European countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 685-699, May.
    17. Maja Jokić & Andrea Mervar & Stjepan Mateljan, 2019. "Comparative analysis of book citations in social science journals by Central and Eastern European authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1005-1029, September.
    18. Matthew S. Bickley & Kayvan Kousha & Michael Thelwall, 2020. "Can the impact of grey literature be assessed? An investigation of UK government publications cited by articles and books," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1425-1444, November.
    19. Qingqing Zhou & Chengzhi Zhang, 2020. "Evaluating wider impacts of books via fine-grained mining on citation literatures," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 1923-1948, December.
    20. Martin-Martin, Alberto & Orduna-Malea, Enrique & Harzing, Anne-Wil & Delgado López-Cózar, Emilio, 2017. "Can we use Google Scholar to identify highly-cited documents?," Journal of Informetrics, Elsevier, vol. 11(1), pages 152-163.

    More about this item

    Keywords

    Scholarly books; Book publishers; Evaluation processes; Classification; Research evaluation; Social sciences; Humanities; Book series;
    All these keywords.

    JEL classification:

    • C00 - Mathematical and Quantitative Methods - - General - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:118:y:2019:i:1:d:10.1007_s11192-018-2956-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.