IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v129y2024i11d10.1007_s11192-024-05174-1.html
   My bibliography  Save this article

Evaluating book impacts via integrating multi-source reviews

Author

Listed:
  • Qingqing Zhou

    (Nanjing Normal University)

Abstract

Citations and alternative metrics are commonly used to assess impacts of books. However, such metrics often cannot reflect detailed evaluation information, as they are often frequency-level metrics and neglect content information about books. Existing research reveals that book reviews are useful sources for measuring book impacts, which can provide content-level supplementary information for evaluation. Meanwhile, book reviews are generated from multiple sources, including academic reviews from experts and online reviews from the public. These multi-source reviews reveal opinions on books from different dimensions. Thus, evaluating book impact based on single category of reviews are difficult to get fully assessment results. Hence, this paper assesses book impacts by integrating academic and online reviews, so as to measuring book impacts comprehensively. Specifically, we firstly collected books’ academic reviews and online reviews. Then, we extracted multi-dimensional metrics via finer-grained mining on book reviews. Finally, we compared assessment results based on book review integration and library information to verify assessment results. Experimental results infer that book review integration can complement evaluation information for book impact assessment, and thus improve the book evaluation system and methods.

Suggested Citation

  • Qingqing Zhou, 2024. "Evaluating book impacts via integrating multi-source reviews," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(11), pages 6931-6946, November.
    • Handle: RePEc:spr:scient:v:129:y:2024:i:11:d:10.1007_s11192-024-05174-1
    DOI: 10.1007/s11192-024-05174-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-024-05174-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-024-05174-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Torres-Salinas, Daniel & Moed, Henk F., 2009. "Library Catalog Analysis as a tool in studies of social sciences and humanities: An exploratory study of published book titles in Economics," Journal of Informetrics, Elsevier, vol. 3(1), pages 9-26.
    2. Ashraf Maleki, 2022. "Why does library holding format really matter for book impact assessment?: Modelling the relationship between citations and altmetrics with print and electronic holdings," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 1129-1160, February.
    3. Howard D. White & Sebastian K. Boell & Hairong Yu & Mari Davis & Concepción S. Wilson & Fletcher T.H. Cole, 2009. "Libcitations: A measure for comparative assessment of book publications in the humanities and social sciences," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(6), pages 1083-1096, June.
    4. Kayvan Kousha & Mike Thelwall & Mahshid Abdoli, 2017. "Goodreads reviews to assess the wider impacts of books," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(8), pages 2004-2016, August.
    5. Kousha, Kayvan & Thelwall, Mike, 2018. "Can Microsoft Academic help to assess the citation impact of academic books?," Journal of Informetrics, Elsevier, vol. 12(3), pages 972-984.
    6. Qingqing Zhou & Chengzhi Zhang & Star X. Zhao & Bikun Chen, 2016. "Measuring book impact based on the multi-granularity online review mining," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1435-1455, June.
    7. Alesia Zuccala & Roberto Cornacchia, 2016. "Data matching, integration, and interoperability for a metric assessment of monographs," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(1), pages 465-484, July.
    8. Howard D. White & Alesia A. Zuccala, 2018. "Libcitations, worldcat, cultural impact, and fame," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 69(12), pages 1502-1512, December.
    9. Xia Nan & Ming Li & Jin Shi, 2020. "Using altmetrics for assessing impact of highly-cited books in Chinese Book Citation Index," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1651-1669, March.
    10. Alesia Zuccala & Thed van Leeuwen, 2011. "Book reviews in humanities research evaluations," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(10), pages 1979-1991, October.
    11. Grant Lewison, 2001. "Evaluation of books as research outputs in history of medicine," Research Evaluation, Oxford University Press, vol. 10(2), pages 89-95, August.
    12. Kayvan Kousha & Mike Thelwall, 2016. "Can Amazon.com reviews help to assess the wider impacts of books?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(3), pages 566-581, March.
    13. Thelwall, Mike & Nevill, Tamara, 2018. "Could scientists use Altmetric.com scores to predict longer term citation counts?," Journal of Informetrics, Elsevier, vol. 12(1), pages 237-248.
    14. Kayvan Kousha & Mike Thelwall & Somayeh Rezaie, 2011. "Assessing the citation impact of books: The role of Google Books, Google Scholar, and Scopus," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(11), pages 2147-2164, November.
    15. A. Abrizah & Mike Thelwall, 2014. "Can the impact of non-Western academic books be measured? An investigation of Google Books and Google Scholar for Malaysia," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(12), pages 2498-2508, December.
    16. Zohreh Zahedi & Rodrigo Costas & Paul Wouters, 2014. "How well developed are altmetrics? A cross-disciplinary analysis of the presence of ‘alternative metrics’ in scientific publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1491-1513, November.
    17. Daniel Torres-Salinas & Nicolás Robinson-Garcia & Juan Gorraiz, 2017. "Filling the citation gap: measuring the multidimensional impact of the academic book at institutional level with PlumX," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1371-1384, December.
    18. Alesia Zuccala & Maarten Someren & Maurits Bellen, 2014. "A machine-learning approach to coding book reviews as quality indicators: Toward a theory of megacitation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(11), pages 2248-2260, November.
    19. Alberto Martín-Martín & Mike Thelwall & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2021. "Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: a multidisciplinary comparison of coverage via citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 871-906, January.
    20. Alesia Zuccala & Thed van Leeuwen, 2011. "Book reviews in humanities research evaluations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(10), pages 1979-1991, October.
    21. Kayvan Kousha & Mike Thelwall & Somayeh Rezaie, 2011. "Assessing the citation impact of books: The role of Google Books, Google Scholar, and Scopus," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(11), pages 2147-2164, November.
    22. Gerson Pech & Catarina Delgado, 2020. "Assessing the publication impact using citation data from both Scopus and WoS databases: an approach validated in 15 research fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 909-924, November.
    23. Alberto Martín-Martín & Mike Thelwall & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2021. "Correction to: Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: a multidisciplinary comparison of coverage via citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 907-908, January.
    24. Zhou, Qingqing & Zhang, Chengzhi, 2021. "Impacts towards a comprehensive assessment of the book impact by integrating multiple evaluation sources," Journal of Informetrics, Elsevier, vol. 15(3).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhou, Qingqing & Zhang, Chengzhi, 2021. "Impacts towards a comprehensive assessment of the book impact by integrating multiple evaluation sources," Journal of Informetrics, Elsevier, vol. 15(3).
    2. Siluo Yang & Xin Xing & Fan Qi & Maria Cláudia Cabrini Grácio, 2021. "Comparison of academic book impact from a disciplinary perspective: an analysis of citations and altmetric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1101-1123, February.
    3. Eleonora Dagienė, 2024. "Mapping scholarly books: library metadata and research assessment," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(9), pages 5689-5714, September.
    4. Qingqing Zhou & Chengzhi Zhang, 2020. "Evaluating wider impacts of books via fine-grained mining on citation literatures," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 1923-1948, December.
    5. Daniel Torres-Salinas & Nicolás Robinson-Garcia & Juan Gorraiz, 2017. "Filling the citation gap: measuring the multidimensional impact of the academic book at institutional level with PlumX," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1371-1384, December.
    6. Mohammadamin Erfanmanesh & A. Noorhidawati & A. Abrizah, 2019. "What can Bookmetrix tell us about the impact of Springer Nature’s books," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 521-536, October.
    7. Ashraf Maleki, 2022. "OCLC library holdings: assessing availability of academic books in libraries in print and electronic compared to citations and altmetrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 991-1020, February.
    8. Zhang, Chengzhi & Zhou, Qingqing, 2020. "Assessing books’ depth and breadth via multi-level mining on tables of contents," Journal of Informetrics, Elsevier, vol. 14(2).
    9. Torres-Salinas, Daniel & Rodríguez-Sánchez, Rosa & Robinson-García, Nicolás & Fdez-Valdivia, J. & García, J.A., 2013. "Mapping citation patterns of book chapters in the Book Citation Index," Journal of Informetrics, Elsevier, vol. 7(2), pages 412-424.
    10. Yajie Wang & Alesia Zuccala, 2021. "Scholarly book publishers as publicity agents for SSH titles on Twitter," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4817-4840, June.
    11. Daniel Torres-Salinas & Nicolás Robinson-García & Álvaro Cabezas-Clavijo & Evaristo Jiménez-Contreras, 2014. "Analyzing the citation characteristics of books: edited books, book series and publisher types in the book citation index," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 2113-2127, March.
    12. Ashraf Maleki, 2022. "Why does library holding format really matter for book impact assessment?: Modelling the relationship between citations and altmetrics with print and electronic holdings," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 1129-1160, February.
    13. Maja Jokić & Andrea Mervar & Stjepan Mateljan, 2019. "Comparative analysis of book citations in social science journals by Central and Eastern European authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1005-1029, September.
    14. Kousha, Kayvan & Thelwall, Mike, 2018. "Can Microsoft Academic help to assess the citation impact of academic books?," Journal of Informetrics, Elsevier, vol. 12(3), pages 972-984.
    15. Elea Giménez-Toledo & Jorge Mañana-Rodríguez & Tim C. E. Engels & Peter Ingwersen & Janne Pölönen & Gunnar Sivertsen & Frederik T. Verleysen & Alesia A. Zuccala, 2016. "Taking scholarly books into account: current developments in five European countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 685-699, May.
    16. Kayvan Kousha & Mike Thelwall, 2024. "Factors associating with or predicting more cited or higher quality journal articles: An Annual Review of Information Science and Technology (ARIST) paper," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 75(3), pages 215-244, March.
    17. Ronald Snijder, 2016. "Revisiting an open access monograph experiment: measuring citations and tweets 5 years later," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1855-1875, December.
    18. Daniel Torres-Salinas & Wenceslao Arroyo-Machado & Mike Thelwall, 2021. "Exploring WorldCat identities as an altmetric information source: a library catalog analysis experiment in the field of Scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1725-1743, February.
    19. Alesia Zuccala & Roberto Cornacchia, 2016. "Data matching, integration, and interoperability for a metric assessment of monographs," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(1), pages 465-484, July.
    20. Tausch, Arno, 2018. "The Market Power of Global Scientific Publishing Companies in the Age of Globalization. An Analysis Based on the OCLC Worldcat," MPRA Paper 87442, University Library of Munich, Germany.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:129:y:2024:i:11:d:10.1007_s11192-024-05174-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.