IDEAS home Printed from https://ideas.repec.org/a/oup/rseval/v31y2022i4p475-485..html
   My bibliography  Save this article

‘I want to be able to do what I know the tools will allow us to do’: Practicing evaluative bibliometrics through digital infrastructure

Author

Listed:
  • Anne K Krüger
  • Sabrina Petersohn

Abstract

The proliferation of quantitative research assessment has been accompanied by an increasing growth and diversification of digital infrastructure for evaluative bibliometrics. Since the beginning of the 2000s, insights into academic performance provided by a variety of new databases and devices significantly exceed the capacities of the former Science Citation Index and embedded metrics. Going beyond the research on the construction, uses, and consequences of bibliometric indicators, we therefore posit that a perspective on bibliometric infrastructure is crucial for understanding how evaluative bibliometrics is put into practice. Drawing on interviews with academic librarians on the increasing provision and implementation of bibliometric infrastructure in the years 2013 and 2014, we analyse how the entanglement of technology and its users shapes how evaluative bibliometrics is understood and practiced.

Suggested Citation

  • Anne K Krüger & Sabrina Petersohn, 2022. "‘I want to be able to do what I know the tools will allow us to do’: Practicing evaluative bibliometrics through digital infrastructure," Research Evaluation, Oxford University Press, vol. 31(4), pages 475-485.
    • Handle: RePEc:oup:rseval:v:31:y:2022:i:4:p:475-485.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/reseval/rvac009
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sabrina Petersohn & Thomas Heinze, 2018. "Professionalization of bibliometric research assessment. Insights from the history of the Leiden Centre for Science and Technology Studies (CWTS)," Science and Public Policy, Oxford University Press, vol. 45(4), pages 596-596.
    2. Sabrina Petersohn & Thomas Heinze, 2018. "Professionalization of bibliometric research assessment. Insights from the history of the Leiden Centre for Science and Technology Studies (CWTS)," Science and Public Policy, Oxford University Press, vol. 45(4), pages 565-578.
    3. Sarah Rijcke & Alexander Rushforth, 2015. "To intervene or not to intervene; is that the question? On the role of scientometrics in research evaluation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(9), pages 1954-1958, September.
    4. Torger Möller & Marion Schmidt & Stefan Hornbostel, 2016. "Assessing the effects of the German Excellence Initiative with bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2217-2239, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anne K. Krüger, 2020. "Quantification 2.0? Bibliometric Infrastructures in Academic Evaluation," Politics and Governance, Cogitatio Press, vol. 8(2), pages 58-67.
    2. Torres-Salinas, Daniel & Orduña-Malea, Enrique & Delgado-Vázquez, Ángel & Gorraiz, Juan & Arroyo-Machado, Wenceslao, 2024. "Foundations of Narrative Bibliometrics," Journal of Informetrics, Elsevier, vol. 18(3).
    3. Gregorio González-Alcaide, 2021. "Bibliometric studies outside the information science and library science field: uncontainable or uncontrollable?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(8), pages 6837-6870, August.
    4. Eugenio Petrovich, 2022. "Bibliometrics in Press. Representations and uses of bibliometric indicators in the Italian daily newspapers," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2195-2233, May.
    5. Jappe, Arlette, 2023. "Mergers between universities and governmental research organizations in the Netherlands and Denmark. Institutional platforms for agricultural transformations," SocArXiv 35kfa, Center for Open Science.
    6. Mohammed R. AlShareef & Ibrahim A. Alrammah & Nasser A. Alshoukani & Abdulaziz M. Almalik, 2023. "The impact of financial incentives on research production: Evidence from Saudi Arabia," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 3067-3089, May.
    7. Wu, Jiang & Ou, Guiyan & Liu, Xiaohui & Dong, Ke, 2022. "How does academic education background affect top researchers’ performance? Evidence from the field of artificial intelligence," Journal of Informetrics, Elsevier, vol. 16(2).
    8. Nicolas Carayol & Emeric Henry & Marianne Lanoë, 2020. "Stimulating Peer Effects? Evidence from a Research Cluster Policy," Working Papers hal-03874261, HAL.
    9. Sabrina Petersohn & Thomas Heinze, 2018. "Professionalization of bibliometric research assessment. Insights from the history of the Leiden Centre for Science and Technology Studies (CWTS)," Science and Public Policy, Oxford University Press, vol. 45(4), pages 565-578.
    10. Péter Sasvári & Gergely Ferenc Lendvai, 2024. "On the Periphery of the European Social Sciences—A Scientometric Analysis of Publication Performance, Excellence, and Internal Bias in Social Sciences in the Visegrad Countries," Social Sciences, MDPI, vol. 13(10), pages 1-20, October.
    11. Shengbo Liu & Xiaoting Luo & Miaomiao Liu, 2023. "Was Chinese “Double-First Class” Construction Policy Influential? Analysis Using Propensity Score Matching," Sustainability, MDPI, vol. 15(8), pages 1-13, April.
    12. Civera, Alice & Lehmann, Erik E. & Paleari, Stefano & Stockinger, Sarah A.E., 2020. "Higher education policy: Why hope for quality when rewarding quantity?," Research Policy, Elsevier, vol. 49(8).
    13. Massimiliano Coda-Zabetta & Francesco Lissoni & Ernest Miguelez, 2024. "Star recruitment and internationalization effects: an analysis of the Alexander von Humboldt professorship programme," Economia e Politica Industriale: Journal of Industrial and Business Economics, Springer;Associazione Amici di Economia e Politica Industriale, vol. 51(3), pages 667-690, September.
    14. Antonin Bergeaud & Arthur Guillouzouic & Emeric Henry & Clement Malgouyres, 2022. "From public labs to private firms: magnitude and channels of R&D spillovers," POID Working Papers 041, Centre for Economic Performance, LSE.
    15. Isabel M. Habicht & Mark Lutter & Martin Schröder, 2021. "How human capital, universities of excellence, third party funding, mobility and gender explain productivity in German political science," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9649-9675, December.
    16. Cantner, Uwe & Grashof, Nils & Grebel, Thomas & Zhang, Xijie, 2023. "When Excellence is not Excellent: The Impact of the Excellence Initiative on the Relative Productivity of German Universities," MPRA Paper 118139, University Library of Munich, Germany.
    17. Matveeva, Nataliya & Sterligov, Ivan & Yudkevich, Maria, 2021. "The effect of Russian University Excellence Initiative on publications and collaboration patterns," Journal of Informetrics, Elsevier, vol. 15(1).
    18. Manoj Kumar Verma & Daud Khan & Mayank Yuvaraj, 2023. "Scientometric assessment of funded scientometrics and bibliometrics research (2011–2021)," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4305-4320, August.
    19. Nataliya Matveeva & Ivan Sterligov & Maria Yudkevich, 2019. "The Russian University Excellence Initiative: Is It Really Excellence That Is Promoted?," HSE Working papers WP BRP 49/EDU/2019, National Research University Higher School of Economics.
    20. Clemens Blümel & Stephan Gauch, 2021. "Introduction to special issue: quantitative studies of science in Germany," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9641-9647, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:rseval:v:31:y:2022:i:4:p:475-485.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/rev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.