IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v15y2021i4s1751157721000900.html
   My bibliography  Save this article

Disruption indices and their calculation using web-of-science data: Indicators of historical developments or evolutionary dynamics?

Author

Listed:
  • Leydesdorff, Loet
  • Bornmann, Lutz

Abstract

Science and technology develop not only along historical trajectories, but also as next-order regimes that periodically change the landscape. Regimes can incur on trajectories which are then disrupted. Using citations and references for the operationalization, we discuss and quantify both the recently proposed “disruption indicator” and the older indicator for “critical transitions” among reference lists as changes which may necessitate a rewriting of history. We elaborate this with three examples in order to provide a proof of concept. We shall show how the indicators can be calculated using Web-of-Science data. The routine is automated (available at < http://www.leydesdorff.net/software/di/index.htm >) so that it can be upscaled in future research. We suggest that “critical transitions” can be used to indicate disruption at the regime level, whereas disruption is developed at the trajectory level. Both conceptually and empirically, however, continuity is grasped more easily than disruption.

Suggested Citation

  • Leydesdorff, Loet & Bornmann, Lutz, 2021. "Disruption indices and their calculation using web-of-science data: Indicators of historical developments or evolutionary dynamics?," Journal of Informetrics, Elsevier, vol. 15(4).
    • Handle: RePEc:eee:infome:v:15:y:2021:i:4:s1751157721000900
    DOI: 10.1016/j.joi.2021.101219
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157721000900
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2021.101219?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bornmann, Lutz & Mutz, Rüdiger & Hug, Sven E. & Daniel, Hans-Dieter, 2011. "A multilevel meta-analysis of studies reporting correlations between the h index and 37 different h index variants," Journal of Informetrics, Elsevier, vol. 5(3), pages 346-359.
    2. Lingfei Wu & Dashun Wang & James A. Evans, 2019. "Large teams develop and small teams disrupt science and technology," Nature, Nature, vol. 566(7744), pages 378-382, February.
    3. van Eck, Nees Jan & Waltman, Ludo, 2014. "CitNetExplorer: A new software tool for analyzing and visualizing citation networks," Journal of Informetrics, Elsevier, vol. 8(4), pages 802-823.
    4. Lutz Bornmann & Sitaram Devarakonda & Alexander Tekles & George Chacko, 2020. "Disruptive papers published in Scientometrics: meaningful results by using an improved variant of the disruption index originally proposed by Wu, Wang, and Evans (2019)," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 1149-1155, May.
    5. Burrell, Quentin L., 2013. "The h-index: A case of the tail wagging the dog?," Journal of Informetrics, Elsevier, vol. 7(4), pages 774-783.
    6. Eugene Garfield & A. I. Pudovkin & V. S. Istomin, 2003. "Why do we need algorithmic historiography?," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 54(5), pages 400-412, March.
    7. Hayami, Yujiro & Ruttan, Vernon W, 1970. "Agricultural Productivity Differences Among Countries," American Economic Review, American Economic Association, vol. 60(5), pages 895-911, December.
    8. Russell J. Funk & Jason Owen-Smith, 2017. "A Dynamic Network Measure of Technological Change," Management Science, INFORMS, vol. 63(3), pages 791-817, March.
    9. Bornmann, Lutz & Tekles, Alexander, 2021. "Convergent validity of several indicators measuring disruptiveness with milestone assignments to physics papers by experts," Journal of Informetrics, Elsevier, vol. 15(3).
    10. Nelson, Richard R. & Winter, Sidney G., 1993. "In search of useful theory of innovation," Research Policy, Elsevier, vol. 22(2), pages 108-108, April.
    11. Lee,Keun, 2013. "Schumpeterian Analysis of Economic Catch-up," Cambridge Books, Cambridge University Press, number 9781107042681, September.
    12. Loet Leydesdorff & Caroline S. Wagner & Lutz Bornmann, 2018. "Discontinuities in citation relations among journals: self-organized criticality as a model of scientific revolutions and change," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 623-644, July.
    13. Dosi, Giovanni, 1993. "Technological paradigms and technological trajectories : A suggested interpretation of the determinants and directions of technical change," Research Policy, Elsevier, vol. 22(2), pages 102-103, April.
    14. Frenken, Koen & Leydesdorff, Loet, 2000. "Scaling trajectories in civil aircraft (1913-1997)," Research Policy, Elsevier, vol. 29(3), pages 331-348, March.
    15. Tahamtan, Iman & Bornmann, Lutz, 2018. "Creativity in science and the link to cited references: Is the creative potential of papers reflected in their cited references?," Journal of Informetrics, Elsevier, vol. 12(3), pages 906-930.
    16. Lutz Bornmann & Alexander Tekles, 2019. "Disruptive papers published in Scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(1), pages 331-336, July.
    17. Geels, Frank W., 2002. "Technological transitions as evolutionary reconfiguration processes: a multi-level perspective and a case-study," Research Policy, Elsevier, vol. 31(8-9), pages 1257-1274, December.
    18. Thor, Andreas & Marx, Werner & Leydesdorff, Loet & Bornmann, Lutz, 2016. "Introducing CitedReferencesExplorer (CRExplorer): A program for reference publication year spectroscopy with cited references standardization," Journal of Informetrics, Elsevier, vol. 10(2), pages 503-515.
    19. Loet Leydesdorff & Inga A. Ivanova, 2014. "Mutual redundancies in interhuman communication systems: Steps toward a calculus of processing meaning," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(2), pages 386-399, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Ming-Ze & Wang, Tang-Rong & Lyu, Peng-Hui & Chen, Qi-Mei & Li, Ze-Xia & Ngai, Eric W.T., 2024. "Impact of gender composition of academic teams on disruptive output," Journal of Informetrics, Elsevier, vol. 18(2).
    2. Tong, Tong & Wang, Wanru & Ye, Fred Y., 2024. "A complement to the novel disruption indicator based on knowledge entities," Journal of Informetrics, Elsevier, vol. 18(2).
    3. Yuyan Jiang & Xueli Liu, 2023. "A construction and empirical research of the journal disruption index based on open citation data," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(7), pages 3935-3958, July.
    4. Yiling Lin & Carl Benedikt Frey & Lingfei Wu, 2022. "Remote Collaboration Fuses Fewer Breakthrough Ideas," Papers 2206.01878, arXiv.org, revised Oct 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bornmann, Lutz & Tekles, Alexander, 2021. "Convergent validity of several indicators measuring disruptiveness with milestone assignments to physics papers by experts," Journal of Informetrics, Elsevier, vol. 15(3).
    2. Nan Deng & An Zeng, 2023. "Enhancing the robustness of the disruption metric against noise," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2419-2428, April.
    3. K. Brad Wray & Søren R. Paludan & Lutz Bornmann & Robin Haunschild, 2024. "Using Reference Publication Year Spectroscopy (RPYS) to analyze the research and publication culture in immunology," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(6), pages 3271-3283, June.
    4. Keye Wu & Ziyue Xie & Jia Tina Du, 2024. "Does science disrupt technology? Examining science intensity, novelty, and recency through patent-paper citations in the pharmaceutical field," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(9), pages 5469-5491, September.
    5. Ruan, Xuanmin & Lyu, Dongqing & Gong, Kaile & Cheng, Ying & Li, Jiang, 2021. "Rethinking the disruption index as a measure of scientific and technological advances," Technological Forecasting and Social Change, Elsevier, vol. 172(C).
    6. Ruijie Wang & Yuhao Zhou & An Zeng, 2023. "Evaluating scientists by citation and disruption of their representative works," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1689-1710, March.
    7. Peter Sjögårde & Fereshteh Didegah, 2022. "The association between topic growth and citation impact of research publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1903-1921, April.
    8. Yue Wang & Ning Li & Bin Zhang & Qian Huang & Jian Wu & Yang Wang, 2023. "The effect of structural holes on producing novel and disruptive research in physics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1801-1823, March.
    9. Lin, Yiling & Evans, James A. & Wu, Lingfei, 2022. "New directions in science emerge from disconnection and discord," Journal of Informetrics, Elsevier, vol. 16(1).
    10. Dongqing Lyu & Kaile Gong & Xuanmin Ruan & Ying Cheng & Jiang Li, 2021. "Does research collaboration influence the “disruption” of articles? Evidence from neurosciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 287-303, January.
    11. Yuyan Jiang & Xueli Liu, 2023. "A construction and empirical research of the journal disruption index based on open citation data," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(7), pages 3935-3958, July.
    12. Hou, Jianhua & Wang, Dongyi & Li, Jing, 2022. "A new method for measuring the originality of academic articles based on knowledge units in semantic networks," Journal of Informetrics, Elsevier, vol. 16(3).
    13. António Osório & Lutz Bornmann, 2021. "On the disruptive power of small-teams research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 117-133, January.
    14. Petersen, Alexander M. & Rotolo, Daniele & Leydesdorff, Loet, 2016. "A triple helix model of medical innovation: Supply, demand, and technological capabilities in terms of Medical Subject Headings," Research Policy, Elsevier, vol. 45(3), pages 666-681.
    15. Bajmócy, Zoltán & Vas, Zsófia, 2012. "Az innovációs rendszerek 25 éve. Szakirodalmi áttekintés evolúciós közgazdaságtani megközelítésben [25 years of innovation systems. A literature review from the angle of evolutionary economics]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(11), pages 1233-1256.
    16. Zhang, Ming-Ze & Wang, Tang-Rong & Lyu, Peng-Hui & Chen, Qi-Mei & Li, Ze-Xia & Ngai, Eric W.T., 2024. "Impact of gender composition of academic teams on disruptive output," Journal of Informetrics, Elsevier, vol. 18(2).
    17. Qu, Guannan & Chen, Jin & Zhang, Ruhao & Wang, Luyao & Yang, Yayu, 2023. "Technological search strategy and breakthrough innovation: An integrated approach based on main-path analysis," Technological Forecasting and Social Change, Elsevier, vol. 196(C).
    18. Jukka Luhas & Mirja Mikkilä & Ville Uusitalo & Lassi Linnanen, 2019. "Product Diversification in Sustainability Transition: The Forest-Based Bioeconomy in Finland," Sustainability, MDPI, vol. 11(12), pages 1-19, June.
    19. Genus, Audley & Coles, Anne-Marie, 2008. "Rethinking the multi-level perspective of technological transitions," Research Policy, Elsevier, vol. 37(9), pages 1436-1445, October.
    20. Raven, Rob P.J.M., 2006. "Towards alternative trajectories? Reconfigurations in the Dutch electricity regime," Research Policy, Elsevier, vol. 35(4), pages 581-595, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:15:y:2021:i:4:s1751157721000900. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.