IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v111y2017i3d10.1007_s11192-017-2348-4.html
   My bibliography  Save this article

Measuring interdisciplinarity of a research system: detecting distinction between publication categories and citation categories

Author

Listed:
  • Xuefeng Wang

    (Beijing Institute of Technology)

  • Zhinan Wang

    (Beijing Institute of Technology)

  • Ying Huang

    (Beijing Institute of Technology)

  • Yun Chen

    (Beijing Institute of Technology)

  • Yi Zhang

    (University of Technology Sydney)

  • Huichao Ren

    (Beijing Institute of Technology)

  • Rongrong Li

    (Beijing Institute of Technology)

  • Jinhui Pang

    (Beijing Institute of Technology)

Abstract

Interdisciplinary research has been a focus in academia, and it is beneficial to understand the properties and structure of interdisciplinary research from the viewpoint of bibliometrics. This paper detects distinctions between publication categories and citation categories to measure the interdisciplinarity of individual publications, and then to measure interdisciplinarity for one research system by the average interdisciplinarity of individual publications, which are taken as elements in the research system. The average and the standard deviation (SD) that reflects the variance of the elements’ interdisciplinarity in one research system, of all the publications’ integration scores and diffusion scores, were then respectively calculated. Sixty of the most productive authors from three Web of Science categories (Mathematics, Applied; Computer Science, Artificial Intelligence; and Operations Research and Management Science) were selected as a case to validate our approach. The results showed that measuring the interdisciplinarity of individual elements effectively lessened the impacts caused by some elements with distinctive citation categories on the research system’s interdisciplinarity (especially those research systems with large SDs). Furthermore, measuring the distinction between publication categories and citation categories is essential for individual publications’ interdisciplinarity when the citation categories do not appear in the categories of the publication itself or the publication has only a single citation category.

Suggested Citation

  • Xuefeng Wang & Zhinan Wang & Ying Huang & Yun Chen & Yi Zhang & Huichao Ren & Rongrong Li & Jinhui Pang, 2017. "Measuring interdisciplinarity of a research system: detecting distinction between publication categories and citation categories," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 2023-2039, June.
    • Handle: RePEc:spr:scient:v:111:y:2017:i:3:d:10.1007_s11192-017-2348-4
    DOI: 10.1007/s11192-017-2348-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-017-2348-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-017-2348-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Stephen Carley & Alan L. Porter, 2012. "A forward diversity index," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 407-427, February.
    2. Fernanda Morillo & María Bordons & Isabel Gómez, 2003. "Interdisciplinarity in science: A tentative typology of disciplines and research areas," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 54(13), pages 1237-1249, November.
    3. Alexis-Michel Mugabushaka & Anthi Kyriakou & Theo Papazoglou, 2016. "Bibliometric indicators of interdisciplinarity: the potential of the Leinster–Cobbold diversity indices to study disciplinary diversity," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 593-607, May.
    4. M.J. Cobo & A.G. López-Herrera & E. Herrera-Viedma & F. Herrera, 2011. "Science mapping software tools: Review, analysis, and cooperative study among tools," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(7), pages 1382-1402, July.
    5. Leydesdorff, Loet & Rafols, Ismael, 2011. "Indicators of the interdisciplinarity of journals: Diversity, centrality, and citations," Journal of Informetrics, Elsevier, vol. 5(1), pages 87-100.
    6. Andy Stirling, 2007. "A General Framework for Analysing Diversity in Science, Technology and Society," SPRU Working Paper Series 156, SPRU - Science Policy Research Unit, University of Sussex Business School.
    7. Qiuju Zhou & Ronald Rousseau & Liying Yang & Ting Yue & Guoliang Yang, 2012. "A general framework for describing diversity within systems and similarity between systems with applications in informetrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(3), pages 787-812, December.
    8. Lin Zhang & Ronald Rousseau & Wolfgang Glänzel, 2016. "Diversity of references as an indicator of the interdisciplinarity of journals: Taking similarity between subject fields into account," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(5), pages 1257-1265, May.
    9. Ismael Rafols & Martin Meyer, 2010. "Diversity and network coherence as indicators of interdisciplinarity: case studies in bionanoscience," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(2), pages 263-287, February.
    10. Levitin, Gregory & Hausken, Kjell, 2009. "Parallel systems under two sequential attacks," Reliability Engineering and System Safety, Elsevier, vol. 94(3), pages 763-772.
    11. Lorenzo Cassi & Wilfriedo Mescheba & Élisabeth Turckheim, 2014. "How to evaluate the degree of interdisciplinarity of an institution?," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(3), pages 1871-1895, December.
    12. Wagner, Caroline S. & Roessner, J. David & Bobb, Kamau & Klein, Julie Thompson & Boyack, Kevin W. & Keyton, Joann & Rafols, Ismael & Börner, Katy, 2011. "Approaches to understanding and measuring interdisciplinary scientific research (IDR): A review of the literature," Journal of Informetrics, Elsevier, vol. 5(1), pages 14-26.
    13. Stirling, Andrew, 1994. "Diversity and ignorance in electricity supply investment : Addressing the solution rather than the problem," Energy Policy, Elsevier, vol. 22(3), pages 195-216, March.
    14. Kevin W. Boyack & Richard Klavans & Katy Börner, 2005. "Mapping the backbone of science," Scientometrics, Springer;Akadémiai Kiadó, vol. 64(3), pages 351-374, August.
    15. Alan L. Porter & Alex S. Cohen & J. David Roessner & Marty Perreault, 2007. "Measuring researcher interdisciplinarity," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(1), pages 117-147, July.
    16. Wang, Yujie & Xing, Liudong & Wang, Honggang & Levitin, Gregory, 2015. "Combinatorial analysis of body sensor networks subject to probabilistic competing failures," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 388-398.
    17. K Hausken & G Levitin, 2009. "Parallel systems with different types of defence resource expenditure under two sequential attacks," Journal of Risk and Reliability, , vol. 223(1), pages 71-85, March.
    18. Joachim Schummer, 2004. "Multidisciplinarity, interdisciplinarity, and patterns of research collaboration in nanoscience and nanotechnology," Scientometrics, Springer;Akadémiai Kiadó, vol. 59(3), pages 425-465, March.
    19. Alfredo Yegros-Yegros & Ismael Rafols & Pablo D’Este, 2015. "Does Interdisciplinary Research Lead to Higher Citation Impact? The Different Effect of Proximal and Distal Interdisciplinarity," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-21, August.
    20. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    21. Alan L. Porter & Ismael Rafols, 2009. "Is science becoming more interdisciplinary? Measuring and mapping six research fields over time," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 719-745, December.
    22. Michael Gowanlock & Rich Gazan, 2013. "Assessing researcher interdisciplinarity: a case study of the University of Hawaii NASA Astrobiology Institute," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 133-161, January.
    23. Loet Leydesdorff, 2007. "Betweenness centrality as an indicator of the interdisciplinarity of scientific journals," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(9), pages 1303-1319, July.
    24. Alan L Porter & David J Roessner & Anne E Heberger, 2008. "How interdisciplinary is a given body of research?," Research Evaluation, Oxford University Press, vol. 17(4), pages 273-282, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shu-Hao Chang, 2018. "A pilot study on the connection between scientific fields and patent classification systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 951-970, March.
    2. Shunshun Shi & Wenyu Zhang & Shuai Zhang & Jie Chen, 2018. "Does prestige dimension influence the interdisciplinary performance of scientific entities in knowledge flow? Evidence from the e-government field," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 1237-1264, November.
    3. Tang, Li & Yang, Defang & Wang, Mingxing & Guo, Ying, 2024. "The mediating impact of citation scope: Evidence from China's ESI publications," Journal of Informetrics, Elsevier, vol. 18(3).
    4. Giulio Giacomo Cantone, 2024. "How to measure interdisciplinary research? A systemic design for the model of measurement," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(8), pages 4937-4982, August.
    5. Sander Zwanenburg & Maryam Nakhoda & Peter Whigham, 2022. "Toward greater consistency and validity in measuring interdisciplinarity: a systematic and conceptual evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7769-7788, December.
    6. Stephen F. Carley & Seokbeom Kwon & Alan L. Porter & Jan L. Youtie, 2019. "The relationship between forward and backward diversity in CORE datasets," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 961-974, September.
    7. Wooseok Jang & Heeyeul Kwon & Yongtae Park & Hakyeon Lee, 2018. "Predicting the degree of interdisciplinarity in academic fields: the case of nanotechnology," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 231-254, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alfonso Ávila-Robinson & Cristian Mejia & Shintaro Sengoku, 2021. "Are bibliometric measures consistent with scientists’ perceptions? The case of interdisciplinarity in research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7477-7502, September.
    2. Giulio Giacomo Cantone, 2024. "How to measure interdisciplinary research? A systemic design for the model of measurement," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(8), pages 4937-4982, August.
    3. Sander Zwanenburg & Maryam Nakhoda & Peter Whigham, 2022. "Toward greater consistency and validity in measuring interdisciplinarity: a systematic and conceptual evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7769-7788, December.
    4. Lin Zhang & Beibei Sun & Zaida Chinchilla-Rodríguez & Lixin Chen & Ying Huang, 2018. "Interdisciplinarity and collaboration: on the relationship between disciplinary diversity in departmental affiliations and reference lists," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 271-291, October.
    5. Shengli Deng & Sudi Xia, 2020. "Mapping the interdisciplinarity in information behavior research: a quantitative study using diversity measure and co-occurrence analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 489-513, July.
    6. Abramo, Giovanni & D’Angelo, Ciriaco Andrea & Zhang, Lin, 2018. "A comparison of two approaches for measuring interdisciplinary research output: The disciplinary diversity of authors vs the disciplinary diversity of the reference list," Journal of Informetrics, Elsevier, vol. 12(4), pages 1182-1193.
    7. Ryo Takahashi & Kenji Kaibe & Kazuyuki Suzuki & Sayaka Takahashi & Kotaro Takeda & Marc Hansen & Michiaki Yumoto, 2023. "New concept of the affinity between research fields using academic journal data in Scopus," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3507-3534, June.
    8. Loet Leydesdorff & Caroline S. Wagner & Lutz Bornmann, 2018. "Betweenness and diversity in journal citation networks as measures of interdisciplinarity—A tribute to Eugene Garfield," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 567-592, February.
    9. Ricardo Arencibia-Jorge & Rosa Lidia Vega-Almeida & José Luis Jiménez-Andrade & Humberto Carrillo-Calvet, 2022. "Evolutionary stages and multidisciplinary nature of artificial intelligence research," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(9), pages 5139-5158, September.
    10. Chen, Shiji & Qiu, Junping & Arsenault, Clément & Larivière, Vincent, 2021. "Exploring the interdisciplinarity patterns of highly cited papers," Journal of Informetrics, Elsevier, vol. 15(1).
    11. Leydesdorff, Loet & Wagner, Caroline S. & Bornmann, Lutz, 2019. "Interdisciplinarity as diversity in citation patterns among journals: Rao-Stirling diversity, relative variety, and the Gini coefficient," Journal of Informetrics, Elsevier, vol. 13(1), pages 255-269.
    12. Shiji Chen & Yanhui Song & Fei Shu & Vincent Larivière, 2022. "Interdisciplinarity and impact: the effects of the citation time window," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2621-2642, May.
    13. Andrea Bonaccorsi & Nicola Melluso & Francesco Alessandro Massucci, 2022. "Exploring the antecedents of interdisciplinarity at the European Research Council: a topic modeling approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 6961-6991, December.
    14. Jingjing Ren & Fang Wang & Minglu Li, 2023. "Dynamics and characteristics of interdisciplinary research in scientific breakthroughs: case studies of Nobel-winning research in the past 120 years," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4383-4419, August.
    15. Wooseok Jang & Heeyeul Kwon & Yongtae Park & Hakyeon Lee, 2018. "Predicting the degree of interdisciplinarity in academic fields: the case of nanotechnology," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 231-254, July.
    16. Jorge Mañana Rodríguez, 2017. "Disciplinarity and interdisciplinarity in citation and reference dimensions: knowledge importation and exportation taxonomy of journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 617-642, February.
    17. Xin Liu & Yi Bu & Ming Li & Jiang Li, 2024. "Monodisciplinary collaboration disrupts science more than multidisciplinary collaboration," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 75(1), pages 59-78, January.
    18. Hongyu Zhou & Raf Guns & Tim C. E. Engels, 2022. "Are social sciences becoming more interdisciplinary? Evidence from publications 1960–2014," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(9), pages 1201-1221, September.
    19. Chiara Carusi & Giuseppe Bianchi, 2020. "A look at interdisciplinarity using bipartite scholar/journal networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 867-894, February.
    20. Wolfgang Glänzel & Koenraad Debackere, 2022. "Various aspects of interdisciplinarity in research and how to quantify and measure those," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(9), pages 5551-5569, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:111:y:2017:i:3:d:10.1007_s11192-017-2348-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.