IDEAS home Printed from https://ideas.repec.org/p/osf/metaar/hva4p_v1.html
   My bibliography  Save this paper

How to measure Interdisciplinary Research? A `systemic' design for the model of measurement

Author

Listed:
  • Cantone, Giulio Giacomo

Abstract

Interdisciplinarity is a polysemous concept with multiple, reasoned and intuitive, interpretations across scholars and policy-makers. Historically, quantifying the interdisciplinarity of research has been challenging due to the variety of methods used to identify metadata, taxonomies, and mathematical formulas. This has resulted in considerable uncertainty about the ability of quantitative models to provide clear insights for policy-making. This study proposes a systemic design, grounded in an advanced literature review, to demonstrate that the quantification of the interdisciplinarity of research can be treated as a process of decision-making in mathematical modelling, where alternatives choices are evaluated based on how closely their mathematical properties align with the theoretical objectives of the research design. The study addresses modeling choices regarding the stylisation of metadata into units of observation, and the operational definition of the conceptual dimensions of interdisciplinarity, presenting both established and novel methods and formulas. The final section discusses advanced topics in modelling the measurement, including a dedicated discussion on the difference in analysing the status of papers versus collective bodies of research; and distinguishing between reflective, formative, and inferential causal models of interdisciplinary research.

Suggested Citation

  • Cantone, Giulio Giacomo, 2024. "How to measure Interdisciplinary Research? A `systemic' design for the model of measurement," MetaArXiv hva4p_v1, Center for Open Science.
    • Handle: RePEc:osf:metaar:hva4p_v1
    DOI: 10.31219/osf.io/hva4p_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/65c3f0a335be200ba1a50715/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/hva4p_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jian Xu & Yi Bu & Ying Ding & Sinan Yang & Hongli Zhang & Chen Yu & Lin Sun, 2018. "Understanding the formation of interdisciplinary research from the perspective of keyword evolution: a case study on joint attention," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 973-995, November.
    2. Alexander J. Gates & Qing Ke & Onur Varol & Albert-László Barabási, 2019. "Nature’s reach: narrow work has broad impact," Nature, Nature, vol. 575(7781), pages 32-34, November.
    3. Nicholas Bloom & Charles I. Jones & John Van Reenen & Michael Webb, 2020. "Are Ideas Getting Harder to Find?," American Economic Review, American Economic Association, vol. 110(4), pages 1104-1144, April.
    4. Frédérique Bone & Michael M Hopkins & Ismael Ràfols & Jordi Molas-Gallart & Puay Tang & Gail Davey & Antony M Carr, 2020. "DARE to be different? A novel approach for analysing diversity in collaborative research projects," Research Evaluation, Oxford University Press, vol. 29(3), pages 300-315.
    5. Alfredo Yegros-Yegros & Ismael Rafols & Pablo D’Este, 2015. "Does Interdisciplinary Research Lead to Higher Citation Impact? The Different Effect of Proximal and Distal Interdisciplinarity," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-21, August.
    6. Loet Leydesdorff & Ismael Rafols, 2009. "A global map of science based on the ISI subject categories," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(2), pages 348-362, February.
    7. Monya Baker, 2016. "1,500 scientists lift the lid on reproducibility," Nature, Nature, vol. 533(7604), pages 452-454, May.
    8. Sander Zwanenburg & Maryam Nakhoda & Peter Whigham, 2022. "Toward greater consistency and validity in measuring interdisciplinarity: a systematic and conceptual evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7769-7788, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giulio Giacomo Cantone, 2024. "How to measure interdisciplinary research? A systemic design for the model of measurement," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(8), pages 4937-4982, August.
    2. Jingjing Ren & Fang Wang & Minglu Li, 2023. "Dynamics and characteristics of interdisciplinary research in scientific breakthroughs: case studies of Nobel-winning research in the past 120 years," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4383-4419, August.
    3. Gabriele Sampagnaro, 2023. "Keyword occurrences and journal specialization," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5629-5645, October.
    4. Hongyu Zhou & Raf Guns & Tim C. E. Engels, 2022. "Are social sciences becoming more interdisciplinary? Evidence from publications 1960–2014," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(9), pages 1201-1221, September.
    5. Keungoui Kim & Dieter F. Kogler & Sira Maliphol, 2024. "Identifying interdisciplinary emergence in the science of science: combination of network analysis and BERTopic," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-15, December.
    6. Keisuke Okamura, 2019. "Interdisciplinarity revisited: evidence for research impact and dynamism," Palgrave Communications, Palgrave Macmillan, vol. 5(1), pages 1-9, December.
    7. Lu Liu & Benjamin F. Jones & Brian Uzzi & Dashun Wang, 2023. "Data, measurement and empirical methods in the science of science," Nature Human Behaviour, Nature, vol. 7(7), pages 1046-1058, July.
    8. Junping Qiu & Yunlong Yu & Shiji Chen & Teng Zhao & Shanshan Wang, 2024. "Effect of Scientific Collaboration on Interdisciplinarity in Climate Change From a Scientometric Perspective," SAGE Open, , vol. 14(2), pages 21582440241, April.
    9. Qing Ke, 2023. "Interdisciplinary research and technological impact: evidence from biomedicine," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2035-2077, April.
    10. Roberto Savona & Cristina Maria Alberini & Lucia Alessi & Iacopo Baussano & Petros Dellaportas & Ranieri Guerra & Sean Khozin & Andrea Modena & Sergio Pecorelli & Guido Rasi & Paolo Daniele Siviero & , 2023. "Towards a Framework for a New Research Ecosystem," Papers 2312.07065, arXiv.org, revised Dec 2023.
    11. Roland Barthel & Roman Seidl, 2017. "Interdisciplinary Collaboration between Natural and Social Sciences – Status and Trends Exemplified in Groundwater Research," PLOS ONE, Public Library of Science, vol. 12(1), pages 1-27, January.
    12. Banal-Estañol, Albert & Macho-Stadler, Inés & Pérez-Castrillo, David, 2019. "Evaluation in research funding agencies: Are structurally diverse teams biased against?," Research Policy, Elsevier, vol. 48(7), pages 1823-1840.
    13. Lina Xu & Steven Dellaportas & Jin Wang, 2022. "A study of interdisciplinary accounting research: analysing the diversity of cited references," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 62(2), pages 2131-2162, June.
    14. Alexey Lyutov & Yilmaz Uygun & Marc-Thorsten Hütt, 2021. "Machine learning misclassification of academic publications reveals non-trivial interdependencies of scientific disciplines," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1173-1186, February.
    15. Andrea Bonaccorsi & Nicola Melluso & Francesco Alessandro Massucci, 2022. "Exploring the antecedents of interdisciplinarity at the European Research Council: a topic modeling approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 6961-6991, December.
    16. Shiyun Wang & Jin Mao & Yujie Cao & Gang Li, 2022. "Integrated knowledge content in an interdisciplinary field: identification, classification, and application," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6581-6614, November.
    17. Frank R. Lichtenberg, 2019. "The long-run impact of new medical ideas on cancer survival and mortality," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 28(7), pages 722-740, October.
    18. Kuosmanen, Natalia & Valmari, Nelli, 2023. "Renewal of Companies Through Product Switching," ETLA Working Papers 104, The Research Institute of the Finnish Economy.
    19. Basso, Henrique S. & Jimeno, Juan F., 2021. "From secular stagnation to robocalypse? Implications of demographic and technological changes," Journal of Monetary Economics, Elsevier, vol. 117(C), pages 833-847.
    20. Daniel Torres-Salinas & Nicolás Robinson-García & Álvaro Cabezas-Clavijo & Evaristo Jiménez-Contreras, 2014. "Analyzing the citation characteristics of books: edited books, book series and publisher types in the book citation index," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 2113-2127, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:metaar:hva4p_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/metaarxiv .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.