IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v50y2021i1s0048733320301475.html
   My bibliography  Save this article

Do synthesis centers synthesize? A semantic analysis of topical diversity in research

Author

Listed:
  • Hackett, Edward J.
  • Leahey, Erin
  • Parker, John N.
  • Rafols, Ismael
  • Hampton, Stephanie E.
  • Corte, Ugo
  • Chavarro, Diego
  • Drake, John M.
  • Penders, Bart
  • Sheble, Laura
  • Vermeulen, Niki
  • Vision, Todd J.

Abstract

Synthesis centers are a form of scientific organization that catalyzes and supports research that integrates diverse theories, methods and data across spatial or temporal scales to increase the generality, parsimony, applicability, or empirical soundness of scientific explanations. Synthesis working groups are a distinctive form of scientific collaboration that produce consequential, high-impact publications. But no one has asked if synthesis working groups synthesize: are their publications substantially more diverse than others, and if so, in what ways and with what effect? We investigate these questions by using Latent Dirichlet Analysis to compare the topical diversity of papers published by synthesis center collaborations with that of papers in a reference corpus. Topical diversity was operationalized and measured in several ways, both to reflect aggregate diversity and to emphasize particular aspects of diversity (such as variety, evenness, and balance). Synthesis center publications have greater topical variety and evenness, but less disparity, than do papers in the reference corpus. The influence of synthesis center origins on aspects of diversity is only partly mediated by the size and heterogeneity of collaborations: when taking into account the numbers of authors, distinct institutions, and references, synthesis center origins retain a significant direct effect on diversity measures. Controlling for the size and heterogeneity of collaborative groups, synthesis center origins and diversity measures significantly influence the visibility of publications, as indicated by citation measures. We conclude by suggesting social processes within collaborations that might account for the observed effects, by inviting further exploration of what this novel textual analysis approach might reveal about interdisciplinary research, and by offering some practical implications of our results.

Suggested Citation

  • Hackett, Edward J. & Leahey, Erin & Parker, John N. & Rafols, Ismael & Hampton, Stephanie E. & Corte, Ugo & Chavarro, Diego & Drake, John M. & Penders, Bart & Sheble, Laura & Vermeulen, Niki & Vision,, 2021. "Do synthesis centers synthesize? A semantic analysis of topical diversity in research," Research Policy, Elsevier, vol. 50(1).
  • Handle: RePEc:eee:respol:v:50:y:2021:i:1:s0048733320301475
    DOI: 10.1016/j.respol.2020.104069
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733320301475
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.respol.2020.104069?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Vincent Larivière & Yves Gingras, 2010. "On the relationship between interdisciplinarity and scientific impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(1), pages 126-131, January.
    2. repec:nas:journl:v:115:y:2018:p:8734-8739 is not listed on IDEAS
    3. Alan L Porter & J David Roessner & Alex S Cohen & Marty Perreault, 2006. "Interdisciplinary research: meaning, metrics and nurture," Research Evaluation, Oxford University Press, vol. 15(3), pages 187-195, December.
    4. Alexis-Michel Mugabushaka & Anthi Kyriakou & Theo Papazoglou, 2016. "Bibliometric indicators of interdisciplinarity: the potential of the Leinster–Cobbold diversity indices to study disciplinary diversity," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 593-607, May.
    5. Vincent Larivière & Yves Gingras, 2010. "On the relationship between interdisciplinarity and scientific impact," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(1), pages 126-131, January.
    6. Andy Stirling, 2007. "A General Framework for Analysing Diversity in Science, Technology and Society," SPRU Working Paper Series 156, SPRU - Science Policy Research Unit, University of Sussex Business School.
    7. Sarah Kaplan & Keyvan Vakili, 2015. "The double-edged sword of recombination in breakthrough innovation," Strategic Management Journal, Wiley Blackwell, vol. 36(10), pages 1435-1457, October.
    8. Magda Fontana & Martina Iori & Fabio Montobbio & Roberta Sinatra, 2018. "A bridge over troubled water: Interdisciplinarity, Novelty, and Impact," DISCE - Quaderni del Dipartimento di Politica Economica dipe0002, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    9. Boardman, P. Craig & Corley, Elizabeth A., 2008. "University research centers and the composition of research collaborations," Research Policy, Elsevier, vol. 37(5), pages 900-913, June.
    10. Ismael Rafols & Martin Meyer, 2010. "Diversity and network coherence as indicators of interdisciplinarity: case studies in bionanoscience," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(2), pages 263-287, February.
    11. Jian Wang & Bart Thijs & Wolfgang Glänzel, 2015. "Interdisciplinarity and Impact: Distinct Effects of Variety, Balance, and Disparity," PLOS ONE, Public Library of Science, vol. 10(5), pages 1-18, May.
    12. Kabo, Felichism W. & Cotton-Nessler, Natalie & Hwang, Yongha & Levenstein, Margaret C. & Owen-Smith, Jason, 2014. "Proximity effects on the dynamics and outcomes of scientific collaborations," Research Policy, Elsevier, vol. 43(9), pages 1469-1485.
    13. Alfredo Yegros-Yegros & Ismael Rafols & Pablo D’Este, 2015. "Does Interdisciplinary Research Lead to Higher Citation Impact? The Different Effect of Proximal and Distal Interdisciplinarity," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-21, August.
    14. Jodi E. Basner & Katrina I. Theisz & Unni S. Jensen & C. David Jones & Ilya Ponomarev & Pawel Sulima & Karen Jo & Mariam Eljanne & Michael G. Espey & Jonathan Franca-Koh & Sean E. Hanlon & Nastaran Z., 2013. "Measuring the evolution and output of cross-disciplinary collaborations within the NCI Physical Sciences--Oncology Centers Network," Research Evaluation, Oxford University Press, vol. 22(5), pages 285-297, October.
    15. Susan Biancani & Daniel A. McFarland & Linus Dahlander, 2014. "The Semiformal Organization," Organization Science, INFORMS, vol. 25(5), pages 1306-1324, October.
    16. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    17. Giovanni Abramo & Ciriaco Andrea D’Angelo & Gianluca Murgia, 2014. "Variation in research collaboration patterns across academic ranks," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 2275-2294, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. van Loon, Austin, 2022. "Three Families of Automated Text Analysis," SocArXiv htnej, Center for Open Science.
    2. Zhao, Lu-Tao & Xing, Yue-Yue & Zhao, Qiu-Rong & Chen, Xue-Hui, 2023. "Dynamic impacts of online investor sentiment on international crude oil prices," Resources Policy, Elsevier, vol. 82(C).
    3. Fontana, Magda & Iori, Martina & Leone Sciabolazza, Valerio & Souza, Daniel, 2022. "The interdisciplinarity dilemma: Public versus private interests," Research Policy, Elsevier, vol. 51(7).
    4. Giulio Giacomo Cantone, 2024. "How to measure interdisciplinary research? A systemic design for the model of measurement," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(8), pages 4937-4982, August.
    5. Yaqub, Ohid & Coburn, Josie & Moore, Duncan A.Q., 2024. "Research-targeting, spillovers, and the direction of science: Evidence from HIV research-funding," Research Policy, Elsevier, vol. 53(8).
    6. Brea, Edgar, 2024. "The yin yang of AI: Exploring how commercial and non-commercial orientations shape machine learning innovation," Research Policy, Elsevier, vol. 53(6).
    7. Wouter van de & Alfredo Yegros-Yegros & Tim Willemse & Ismael Rafols, 2023. "Priorities in research portfolios: exploring the need for upstream research in cardiometabolic and mental health," Science and Public Policy, Oxford University Press, vol. 50(6), pages 961-976.
    8. Maria Bårdsen Hesjedal & Heidrun Åm, 2023. "Making sense of transdisciplinarity: Interpreting science policy in a biotechnology centre," Science and Public Policy, Oxford University Press, vol. 50(2), pages 219-229.
    9. Qing Ke, 2023. "Interdisciplinary research and technological impact: evidence from biomedicine," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2035-2077, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Shiji & Qiu, Junping & Arsenault, Clément & Larivière, Vincent, 2021. "Exploring the interdisciplinarity patterns of highly cited papers," Journal of Informetrics, Elsevier, vol. 15(1).
    2. Giulio Giacomo Cantone, 2024. "How to measure interdisciplinary research? A systemic design for the model of measurement," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(8), pages 4937-4982, August.
    3. Alfonso Ávila-Robinson & Cristian Mejia & Shintaro Sengoku, 2021. "Are bibliometric measures consistent with scientists’ perceptions? The case of interdisciplinarity in research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7477-7502, September.
    4. Qing Ke, 2023. "Interdisciplinary research and technological impact: evidence from biomedicine," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2035-2077, April.
    5. Shiji Chen & Yanhui Song & Fei Shu & Vincent Larivière, 2022. "Interdisciplinarity and impact: the effects of the citation time window," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2621-2642, May.
    6. Wolfgang Glänzel & Koenraad Debackere, 2022. "Various aspects of interdisciplinarity in research and how to quantify and measure those," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(9), pages 5551-5569, September.
    7. Erin Leahey & Sondra N. Barringer & Misty Ring-Ramirez, 2019. "Universities’ structural commitment to interdisciplinary research," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 891-919, March.
    8. Shiji Chen & Kaiqi Zhang & Junping Qiu & Jiaqi Chai, 2024. "Interdisciplinarity and expert rating: an analysis based on faculty opinions," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(11), pages 6597-6628, November.
    9. Xin Liu & Yi Bu & Ming Li & Jiang Li, 2024. "Monodisciplinary collaboration disrupts science more than multidisciplinary collaboration," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 75(1), pages 59-78, January.
    10. Hongyu Zhou & Raf Guns & Tim C. E. Engels, 2022. "Are social sciences becoming more interdisciplinary? Evidence from publications 1960–2014," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(9), pages 1201-1221, September.
    11. Chen, Shiji & Arsenault, Clément & Larivière, Vincent, 2015. "Are top-cited papers more interdisciplinary?," Journal of Informetrics, Elsevier, vol. 9(4), pages 1034-1046.
    12. Kwon, Seokbeom, 2022. "Interdisciplinary knowledge integration as a unique knowledge source for technology development and the role of funding allocation," Technological Forecasting and Social Change, Elsevier, vol. 181(C).
    13. Lina Xu & Steven Dellaportas & Jin Wang, 2022. "A study of interdisciplinary accounting research: analysing the diversity of cited references," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 62(2), pages 2131-2162, June.
    14. Fei Shu & Jesse David Dinneen & Shiji Chen, 2022. "Measuring the disparity among scientific disciplines using Library of Congress Subject Headings," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3613-3628, June.
    15. Lin Zhang & Beibei Sun & Zaida Chinchilla-Rodríguez & Lixin Chen & Ying Huang, 2018. "Interdisciplinarity and collaboration: on the relationship between disciplinary diversity in departmental affiliations and reference lists," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 271-291, October.
    16. Seolmin Yang & So Young Kim, 2023. "Knowledge-integrated research is more disruptive when supported by homogeneous funding sources: a case of US federally funded research in biomedical and life sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3257-3282, June.
    17. Hou, Jianhua & Li, Hao & Zhang, Yang, 2024. "Influence of interdisciplinarity of scientific papers on the durability of citation diffusion: A perspective from citation discontinuance," Journal of Informetrics, Elsevier, vol. 18(3).
    18. Núria Bautista-Puig & Jorge Mañana-Rodríguez & Antonio Eleazar Serrano-López, 2021. "Role taxonomy of green and sustainable science and technology journals: exportation, importation, specialization and interdisciplinarity," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 3871-3892, May.
    19. D’Este, Pablo & Robinson-García, Nicolás, 2023. "Interdisciplinary research and the societal visibility of science: The advantages of spanning multiple and distant scientific fields," Research Policy, Elsevier, vol. 52(2).
    20. Magda Fontana & Martina Iori & Fabio Montobbio & Roberta Sinatra, 2018. "A bridge over troubled water: Interdisciplinarity, Novelty, and Impact," DISCE - Quaderni del Dipartimento di Politica Economica dipe0002, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:50:y:2021:i:1:s0048733320301475. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.