IDEAS home Printed from https://ideas.repec.org/a/kap/jtecht/v47y2022i3d10.1007_s10961-017-9607-7.html
   My bibliography  Save this article

Evaluation and monitoring of transdisciplinary collaborations

Author

Listed:
  • Leonie Drooge

    (Rathenau Institute)

  • Jack Spaapen

    (Royal Netherlands Academy of Arts and Sciences)

Abstract

In this paper we focus on the governance, in particular evaluation and monitoring, of the growing number of transdisciplinary collaborations (TDC’s). Researchers and a variety of stakeholders collaborate in such TDC’s, the purpose of which is to address societal challenges, like renewable energy, healthy aging or better language teaching in schools. Commonly used practices for evaluation of scientific research (accountability, rankings and benchmarking, dedicated to scientific excellence) do not fit the goals of TDC’s. A bottom up or stakeholder oriented approach is better suited; one that stimulates mutual learning as well as the development of socially robust knowledge. We introduce the participatory impact pathways analysis (PIPA), as a method that suits the requirements. It has been developed in the context of development research. Two crucial features are the involvement of stakeholders from the start, and the joint development of a theory of change. This narrates what one wants to achieve and how that will be achieved. From this, stakeholders construct a logical frame that serves as a source for indicators. These indicators enable monitoring ex durante, during the TDC. We present evidence of the use of PIPA for a TDC. From this empirical evidence a number of issues with regard to evaluation, monitoring and indicators can be identified that require attention. Most prominent is the change of function of indicators. Instead of looking back and a focus on past performance, indicators look forward, in the short, intermediate and more distant future.

Suggested Citation

  • Leonie Drooge & Jack Spaapen, 2022. "Evaluation and monitoring of transdisciplinary collaborations," The Journal of Technology Transfer, Springer, vol. 47(3), pages 747-761, June.
    • Handle: RePEc:kap:jtecht:v:47:y:2022:i:3:d:10.1007_s10961-017-9607-7
    DOI: 10.1007/s10961-017-9607-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10961-017-9607-7
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s10961-017-9607-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Stefan P. L. de Jong & Jorrit Smit & Leonie van Drooge, 2016. "Scientists’ response to societal impact policies: A policy paradox," Science and Public Policy, Oxford University Press, vol. 43(1), pages 102-114.
    2. Patricia Rogers, 2014. "Theory of Change: Methodological Briefs - Impact Evaluation No. 2," Papers innpub747, Methodological Briefs.
    3. Joly, P.B. & Gaunand, A. & Colinet, L. & Larédo, P. & Lemarié, S. & Matt, M., 2015. "ASIRPA: a comprehensive theory-based approach to assessing the societal impacts of a research organization," Working Papers 2015-04, Grenoble Applied Economics Laboratory (GAEL).
    4. Jakob Edler & Stefan Kuhlmann, 2008. "Coordination within fragmentation: Governance in knowledge policy in the German federal system," Science and Public Policy, Oxford University Press, vol. 35(4), pages 265-276, May.
    5. Douthwaite, Boru & Schulz, Steffen & Olanrewaju, Adetunji S. & Ellis-Jones, Jim, 2007. "Impact pathway evaluation of an integrated Striga hermonthica control project in Northern Nigeria," Agricultural Systems, Elsevier, vol. 92(1-3), pages 201-222, January.
    6. Laurens K Hessels & Harro van Lente & Ruud Smits, 2009. "In search of relevance: The changing contract between science and society," Science and Public Policy, Oxford University Press, vol. 36(5), pages 387-401, June.
    7. Chris Freeman & Luc Soete, 1997. "The Economics of Industrial Innovation, 3rd Edition," MIT Press Books, The MIT Press, edition 3, volume 1, number 0262061953, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rosa Kuipers-Dirven & Matthijs Janssen & Jarno Hoekman, 2023. "Assessing university policies for enhancing societal impact of academic research: A multicriteria mapping approach," Research Evaluation, Oxford University Press, vol. 32(2), pages 371-383.
    2. Jorrit P Smit & Laurens K Hessels, 2021. "The production of scientific and societal value in research evaluation: a review of societal impact assessment methods [Systems Thinking, Knowledge and Action: Towards Better Models and Methods]," Research Evaluation, Oxford University Press, vol. 30(3), pages 323-335.
    3. Maru, Yiheyis Taddele & Sparrow, Ashley & Butler, James R.A. & Banerjee, Onil & Ison, Ray & Hall, Andy & Carberry, Peter, 2018. "Towards appropriate mainstreaming of “Theory of Change” approaches into agricultural research for development: Challenges and opportunities," Agricultural Systems, Elsevier, vol. 165(C), pages 344-353.
    4. repec:oup:rseval:v:32:y:2024:i:2:p:371-383. is not listed on IDEAS
    5. Foxon, T. J. & Gross, R. & Chase, A. & Howes, J. & Arnall, A. & Anderson, D., 2005. "UK innovation systems for new and renewable energy technologies: drivers, barriers and systems failures," Energy Policy, Elsevier, vol. 33(16), pages 2123-2137, November.
    6. Ziad Rotaba & Catherine Beaudry, 2012. "How Do High, Medium, And Low Tech Firms Innovate? A System Of Innovation (Si) Approach," International Journal of Innovation and Technology Management (IJITM), World Scientific Publishing Co. Pte. Ltd., vol. 9(05), pages 1-23.
    7. Cimoli, Mario & Primi, Annalisa & Rovira, Sebastián, 2011. "National innovation surveys in latin America: empirical evidence and policy implications," Documentos de Proyectos 3897, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL).
    8. Petersen, Alexander M. & Rotolo, Daniele & Leydesdorff, Loet, 2016. "A triple helix model of medical innovation: Supply, demand, and technological capabilities in terms of Medical Subject Headings," Research Policy, Elsevier, vol. 45(3), pages 666-681.
    9. José Monteiro-Barata, 2005. "Innovation in the Portuguese Manufacturing Industry: Analysis of a Longitudinal Company Panel," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 11(3), pages 301-314, August.
    10. Hoekman, Jarno & Rake, Bastian, 2024. "Geography of authorship: How geography shapes authorship attribution in big team science," Research Policy, Elsevier, vol. 53(2).
    11. Mark Knell & Simone Vannuccini, 2022. "Tools and concepts for understanding disruptive technological change after Schumpeter," Jena Economics Research Papers 2022-005, Friedrich-Schiller-University Jena.
    12. Jacek Wysocki, 2021. "Innovative Green Initiatives in the Manufacturing SME Sector in Poland," Sustainability, MDPI, vol. 13(4), pages 1-19, February.
    13. Jochen Streb, 1999. "How to Win Schumpeterian Competition: Technological Transfers in the German Plastics Industry from the 1930s to the 1970s," Working Papers 811, Economic Growth Center, Yale University.
    14. Jarunee Wonglimpiyarat, 2010. "Commercialization strategies of technology: lessons from Silicon Valley," The Journal of Technology Transfer, Springer, vol. 35(2), pages 225-236, April.
    15. Huy-Cuong Vo-Thai & Trinh-Hoang Hong-Hue & My-Linh Tran, 2021. "Technological- and Non-Technological Innovation During the Growth Phase of Industry Life Cycle: An Evidence From Vietnamese Manufacturing Enterprises," SAGE Open, , vol. 11(3), pages 21582440211, July.
    16. Marletto, Gerardo, 2011. "Structure, agency and change in the car regime. A review of the literature," European Transport \ Trasporti Europei, ISTIEE, Institute for the Study of Transport within the European Economic Integration, issue 47, pages 71-88.
    17. Gasperin, Simone, 2022. "Lessons from the past for 21st century systems of state-owned enterprises: The case of Italy's IRI in the 1930s," Structural Change and Economic Dynamics, Elsevier, vol. 62(C), pages 599-612.
    18. Stefan P L de Jong & Corina Balaban & Maria Nedeva, 2022. "From ‘productive interactions’ to ‘enabling conditions’: The role of organizations in generating societal impact of academic research [One Size Does Not Fit All! New Perspectives on the University ," Science and Public Policy, Oxford University Press, vol. 49(4), pages 643-645.
    19. Andrea Vaona, 2016. "A nonparametric panel data approach to the cyclical dynamics of price-cost margins in the fourth Kondratieff wave," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 6(2), pages 155-170, August.
    20. Kalenjyan, S. (Календжян, Сергей) & Solntsev, V.I. (Солнцев, В.И.) & Vardapetyan, V.V. (Вардапетян, В.В.) & Gumilevskaya, Olga (Гумилевская, Ольга), 2016. "The Usage of Complex Strategic Planning, Management, Implementation of the Strategy, the Cluster Approach and Innovation as a Means to Improve the Effectiveness of Regional Development [On the Example," Working Papers 2863, Russian Presidential Academy of National Economy and Public Administration.
    21. John Britton, 2002. "Regional Implications of North American Integration: A Canadian Perspective on High Technology Manufacturing," Regional Studies, Taylor & Francis Journals, vol. 36(4), pages 359-374.

    More about this item

    Keywords

    Transdisciplinary collaboration; Evaluation; Research governance; Monitoring; Stakeholders; Theory of change; PIPA;
    All these keywords.

    JEL classification:

    • O35 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Social Innovation
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:jtecht:v:47:y:2022:i:3:d:10.1007_s10961-017-9607-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.