IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v100y2023ics0149718923001271.html
   My bibliography  Save this article

Creating a developmental framework for evaluating RRI implementation in research organisations

Author

Listed:
  • Kalpazidou Schmidt, Evanthia

Abstract

The evaluation of Responsible Research and Innovation (RRI) actions presents important challenges for the key stakeholders engaged in the process of RRI implementation, such as policy makers, programme managers, and researchers. While there is a considerable body of literature on the conceptualization of responsibility in research and a plethora of attempts to practice RRI, there is a need for increased attention to the monitoring and evaluation of case studies of RRI implementations in research organisations, in particular regarding their structural change effects. This paper aims to discuss a contextualised developmental framework for evaluating RRI implementation in research organisations, with a specific focus on achieving structural change through tailor-made action plans. The framework, developed through RRI evaluation work in the field of biosciences, adopts a systemic and process-oriented perspective, encompassing participatory, anticipatory, reflexive, and responsive dimensions. Concrete empirical examples from bioscience organizations are provided to illustrate how the framework relates to specific conditions, experiences, and solutions, demonstrating how conceptual insights have emerged from real-life practices and data analysis. While the framework was initially customized for the specific contexts of six bioscience research organizations, it holds potential for broader relevance and applicability in addressing challenges related to RRI design, implementation, and evaluation.

Suggested Citation

  • Kalpazidou Schmidt, Evanthia, 2023. "Creating a developmental framework for evaluating RRI implementation in research organisations," Evaluation and Program Planning, Elsevier, vol. 100(C).
    • Handle: RePEc:eee:epplan:v:100:y:2023:i:c:s0149718923001271
    DOI: 10.1016/j.evalprogplan.2023.102350
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718923001271
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2023.102350?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Palmén, Rachel & Kalpazidou Schmidt, Evanthia, 2019. "Analysing facilitating and hindering factors for implementing gender equality interventions in R&I: Structures and processes," Evaluation and Program Planning, Elsevier, vol. 77(C).
    2. Richard Owen & Phil Macnaghten & Jack Stilgoe, 2012. "Responsible research and innovation: From science in society to science for society, with society," Science and Public Policy, Oxford University Press, vol. 39(6), pages 751-760, December.
    3. Kalpazidou Schmidt, Evanthia & Graversen, Ebbe Krogh, 2020. "Developing a conceptual evaluation framework for gender equality interventions in research and innovation," Evaluation and Program Planning, Elsevier, vol. 79(C).
    4. Owen, Richard & Pansera, Mario & Macnaghten, Phil & Randles, Sally, 2021. "Organisational institutionalisation of responsible innovation," Research Policy, Elsevier, vol. 50(1).
    5. Marra, Mita, 2022. "Productive interactions in digital training partnerships: Lessons learned for regional development and university societal impact assessment," Evaluation and Program Planning, Elsevier, vol. 95(C).
    6. Stilgoe, Jack & Owen, Richard & Macnaghten, Phil, 2013. "Developing a framework for responsible innovation," Research Policy, Elsevier, vol. 42(9), pages 1568-1580.
    7. Wiarda, Martijn & van de Kaa, Geerten & Yaghmaei, Emad & Doorn, Neelke, 2021. "A comprehensive appraisal of responsible research and innovation: From roots to leaves," Technological Forecasting and Social Change, Elsevier, vol. 172(C).
    8. Evanthia Kalpazidou Schmidt & Marina Cacace, 2019. "Setting up a dynamic framework to activate gender equality structural transformation in research organizations," Science and Public Policy, Oxford University Press, vol. 46(1), pages 159-159.
    9. Jan Rotmans & Derk Loorbach, 2009. "Complexity and Transition Management," Journal of Industrial Ecology, Yale University, vol. 13(2), pages 184-196, April.
    10. Dotti, Nicola Francesco & Walczyk, Julia, 2022. "What is the societal impact of university research? A policy-oriented review to map approaches, identify monitoring methods and success factors," Evaluation and Program Planning, Elsevier, vol. 95(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. van Geenhuizen, Marina & Ye, Qing, 2014. "Responsible innovators: open networks on the way to sustainability transitions," Technological Forecasting and Social Change, Elsevier, vol. 87(C), pages 28-40.
    2. Stahl, Bernd Carsten & Brooks, Laurence & Hatzakis, Tally & Santiago, Nicole & Wright, David, 2023. "Exploring ethics and human rights in artificial intelligence – A Delphi study," Technological Forecasting and Social Change, Elsevier, vol. 191(C).
    3. Wiarda, Martijn & Sobota, Vladimir C.M. & Janssen, Matthijs J. & van de Kaa, Geerten & Yaghmaei, Emad & Doorn, Neelke, 2023. "Public participation in mission-oriented innovation projects," Technological Forecasting and Social Change, Elsevier, vol. 191(C).
    4. Paredes-Frigolett, Harold, 2016. "Modeling the effect of responsible research and innovation in quadruple helix innovation systems," Technological Forecasting and Social Change, Elsevier, vol. 110(C), pages 126-133.
    5. Llopis, Oscar & D'Este, Pablo & McKelvey, Maureen & Yegros, Alfredo, 2022. "Navigating multiple logics: Legitimacy and the quest for societal impact in science," Technovation, Elsevier, vol. 110(C).
    6. Reichelt, Nicole & Nettle, Ruth, 2023. "Practice insights for the responsible adoption of smart farming technologies using a participatory technology assessment approach: The case of virtual herding technology in Australia," Agricultural Systems, Elsevier, vol. 206(C).
    7. Genus, Audley & Iskandarova, Marfuga, 2018. "Responsible innovation: its institutionalisation and a critique," Technological Forecasting and Social Change, Elsevier, vol. 128(C), pages 1-9.
    8. Timotijevic, Lada & Khan, Shumaisa S. & Raats, Monique & Braun, Susanne, 2019. "Research priority setting in food and health domain: European stakeholder beliefs about legitimacy criteria and processes," Food Policy, Elsevier, vol. 83(C), pages 116-124.
    9. Sophie Bacq & Ruth V. Aguilera, 2022. "Stakeholder Governance for Responsible Innovation: A Theory of Value Creation, Appropriation, and Distribution," Journal of Management Studies, Wiley Blackwell, vol. 59(1), pages 29-60, January.
    10. Jakob Edler & Jan Fagerberg, 2017. "Innovation policy: what, why, and how," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 33(1), pages 2-23.
    11. Pfotenhauer, Sebastian M. & Wentland, Alexander & Ruge, Luise, 2023. "Understanding regional innovation cultures: Narratives, directionality, and conservative innovation in Bavaria," Research Policy, Elsevier, vol. 52(3).
    12. Glover, Dominic & Poole, Nigel, 2019. "Principles of innovation to build nutrition-sensitive food systems in South Asia," Food Policy, Elsevier, vol. 82(C), pages 63-73.
    13. Sara H. Wilford, 2018. "First Line Steps in Requirements Identification for Guidelines Development in Responsible Research and Innovation (RRI)," Systemic Practice and Action Research, Springer, vol. 31(5), pages 539-556, October.
    14. Kwon, Seokbeom & Liu, Xiaoyu & Porter, Alan L. & Youtie, Jan, 2019. "Research addressing emerging technological ideas has greater scientific impact," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    15. Carbajo, Ruth & Cabeza, Luisa F., 2018. "Renewable energy research and technologies through responsible research and innovation looking glass: Reflexions, theoretical approaches and contemporary discourses," Applied Energy, Elsevier, vol. 211(C), pages 792-808.
    16. Sophie Pellé & Bernard Reber, 2015. "Responsible Innovation in the Light of Moral Responsibility," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-01418017, HAL.
    17. Buhmann, Alexander & Fieseler, Christian, 2021. "Towards a deliberative framework for responsible innovation in artificial intelligence," Technology in Society, Elsevier, vol. 64(C).
    18. Fisher, Erik, 2019. "Governing with ambivalence: The tentative origins of socio-technical integration," Research Policy, Elsevier, vol. 48(5), pages 1138-1149.
    19. Snellman, Kirsi & Fink, Matthias & Hakala, Henri & Bor, Sanne, 2023. "The creation of desirable futures: A call for supererogatory management to foster sustainability transitions," Technological Forecasting and Social Change, Elsevier, vol. 196(C).
    20. Miklós Lukovics & Beáta Udvari & Nikoletta Nádas & Erik Fisher, 2019. "Raising Awareness of Researchers-in-the-Making Toward Responsible Research and Innovation," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 10(4), pages 1558-1577, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:100:y:2023:i:c:s0149718923001271. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.