IDEAS home Printed from https://ideas.repec.org/a/oup/rseval/v32y2023i3p577-590..html
   My bibliography  Save this article

Evaluating transformative innovation policy in a formative way: Insights from Vinnova’s food mission experiment

Author

Listed:
  • Alejandra Boni
  • Diana Velasco
  • Jordi Molas-Gallart
  • Johan Schot

Abstract

This article presents the insights from an evaluation of a transformative policy experiment, in the food domain, conducted at the Swedish Agency of Innovation (Vinnova). To be consistent with the principles and objectives of these policies, it was necessary to implement a formative evaluation approach developed in the Transformative Innovation Policy Consortium (TIPC), that is supportive of experimental policies designed for highly complex and uncertain environments. The article presents the main characteristics of this approach and its differences and similarities with other proposals to assess transformative innovation policies. Next, the article describes how the evaluation was conducted in Vinnova during a 2-year engagement. Subsequently, the main insights gleaned from the process are highlighted in terms of (1) understanding the expectations of actors; (2) what has been learned by doing, from a technical and organizational point of view; and (3) the constraints that emerged during the engagement. It is then argued that the TIPC- formative evaluation approach challenges the role of evaluators, stretching them, and requires different attitudes from those that are common in evaluation practice.

Suggested Citation

  • Alejandra Boni & Diana Velasco & Jordi Molas-Gallart & Johan Schot, 2023. "Evaluating transformative innovation policy in a formative way: Insights from Vinnova’s food mission experiment," Research Evaluation, Oxford University Press, vol. 32(3), pages 577-590.
    • Handle: RePEc:oup:rseval:v:32:y:2023:i:3:p:577-590.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/reseval/rvad029
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jordi Molas-Gallart & Alejandra Boni & Sandro Giachi & Johan Schot, 2021. "A formative approach to the evaluation of Transformative Innovation Policies [The Need for Reflexive Evaluation Approaches in Development Cooperation]," Research Evaluation, Oxford University Press, vol. 30(4), pages 431-442.
    2. Wise, Emily & Arnold, Erik, 2022. "Evaluating Transformation – what can we learn from the literature?," Papers in Innovation Studies 2022/10, Lund University, CIRCLE - Centre for Innovation Research.
    3. Mireille Matt & Douglas Robinson & Pierre-Benoît Joly & Renée van Dis & Laurence Colinet, 2023. "ASIRPAReal-Time in the making or how to empower researchers to steer research towards desired societal goals," Post-Print hal-04158368, HAL.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:oup:rseval:v:32:y:2024:i:3:p:577-590. is not listed on IDEAS
    2. Rosa Kuipers-Dirven & Matthijs Janssen & Jarno Hoekman, 2023. "Assessing university policies for enhancing societal impact of academic research: A multicriteria mapping approach," Research Evaluation, Oxford University Press, vol. 32(2), pages 371-383.
    3. repec:oup:rseval:v:32:y:2024:i:2:p:286-298. is not listed on IDEAS
    4. Santos, Anabela M. & Coad, Alex, 2023. "Monitoring and evaluation of transformative innovation policy: Suggestions for Improvement," Socio-Economic Planning Sciences, Elsevier, vol. 90(C).
    5. Wouter van de & Alfredo Yegros-Yegros & Tim Willemse & Ismael Rafols, 2023. "Priorities in research portfolios: exploring the need for upstream research in cardiometabolic and mental health," Science and Public Policy, Oxford University Press, vol. 50(6), pages 961-976.
    6. repec:oup:rseval:v:32:y:2024:i:2:p:171-187. is not listed on IDEAS
    7. Haddad, Carolina R. & Bergek, Anna, 2023. "Towards an integrated framework for evaluating transformative innovation policy," Research Policy, Elsevier, vol. 52(2).
    8. Essén, Anna & Wennberg, Karl & Krohwinkel, Anna, 2022. "Assessing Whether Mission-Driven Innovation Makes a Difference: Mission Impossible? Developing a Guiding Framework for the Evaluation of Five Mission Driven Environments for Health in Sweden," SSE Working Paper Series in Business Administration 2022:2, Stockholm School of Economics.
    9. Harald Rohracher & Lars Coenen & Olga Kordas, 2023. "Mission incomplete: Layered practices of monitoring and evaluation in Swedish transformative innovation policy," Science and Public Policy, Oxford University Press, vol. 50(2), pages 336-349.
    10. repec:oup:rseval:v:32:y:2024:i:2:p:371-383. is not listed on IDEAS
    11. Paula Kivimaa & Jani Lukkarinen & David Lazarevic, 2023. "Analysis of COVID-19 recovery and resilience policy in Finland: a transformative policy mix approach," Science and Public Policy, Oxford University Press, vol. 50(4), pages 681-694.
    12. Peter Meister & Elisabeth A M & Lummina G, 2023. "Evaluating co-creation in social innovation projects: Towards a process orientated framework for EU projects and beyond," Research Evaluation, Oxford University Press, vol. 32(2), pages 286-298.
    13. Víctor Gómez-Valenzuela, 2023. "Stated preference methods and STI policy studies: a foreground approach," Research Evaluation, Oxford University Press, vol. 32(2), pages 171-187.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:rseval:v:32:y:2023:i:3:p:577-590.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/rev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.