IDEAS home Printed from https://ideas.repec.org/a/eee/teinso/v66y2021ics0160791x2100049x.html
   My bibliography  Save this article

A methodology for identifying results and impacts in technological innovation projects

Author

Listed:
  • de Almeida, Liliane
  • Augusto de Jesus Pacheco, Diego
  • Caten, Carla Schwengber ten
  • Jung, Carlos Fernando

Abstract

As investments in policies and projects in science, technology, and innovation (STI) grow, it becomes increasingly important to determine the benefits society receives in return for the public resources thus invested. However, existing methodologies are somewhat limited in scope as they do not possess mechanisms for correctly identifying non-measurable, indirect results and impacts. This study addresses these knowledge shortcomings, and it proposes and validates an alternative method to identify the social, environmental, and economic outcomes and indirect impacts of STI projects. Findings indicate that the proposed method helps fills the gaps in knowledge about ex-post methodologies used to evaluate indirect results and impacts in STI projects. One aspect that sets the proposed method apart from the existing approaches is that it contemplates a wide range of analytical categories of indirect impacts for assessing the effects of STI projects. The principal academic and practical contribution of this study is the development of an accessible artifact that can identify the results and indirect impacts of projects in diverse areas of STI. The study extends the understanding on the methodologies to identifying results and indirect impacts of STI projects.

Suggested Citation

  • de Almeida, Liliane & Augusto de Jesus Pacheco, Diego & Caten, Carla Schwengber ten & Jung, Carlos Fernando, 2021. "A methodology for identifying results and impacts in technological innovation projects," Technology in Society, Elsevier, vol. 66(C).
    • Handle: RePEc:eee:teinso:v:66:y:2021:i:c:s0160791x2100049x
    DOI: 10.1016/j.techsoc.2021.101574
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160791X2100049X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.techsoc.2021.101574?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fox, Stephen & Griffy-Brown, Charla & Dabic, Marina, 2020. "From socio-technical systems to biosocial technical systems: New themes and new guidance for the field of technology in society," Technology in Society, Elsevier, vol. 62(C).
    2. Salter, Ammon J. & Martin, Ben R., 2001. "The economic benefits of publicly funded basic research: a critical review," Research Policy, Elsevier, vol. 30(3), pages 509-532, March.
    3. David Güemes‐Castorena & Idalia E. Ponce‐Jaramillo, 2019. "University–Industry Linkage Framework to Identify Opportunity Areas," Review of Policy Research, Policy Studies Organization, vol. 36(5), pages 660-682, September.
    4. Gretchen B Jordan, 2010. "A theory-based logic model for innovation policy and evaluation," Research Evaluation, Oxford University Press, vol. 19(4), pages 263-273, October.
    5. Channing Arndt & Karl Pauw & James Thurlow, 2016. "The Economy-wide Impacts and Risks of Malawi's Farm Input Subsidy Program," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 98(3), pages 962-980.
    6. Kwayu, Emmanuel J. & Paavola, Jouni & Sallu, Susannah M., 2017. "The livelihood impacts of the Equitable Payments for Watershed Services (EPWS) Program in Morogoro, Tanzania," Environment and Development Economics, Cambridge University Press, vol. 22(3), pages 328-349, June.
    7. Davoudabadi, Reza & Mousavi, Seyed Meysam & Mohagheghi, Vahid, 2021. "A new decision model based on DEA and simulation to evaluate renewable energy projects under interval-valued intuitionistic fuzzy uncertainty," Renewable Energy, Elsevier, vol. 164(C), pages 1588-1601.
    8. André Tosi Furtado & Edmilson Jesus Costa Filho, 2003. "Assessing the economic impacts of the China-Brazil resources satellite program," Science and Public Policy, Oxford University Press, vol. 30(1), pages 25-39, February.
    9. Beegle, Kathleen & Galasso, Emanuela & Goldberg, Jessica, 2017. "Direct and indirect effects of Malawi's public works program on food security," Journal of Development Economics, Elsevier, vol. 128(C), pages 1-23.
    10. Martin Ravallion, 2009. "Evaluation in the Practice of Development," The World Bank Research Observer, World Bank, vol. 24(1), pages 29-53, March.
    11. Montmartin, Benjamin & Herrera, Marcos, 2015. "Internal and external effects of R&D subsidies and fiscal incentives: Empirical evidence using spatial dynamic panel models," Research Policy, Elsevier, vol. 44(5), pages 1065-1079.
    12. Ma, Ding & Yu, Qian & Li, Jing & Ge, Mengni, 2021. "Innovation diffusion enabler or barrier: An investigation of international patenting based on temporal exponential random graph models," Technology in Society, Elsevier, vol. 64(C).
    13. Freeman, Chris, 1995. "The 'National System of Innovation' in Historical Perspective," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 19(1), pages 5-24, February.
    14. Rau, Henrike & Goggins, Gary & Fahy, Frances, 2018. "From invisibility to impact: Recognising the scientific and societal relevance of interdisciplinary sustainability research," Research Policy, Elsevier, vol. 47(1), pages 266-276.
    15. Junichi Nishimura & Hiroyuki Okamuro, 2016. "Knowledge and rent spillovers through government-sponsored R&D consortia," Science and Public Policy, Oxford University Press, vol. 43(2), pages 207-225.
    16. De Moortel, Kevin & Crispeels, Thomas, 2018. "International university-university technology transfer: Strategic management framework," Technological Forecasting and Social Change, Elsevier, vol. 135(C), pages 145-155.
    17. Bozeman, Barry & Rimes, Heather & Youtie, Jan, 2015. "The evolving state-of-the-art in technology transfer research: Revisiting the contingent effectiveness model," Research Policy, Elsevier, vol. 44(1), pages 34-49.
    18. Graeme Auld, 2018. "Over a Decade of Scholarship on the Politics and Policy of Science and Technology," Review of Policy Research, Policy Studies Organization, vol. 35(1), pages 4-11, January.
    19. Mario Coccia, 2008. "Spatial mobility of knowledge transfer and absorptive capacity: analysis and measurement of the impact within the geoeconomic space," The Journal of Technology Transfer, Springer, vol. 33(1), pages 105-122, February.
    20. Federico Stezano, 2018. "The Role of Technology Centers as Intermediary Organizations Facilitating Links for Innovation: Four Cases of Federal Technology Centers in Mexico," Review of Policy Research, Policy Studies Organization, vol. 35(4), pages 642-666, July.
    21. Huergo, Elena & Moreno, Lourdes, 2017. "Subsidies or loans? Evaluating the impact of R&D support programmes," Research Policy, Elsevier, vol. 46(7), pages 1198-1214.
    22. Laurie E. Adkin, 2019. "Technology Innovation as a Response to Climate Change: The Case of the Climate Change Emissions Management Corporation of Alberta," Review of Policy Research, Policy Studies Organization, vol. 36(5), pages 603-634, September.
    23. Chen, Zhenhua & Daito, Nobuhiko & Gifford, Jonathan L., 2017. "Socioeconomic impacts of transportation public-private partnerships: A dynamic CGE assessment," Transport Policy, Elsevier, vol. 58(C), pages 80-87.
    24. Coccia, Mario, 2019. "Why do nations produce science advances and new technology?," Technology in Society, Elsevier, vol. 59(C).
    25. Bozeman, Barry & Youtie, Jan, 2017. "Socio-economic impacts and public value of government-funded research: Lessons from four US National Science Foundation initiatives," Research Policy, Elsevier, vol. 46(8), pages 1387-1398.
    26. Ivanova, Inga & Strand, Øivind & Kushnir, Duncan & Leydesdorff, Loet, 2017. "Economic and technological complexity: A model study of indicators of knowledge-based innovation systems," Technological Forecasting and Social Change, Elsevier, vol. 120(C), pages 77-89.
    27. Youwen Zhong & Xiaoling Wu, 2020. "Effects of cost-benefit analysis under back propagation neural network on financial benefit evaluation of investment projects," PLOS ONE, Public Library of Science, vol. 15(3), pages 1-15, March.
    28. Ernst, Anna & Biß, Klaus H. & Shamon, Hawal & Schumann, Diana & Heinrichs, Heidi U., 2018. "Benefits and challenges of participatory methods in qualitative energy scenario development," Technological Forecasting and Social Change, Elsevier, vol. 127(C), pages 245-257.
    29. Gordon Kingsley & Julia Melkers, 1999. "Value mapping social capital outcomes in state research and development programs," Research Evaluation, Oxford University Press, vol. 8(3), pages 165-175, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ferreira, Paula & Rocha, Ana & Araujo, Madalena & Afonso, Joao L. & Antunes, Carlos Henggeler & Lopes, Marta A.R. & Osório, Gerardo J. & Catalão, João P.S. & Lopes, João Peças, 2023. "Assessing the societal impact of smart grids: Outcomes of a collaborative research project," Technology in Society, Elsevier, vol. 72(C).
    2. Allers, Sanne & Eijkenaar, Frank & van Raaij, Erik M. & Schut, Frederik T., 2023. "The long and winding road towards payment for healthcare innovation with high societal value but limited commercial value: A comparative case study of devices and health information technologies," Technology in Society, Elsevier, vol. 75(C).
    3. Wang, Lei & Chen, Yangyang & Ramsey, Thomas Stephen & Hewings, Geoffrey J.D., 2021. "Will researching digital technology really empower green development?," Technology in Society, Elsevier, vol. 66(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thomas H. W. Ziesemer, 2021. "The Effects of R&D Subsidies and Publicly Performed R&D on Business R&D: A Survey," Hacienda Pública Española / Review of Public Economics, IEF, vol. 236(1), pages 171-205, March.
    2. Montmartin, Benjamin & Herrera, Marcos & Massard, Nadine, 2018. "The impact of the French policy mix on business R&D: How geography matters," Research Policy, Elsevier, vol. 47(10), pages 2010-2027.
    3. Hoppmann, Joern, 2021. "Hand in hand to Nowhereland? How the resource dependence of research institutes influences their co-evolution with industry," Research Policy, Elsevier, vol. 50(2).
    4. Gao, Kang & Yuan, Yijun, 2022. "Government intervention, spillover effect and urban innovation performance: Empirical evidence from national innovative city pilot policy in China," Technology in Society, Elsevier, vol. 70(C).
    5. Benjamin Montmartin & Marcos Herrera & Nadine Massard, 2017. "R&D policy regimes in France: New evidence from a spatio-temporal analysis," Working Papers hal-01559041, HAL.
    6. Van Elk, Roel & Verspagen, Bart & Ter Weel, Bas & Van der Wiel, Karen & Wouterse, Bram, 2015. "A macroeconomic analysis of the returns to public R&D investments," MERIT Working Papers 2015-042, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    7. repec:hal:spmain:info:hdl:2441/7rrsl07p559bjr85tr7hsft1o9 is not listed on IDEAS
    8. Huseyin Emre Sayici & Mehmet Fatih Ulu, 2023. "Economic Effects of R&D Supports," Koç University-TUSIAD Economic Research Forum Working Papers 2308, Koc University-TUSIAD Economic Research Forum.
    9. Weidong Meng & Ye Wang & Yuyu Li & Bo Huang, 2020. "Impact of product subsidies on R&D investment for new energy vehicle firms: Considering quality preference of the early adopter group," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-14, July.
    10. Joao J. M. Ferreira & Cristina Fernandes & Vanessa Ratten, 2019. "The effects of technology transfers and institutional factors on economic growth: evidence from Europe and Oceania," The Journal of Technology Transfer, Springer, vol. 44(5), pages 1505-1528, October.
    11. Bai, Xue-Jie & Li, Zhen-Yang & Zeng, Jin, 2020. "Performance evaluation of China's innovation during the industry-university-research collaboration process—an analysis basis on the dynamic network slacks-based measurement model," Technology in Society, Elsevier, vol. 62(C).
    12. repec:spo:wpmain:info:hdl:2441/7rrsl07p559bjr85tr7hsft1o9 is not listed on IDEAS
    13. TIAN, Xiaoli & KOU, Gang & ZHANG, Weike, 2020. "Geographic distance, venture capital and technological performance: Evidence from Chinese enterprises," Technological Forecasting and Social Change, Elsevier, vol. 158(C).
    14. James Cunningham & Paul O'Reilly, 2019. "Roles and Responsibilities of Project Coordinators: A Contingency Model for Project Coordinator Effectiveness," JRC Research Reports JRC117576, Joint Research Centre.
    15. Reed, M.S. & Ferré, M. & Martin-Ortega, J. & Blanche, R. & Lawford-Rolfe, R. & Dallimer, M. & Holden, J., 2021. "Evaluating impact from research: A methodological framework," Research Policy, Elsevier, vol. 50(4).
    16. Hongchen Li & Huijun Qi & Hongjian Cao & Li Yuan, 2022. "Industrial Policy and Technological Innovation of New Energy Vehicle Industry in China," Energies, MDPI, vol. 15(24), pages 1-17, December.
    17. Viktorie Klímová & Vladimír Žítek & Maria Králová, 2020. "How Public R&D Support Affects Research Activity of Enterprises: Evidence from the Czech Republic," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 11(3), pages 888-907, September.
    18. René Belderbos & Nazareno Braito & Jian Wang, 2024. "Heterogeneous university research and firm R&D location decisions: research orientation, academic quality, and investment type," The Journal of Technology Transfer, Springer, vol. 49(5), pages 1959-1989, October.
    19. Van Elk, Roel & Verspagen, Bart & Ter Weel, Bas & Van der Wiel, Karen & Wouterse, Bram, 2015. "A macroeconomic analysis of the returns to public R&D investments," MERIT Working Papers 2015-042, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    20. Yongli Tang & Kazuyuki Motohashi & Xinyue Hu & Angeles Montoro-Sanchez, 2020. "University-industry interaction and product innovation performance of Guangdong manufacturing firms: the roles of regional proximity and research quality of universities," The Journal of Technology Transfer, Springer, vol. 45(2), pages 578-618, April.
    21. Kou, Mingting & Yang, Yuanqi & Chen, Kaihua, 2020. "The impact of external R&D financing on innovation process from a supply-demand perspective," Economic Modelling, Elsevier, vol. 92(C), pages 375-387.
    22. Rossi, Federica & De Silva, Muthu & Pavone, Pasquale & Rosli, Ainurul & Yip, Nick K.T., 2024. "Proximity and impact of university-industry collaborations. A topic detection analysis of impact reports," Technological Forecasting and Social Change, Elsevier, vol. 205(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:teinso:v:66:y:2021:i:c:s0160791x2100049x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/technology-in-society .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.