IDEAS home Printed from https://ideas.repec.org/a/gam/jecomi/v12y2024i12p327-d1532424.html
   My bibliography  Save this article

Innovation Metrics: A Critical Review

Author

Listed:
  • Lyubomir Todorov

    (Department of Statistics and Applied Mathematics, Faculty of Economic Accounting, “D. A. Tsenov” Academy of Economics, 5250 Svishtov, Bulgaria)

  • Margarita Shopova

    (Department of Statistics and Applied Mathematics, Faculty of Economic Accounting, “D. A. Tsenov” Academy of Economics, 5250 Svishtov, Bulgaria)

  • Iskra Marinova Panteleeva

    (Department of Statistics and Applied Mathematics, Faculty of Economic Accounting, “D. A. Tsenov” Academy of Economics, 5250 Svishtov, Bulgaria)

  • Lyubomira Todorova

    (Department of Statistics and Applied Mathematics, Faculty of Economic Accounting, “D. A. Tsenov” Academy of Economics, 5250 Svishtov, Bulgaria)

Abstract

Innovations are complex phenomena with important impacts on firms, regions, the economy as a whole, society, and the environment. Measuring innovation is a challenging and time-consuming task with many problems ranging from the conceptual framework to data collection and interpretation. The development of the produced variety of single indicators and multidimensional metrics covers one or more innovation characteristics—inputs, stages, sources, mechanics, outputs, and impacts. While the abundance of metrics allowed measurement of many innovation aspects, it also created problems with comparability, coverage, timeliness, and reliability, making it difficult for academics, businesses and policymakers to efficiently use the information, perform correct analysis and make adequate decisions. To address this problem, this article aimed to review the literature, develop instruments for the structuring and assessment of the innovation measurements, systematize the variety of metrics, and evaluate their compliance with the requirements of users’ needs and the quality of statistical information. The literature review identified 23 innovation metrics and helped create a classification scheme with 11 attributes and a criteria checklist with seven criteria groups. The results from the application of the instrument for the identified metrics revealed that they could be divided into three groups: appropriate, needing refinement, and unsuitable, with the best ones being the European Innovation Scoreboard and Global Innovation Index. They too showed some data gaps, connected with cultural environment, sustainability, open innovations, structural changes, and regional development, thus reinforcing the necessity for further advancement of theory and methodology for innovation measurement to augment the high-quality macro-information that is readily available with firm-level qualitative data of the innovation at the place where they emerge.

Suggested Citation

  • Lyubomir Todorov & Margarita Shopova & Iskra Marinova Panteleeva & Lyubomira Todorova, 2024. "Innovation Metrics: A Critical Review," Economies, MDPI, vol. 12(12), pages 1-28, November.
  • Handle: RePEc:gam:jecomi:v:12:y:2024:i:12:p:327-:d:1532424
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7099/12/12/327/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7099/12/12/327/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rammer, Christian & Es-Sadki, Nordine, 2023. "Using big data for generating firm-level innovation indicators - a literature review," Technological Forecasting and Social Change, Elsevier, vol. 197(C).
    2. João Nuno Morais Lopes & Luís Farinha, 2018. "Measuring the Performance of Innovation and Entrepreneurship Networks," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 9(2), pages 402-423, June.
    3. Abdullah Gök & Alec Waterworth & Philip Shapira, 2015. "Use of web mining in studying innovation," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 653-671, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bottai, Carlo & Crosato, Lisa & Domenech, Josep & Guerzoni, Marco & Liberati, Caterina, 2024. "Scraping innovativeness from corporate websites: Empirical evidence on Italian manufacturing SMEs," Technological Forecasting and Social Change, Elsevier, vol. 207(C).
    2. Ashouri, Sajad & Hajikhani, Arash & Suominen, Arho & Pukelis, Lukas & Cunningham, Scott W., 2024. "Measuring digitalization at scale using web scraped data," Technological Forecasting and Social Change, Elsevier, vol. 207(C).
    3. Axenbeck, Janna & Breithaupt, Patrick, 2022. "Measuring the digitalisation of firms: A novel text mining approach," ZEW Discussion Papers 22-065, ZEW - Leibniz Centre for European Economic Research.
    4. Zhao Qu & Shanshan Zhang & Chunbo Zhang, 2017. "Patent research in the field of library and information science: Less useful or difficult to explore?," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 205-217, April.
    5. Li, Yin & Arora, Sanjay & Youtie, Jan & Shapira, Philip, 2018. "Using web mining to explore Triple Helix influences on growth in small and mid-size firms," Technovation, Elsevier, vol. 76, pages 3-14.
    6. Breithaupt, Patrick & Kesler, Reinhold & Niebel, Thomas & Rammer, Christian, 2020. "Intangible capital indicators based on web scraping of social media," ZEW Discussion Papers 20-046, ZEW - Leibniz Centre for European Economic Research.
    7. Blazquez, Desamparados & Domenech, Josep, 2018. "Big Data sources and methods for social and economic analyses," Technological Forecasting and Social Change, Elsevier, vol. 130(C), pages 99-113.
    8. Abbasiharofteh, Milad & Kriesch, Lukas, 2024. "Not all twins are identical: the digital layer of “twin” transition market applications," Papers in Innovation Studies 2024/16, Lund University, CIRCLE - Centre for Innovation Research.
    9. Roberto Camerani & Daniele Rotolo & Nicola Grassano, 2018. "Do Firms Publish? A Multi-Sectoral Analysis," SPRU Working Paper Series 2018-21, SPRU - Science Policy Research Unit, University of Sussex Business School.
    10. Jiwon Yang & Jay Hyuk Rhee, 2020. "CSR disclosure against boycotts: evidence from Korea," Asian Business & Management, Palgrave Macmillan, vol. 19(3), pages 311-343, July.
    11. Abbasiharofteh, Milad & Kinne, Jan & Krüger, Miriam, 2021. "The strength of weak and strong ties in bridging geographic and cognitive distances," ZEW Discussion Papers 21-049, ZEW - Leibniz Centre for European Economic Research.
    12. Anna Misztal & Magdalena Kowalska, 2024. "Factors of green entrepreneurship in selected emerging markets in the European Union," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 26(11), pages 28269-28292, November.
    13. Andrew Watkins & Adam McCarthy & Claire Holland & Philip Shapira, 2024. "Public biofoundries as innovation intermediaries: the integration of translation, sustainability, and responsibility," The Journal of Technology Transfer, Springer, vol. 49(4), pages 1259-1286, August.
    14. Andrés Vallone & Coro Chasco & Beatriz Sánchez, 2020. "Strategies to access web-enabled urban spatial data for socioeconomic research using R functions," Journal of Geographical Systems, Springer, vol. 22(2), pages 217-239, April.
    15. Ozcan Saritas & Pavel Bakhtin & Ilya Kuzminov & Elena Khabirova, 2021. "Big data augmentated business trend identification: the case of mobile commerce," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1553-1579, February.
    16. Dörr, Julian Oliver & Kinne, Jan & Lenz, David & Licht, Georg & Winker, Peter, 2021. "An integrated data framework for policy guidance in times of dynamic economic shocks," ZEW Discussion Papers 21-062, ZEW - Leibniz Centre for European Economic Research.
    17. Xia Tao & Stavros Sindakis & Charles Chen & Panagiotis Theodorou & Saloome Showkat, 2024. "Validation Analysis of Charitable Organizations and Media Monitoring Using an Evolutionary Model in China," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(2), pages 5539-5570, June.
    18. Occhini, Giulia & Tranos, Emmanouil & Wolf, Levi John, 2023. "Occupational segregation in the digital economy? A Natural Language Processing approach using UK Web Data," SocArXiv z8xta, Center for Open Science.
    19. Gaizka Garechana & Rosa Río-Belver & Iñaki Bildosola & Marisela Rodríguez Salvador, 2017. "Effects of innovation management system standardization on firms: evidence from text mining annual reports," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1987-1999, June.
    20. Chenxi Liu & Zhenghong Peng & Lingbo Liu & Shixuan Li, 2023. "Innovation Networks of Science and Technology Firms: Evidence from China," Land, MDPI, vol. 12(7), pages 1-21, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jecomi:v:12:y:2024:i:12:p:327-:d:1532424. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.