IDEAS home Printed from https://ideas.repec.org/p/hig/wpaper/116sti2020.html
   My bibliography  Save this paper

How To Measure Ai: Trends, Challenges And Implications

Author

Listed:
  • Yulia Turovets

    (National Research University Higher School of Economics)

  • Konstantin Vishnevskiy

    (National Research University Higher School of Economics)

  • Artem Altynov

    (National Research University Higher School of Economics)

Abstract

How do comparable and similar indicators to measure artificial intelligence (AI) look across countries? In answering this question, our study addresses two main aims. Firstly, the paper introduces a holistic approach as operational tool to measure AI development (supply side) and adoption (demand side), which covers AI definition, AI technologies taxonomy, and a set of indicators. Secondly, the suggested methodology combines several sources of information like survey, bibliometric, and patent analysis. Next, by analyzing the results of a pilot survey and calculations, the reliability of indicators and a tentative assessment the state of the art of AI development and adoption in Russia is provided. Taking into consideration the complex nature of AI, the study represents a number of baseline parameters that give an overview of AI progress on a country level. The next step will be an elaboration of detailed indicators that at capture AI characteristics to a greater extent in different economic sectors

Suggested Citation

  • Yulia Turovets & Konstantin Vishnevskiy & Artem Altynov, 2020. "How To Measure Ai: Trends, Challenges And Implications," HSE Working papers WP BRP 116/STI/2020, National Research University Higher School of Economics.
    • Handle: RePEc:hig:wpaper:116sti2020
    as

    Download full text from publisher

    File URL: https://wp.hse.ru/data/2020/11/24/1352643519/116STI2020.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bresnahan, Timothy F. & Trajtenberg, M., 1995. "General purpose technologies 'Engines of growth'?," Journal of Econometrics, Elsevier, vol. 65(1), pages 83-108, January.
    2. Fujii, Hidemichi & Managi, Shunsuke, 2018. "Trends and priority shifts in artificial intelligence technology invention: A global patent analysis," Economic Analysis and Policy, Elsevier, vol. 58(C), pages 60-69.
    3. Chad Syverson, 2017. "Challenges to Mismeasurement Explanations for the US Productivity Slowdown," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 165-186, Spring.
    4. Philippe Aghion & Céline Antonin & Simon Bunel, 2019. "Artificial Intelligence, Growth and Employment: The Role of Policy," Economie et Statistique / Economics and Statistics, Institut National de la Statistique et des Etudes Economiques (INSEE), issue 510-511-5, pages 149-164.
    5. Dziallas, Marisa & Blind, Knut, 2019. "Innovation indicators throughout the innovation process: An extensive literature analysis," Technovation, Elsevier, vol. 80, pages 3-29.
    6. Daron Acemoglu & Pascual Restrepo, 2019. "Automation and New Tasks: How Technology Displaces and Reinstates Labor," Journal of Economic Perspectives, American Economic Association, vol. 33(2), pages 3-30, Spring.
    7. Sangsung Park & Sunghae Jun, 2020. "Patent Keyword Analysis of Disaster Artificial Intelligence Using Bayesian Network Modeling and Factor Analysis," Sustainability, MDPI, vol. 12(2), pages 1-11, January.
    8. Timothy F. Bresnahan & Erik Brynjolfsson & Lorin M. Hitt, 2002. "Information Technology, Workplace Organization, and the Demand for Skilled Labor: Firm-Level Evidence," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(1), pages 339-376.
    9. Dolores Añón Higón & Jaime Gómez & Pilar Vargas, 2017. "Complementarities in innovation strategy: do intangibles play a role in enhancing firm performance?," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 26(5), pages 865-886.
    10. James Bessen, 2019. "Automation and jobs: when technology boosts employment," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 34(100), pages 589-626.
    11. Mikhail Gershman & Galina Kitova, 2017. "Erratum to: Assessing Government Support for Research and Innovation in Russian Universities," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 8(3), pages 1085-1085, September.
    12. Xi Zhang & Xianhai Wang & Hongke Zhao & Patricia Ordóñez de Pablos & Yongqiang Sun & Hui Xiong, 2019. "An effectiveness analysis of altmetrics indices for different levels of artificial intelligence publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1311-1344, June.
    13. Cette, G. & Clerc, C. & Bresson, L., 2016. "Contribution of information and communication technologies (ICT) to growth," Rue de la Banque, Banque de France, issue 22, April..
    14. Stefano Baruffaldi & Brigitte van Beuzekom & Hélène Dernis & Dietmar Harhoff & Nandan Rao & David Rosenfeld & Mariagrazia Squicciarini, 2020. "Identifying and measuring developments in artificial intelligence: Making the impossible possible," OECD Science, Technology and Industry Working Papers 2020/05, OECD Publishing.
    15. repec:hal:spmain:info:hdl:2441/7n49nkmngd8448a5ts5gt5ade0 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Czarnitzki, Dirk & Fernández, Gastón P. & Rammer, Christian, 2023. "Artificial intelligence and firm-level productivity," Journal of Economic Behavior & Organization, Elsevier, vol. 211(C), pages 188-205.
    2. Ekaterina Prytkova, 2021. "ICT's Wide Web: a System-Level Analysis of ICT's Industrial Diffusion with Algorithmic Links," Jena Economics Research Papers 2021-005, Friedrich-Schiller-University Jena.
    3. Venturini, Francesco, 2022. "Intelligent technologies and productivity spillovers: Evidence from the Fourth Industrial Revolution," Journal of Economic Behavior & Organization, Elsevier, vol. 194(C), pages 220-243.
    4. Parteka, Aleksandra & Kordalska, Aleksandra, 2023. "Artificial intelligence and productivity: global evidence from AI patent and bibliometric data," Technovation, Elsevier, vol. 125(C).
    5. Cui, Huijie & Liang, Shangkun & Xu, Canyu & Junli, Yu, 2024. "Robots and analyst forecast precision: Evidence from Chinese manufacturing," International Review of Financial Analysis, Elsevier, vol. 94(C).
    6. Johanna Deperi & Ludovic Dibiaggio & Mohamed Keita & Lionel Nesta, 2023. "Ideas Without Scale in French Artificial Intelligence Innovations," SciencePo Working papers Main hal-04144817, HAL.
    7. Fabien Petit & Florencia Jaccoud & Tommaso Ciarli, 2023. "Heterogeneous Adjustments of Labor Markets to Automation Technologies," CESifo Working Paper Series 10237, CESifo.
    8. Heyman, Fredrik & Norbäck, Pehr-Johan & Persson, Lars, 2021. "Automation, Work and Productivity: The Role of Firm Heterogeneity," Working Paper Series 1382, Research Institute of Industrial Economics, revised 09 Mar 2023.
    9. Irene Bertschek & Joern Block & Alexander S. Kritikos & Caroline Stiel, 2024. "German financial state aid during Covid-19 pandemic: Higher impact among digitalized self-employed," Entrepreneurship & Regional Development, Taylor & Francis Journals, vol. 36(1-2), pages 76-97, January.
    10. repec:ipg:wpaper:2014-587 is not listed on IDEAS
    11. Christian Rammer & Gastón P Fernández & Dirk Czarnitzki, 2021. "Artificial Intelligence and Industrial Innovation: Evidence from Firm-Level Data," Working Papers of Department of Economics, Leuven 674605, KU Leuven, Faculty of Economics and Business (FEB), Department of Economics, Leuven.
    12. Barth, Erling & Davis, James C. & Freeman, Richard B. & McElheran, Kristina, 2023. "Twisting the demand curve: Digitalization and the older workforce," Journal of Econometrics, Elsevier, vol. 233(2), pages 443-467.
    13. Tatiana Kiseleva & Ali Palali & Bas Straathof, 2016. "Do national borders slow down knowledge diffusion within new technological fields? The case of big data in Europe," CPB Discussion Paper 330, CPB Netherlands Bureau for Economic Policy Analysis.
    14. Gambardella, Alfonso & Conti, Raffaele & Novelli, Elena, 2018. "Specializing in Generality: Firm Strategies When Intermediate Markets Work," CEPR Discussion Papers 12782, C.E.P.R. Discussion Papers.
    15. Anissa Chaibi & Adel Ben Youssef & Leila Peltier-Ben Aoun, 2015. "E-Skills, Brains And Performance Of The Firms: ICT And Ability Of Firms To Conduct Successful Projects In Luxembourg," Post-Print halshs-01068225, HAL.
    16. Sophia P. Dimelis & Sotiris K. Papaioannou, 2011. "Technical Efficiency and the Role of ICT: A Comparison of Developed and Developing Countries," Emerging Markets Finance and Trade, Taylor & Francis Journals, vol. 47(0), pages 40-53, July.
    17. Singh, Nirvikar, 2006. "Services-led industrialization in India: Assessment and lessons," MPRA Paper 1276, University Library of Munich, Germany.
    18. repec:zbw:rwimat:036 is not listed on IDEAS
    19. Sadaf Bashir & Bert Sadowski, 2014. "General Purpose Technologies: A Survey, a Critique and Future Research Directions," Working Papers 14-02, Eindhoven Center for Innovation Studies, revised Feb 2014.
    20. Oliner, Stephen D. & Sichel, Daniel E. & Stiroh, Kevin J., 2008. "Explaining a productive decade," Journal of Policy Modeling, Elsevier, vol. 30(4), pages 633-673.
    21. Montobbio, Fabio & Staccioli, Jacopo & Virgillito, Maria Enrica & Vivarelli, Marco, 2022. "Robots and the origin of their labour-saving impact," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    22. Chris Forman & Avi Goldfarb & Shane Greenstein, 2003. "How did Location Affect Adoption of the Commercial Internet? Global Village, Urban Density, and Industry Composition," NBER Working Papers 9979, National Bureau of Economic Research, Inc.

    More about this item

    Keywords

    artificial intelligence; AI definition; digital technologies; indicators; measurement.;
    All these keywords.

    JEL classification:

    • O33 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Technological Change: Choices and Consequences; Diffusion Processes
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hig:wpaper:116sti2020. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Shamil Abdulaev or Shamil Abdulaev (email available below). General contact details of provider: https://edirc.repec.org/data/hsecoru.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.