IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v2y2008i3p183-194.html
   My bibliography  Save this article

Measuring scientific performance of public research units for strategic change

Author

Listed:
  • Coccia, Mario

Abstract

This research presents a new metrics to measure and assess the scientific performance of public research institutes, which improves models based on standard multivariate techniques. These models called Research Lab Evaluation (RELEV) adjusted are successfully applied to Italian public research institutes, operating in five scientific fields. In addition, the paper presents a comparison between this method and the Data Envelopment Analysis to show some analogies and differences in the results.

Suggested Citation

  • Coccia, Mario, 2008. "Measuring scientific performance of public research units for strategic change," Journal of Informetrics, Elsevier, vol. 2(3), pages 183-194.
    • Handle: RePEc:eee:infome:v:2:y:2008:i:3:p:183-194
    DOI: 10.1016/j.joi.2008.04.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157708000229
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2008.04.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Grit Laudel, 2006. "The art of getting funded: How scientists adapt to their funding conditions," Science and Public Policy, Oxford University Press, vol. 33(7), pages 489-504, August.
    2. Dennis A. Gioia & Kumar Chittipeddi, 1991. "Sensemaking and sensegiving in strategic change initiation," Strategic Management Journal, Wiley Blackwell, vol. 12(6), pages 433-448, September.
    3. Alberto Silvani & Giorgio Sirilli & Fabrizio Tuzi, 2005. "R&D evaluation in Italy: more needs to be done," Research Evaluation, Oxford University Press, vol. 14(3), pages 207-215, December.
    4. Johnes, Geraint, 1992. "Performance Indicators in Higher Education: A Survey of Recent Work," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 8(2), pages 19-34, Summer.
    5. Kenneth Arrow, 1962. "Economic Welfare and the Allocation of Resources for Invention," NBER Chapters, in: The Rate and Direction of Inventive Activity: Economic and Social Factors, pages 609-626, National Bureau of Economic Research, Inc.
    6. Frank Neri & Joan R. Rodgers, 2006. "Ranking Australian Economics Departments by Research Productivity," The Economic Record, The Economic Society of Australia, vol. 82(s1), pages 74-84, September.
    7. Tommaso Agasisti & Antonio Dal Bianco, 2006. "Data envelopment analysis to the Italian university system: theoretical issues and policy implications," International Journal of Business Performance Management, Inderscience Enterprises Ltd, vol. 8(4), pages 344-367.
    8. Joan R. Rodgers & Abbas Valadkhani, 2006. "A Multidimensional Ranking of Australian Economics Departments," The Economic Record, The Economic Society of Australia, vol. 82(256), pages 30-43, March.
    9. Dino Rizzi, 2001. "L'efficienza dei dipartimenti dell'Universit? Ca' Foscari di Venezia via DEA e DFA," ECONOMIA PUBBLICA, FrancoAngeli Editore, vol. 2001(3).
    10. Mario Coccia, 2005. "A scientometric model for the assessment of scientific research performance within public institutes," Scientometrics, Springer;Akadémiai Kiadó, vol. 65(3), pages 307-321, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Young-Don Cho & Hoo-Gon Choi, 2013. "Principal parameters affecting R&D exploitation of nanotechnology research: a case for Korea," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(3), pages 881-899, September.
    2. Mario Coccia & Igor Benati, 2017. "What is the relation between public manager compensation and government effectiveness? An explorative analysis with public management implications," quaderni IRCrES 201701, CNR-IRCrES Research Institute on Sustainable Economic Growth - Moncalieri (TO) ITALY - former Institute for Economic Research on Firms and Growth - Torino (TO) ITALY.
    3. Almeida, J.A.S. & Pais, A.A.C.C. & Formosinho, S.J., 2009. "Science indicators and science patterns in Europe," Journal of Informetrics, Elsevier, vol. 3(2), pages 134-142.
    4. Sung-Shun Weng & Yang Liu & Yen-Ching Chuang, 2019. "Reform of Chinese Universities in the Context of Sustainable Development: Teacher Evaluation and Improvement Based on Hybrid Multiple Criteria Decision-Making Model," Sustainability, MDPI, vol. 11(19), pages 1-23, October.
    5. Xiong, Xi & Yang, Guo-liang & Guan, Zhong-cheng, 2020. "Estimating the multi-period efficiency of high-tech research institutes of the Chinese Academy of Sciences: A dynamic slacks-based measure," Socio-Economic Planning Sciences, Elsevier, vol. 71(C).
    6. Mario Coccia, 2018. "National debts and government deficits within European Monetary Union: Statistical evidence of economic issues," Papers 1806.07830, arXiv.org.
    7. Djuro Kutlača & Dragan Babić & Lazar Živković & Dijana Štrbac, 2015. "Analysis of quantitative and qualitative indicators of SEE countries scientific output," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 247-265, January.
    8. Bana e Costa, Carlos A. & Oliveira, Mónica D., 2012. "A multicriteria decision analysis model for faculty evaluation," Omega, Elsevier, vol. 40(4), pages 424-436.
    9. Mario Coccia, 2018. "Socioeconomic driving forces of scientific research," Papers 1806.05028, arXiv.org.
    10. Mario Coccia & Greta Falavigna & Alessandro Manello, 2015. "The impact of hybrid public and market-oriented financing mechanisms on the scientific portfolio and performances of public research labs: a scientometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 151-168, January.
    11. Mario Coccia, 2019. "Metabolism of Public Research Organizations: How Do Laboratories Consume State Subsidies?," Public Organization Review, Springer, vol. 19(4), pages 473-491, December.
    12. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    13. Igor Benati & Mario Coccia, 2017. "The relation between public manager compensation and members of parliament’s salary across OECD countries: explorative analysis and possible determinants with public policy implications," quaderni IRCrES 201702, CNR-IRCrES Research Institute on Sustainable Economic Growth - Moncalieri (TO) ITALY - former Institute for Economic Research on Firms and Growth - Torino (TO) ITALY.
    14. BERBEGAL MIRABENT, Jasmina & SOLÉ PARELLADA, Francesc, 2012. "What Are We Measuring When Evaluating Universities’ Efficiency?," Regional and Sectoral Economic Studies, Euro-American Association of Economic Development, vol. 12(3).
    15. Mario Coccia & Barry Bozeman, 2016. "Allometric models to measure and analyze the evolution of international research collaboration," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1065-1084, September.
    16. Mario Coccia, 2021. "Evolution and structure of research fields driven by crises and environmental threats: the COVID-19 research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9405-9429, December.
    17. Brandão, Luana Carneiro & Soares de Mello, João Carlos Correia Baptista, 2019. "A multi-criteria approach to the h-index," European Journal of Operational Research, Elsevier, vol. 276(1), pages 357-363.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laureti, Tiziana & Secondi, Luca & Biggeri, Luigi, 2014. "Measuring the efficiency of teaching activities in Italian universities: An information theoretic approach," Economics of Education Review, Elsevier, vol. 42(C), pages 147-164.
    2. Melika Mosleh & Saeed Roshani & Mario Coccia, 2022. "Scientific laws of research funding to support citations and diffusion of knowledge in life science," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1931-1951, April.
    3. Mario Coccia, 2018. "Socioeconomic driving forces of scientific research," Papers 1806.05028, arXiv.org.
    4. Fabel Oliver & Hein Miriam & Hofmeister Robert, 2008. "Research Productivity in Business Economics: An Investigation of Austrian, German and Swiss Universities," German Economic Review, De Gruyter, vol. 9(4), pages 506-531, December.
    5. Cristiano Antonelli & Chiara Franzoni & Aldo Geuna, 2011. "The Contributions of Economics to a Science of Science Policy," Chapters, in: Massimo G. Colombo & Luca Grilli & Lucia Piscitello & Cristina Rossi-Lamastra (ed.), Science and Innovation Policy for the New Knowledge Economy, chapter 1, Edward Elgar Publishing.
    6. Wai Ching Poon & Gareth D. Leeves, 2017. "Research output: evidence from economics departments in the Asia-Pacific region," Journal of the Asia Pacific Economy, Taylor & Francis Journals, vol. 22(4), pages 604-620, October.
    7. Nicolas Battard & Paul F. Donnelly & Vincent Mangematin, 2012. "Integration of multiple stakeholders in scientific research : A sensemaking-sensegiving approach," Post-Print hal-01514751, HAL.
    8. Angela Stefania Bergantino & Claudia Capozza & Francesco Porcelli, 2015. "Hotelling competition and teaching efficiency of Italian university faculties. A semi-parametric analysis," Working papers 26, Società Italiana di Economia Pubblica.
    9. Renato A. Villano & Carolyn‐Dung T. T. Tran, 2021. "Survey on technical efficiency in higher education: A meta‐fractional regression analysis," Pacific Economic Review, Wiley Blackwell, vol. 26(1), pages 110-135, February.
    10. David L. Anderson & John Tressler, 2009. "The Excellence in Research for Australia Scheme: An Evaluation of the Draft Journal Weights for Economics," Working Papers in Economics 09/07, University of Waikato.
    11. Mario Coccia & Greta Falavigna & Alessandro Manello, 2015. "The impact of hybrid public and market-oriented financing mechanisms on the scientific portfolio and performances of public research labs: a scientometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 151-168, January.
    12. David L. Anderson & John Tressler, 2009. "The ‘Excellence in Research for Australia’ Scheme: A Test Drive of Draft Journal Weights with New Zealand Data," Agenda - A Journal of Policy Analysis and Reform, Australian National University, College of Business and Economics, School of Economics, vol. 16(4), pages 7-24.
    13. Nicolas Battard & Paul F. Donnelly & Vincent Mangematin, 2012. "Integration of multiple stakeholders in scientific research : A sensemaking-sensegiving approach," Grenoble Ecole de Management (Post-Print) hal-01514751, HAL.
    14. Foege, J. Nils & Lauritzen, Ghita Dragsdahl & Tietze, Frank & Salge, Torsten Oliver, 2019. "Reconceptualizing the paradox of openness: How solvers navigate sharing-protecting tensions in crowdsourcing," Research Policy, Elsevier, vol. 48(6), pages 1323-1339.
    15. Mario Coccia, 2009. "Research performance and bureaucracy within public research labs," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(1), pages 93-107, April.
    16. Sakakibara, Mariko, 1997. "Evaluating government-sponsored R&D consortia in Japan: who benefits and how?," Research Policy, Elsevier, vol. 26(4-5), pages 447-473, December.
    17. Gersbach, Hans & Schneider, Maik & Schneller, Olivier, 2010. "Optimal Mix of Applied and Basic Research, Distance to Frontier, and Openness," CEPR Discussion Papers 7795, C.E.P.R. Discussion Papers.
    18. Chen, Ya & Pan, Yongbin & Liu, Haoxiang & Wu, Huaqing & Deng, Guangwei, 2023. "Efficiency analysis of Chinese universities with shared inputs: An aggregated two-stage network DEA approach," Socio-Economic Planning Sciences, Elsevier, vol. 90(C).
    19. Dirk Czarnitzki & Hanna Hottenrott & Susanne Thorwarth, 2011. "Industrial research versus development investment: the implications of financial constraints," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 35(3), pages 527-544.
    20. Ali-Yrkkö, Jyrki, 2004. "Impact of Public R&D Financing on Private R&D - Does Financial Constraint Matter?," Discussion Papers 943, The Research Institute of the Finnish Economy.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:2:y:2008:i:3:p:183-194. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.