IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v33y2009i2p159-188.html
   My bibliography  Save this article

Mapping Excellence in National Research Systems

Author

Listed:
  • Giovanni Abramo

    (Italian Research Council University of Rome Tor Vergata)

  • Ciriaco Andrea D'Angelo

    (University of Rome Tor Vergata)

  • Flavia Di Costa

    (University of Rome Tor Vergata)

Abstract

The study of “scientific excellence†is taking on increasing importance in the development of research policies in many nations. However, scientific excellence is difficult to define because of its multidimensional and highly complex character. This work contributes to the state of the art by exploring an effective, simple, and inexpensive bibliometric methodology that further identifies “excellent†centers of research by beginning with the individual researchers affiliated with such centers. The study concentrates on public research organizations in Italy, analyzing 109 scientific categories of research in the “hard†sciences and 157 centers of excellence operating in 60 of these categories. Findings from this first application of the methodology should be considered exploratory and indicative. With a longer period of observation and the addition of further measurements, this methodology could be extended and adapted to a variety of national and supranational contexts, aiding policy decisions at various levels.

Suggested Citation

  • Giovanni Abramo & Ciriaco Andrea D'Angelo & Flavia Di Costa, 2009. "Mapping Excellence in National Research Systems," Evaluation Review, , vol. 33(2), pages 159-188, April.
    • Handle: RePEc:sae:evarev:v:33:y:2009:i:2:p:159-188
    DOI: 10.1177/0193841X08322871
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X08322871
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X08322871?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. James Adams & Zvi Griliches, 1996. "Measuring Science: An Exploration," NBER Working Papers 5478, National Bureau of Economic Research, Inc.
    2. Thed N. Van Leeuwen & Martijn S. Visser & Henk F. Moed & Ton J. Nederhof & Anthony F. J. Van Raan, 2003. "The Holy Grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 57(2), pages 257-280, June.
    3. Robert J W Tijssen, 2003. "Scoreboards of research excellence," Research Evaluation, Oxford University Press, vol. 12(2), pages 91-103, August.
    4. Robert J. W. Tijssen & Martijn S. Visser & Thed N. van Leeuwen, 2002. "Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference?," Scientometrics, Springer;Akadémiai Kiadó, vol. 54(3), pages 381-397, July.
    5. Henk F. Moed, 2002. "The impact-factors debate: the ISI's uses and limits," Nature, Nature, vol. 415(6873), pages 731-732, February.
    6. Anthony F. J. van Raan, 2005. "Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 133-143, January.
    7. Thed N. van Leeuwen & Henk F. Moed, 2002. "Development and application of journal impact measures in the Dutch science system," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 249-266, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yi-Ching Liaw & Te-Yi Chan & Chin-Yuan Fan & Cheng-Hsin Chiang, 2014. "Can the technological impact of academic journals be evaluated? The practice of non-patent reference (NPR) analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 17-37, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rodríguez-Navarro, Alonso & Brito, Ricardo, 2018. "Technological research in the EU is less efficient than the world average. EU research policy risks Europeans’ future," Journal of Informetrics, Elsevier, vol. 12(3), pages 718-731.
    2. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    3. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    4. Albarrán, Pedro & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2011. "The measurement of low- and high-impact in citation distributions: Technical results," Journal of Informetrics, Elsevier, vol. 5(1), pages 48-63.
    5. Javier Ruiz-Castillo, 2012. "The evaluation of citation distributions," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 3(1), pages 291-310, March.
    6. Domingo Docampo & Lawrence Cram, 2019. "Highly cited researchers: a moving target," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1011-1025, March.
    7. Robert J. W. Tijssen & Jos J. Winnink, 2018. "Capturing ‘R&D excellence’: indicators, international statistics, and innovative universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 687-699, February.
    8. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    9. Ludo Waltman & Michael Schreiber, 2013. "On the calculation of percentile-based bibliometric indicators," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(2), pages 372-379, February.
    10. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Rankings and university performance: A conditional multidimensional approach," European Journal of Operational Research, Elsevier, vol. 244(3), pages 918-930.
    11. Bárbara S. Lancho-Barrantes & Vicente P. Guerrero-Bote & Félix Moya-Anegón, 2010. "The iceberg hypothesis revisited," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 443-461, November.
    12. Abramo, Giovanni & D’Angelo, Ciriaco Andrea, 2014. "Assessing national strengths and weaknesses in research fields," Journal of Informetrics, Elsevier, vol. 8(3), pages 766-775.
    13. Vicente P. Guerrero-Bote & Felipe Zapico-Alonso & María Eugenia Espinosa-Calvo & Rocío Gómez-Crisóstomo & Félix Moya-Anegón, 2007. "Import-export of knowledge between scientific subject categories: The iceberg hypothesis," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(3), pages 423-441, June.
    14. Pedro Albarrán & Ignacio Ortuño & Javier Ruiz-Castillo, 2011. "Average-based versus high- and low-impact indicators for the evaluation of scientific distributions," Research Evaluation, Oxford University Press, vol. 20(4), pages 325-339, October.
    15. Ruimin Ma & Chaoqun Ni & Junping Qiu, 2008. "Scientific research competitiveness of world universities in computer science," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(2), pages 245-260, August.
    16. Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
    17. Albarrán, Pedro & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2011. "High- and low-impact citation measures: Empirical applications," Journal of Informetrics, Elsevier, vol. 5(1), pages 122-145.
    18. repec:cte:werepe:11672 is not listed on IDEAS
    19. Andrea Bonaccorsi & Cinzia Daraio, 2014. "Beyond university rankings ? Generating new indicators on European universities by linking data in open platforms," DIAG Technical Reports 2014-12, Department of Computer, Control and Management Engineering, Universita' degli Studi di Roma "La Sapienza".
    20. Thed N. Van Leeuwen & Martijn S. Visser & Henk F. Moed & Ton J. Nederhof & Anthony F. J. Van Raan, 2003. "The Holy Grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 57(2), pages 257-280, June.
    21. Brito, Ricardo & Navarro, Alonso Rodríguez, 2021. "The inconsistency of h-index: A mathematical analysis," Journal of Informetrics, Elsevier, vol. 15(1).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:33:y:2009:i:2:p:159-188. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.