IDEAS home Printed from https://ideas.repec.org/p/usi/wpaper/527.html
   My bibliography  Save this paper

L’ “R-Factor”: un nuovo modo di valutare la ricerca scientifica

Author

Listed:
  • Marco p. Tucci
  • Sandra Fontani
  • Silvia Ferrini

Abstract

As pointed out in Amin e Mabe (2000, p. 1), the journal impact factor (IF) “has moved in recent years from an obscure bibliometric indicator to become the chief quantitative measure of the quality of a journal, its research papers, the researchers who wrote those papers, and even the institution they work in.” However, the use of this index for evaluating individual scientists is dubious and may “skew the course of scientific research” (Monastersky, 2005, p, 1). Moreover the IF is, at most, able to measure only the quality of a very restricted range of research activities: namely, publishing journal articles. In the present work a new indicator of a researcher quality, named the Researcher Impact Factor (RF), is introduced. It is constructed as a function of the number and quality of publications (articles, books and working papers) and of the “other activities” usually associated with being a researcher (attending and/or organizing conferences, being the Editor, Associate Editor or referee for a journal, teaching or supervising at graduate level, coordinating research groups and so on). To show the characteristics of the new index, a numerical example is carried out to rank two hypothetical scientists. The main conclusion is that by replacing the IF with the RF in hiring, tenure decisions and awarding of grants would greatly increase the number of topics investigated and the number and quality of long run projects. The Excel spreadsheet used for the computations is available on demand from the authors.

Suggested Citation

  • Marco p. Tucci & Sandra Fontani & Silvia Ferrini, 2008. "L’ “R-Factor”: un nuovo modo di valutare la ricerca scientifica," Department of Economics University of Siena 527, Department of Economics, University of Siena.
  • Handle: RePEc:usi:wpaper:527
    as

    Download full text from publisher

    File URL: http://repec.deps.unisi.it/quaderni/527.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Martin Davies & Joe Hirschberg & Jenny Lye & Carol Johnston & Ian Mcdonald, 2007. "Systematic Influences On Teaching Evaluations: The Case For Caution," Australian Economic Papers, Wiley Blackwell, vol. 46(1), pages 18-38, March.
    2. Stigler, George J & Stigler, Stephen M & Friedland, Claire, 1995. "The Journals of Economics," Journal of Political Economy, University of Chicago Press, vol. 103(2), pages 331-359, April.
    3. Maria Cristina Marcuzzo & Giulia Zacchia, 2007. "L'ECONLIT e gli strumenti per la valutazione della ricerca economica in Italia," Rivista italiana degli economisti, Società editrice il Mulino, issue 2, pages 277-306.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Silvia Ferrini & Marco P. Tucci, 2011. "Evaluating Research Activity:Impact Factor vs. Research Factor," Department of Economics University of Siena 614, Department of Economics, University of Siena.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Silvia Ferrini & Marco P. Tucci, 2011. "Evaluating Research Activity:Impact Factor vs. Research Factor," Department of Economics University of Siena 614, Department of Economics, University of Siena.
    2. Ignacio Palacios-Huerta & Oscar Volij, 2004. "The Measurement of Intellectual Influence," Econometrica, Econometric Society, vol. 72(3), pages 963-977, May.
    3. Jinyoung Kim & Kanghyock Koh, 2014. "Incentives for Journal Editors," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 47(1), pages 348-371, February.
    4. Florentin Gloetzl & Ernest Aigner, 2015. "Pluralism in the Market of Science? A citation network analysis of economic research at universities in Vienna," Ecological Economics Papers ieep5, Institute of Ecological Economics.
    5. Besancenot, Damien & Vranceanu, Radu, 2008. "Can incentives for research harm research? A business schools' tale," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 37(3), pages 1248-1265, June.
    6. Cristiano Varin & Manuela Cattelan & David Firth, 2016. "Statistical modelling of citation exchange between statistics journals," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(1), pages 1-63, January.
    7. Monacciani, Fabiana, 2010. "University departments evaluation: a multivariate approach," MPRA Paper 24224, University Library of Munich, Germany.
    8. Pierre-Philippe Combes & Laurent Linnemer, 2003. "L'impact international des articles de recherche français en économie," Revue économique, Presses de Sciences-Po, vol. 54(1), pages 181-217.
    9. Rieger, Matthias & Voorvelt, Katherine, 2016. "Gender, ethnicity and teaching evaluations: Evidence from mixed teaching teamsAuthor-Name: Wagner, Natascha," Economics of Education Review, Elsevier, vol. 54(C), pages 79-94.
    10. Wohlrabe, Klaus, 2016. "Taking the Temperature: A Meta-Ranking of Economics Journals," MPRA Paper 68933, University Library of Munich, Germany.
    11. Hargreaves Heap, Shaun P. & Parikh, Ashok, 2005. "The diffusion of ideas in the academy: A quantitative illustration from economics," Research Policy, Elsevier, vol. 34(10), pages 1619-1632, December.
    12. Bruno S. Frey, "undated". "Publishing as Prostitution? Choosing Between One�s Own Ideas and Academic Failure," IEW - Working Papers 117, Institute for Empirical Research in Economics - University of Zurich.
    13. Joe Hirschberg & Jenny Lye & Martin Davies & Carol Johnston, 2011. "Measuring Student Experience: Relationships between Teaching Quality Instruments (TQI) and Course Experience Questionnaire (CEQ)," Department of Economics - Working Papers Series 1134, The University of Melbourne.
    14. David W. Johnston & Marco Piatti & Benno Torgler, 2013. "Citation success over time: theory or empirics?," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 1023-1029, June.
    15. Carlo D’Ippoliti & Giulia Zacchia, 2017. "On the Efficiency of Italian Universities: A Comment," Italian Economic Journal: A Continuation of Rivista Italiana degli Economisti and Giornale degli Economisti, Springer;Società Italiana degli Economisti (Italian Economic Association), vol. 3(1), pages 113-123, March.
    16. Campiglio, Luigi & Caruso, Raul, 2007. "Where Economics Has Been Headed? Multiple Identities And Diversity In Economic Literature Evidence From Top Journals Over The Period 2000-2006 A First Note," MPRA Paper 4540, University Library of Munich, Germany.
    17. Robert A. Margo, 2011. "The Economic History of the American Economic Review : A Century's Explosion of Economics Research," American Economic Review, American Economic Association, vol. 101(1), pages 9-35, February.
    18. Sridhar Nerur & Abdul A. Rasheed & Alankrita Pandey, 2016. "Citation footprints on the sands of time: An analysis of idea migrations in strategic management," Strategic Management Journal, Wiley Blackwell, vol. 37(6), pages 1065-1084, June.
    19. William J. Collins, 2004. "The Political Economy of Fair Housing Laws Prior to 1968," NBER Working Papers 10610, National Bureau of Economic Research, Inc.
    20. João Ricardo Faria & Damien Besancenot & Andreas J. Novak, 2011. "Paradigm Depletion, Knowledge Production And Research Effort: Considering Thomas Kuhn'S Ideas," Metroeconomica, Wiley Blackwell, vol. 62(4), pages 587-604, November.

    More about this item

    Keywords

    Impact factor; bibliometric indices; research evaluation; researcher impact factor;
    All these keywords.

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • A12 - General Economics and Teaching - - General Economics - - - Relation of Economics to Other Disciplines

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:usi:wpaper:527. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Fabrizio Becatti (email available below). General contact details of provider: https://edirc.repec.org/data/desieit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.