IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v88y2011i1d10.1007_s11192-011-0375-0.html
   My bibliography  Save this article

On measuring scholarly influence by citations

Author

Listed:
  • Martin Ravallion

    (World Bank)

  • Adam Wagstaff

    (World Bank)

Abstract

Bibliometric measures based on citations are widely used in assessing the scientific publication records of authors, institutions and journals. Yet currently favored measures lack a clear theoretical foundation and are known to have counter-intuitive properties. The paper proposes a new approach that is grounded on a theoretical “influence function,” representing explicit prior beliefs about how citations reflect influence. Conditions are derived for robust qualitative comparisons of influence—conditions that can be implemented using readily-available data. Two examples are provided, one using the world’s top-10 economics department, the other using the top-10 economics journals.

Suggested Citation

  • Martin Ravallion & Adam Wagstaff, 2011. "On measuring scholarly influence by citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(1), pages 321-337, July.
    • Handle: RePEc:spr:scient:v:88:y:2011:i:1:d:10.1007_s11192-011-0375-0
    DOI: 10.1007/s11192-011-0375-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-011-0375-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-011-0375-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Atkinson, A B, 1987. "On the Measurement of Poverty," Econometrica, Econometric Society, vol. 55(4), pages 749-764, July.
    2. Hadar, Josef & Russell, William R., 1971. "Stochastic dominance and diversification," Journal of Economic Theory, Elsevier, vol. 3(3), pages 288-305, September.
    3. Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision‐Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, February.
    4. Woeginger, Gerhard J., 2008. "An axiomatic characterization of the Hirsch-index," Mathematical Social Sciences, Elsevier, vol. 56(2), pages 224-232, September.
    5. Kristie M. Engemann & Howard J. Wall, 2009. "A journal ranking for the ambitious economist," Review, Federal Reserve Bank of St. Louis, vol. 91(May), pages 127-140.
    6. Atkinson, Anthony B., 1970. "On the measurement of inequality," Journal of Economic Theory, Elsevier, vol. 2(3), pages 244-263, September.
    7. Leo Egghe, 2006. "Theory and practise of the g-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 131-152, October.
    8. Woeginger, Gerhard J., 2008. "An axiomatic analysis of Egghe’s g-index," Journal of Informetrics, Elsevier, vol. 2(4), pages 364-368.
    9. Dasgupta, Partha & Sen, Amartya & Starrett, David, 1973. "Notes on the measurement of inequality," Journal of Economic Theory, Elsevier, vol. 6(2), pages 180-187, April.
    10. Shorrocks, Anthony F, 1983. "Ranking Income Distributions," Economica, London School of Economics and Political Science, vol. 50(197), pages 3-17, February.
    11. Sen, Amartya, 1973. "On Economic Inequality," OUP Catalogue, Oxford University Press, number 9780198281931.
    12. Alonso, S. & Cabrerizo, F.J. & Herrera-Viedma, E. & Herrera, F., 2009. "h-Index: A review focused in its variants, computation and standardization for different scientific fields," Journal of Informetrics, Elsevier, vol. 3(4), pages 273-289.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Waltman, Ludo & van Eck, Nees Jan & Wouters, Paul, 2013. "Counting publications and citations: Is more always better?," Journal of Informetrics, Elsevier, vol. 7(3), pages 635-641.
    2. David L. Anderson & John Tressler, 2013. "The Relevance of the “h-” and “g-” Index to Economics in the Context of A Nation-Wide Research Evaluation Scheme: The New Zealand Case," Economic Papers, The Economic Society of Australia, vol. 32(1), pages 81-94, March.
    3. Giovanni Abramo & Ciriaco Andrea D’Angelo & Fulvio Viel, 2013. "The suitability of h and g indexes for measuring the research performance of institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 555-570, December.
    4. Neus Herranz & Javier Ruiz-Castillo, 2013. "The end of the “European Paradox”," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 453-464, April.
    5. L'aszl'o Csat'o & D'ora Gr'eta Petr'oczy, 2020. "Bibliometric indices as a measure of performance and competitive balance in the knockout stage of the UEFA Champions League," Papers 2005.13416, arXiv.org, revised Sep 2023.
    6. Kuan, Chung-Huei & Huang, Mu-Hsuan & Chen, Dar-Zen, 2013. "Cross-field evaluation of publications of research institutes using their contributions to the fields’ MVPs determined by h-index," Journal of Informetrics, Elsevier, vol. 7(2), pages 455-468.
    7. Schreiber, Michael, 2013. "A case study of the arbitrariness of the h-index and the highly-cited-publications indicator," Journal of Informetrics, Elsevier, vol. 7(2), pages 379-387.
    8. Bouyssou, Denis & Marchant, Thierry, 2014. "An axiomatic approach to bibliometric rankings and indices," Journal of Informetrics, Elsevier, vol. 8(3), pages 449-477.
    9. Martin Ravallion & Adam Wagstaff, 2012. "The World Bank’s publication record," The Review of International Organizations, Springer, vol. 7(4), pages 343-368, December.
    10. Antonio Abatemarco & Roberto Dell’Anno, 2013. "Certainty equivalent citation: generalized classes of citation indexes," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 263-271, January.
    11. Aurora A. C. Teixeira, 2011. "Mapping the (in)visible college(s) in the field of entrepreneurship," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(1), pages 1-36, October.
    12. David Anderson & John Tressler, 2018. "The Impact of Citation Timing: A Framework and Examples," Review of Economics and Institutions, Università di Perugia, vol. 9(2).
    13. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    14. Wagstaff, Adam & Culyer, Anthony J., 2012. "Four decades of health economics through a bibliometric lens," Journal of Health Economics, Elsevier, vol. 31(2), pages 406-439.
    15. Christopher Carroll, 2016. "Measuring academic research impact: creating a citation profile using the conceptual framework for implementation fidelity as a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1329-1340, November.
    16. Schreiber, Michael, 2013. "How to derive an advantage from the arbitrariness of the g-index," Journal of Informetrics, Elsevier, vol. 7(2), pages 555-561.
    17. Shengbo Liu & Xiaoting Luo & Miaomiao Liu, 2023. "Was Chinese “Double-First Class” Construction Policy Influential? Analysis Using Propensity Score Matching," Sustainability, MDPI, vol. 15(8), pages 1-13, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jean‐Yves Duclos & Paul Makdissi, 2004. "Restricted and Unrestricted Dominance for Welfare, Inequality, and Poverty Orderings," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 6(1), pages 145-164, February.
    2. Gian Maria Tomat, 2014. "Revisiting poverty and welfare dominance," ECONOMIA PUBBLICA, FrancoAngeli Editore, vol. 2014(2), pages 125-149.
    3. Louis Kaplow, 2005. "Why measure inequality?," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 3(1), pages 65-79, April.
    4. Bouyssou, Denis & Marchant, Thierry, 2014. "An axiomatic approach to bibliometric rankings and indices," Journal of Informetrics, Elsevier, vol. 8(3), pages 449-477.
    5. Makdissi, Paul & Groleau, Yves, 2002. "Que pouvons-nous apprendre des profils de pauvreté canadiens?," L'Actualité Economique, Société Canadienne de Science Economique, vol. 78(2), pages 257-286, Juin.
    6. Daniel Sotelsek-Salem & Ismael Ahamdanech-Zarco & John Bishop, 2012. "Dominance testing for ‘pro-poor’ growth with an application to European growth," Empirical Economics, Springer, vol. 43(2), pages 723-739, October.
    7. Jean-Yves Duclos & Paul Makdissi, 2000. "Restricted and Unrestricted Dominance Welfare, Inequality and Povery Orderings," Cahiers de recherche 00-01, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    8. Carbonell-Nicolau, Oriol & Llavador, Humberto, 2018. "Inequality reducing properties of progressive income tax schedules: the case of endogenous income," Theoretical Economics, Econometric Society, vol. 13(1), January.
    9. John P. Formby & Steven G. Medema & W. James Smith, 1995. "Tax Neutrality and Social Welfare in a Comptutational General Equilibrium Framework," Public Finance Review, , vol. 23(4), pages 419-447, October.
    10. Morton, Alec, 2014. "Aversion to health inequalities in healthcare prioritisation: A multicriteria optimisation perspective," Journal of Health Economics, Elsevier, vol. 36(C), pages 164-173.
    11. repec:zbw:hohpro:331 is not listed on IDEAS
    12. Walter Bossert & Bhaskar Dutta, 2019. "The measurement of welfare change," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 53(4), pages 603-619, December.
    13. Gravel, Nicolas & Moyes, Patrick, 2012. "Ethically robust comparisons of bidimensional distributions with an ordinal attribute," Journal of Economic Theory, Elsevier, vol. 147(4), pages 1384-1426.
    14. McKinley L. Blackburn & David E. Bloom, 1993. "The Distribution of Family Income: Measuring and Explaining Changes in the 1980s for Canada and the United States," NBER Chapters, in: Small Differences That Matter: Labor Markets and Income Maintenance in Canada and the United States, pages 233-266, National Bureau of Economic Research, Inc.
    15. Walter Bossert & Bhaskar Dutta, 2018. "The Measurement of Welfare Change," Working Papers 1004, Ashoka University, Department of Economics.
    16. Nicolas Gravel & Brice Magdalou & Patrick Moyes, 2021. "Ranking distributions of an ordinal variable," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 71(1), pages 33-80, February.
    17. Claudio Zoli, 2002. "Inverse stochastic dominance, inequality measurement and Gini indices," Journal of Economics, Springer, vol. 77(1), pages 119-161, December.
    18. Nicolas Gravel & Patrick Moyes, 2013. "Utilitarianism or welfarism: does it make a difference?," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 40(2), pages 529-551, February.
    19. Paul D. Thistle & John P. Formby, 1988. "On One Parameter Functional Forms for Lorenz Curves," Eastern Economic Journal, Eastern Economic Association, vol. 14(1), pages 81-85, Jan-Mar.
    20. Udo Ebert, 2011. "The redistribution of income when needs differ," Working Papers V-331-11, University of Oldenburg, Department of Economics, revised Feb 2011.
    21. Alain Trannoy & John Weymark, 2007. "Dominance Criteria for Critical-Level Generalized Utilitarianism," Vanderbilt University Department of Economics Working Papers 0707, Vanderbilt University Department of Economics.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:88:y:2011:i:1:d:10.1007_s11192-011-0375-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.