IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v88y2011i1d10.1007_s11192-011-0375-0.html
   My bibliography  Save this article

On measuring scholarly influence by citations

Author

Listed:
  • Martin Ravallion

    (World Bank)

  • Adam Wagstaff

    (World Bank)

Abstract

Bibliometric measures based on citations are widely used in assessing the scientific publication records of authors, institutions and journals. Yet currently favored measures lack a clear theoretical foundation and are known to have counter-intuitive properties. The paper proposes a new approach that is grounded on a theoretical “influence function,” representing explicit prior beliefs about how citations reflect influence. Conditions are derived for robust qualitative comparisons of influence—conditions that can be implemented using readily-available data. Two examples are provided, one using the world’s top-10 economics department, the other using the top-10 economics journals.

Suggested Citation

  • Martin Ravallion & Adam Wagstaff, 2011. "On measuring scholarly influence by citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(1), pages 321-337, July.
    • Handle: RePEc:spr:scient:v:88:y:2011:i:1:d:10.1007_s11192-011-0375-0
    DOI: 10.1007/s11192-011-0375-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-011-0375-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-011-0375-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Atkinson, A B, 1987. "On the Measurement of Poverty," Econometrica, Econometric Society, vol. 55(4), pages 749-764, July.
    2. Hadar, Josef & Russell, William R., 1971. "Stochastic dominance and diversification," Journal of Economic Theory, Elsevier, vol. 3(3), pages 288-305, September.
    3. Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision‐Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, February.
    4. Woeginger, Gerhard J., 2008. "An axiomatic characterization of the Hirsch-index," Mathematical Social Sciences, Elsevier, vol. 56(2), pages 224-232, September.
    5. Kristie M. Engemann & Howard J. Wall, 2009. "A journal ranking for the ambitious economist," Review, Federal Reserve Bank of St. Louis, vol. 91(May), pages 127-140.
    6. Atkinson, Anthony B., 1970. "On the measurement of inequality," Journal of Economic Theory, Elsevier, vol. 2(3), pages 244-263, September.
    7. Leo Egghe, 2006. "Theory and practise of the g-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 131-152, October.
    8. Woeginger, Gerhard J., 2008. "An axiomatic analysis of Egghe’s g-index," Journal of Informetrics, Elsevier, vol. 2(4), pages 364-368.
    9. Dasgupta, Partha & Sen, Amartya & Starrett, David, 1973. "Notes on the measurement of inequality," Journal of Economic Theory, Elsevier, vol. 6(2), pages 180-187, April.
    10. repec:bla:econom:v:50:y:1983:i:197:p:3-17 is not listed on IDEAS
    11. Sen, Amartya, 1973. "On Economic Inequality," OUP Catalogue, Oxford University Press, number 9780198281931.
    12. Alonso, S. & Cabrerizo, F.J. & Herrera-Viedma, E. & Herrera, F., 2009. "h-Index: A review focused in its variants, computation and standardization for different scientific fields," Journal of Informetrics, Elsevier, vol. 3(4), pages 273-289.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. László Csató & Dóra Gréta Petróczy, 2024. "Bibliometric indices as a measure of performance and competitive balance in the knockout stage of the UEFA Champions League," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 32(4), pages 961-988, December.
    2. Waltman, Ludo & van Eck, Nees Jan & Wouters, Paul, 2013. "Counting publications and citations: Is more always better?," Journal of Informetrics, Elsevier, vol. 7(3), pages 635-641.
    3. David L. Anderson & John Tressler, 2013. "The Relevance of the “h-” and “g-” Index to Economics in the Context of A Nation-Wide Research Evaluation Scheme: The New Zealand Case," Economic Papers, The Economic Society of Australia, vol. 32(1), pages 81-94, March.
    4. Neus Herranz & Javier Ruiz-Castillo, 2013. "The end of the “European Paradox”," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 453-464, April.
    5. Kuan, Chung-Huei & Huang, Mu-Hsuan & Chen, Dar-Zen, 2013. "Cross-field evaluation of publications of research institutes using their contributions to the fields’ MVPs determined by h-index," Journal of Informetrics, Elsevier, vol. 7(2), pages 455-468.
    6. Schreiber, Michael, 2013. "A case study of the arbitrariness of the h-index and the highly-cited-publications indicator," Journal of Informetrics, Elsevier, vol. 7(2), pages 379-387.
    7. Martin Ravallion & Adam Wagstaff, 2012. "The World Bank’s publication record," The Review of International Organizations, Springer, vol. 7(4), pages 343-368, December.
    8. Antonio Abatemarco & Roberto Dell’Anno, 2013. "Certainty equivalent citation: generalized classes of citation indexes," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 263-271, January.
    9. Aurora A. C. Teixeira, 2011. "Mapping the (in)visible college(s) in the field of entrepreneurship," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(1), pages 1-36, October.
    10. Wagstaff, Adam & Culyer, Anthony J., 2012. "Four decades of health economics through a bibliometric lens," Journal of Health Economics, Elsevier, vol. 31(2), pages 406-439.
    11. David Anderson & John Tressler, 2018. "The Impact of Citation Timing: A Framework and Examples," Review of Economics and Institutions, Università di Perugia, vol. 9(2).
    12. Shengbo Liu & Xiaoting Luo & Miaomiao Liu, 2023. "Was Chinese “Double-First Class” Construction Policy Influential? Analysis Using Propensity Score Matching," Sustainability, MDPI, vol. 15(8), pages 1-13, April.
    13. Giovanni Abramo & Ciriaco Andrea D’Angelo & Fulvio Viel, 2013. "The suitability of h and g indexes for measuring the research performance of institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 555-570, December.
    14. Bouyssou, Denis & Marchant, Thierry, 2014. "An axiomatic approach to bibliometric rankings and indices," Journal of Informetrics, Elsevier, vol. 8(3), pages 449-477.
    15. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    16. Christopher Carroll, 2016. "Measuring academic research impact: creating a citation profile using the conceptual framework for implementation fidelity as a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1329-1340, November.
    17. Schreiber, Michael, 2013. "How to derive an advantage from the arbitrariness of the g-index," Journal of Informetrics, Elsevier, vol. 7(2), pages 555-561.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jean‐Yves Duclos & Paul Makdissi, 2004. "Restricted and Unrestricted Dominance for Welfare, Inequality, and Poverty Orderings," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 6(1), pages 145-164, February.
    2. Gian Maria Tomat, 2014. "Revisiting poverty and welfare dominance," ECONOMIA PUBBLICA, FrancoAngeli Editore, vol. 2014(2), pages 125-149.
    3. Louis Kaplow, 2005. "Why measure inequality?," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 3(1), pages 65-79, April.
    4. Bouyssou, Denis & Marchant, Thierry, 2014. "An axiomatic approach to bibliometric rankings and indices," Journal of Informetrics, Elsevier, vol. 8(3), pages 449-477.
    5. Makdissi, Paul & Groleau, Yves, 2002. "Que pouvons-nous apprendre des profils de pauvreté canadiens?," L'Actualité Economique, Société Canadienne de Science Economique, vol. 78(2), pages 257-286, Juin.
    6. Daniel Sotelsek-Salem & Ismael Ahamdanech-Zarco & John Bishop, 2012. "Dominance testing for ‘pro-poor’ growth with an application to European growth," Empirical Economics, Springer, vol. 43(2), pages 723-739, October.
    7. Albarrán, Pedro & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2011. "The measurement of low- and high-impact in citation distributions: Technical results," Journal of Informetrics, Elsevier, vol. 5(1), pages 48-63.
    8. Antonio Abatemarco & Roberto Dell’Anno, 2013. "Certainty equivalent citation: generalized classes of citation indexes," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 263-271, January.
    9. Jean-Yves Duclos & Paul Makdissi, 2000. "Restricted and Unrestricted Dominance Welfare, Inequality and Povery Orderings," Cahiers de recherche 00-01, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    10. Srinivas Goli & Nagendra Kumar Maurya & Moradhvaj & Prem Bhandari, 2019. "Regional Differentials in Multidimensional Poverty in Nepal: Rethinking Dimensions and Method of Computation," SAGE Open, , vol. 9(1), pages 21582440198, March.
    11. Sreenivasan Subramanian, 2004. "Indicators of Inequality and Poverty," WIDER Working Paper Series RP2004-25, World Institute for Development Economic Research (UNU-WIDER).
    12. Nicolas CARAYOL & Agenor LAHATTE, 2014. "Dominance relations and ranking when quantity and quality both matter: Applications to US universities and econ. departments worldwide," Cahiers du GREThA (2007-2019) 2014-14, Groupe de Recherche en Economie Théorique et Appliquée (GREThA).
    13. Chakravarty, Satya R. & Sarkar, Palash, 2022. "A synthesis of local and effective tax progressivity measurement," MPRA Paper 115180, University Library of Munich, Germany.
    14. Satya R. Chakravarty & Pietro Muliere, 2003. "Welfare indicators: A review and new perspectives. 1. Measurement of inequality," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilità e Statistiche Applicate - University of Rome, vol. 0(3), pages 457-497.
    15. Nanak Kakwani & Marcelo Neri & Hyun H. Son, 2006. "Linkages between Pro-Poor Growth, Social Programmes and Labour Market: The Recent Brazilian Experience," Working Papers 26, International Policy Centre for Inclusive Growth.
    16. Alain Chateauneuf & Patrick Moyes, 2002. "Measuring inequality without the Pigou-Dalton condition," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-00156475, HAL.
    17. Carbonell-Nicolau, Oriol & Llavador, Humberto, 2018. "Inequality reducing properties of progressive income tax schedules: the case of endogenous income," Theoretical Economics, Econometric Society, vol. 13(1), January.
    18. Stiglitz, Joseph E., 2002. "New perspectives on public finance: recent achievements and future challenges," Journal of Public Economics, Elsevier, vol. 86(3), pages 341-360, December.
    19. Oscar Bajo & Rafael Salas, 2002. "Inequality foundations of concentration measures: An application to the Hannah-Kay indices," Spanish Economic Review, Springer;Spanish Economic Association, vol. 4(4), pages 311-316.
    20. Kakwani, Nanak & Neri, Marcelo Côrtes & Son, Hyun H., 2010. "Linkages Between Pro-Poor Growth, Social Programs and Labor Market: The Recent Brazilian Experience," World Development, Elsevier, vol. 38(6), pages 881-894, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:88:y:2011:i:1:d:10.1007_s11192-011-0375-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.