IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v88y2011i1d10.1007_s11192-011-0375-0.html
   My bibliography  Save this article

On measuring scholarly influence by citations

Author

Listed:
  • Martin Ravallion

    (World Bank)

  • Adam Wagstaff

    (World Bank)

Abstract

Bibliometric measures based on citations are widely used in assessing the scientific publication records of authors, institutions and journals. Yet currently favored measures lack a clear theoretical foundation and are known to have counter-intuitive properties. The paper proposes a new approach that is grounded on a theoretical “influence function,” representing explicit prior beliefs about how citations reflect influence. Conditions are derived for robust qualitative comparisons of influence—conditions that can be implemented using readily-available data. Two examples are provided, one using the world’s top-10 economics department, the other using the top-10 economics journals.

Suggested Citation

  • Martin Ravallion & Adam Wagstaff, 2011. "On measuring scholarly influence by citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(1), pages 321-337, July.
    • Handle: RePEc:spr:scient:v:88:y:2011:i:1:d:10.1007_s11192-011-0375-0
    DOI: 10.1007/s11192-011-0375-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-011-0375-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-011-0375-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Leo Egghe, 2006. "Theory and practise of the g-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 131-152, October.
    2. Woeginger, Gerhard J., 2008. "An axiomatic analysis of Egghe’s g-index," Journal of Informetrics, Elsevier, vol. 2(4), pages 364-368.
    3. Atkinson, A B, 1987. "On the Measurement of Poverty," Econometrica, Econometric Society, vol. 55(4), pages 749-764, July.
    4. Hadar, Josef & Russell, William R., 1971. "Stochastic dominance and diversification," Journal of Economic Theory, Elsevier, vol. 3(3), pages 288-305, September.
    5. Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision‐Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, February.
    6. Woeginger, Gerhard J., 2008. "An axiomatic characterization of the Hirsch-index," Mathematical Social Sciences, Elsevier, vol. 56(2), pages 224-232, September.
    7. Dasgupta, Partha & Sen, Amartya & Starrett, David, 1973. "Notes on the measurement of inequality," Journal of Economic Theory, Elsevier, vol. 6(2), pages 180-187, April.
    8. repec:bla:econom:v:50:y:1983:i:197:p:3-17 is not listed on IDEAS
    9. Sen, Amartya, 1973. "On Economic Inequality," OUP Catalogue, Oxford University Press, number 9780198281931.
    10. Kristie M. Engemann & Howard J. Wall, 2009. "A journal ranking for the ambitious economist," Review, Federal Reserve Bank of St. Louis, vol. 91(May), pages 127-140.
    11. Atkinson, Anthony B., 1970. "On the measurement of inequality," Journal of Economic Theory, Elsevier, vol. 2(3), pages 244-263, September.
    12. Alonso, S. & Cabrerizo, F.J. & Herrera-Viedma, E. & Herrera, F., 2009. "h-Index: A review focused in its variants, computation and standardization for different scientific fields," Journal of Informetrics, Elsevier, vol. 3(4), pages 273-289.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Aurora A. C. Teixeira, 2011. "Mapping the (in)visible college(s) in the field of entrepreneurship," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(1), pages 1-36, October.
    2. David Anderson & John Tressler, 2018. "The Impact of Citation Timing: A Framework and Examples," Review of Economics and Institutions, Università di Perugia, vol. 9(2).
    3. László Csató & Dóra Gréta Petróczy, 2024. "Bibliometric indices as a measure of performance and competitive balance in the knockout stage of the UEFA Champions League," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 32(4), pages 961-988, December.
    4. Waltman, Ludo & van Eck, Nees Jan & Wouters, Paul, 2013. "Counting publications and citations: Is more always better?," Journal of Informetrics, Elsevier, vol. 7(3), pages 635-641.
    5. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    6. David L. Anderson & John Tressler, 2013. "The Relevance of the “h-” and “g-” Index to Economics in the Context of A Nation-Wide Research Evaluation Scheme: The New Zealand Case," Economic Papers, The Economic Society of Australia, vol. 32(1), pages 81-94, March.
    7. Neus Herranz & Javier Ruiz-Castillo, 2013. "The end of the “European Paradox”," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 453-464, April.
    8. Giovanni Abramo & Ciriaco Andrea D’Angelo & Fulvio Viel, 2013. "The suitability of h and g indexes for measuring the research performance of institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 555-570, December.
    9. Wagstaff, Adam & Culyer, Anthony J., 2012. "Four decades of health economics through a bibliometric lens," Journal of Health Economics, Elsevier, vol. 31(2), pages 406-439.
    10. Kuan, Chung-Huei & Huang, Mu-Hsuan & Chen, Dar-Zen, 2013. "Cross-field evaluation of publications of research institutes using their contributions to the fields’ MVPs determined by h-index," Journal of Informetrics, Elsevier, vol. 7(2), pages 455-468.
    11. Antonio Abatemarco & Roberto Dell’Anno, 2013. "Certainty equivalent citation: generalized classes of citation indexes," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 263-271, January.
    12. Christopher Carroll, 2016. "Measuring academic research impact: creating a citation profile using the conceptual framework for implementation fidelity as a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1329-1340, November.
    13. Schreiber, Michael, 2013. "How to derive an advantage from the arbitrariness of the g-index," Journal of Informetrics, Elsevier, vol. 7(2), pages 555-561.
    14. Schreiber, Michael, 2013. "A case study of the arbitrariness of the h-index and the highly-cited-publications indicator," Journal of Informetrics, Elsevier, vol. 7(2), pages 379-387.
    15. Martin Ravallion & Adam Wagstaff, 2012. "The World Bank’s publication record," The Review of International Organizations, Springer, vol. 7(4), pages 343-368, December.
    16. Bouyssou, Denis & Marchant, Thierry, 2014. "An axiomatic approach to bibliometric rankings and indices," Journal of Informetrics, Elsevier, vol. 8(3), pages 449-477.
    17. Shengbo Liu & Xiaoting Luo & Miaomiao Liu, 2023. "Was Chinese “Double-First Class” Construction Policy Influential? Analysis Using Propensity Score Matching," Sustainability, MDPI, vol. 15(8), pages 1-13, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Srinivas Goli & Nagendra Kumar Maurya & Moradhvaj & Prem Bhandari, 2019. "Regional Differentials in Multidimensional Poverty in Nepal: Rethinking Dimensions and Method of Computation," SAGE Open, , vol. 9(1), pages 21582440198, March.
    2. Bouyssou, Denis & Marchant, Thierry, 2014. "An axiomatic approach to bibliometric rankings and indices," Journal of Informetrics, Elsevier, vol. 8(3), pages 449-477.
    3. Jean‐Yves Duclos & Paul Makdissi, 2004. "Restricted and Unrestricted Dominance for Welfare, Inequality, and Poverty Orderings," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 6(1), pages 145-164, February.
    4. Sreenivasan Subramanian, 2004. "Indicators of Inequality and Poverty," WIDER Working Paper Series RP2004-25, World Institute for Development Economic Research (UNU-WIDER).
    5. Nicolas CARAYOL & Agenor LAHATTE, 2014. "Dominance relations and ranking when quantity and quality both matter: Applications to US universities and econ. departments worldwide," Cahiers du GREThA (2007-2019) 2014-14, Groupe de Recherche en Economie Théorique et Appliquée (GREThA).
    6. Albarrán, Pedro & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2011. "The measurement of low- and high-impact in citation distributions: Technical results," Journal of Informetrics, Elsevier, vol. 5(1), pages 48-63.
    7. Gian Maria Tomat, 2014. "Revisiting poverty and welfare dominance," ECONOMIA PUBBLICA, FrancoAngeli Editore, vol. 2014(2), pages 125-149.
    8. Louis Kaplow, 2005. "Why measure inequality?," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 3(1), pages 65-79, April.
    9. Antonio Abatemarco & Roberto Dell’Anno, 2013. "Certainty equivalent citation: generalized classes of citation indexes," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 263-271, January.
    10. Makdissi, Paul & Groleau, Yves, 2002. "Que pouvons-nous apprendre des profils de pauvreté canadiens?," L'Actualité Economique, Société Canadienne de Science Economique, vol. 78(2), pages 257-286, Juin.
    11. Daniel Sotelsek-Salem & Ismael Ahamdanech-Zarco & John Bishop, 2012. "Dominance testing for ‘pro-poor’ growth with an application to European growth," Empirical Economics, Springer, vol. 43(2), pages 723-739, October.
    12. Jean-Yves Duclos & Paul Makdissi, 2000. "Restricted and Unrestricted Dominance Welfare, Inequality and Povery Orderings," Cahiers de recherche 00-01, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    13. Karsu, Özlem & Morton, Alec, 2015. "Inequity averse optimization in operational research," European Journal of Operational Research, Elsevier, vol. 245(2), pages 343-359.
    14. Chakravarty, Satya R. & Sarkar, Palash, 2022. "A synthesis of local and effective tax progressivity measurement," MPRA Paper 115180, University Library of Munich, Germany.
    15. Satya R. Chakravarty & Pietro Muliere, 2003. "Welfare indicators: A review and new perspectives. 1. Measurement of inequality," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilità e Statistiche Applicate - University of Rome, vol. 0(3), pages 457-497.
    16. Nanak Kakwani & Marcelo Neri & Hyun H. Son, 2006. "Linkages between Pro-Poor Growth, Social Programmes and Labour Market: The Recent Brazilian Experience," Working Papers 26, International Policy Centre for Inclusive Growth.
    17. Alain Chateauneuf & Patrick Moyes, 2002. "Measuring inequality without the Pigou-Dalton condition," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-00156475, HAL.
    18. R. Bénabou & E. Ok, 2000. "Mobility as Progressivity: Ranking Income Processes According to Equality of Opportunity," Princeton Economic Theory Papers 00f1, Economics Department, Princeton University.
    19. Carbonell-Nicolau, Oriol & Llavador, Humberto, 2018. "Inequality reducing properties of progressive income tax schedules: the case of endogenous income," Theoretical Economics, Econometric Society, vol. 13(1), January.
    20. Fatiha Bennia & Nicolas Gravel & Brice Magdalou & Patrick Moyes, 2022. "Is body weight better distributed among men than among women? A robust normative analysis for France, the UK, and the US," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(1), pages 69-103, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:88:y:2011:i:1:d:10.1007_s11192-011-0375-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.