IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v90y2012i3d10.1007_s11192-011-0555-y.html
   My bibliography  Save this article

Shapley values for assessing research production and impact of schools and scholars

Author

Listed:
  • Richard S. J. Tol

    (Economic and Social Research Institute
    Vrije Universiteit
    Vrije Universiteit
    Trinity College)

Abstract

Performance measures of individual scholars tend to ignore the context. I introduce contextualised metrics: cardinal and ordinal pseudo-Shapley values that measure a scholar’s contribution to (perhaps power over) her own school and her market value to other schools should she change job. I illustrate the proposed measures with business scholars and business schools in Ireland. Although conceptually superior, the power indicators imply a ranking of scholars within a school that is identical to the corresponding conventional performance measures. The market value indicators imply an identical ranking within schools and a very similar ranking between schools. The ordinal indices further contextualise performance measures and thus deviate further from the corresponding conventional indicators. As the ordinal measures are discontinuous by construction, a natural classification of scholars emerges. Averaged over schools, the market values offer little extra information over the corresponding production and impact measures. The ordinal power measure indicates the robustness or fragility of an institution’s place in the rank order. It is only weakly correlated with the concentration of publications and citations.

Suggested Citation

  • Richard S. J. Tol, 2012. "Shapley values for assessing research production and impact of schools and scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 763-780, March.
    • Handle: RePEc:spr:scient:v:90:y:2012:i:3:d:10.1007_s11192-011-0555-y
    DOI: 10.1007/s11192-011-0555-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-011-0555-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-011-0555-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Elizabeth S. Vieira & José A. N. F. Gomes, 2009. "A comparison of Scopus and Web of Science for a typical university," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(2), pages 587-600, November.
    2. Claude d'Aspremont & Alexis Jacquemin & Jean Jaskold Gabszewicz & John A. Weymark, 1983. "On the Stability of Collusive Price Leadership," Canadian Journal of Economics, Canadian Economics Association, vol. 16(1), pages 17-25, February.
    3. John Mingers & Evangelia A. E. C. G. Lipitakis, 2010. "Counting the citations: a comparison of Web of Science and Google Scholar in the field of business and management," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 613-625, November.
    4. R. Coronini & V. Mangematin, 1999. "From individual scientific visibility to collective competencies: The example of an academic department in the social sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 45(1), pages 55-80, May.
    5. Kristof Witte & Nicky Rogge, 2010. "To publish or not to publish? On the aggregation and drivers of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 657-680, December.
    6. Tol, Richard S. J., 2010. "The Research Output of Business Schools and Business Scholars in Ireland," Papers WP364, Economic and Social Research Institute (ESRI).
    7. Gregory John Lee, 2010. "Assessing publication performance of research units: extensions through operational research and economic techniques," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 717-734, September.
    8. Chiang Kao & Hwei-Lan Pao, 2009. "An evaluation of research performance in management of 168 Taiwan universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(2), pages 261-277, February.
    9. Kalaitzidakis, P. & Mamuneas, T.P. & Stengos, T., 2003. "Rankings of Academic Journals and Institutions," Working Papers 2003-8, University of Guelph, Department of Economics and Finance.
    10. Seán Lyons & Karen Mayor & Richard S.J. Tol, 2008. "Environmental Accounts for the Republic of Ireland: 1990-2005," Papers WP223, Economic and Social Research Institute (ESRI).
    11. Pedro Cosme Vieira & Aurora A. C. Teixeira, 2010. "Are finance, management, and marketing autonomous fields of scientific research? An analysis based on journal citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 627-646, December.
    12. Anton J. Nederhof, 2008. "Policy impact of bibliometric rankings of research performance of departments and individuals in economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(1), pages 163-174, January.
    13. Roger Coronini & Vincent Mangematin, 1999. "From individual scientific visibility to collective competencies : the example of an academic department in social science," Post-Print hal-00437647, HAL.
    14. Cox, Raymond A K & Chung, Kee H, 1991. "Patterns of Research Output and Author Concentration in the Economics Literature," The Review of Economics and Statistics, MIT Press, vol. 73(4), pages 740-747, November.
    15. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
    16. A. Peter W. Hodder & Catherine Hodder, 2010. "Research culture and New Zealand’s performance-based research fund: some insights from bibliographic compilations of research outputs," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 887-901, September.
    17. Frances Ruane & Xiaoheng Zhang, 2007. "Location Choices of the Pharmaceutical Industry in Europe after 1992," The Institute for International Integration Studies Discussion Paper Series iiisdp220, IIIS.
    18. Rose M. Rubin & Cyril F. Chang, 2003. "A bibliometric analysis of health economics articles in the economics literature: 1991‐2000," Health Economics, John Wiley & Sons, Ltd., vol. 12(5), pages 403-414, May.
    19. Siluo Yang & Feng Ma & Yanhui Song & Junping Qiu, 2010. "A longitudinal analysis of citation distribution breadth for Chinese scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 755-765, December.
    20. Roger Coronini & Vincent Mangematin, 1999. "From individual scientific visibility to collective competencies : the example of an academic department in social science," Grenoble Ecole de Management (Post-Print) hal-00437647, HAL.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Collings David G. & Cunningham James & Wood Geoffrey, 2015. "Reflections on Irish management research: Past, present and future," The Irish Journal of Management, Sciendo, vol. 34(1), pages 2-6, December.
    2. Mêgnigbêto, Eustache, 2018. "Modelling the Triple Helix of university-industry-government relationships with game theory: Core, Shapley value and nucleolus as indicators of synergy within an innovation system," Journal of Informetrics, Elsevier, vol. 12(4), pages 1118-1132.
    3. Leo Egghe & Raf Guns & Ronald Rousseau, 2013. "Measuring co-authors’ contribution to an article’s visibility," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 55-67, April.
    4. Karpov, Alexander, 2014. "Equal weights coauthorship sharing and the Shapley value are equivalent," Journal of Informetrics, Elsevier, vol. 8(1), pages 71-76.
    5. Demetrescu, Camil & Lupia, Francesco & Mendicelli, Angelo & Ribichini, Andrea & Scarcello, Francesco & Schaerf, Marco, 2019. "On the Shapley value and its application to the Italian VQR research assessment exercise," Journal of Informetrics, Elsevier, vol. 13(1), pages 87-104.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anne-Wil Harzing & Wilfred Mijnhardt, 2015. "Proof over promise: towards a more inclusive ranking of Dutch academics in Economics & Business," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 727-749, January.
    2. Wohlrabe, Klaus, 2016. "Taking the Temperature: A Meta-Ranking of Economics Journals," MPRA Paper 68933, University Library of Munich, Germany.
    3. Benedetto Lepori & Michael Wise & Diana Ingenhoff & Alexander Buhmann, 2016. "The dynamics of university units as a multi‐level process. Credibility cycles and resource dependencies," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2279-2301, December.
    4. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.
    5. David L. Anderson & John Tressler, 2017. "Researcher rank stability across alternative output measurement schemes in the context of a time limited research evaluation: the New Zealand case," Applied Economics, Taylor & Francis Journals, vol. 49(45), pages 4542-4553, September.
    6. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    7. Frederic S. Lee & Therese C. Grijalva & Clifford Nowell, 2010. "Ranking Economics Departments in a Contested Discipline: A Bibliometric Approach to Quality Equality Between Theoretically Distinct Subdisciplines," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1345-1375, November.
    8. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.
    9. Richard Tol, 2011. "Regulating knowledge monopolies: the case of the IPCC," Climatic Change, Springer, vol. 108(4), pages 827-839, October.
    10. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2011. "An updated ranking of academic journals in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 44(4), pages 1525-1538, November.
    11. Melody Lo & M. C. Sunny Wong & Franklin G. Mixon, 2008. "Ranking Economics Journals, Economics Departments, and Economists Using Teaching‐Focused Research Productivity," Southern Economic Journal, John Wiley & Sons, vol. 74(3), pages 894-906, January.
    12. David L. Anderson & John Tressler, 2013. "The Relevance of the “h-” and “g-” Index to Economics in the Context of A Nation-Wide Research Evaluation Scheme: The New Zealand Case," Economic Papers, The Economic Society of Australia, vol. 32(1), pages 81-94, March.
    13. Magnus Henrekson & Daniel Waldenström, 2011. "How Should Research Performance Be Measured? A Study Of Swedish Economists," Manchester School, University of Manchester, vol. 79(6), pages 1139-1156, December.
    14. Vivek Kumar Singh & Prashasti Singh & Mousumi Karmakar & Jacqueline Leta & Philipp Mayr, 2021. "The journal coverage of Web of Science, Scopus and Dimensions: A comparative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5113-5142, June.
    15. Chen, Jihui Susan & Liu, Qihong & Billger, Sherrilyn M., 2012. "Where Do New Ph.D. Economists Go? Evidence from Recent Initial Job Placements," IZA Discussion Papers 6990, Institute of Labor Economics (IZA).
    16. Giovanni Abramo & Ciriaco Andrea D’Angelo & Marco Solazzi, 2010. "National research assessment exercises: a measure of the distortion of performance rankings when labor input is treated as uniform," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 605-619, September.
    17. Timo Boppart & Kevin E. Staub, 2012. "Online accessibility of academic articles and the diversity of economics," ECON - Working Papers 075, Department of Economics - University of Zurich.
    18. Justus Haucap & Johannes Muck, 2015. "What drives the relevance and reputation of economics journals? An update from a survey among economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 849-877, June.
    19. Stephen Bazen & Patrick Moyes, 2012. "Elitism and stochastic dominance," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 39(1), pages 207-251, June.
    20. Önder, Ali Sina & Schweitzer, Sascha & Yilmazkuday, Hakan, 2021. "Specialization, field distance, and quality in economists’ collaborations," Journal of Informetrics, Elsevier, vol. 15(4).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:90:y:2012:i:3:d:10.1007_s11192-011-0555-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.