IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v14y2020i1s175115771930152x.html
   My bibliography  Save this article

Jointly valuing journal visibility and author citation count: An axiomatic approach

Author

Listed:
  • Haley, M. Ryan
  • McGee, M. Kevin

Abstract

This paper proposes a simple, flexible, axiom-based mechanism for facilitating the comparison between a scholar's citation count and the visibility of the journals wherein the scholar's articles were published. The goal is to help research review bodies easily grasp the distinction these two forms of scholarly accomplishment and to provide a transparent way to articulate expectations about them to scholars. The approach is demonstrated using a widely applied and cooperative functional form that can reflect, via different parameter values, a wide range of possible beliefs about the relative merits of citation counts and journal visibility.

Suggested Citation

  • Haley, M. Ryan & McGee, M. Kevin, 2020. "Jointly valuing journal visibility and author citation count: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 14(1).
  • Handle: RePEc:eee:infome:v:14:y:2020:i:1:s175115771930152x
    DOI: 10.1016/j.joi.2019.100988
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S175115771930152X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.joi.2019.100988?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bornmann, Lutz & Mutz, Rüdiger & Hug, Sven E. & Daniel, Hans-Dieter, 2011. "A multilevel meta-analysis of studies reporting correlations between the h index and 37 different h index variants," Journal of Informetrics, Elsevier, vol. 5(3), pages 346-359.
    2. Wilhite, Allen & Fong, Eric A. & Wilhite, Seth, 2019. "The influence of editorial decisions and the academic network on self-citations and journal impact factors," Research Policy, Elsevier, vol. 48(6), pages 1513-1522.
    3. Seeber, Marco & Cattaneo, Mattia & Meoli, Michele & Malighetti, Paolo, 2019. "Self-citations as strategic response to the use of metrics for career decisions," Research Policy, Elsevier, vol. 48(2), pages 478-491.
    4. Ignacio Palacios-Huerta & Oscar Volij, 2004. "The Measurement of Intellectual Influence," Econometrica, Econometric Society, vol. 72(3), pages 963-977, May.
    5. Aksnes, Dag W. & Rip, Arie, 2009. "Researchers' perceptions of citations," Research Policy, Elsevier, vol. 38(6), pages 895-905, July.
    6. Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision‐Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, February.
    7. Juan E. Iglesias & Carlos Pecharromán, 2007. "Scaling the h-index for different scientific ISI fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(3), pages 303-320, December.
    8. Quesada, Antonio, 2011. "Axiomatics for the Hirsch index and the Egghe index," Journal of Informetrics, Elsevier, vol. 5(3), pages 476-480.
    9. Victoria Anauati & Sebastian Galiani & Ramiro H. Gálvez, 2016. "Quantifying The Life Cycle Of Scholarly Articles Across Fields Of Economic Research," Economic Inquiry, Western Economic Association International, vol. 54(2), pages 1339-1355, April.
    10. Daniel Sgroi & Andrew J. Oswald, 2013. "How Should Peer‐review Panels Behave?," Economic Journal, Royal Economic Society, vol. 0, pages 255-278, August.
    11. Judit Bar-Ilan & Gali Halevi, 2017. "Post retraction citations in context: a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 547-565, October.
    12. Woeginger, Gerhard J., 2008. "An axiomatic characterization of the Hirsch-index," Mathematical Social Sciences, Elsevier, vol. 56(2), pages 224-232, September.
    13. Theodore Eisenberg & Martin T. Wells, 2014. "Ranking Law Journals And The Limits Of Journal Citation Reports," Economic Inquiry, Western Economic Association International, vol. 52(4), pages 1301-1314, October.
    14. Loet Leydesdorff & Ping Zhou & Lutz Bornmann, 2013. "How can journal impact factors be normalized across fields of science? An assessment in terms of percentile ranks and fractional counts," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(1), pages 96-107, January.
    15. Motty Perry & Philip J. Reny, 2016. "How to Count Citations If You Must," American Economic Review, American Economic Association, vol. 106(9), pages 2722-2741, September.
    16. M. Ryan Haley, 2016. "A ranking of journals for the aspiring health economist," Applied Economics, Taylor & Francis Journals, vol. 48(18), pages 1710-1718, April.
    17. M. Ryan Haley & M. Kevin McGee, 2018. "A parametric “parent metric†approach for comparing maximum†normalized journal ranking metrics," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 69(1), pages 172-176, January.
    18. M. Ryan Haley, 2017. "On the inauspicious incentives of the scholar-level h-index: an economist’s take on collusive and coercive citation," Applied Economics Letters, Taylor & Francis Journals, vol. 24(2), pages 85-89, January.
    19. Bouyssou, Denis & Marchant, Thierry, 2011. "Bibliometric rankings of journals based on Impact Factors: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 5(1), pages 75-86.
    20. Arthur E. Attema & Werner B.F. Brouwer & Job Van Exel, 2014. "Your Right Arm For A Publication In Aer?," Economic Inquiry, Western Economic Association International, vol. 52(1), pages 495-502, January.
    21. Palacios-Huerta, Ignacio & Volij, Oscar, 2014. "Axiomatic measures of intellectual influence," International Journal of Industrial Organization, Elsevier, vol. 34(C), pages 85-90.
    22. M. Ryan Haley, 2014. "Ranking top economics and finance journals using Microsoft academic search versus Google scholar: How does the new publish or perish option compare?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(5), pages 1079-1084, May.
    23. Lorna Wildgaard, 2015. "A comparison of 17 author-level bibliometric indicators for researchers in Astronomy, Environmental Science, Philosophy and Public Health in Web of Science and Google Scholar," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 873-906, September.
    24. Thierry Marchant, 2009. "An axiomatic characterization of the ranking based on the h-index and some other bibliometric rankings of authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(2), pages 325-342, August.
    25. Jian Wang, 2013. "Citation time window choice for research impact evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 851-872, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. M. Ryan Haley, 2020. "Combining the weighted and unweighted Euclidean indices: a graphical approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 103-111, April.
    2. M. Ryan Haley & M. Kevin McGee, 2023. "A flexible functional method for jointly valuing journal visibility and author citation count," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3337-3346, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. M. Ryan Haley & M. Kevin McGee, 2023. "A flexible functional method for jointly valuing journal visibility and author citation count," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3337-3346, June.
    2. J. Atsu Amegashie, 2020. "Citations And Incentives In Academic Contests," Economic Inquiry, Western Economic Association International, vol. 58(3), pages 1233-1244, July.
    3. M. Ryan Haley, 2020. "Combining the weighted and unweighted Euclidean indices: a graphical approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 103-111, April.
    4. Csató, László, 2019. "Journal ranking should depend on the level of aggregation," Journal of Informetrics, Elsevier, vol. 13(4).
    5. Sylvain Béal & Eric Rémila & Philippe Solal & Sylvain Ferrières, 2016. "An axiomatization of the iterated h-index and applications to sport rankings," Working Papers hal-01394818, HAL.
    6. L'aszl'o Csat'o, 2019. "Journal ranking should depend on the level of aggregation," Papers 1904.06300, arXiv.org, revised Sep 2019.
    7. Bouyssou, Denis & Marchant, Thierry, 2016. "Ranking authors using fractional counting of citations: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 10(1), pages 183-199.
    8. Osório, António (António Miguel), 2019. "The value and credits of n-authors publications," Working Papers 2072/376026, Universitat Rovira i Virgili, Department of Economics.
    9. Bouyssou, Denis & Marchant, Thierry, 2014. "An axiomatic approach to bibliometric rankings and indices," Journal of Informetrics, Elsevier, vol. 8(3), pages 449-477.
    10. Lasso de la Vega, Casilda & Volij, Oscar, 2018. "Ranking scholars: A measure representation," Journal of Informetrics, Elsevier, vol. 12(2), pages 510-517.
    11. Antonin Mac'e, 2017. "The Limits of Citation Counts," Papers 1711.02695, arXiv.org, revised Sep 2023.
    12. Antonin Macé, 2023. "The Limits of Citation Counts," Working Papers halshs-01630095, HAL.
    13. Chambers, Christopher P. & Miller, Alan D., 2014. "Scholarly influence," Journal of Economic Theory, Elsevier, vol. 151(C), pages 571-583.
    14. María Victoria Anauati & Sebastian Galiani & Ramiro H. Gálvez, 2020. "Differences In Citation Patterns Across Journal Tiers: The Case Of Economics," Economic Inquiry, Western Economic Association International, vol. 58(3), pages 1217-1232, July.
    15. Mark Levene & Trevor Fenner & Judit Bar-Ilan, 2019. "Characterisation of the $$\chi$$χ-index and the rec-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 885-896, August.
    16. Conan Mukherjee & Ranojoy Basu & Aftab Alam, 2020. "A measure of authorship by publications," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 41(3), pages 354-361, April.
    17. Bouyssou, D. & Marchant, T., 2010. "Consistent bibliometric rankings of authors and of journals," Journal of Informetrics, Elsevier, vol. 4(3), pages 365-378.
    18. Ana Paula dos Santos Rubem & Ariane Lima Moura & João Carlos Correia Baptista Soares de Mello, 2015. "Comparative analysis of some individual bibliometric indices when applied to groups of researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 1019-1035, January.
    19. Lutz Bornmann & Klaus Wohlrabe, 2019. "Normalisation of citation impact in economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 841-884, August.
    20. Mukherjee, Conan & Alam, Aftab, 2016. "On Evaluating Author's Performance by Publications: An Axiomatic Study," Working Papers 2016:14, Lund University, Department of Economics, revised 12 May 2017.

    More about this item

    Keywords

    Journal prestige; Scholar ranking; Citations; Journal visibility;
    All these keywords.

    JEL classification:

    • A1 - General Economics and Teaching - - General Economics
    • M5 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:14:y:2020:i:1:s175115771930152x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.