IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v102y2015i2d10.1007_s11192-014-1401-9.html
   My bibliography  Save this article

Introducing sub-impact factor (SIF-) sequences and an aggregated SIF-indicator for journal ranking

Author

Listed:
  • Fang Xu

    (Institute of Policy and Management, Chinese Academy of Sciences)

  • Wenbin Liu

    (University of Kent)

  • Ronald Rousseau

    (University of Antwerp (UA)
    KU Leuven)

Abstract

The main methods for ranking academic journals are peer review based approaches and applications of various bibliometric indicators, or a mixture of the two. Such rankings are used to assess the overall quality of journals, although their real meaning remains unclear as long as the notion of “quality’ is not precisely defined. In our approach we examine journal evaluation from the perspective of knowledge accumulation taking the citation distribution into account. A new indicator, the sub-impact factor denoted as SIF, derived sub-impact factor sequences and an aggregated SIF-indicator are proposed. An empirical study is performed on 64 journals in the area of operations research and management science, illustrating the use of these indicators.

Suggested Citation

  • Fang Xu & Wenbin Liu & Ronald Rousseau, 2015. "Introducing sub-impact factor (SIF-) sequences and an aggregated SIF-indicator for journal ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1577-1593, February.
    • Handle: RePEc:spr:scient:v:102:y:2015:i:2:d:10.1007_s11192-014-1401-9
    DOI: 10.1007/s11192-014-1401-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-014-1401-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-014-1401-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wolfgang Glänzel & Henk F. Moed, 2002. "Journal impact measures in bibliometric research," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 171-193, February.
    2. Sandra Rousseau, 2008. "Journal evaluation by environmental and resource economists: A survey," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(2), pages 223-233, November.
    3. Brown, Lawrence D, 2003. "Ranking Journals Using Social Science Research Network Downloads," Review of Quantitative Finance and Accounting, Springer, vol. 20(3), pages 291-307, May.
    4. Loet Leydesdorff & Lutz Bornmann, 2011. "Integrated impact indicators compared with impact factors: An alternative research design with policy implications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(11), pages 2133-2146, November.
    5. Pascal Bador & Thierry Lafouge, 2010. "Comparative analysis between impact factor and h-index for pharmacology and psychiatry journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 65-79, July.
    6. William J. Moore, 1972. "The Relative Quality Of Economics Journals: A Suggested Rating System," Economic Inquiry, Western Economic Association International, vol. 10(2), pages 156-169, June.
    7. Chen, Carl R. & Huang, Ying, 2007. "Author Affiliation Index, finance journal ranking, and the pattern of authorship," Journal of Corporate Finance, Elsevier, vol. 13(5), pages 1008-1026, December.
    8. E. Garfield & I. H. Sher, 1963. "New factors in the evaluation of scientific literature through citation indexing," American Documentation, Wiley Blackwell, vol. 14(3), pages 195-201, July.
    9. Sandra Rousseau & Tom Verbeke & Ronald Rousseau, 2009. "Evaluating Environmental and Resource Economics Journals: A TOP-Curve Approach," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 3(2), pages 270-287, Summer.
    10. Gangan Prathap, 2010. "The iCE approach for journal evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 561-565, November.
    11. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    12. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    13. Alexander Serenko & Nick Bontis, 2009. "A citation-based ranking of the business ethics scholarly journals," International Journal of Business Governance and Ethics, Inderscience Enterprises Ltd, vol. 4(4), pages 390-399.
    14. Doyle, J. R. & Arthurs, A. J., 1995. "Judging the quality of research in business schools: The UK as a case study," Omega, Elsevier, vol. 23(3), pages 257-270, June.
    15. Allen J Morrison & Andrew C Inkpen, 1991. "An Analysis of Significant Contributions to the International Business Literature," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 22(1), pages 143-153, March.
    16. Chun-Yang Yin & Mohd Jindra Aris & Xi Chen, 2010. "Combination of Eigenfactor TM and h-index to evaluate scientific journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 639-648, September.
    17. Tove Faber Frandsen & Ronald Rousseau, 2005. "Article impact calculated over arbitrary periods," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 56(1), pages 58-62, January.
    18. Clyde W. Holsapple, 2008. "A publication power approach for identifying premier information systems journals," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(2), pages 166-185, January.
    19. Tibor Braun & Wolfgang Glänzel & András Schubert, 2006. "A Hirsch-type index for journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 169-173, October.
    20. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dengsheng Wu & Minglu Li & Xiaoqian Zhu & Hongfang Song & Jianping Li, 2015. "Ranking the research productivity of business and management institutions in Asia–Pacific region: empirical research in leading ABS journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(2), pages 1253-1272, November.
    2. Domingo Docampo & Vicente Safón, 2021. "Journal ratings: a paper affiliation methodology," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 8063-8090, September.
    3. Zhang, Fang & Wu, Shengli, 2020. "Predicting future influence of papers, researchers, and venues in a dynamic academic network," Journal of Informetrics, Elsevier, vol. 14(2).
    4. Dejian Yu & Wanru Wang & Shuai Zhang & Wenyu Zhang & Rongyu Liu, 2017. "A multiple-link, mutually reinforced journal-ranking model to measure the prestige of journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 521-542, April.
    5. Laura Vana & Ronald Hochreiter & Kurt Hornik, 2016. "Computing a journal meta-ranking using paired comparisons and adaptive lasso estimators," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 229-251, January.
    6. Zhang, Baolong & Wang, Hao & Deng, Sanhong & Su, Xinning, 2020. "Measurement and analysis of Chinese journal discriminative capacity," Journal of Informetrics, Elsevier, vol. 14(1).
    7. Wu, Dengsheng & Li, Jing & Lu, Xiaoli & Li, Jianping, 2018. "Journal editorship index for assessing the scholarly impact of academic institutions: An empirical analysis in the field of economics," Journal of Informetrics, Elsevier, vol. 12(2), pages 448-460.
    8. Rousseau, Ronald & Xu, Fang & Liu, Wenbin, 2015. "Interpolated sub-impact factor (SIF) sequences for journal rankings," Journal of Informetrics, Elsevier, vol. 9(4), pages 907-914.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ziqiang Zeng & Lantian Shi, 2021. "A two-dimensional journal classification method based on output and input factors: perspectives from citation and authorship related indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 3929-3964, May.
    2. Wolfgang Glänzel & Henk F. Moed, 2013. "Opinion paper: thoughts and facts on bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 381-394, July.
    3. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    4. Kun Lu & Isola Ajiferuke & Dietmar Wolfram, 2014. "Extending citer analysis to journal impact evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(1), pages 245-260, July.
    5. McAleer, M.J. & Oláh, J. & Popp, J., 2018. "Pros and Cons of the Impact Factor in a Rapidly Changing Digital World," Econometric Institute Research Papers EI2018-11, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    6. Mingyang Wang & Shijia Jiao & Kah-Hin Chai & Guangsheng Chen, 2019. "Building journal’s long-term impact: using indicators detected from the sustained active articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 261-283, October.
    7. Péter Vinkler, 2012. "The Garfield impact factor, one of the fundamental indicators in scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 471-483, August.
    8. Mingkun Wei, 2020. "Research on impact evaluation of open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1027-1049, February.
    9. Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
    10. Loet Leydesdorff & Lutz Bornmann & Jonathan Adams, 2019. "The integrated impact indicator revisited (I3*): a non-parametric alternative to the journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1669-1694, June.
    11. David A. Pendlebury & Jonathan Adams, 2012. "Comments on a critique of the Thomson Reuters journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 395-401, August.
    12. Mingers, John & Leydesdorff, Loet, 2015. "A review of theory and practice in scientometrics," European Journal of Operational Research, Elsevier, vol. 246(1), pages 1-19.
    13. Juan Gorraiz & Ursula Ulrych & Wolfgang Glänzel & Wenceslao Arroyo-Machado & Daniel Torres-Salinas, 2022. "Measuring the excellence contribution at the journal level: an alternative to Garfield’s impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7229-7251, December.
    14. Gianfranco Ennas & Battista Biggio & Maria Chiara Di Guardo, 2015. "Data-driven journal meta-ranking in business and management," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1911-1929, December.
    15. Yves Fassin, 2021. "Does the Financial Times FT50 journal list select the best management and economics journals?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5911-5943, July.
    16. S. Douglas Beets & Andrea S. Kelton & Bruce R. Lewis, 2015. "An assessment of accounting journal quality based on departmental lists," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 315-332, January.
    17. Michel Zitt, 2012. "The journal impact factor: angel, devil, or scapegoat? A comment on J.K. Vanclay’s article 2011," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 485-503, August.
    18. Donohue, Joan M. & Fox, Jeremy B., 2000. "A multi-method evaluation of journals in the decision and management sciences by US academics," Omega, Elsevier, vol. 28(1), pages 17-36, February.
    19. Rabishankar Giri & Sabuj Kumar Chaudhuri, 2021. "Ranking journals through the lens of active visibility," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2189-2208, March.
    20. J. A. García & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia & J. Martinez-Baena, 2012. "On first quartile journals which are not of highest impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 925-943, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:102:y:2015:i:2:d:10.1007_s11192-014-1401-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.