IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v102y2015i1d10.1007_s11192-014-1444-y.html
   My bibliography  Save this article

Ranking journals using the dominance hierarchy procedure: an illustration with IS journals

Author

Listed:
  • Kishen Iyengar

    (University of Colorado at Boulder)

  • Venugopal Balijepally

    (Oakland University)

Abstract

Ranking journals is an important exercise in academia. While several approaches to rank journals exist, an inherent assumption of these approaches is that there is indeed a hierarchy of journals, which is captured by the methods used for ranking them. We address a more fundamental question: Is there a linear hierarchy within journals? In this article, we introduce the dominance ranking approach that investigates the extent of hierarchy in a given set of objects by examining the extent of intransitivity in the system of interactions. We test the efficacy of the approach to ranking information systems journals based on citation data spanning a 3 year period from 2009 to 2011. Results indicate that the approach is very effective in identifying the extent of hierarchy within journals, and subsequently in ranking the journals. With its statistical underpinnings, the approach brings greater objectivity to the ranking of journals than prior approaches.

Suggested Citation

  • Kishen Iyengar & Venugopal Balijepally, 2015. "Ranking journals using the dominance hierarchy procedure: an illustration with IS journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 5-23, January.
    • Handle: RePEc:spr:scient:v:102:y:2015:i:1:d:10.1007_s11192-014-1444-y
    DOI: 10.1007/s11192-014-1444-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-014-1444-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-014-1444-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. van Eck, N.J.P. & Waltman, L., 2009. "How to Normalize Co-Occurrence Data? An Analysis of Some Well-Known Similarity Measures," ERIM Report Series Research in Management ERS-2009-001-LIS, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    2. Philip M. Davis, 2008. "Eigenfactor: Does the principle of repeated improvement result in better estimates than raw citation counts?," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(13), pages 2186-2188, November.
    3. Richard A. Harshman & Paul E. Green & Yoram Wind & Margaret E. Lundy, 1982. "A Model for the Analysis of Asymmetric Data in Marketing Research," Marketing Science, INFORMS, vol. 1(2), pages 205-242.
    4. Clyde W. Holsapple, 2008. "A publication power approach for identifying premier information systems journals," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(2), pages 166-185, January.
    5. Nees Jan van Eck & Ludo Waltman, 2009. "How to normalize cooccurrence data? An analysis of some well‐known similarity measures," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(8), pages 1635-1651, August.
    6. Michael E. Whitman & Anthony R. Hendrickson & Anthony M. Townsend, 1999. "Research Commentary. Academic Rewards for Teaching, Research, and Service: Data and Discourse," Information Systems Research, INFORMS, vol. 10(2), pages 99-109, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Justus Haucap & Johannes Muck, 2015. "What drives the relevance and reputation of economics journals? An update from a survey among economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 849-877, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Serhat Burmaoglu & Ozcan Saritas, 2019. "An evolutionary analysis of the innovation policy domain: Is there a paradigm shift?," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 823-847, March.
    2. Massimiliano M. Pellegrini & Riccardo Rialti & Giacomo Marzi & Andrea Caputo, 2020. "Sport entrepreneurship: A synthesis of existing literature and future perspectives," International Entrepreneurship and Management Journal, Springer, vol. 16(3), pages 795-826, September.
    3. Cathelijn J. F. Waaijer & Cornelis A. Bochove & Nees Jan Eck, 2011. "On the map: Nature and Science editorials," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(1), pages 99-112, January.
    4. María Pinto & Rosaura Fernández-Pascual & David Caballero-Mariscal & Dora Sales, 2020. "Information literacy trends in higher education (2006–2019): visualizing the emerging field of mobile information literacy," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1479-1510, August.
    5. Lilian Cervo Cabrera & Carlos Eduardo Caldarelli & Marcia Regina Gabardo Camara, 2020. "Mapping collaboration in international coffee certification research," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2597-2618, September.
    6. Duygu Buyukyazici & Leonardo Mazzoni & Massimo Riccaboni & Francesco Serti, 2024. "Workplace skills as regional capabilities: relatedness, complexity and industrial diversification of regions," Regional Studies, Taylor & Francis Journals, vol. 58(3), pages 469-489, March.
    7. Evi Sachini & Nikolaos Karampekios & Pierpaolo Brutti & Konstantinos Sioumalas-Christodoulou, 2020. "Should I stay or should I go? Using bibliometrics to identify the international mobility of highly educated Greek manpower," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 641-663, October.
    8. Ying Huang & Wolfgang Glänzel & Lin Zhang, 2021. "Tracing the development of mapping knowledge domains," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6201-6224, July.
    9. Pierre-Alexandre Balland & David Rigby & Ron Boschma, 2015. "The technological resilience of US cities," Cambridge Journal of Regions, Economy and Society, Cambridge Political Economy Society, vol. 8(2), pages 167-184.
    10. Valentina Di Iasio & Ernest Miguelez, 2022. "The ties that bind and transform: knowledge remittances, relatedness and the direction of technical change [Brain drain or brain bank? The impact of skilled emigration on poor-country innovation]," Journal of Economic Geography, Oxford University Press, vol. 22(2), pages 423-448.
    11. Dieter F. Kogler & Jürgen Essletzbichler & David L. Rigby, 2017. "The evolution of specialization in the EU15 knowledge space," Journal of Economic Geography, Oxford University Press, vol. 17(2), pages 345-373.
    12. Danilo Silva Carvalho & Lucas Lopes Felipe & Priscila Costa Albuquerque & Fabio Zicker & Bruna de Paula Fonseca, 2023. "Leadership and international collaboration on COVID-19 research: reducing the North–South divide?," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4689-4705, August.
    13. Matias Nehuen Iglesias, 2021. "The Overlooked Insights from Correlation Structures in Economic Geography," Papers in Evolutionary Economic Geography (PEEG) 2105, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Jan 2021.
    14. Mercedes Campi & Marco Duenas & Giorgio Fagiolo, 2019. "How do countries specialize in food production? A complex-network analysis of the global agricultural product space," LEM Papers Series 2019/37, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    15. Perianes-Rodriguez, Antonio & Waltman, Ludo & van Eck, Nees Jan, 2016. "Constructing bibliometric networks: A comparison between full and fractional counting," Journal of Informetrics, Elsevier, vol. 10(4), pages 1178-1195.
    16. Saudi‐Yulieth Enciso‐Alfaro & Isabel‐María García‐Sánchez, 2023. "Corporate governance and environmental sustainability: Addressing the dual theme from a bibliometric approach," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 30(3), pages 1025-1041, May.
    17. Jiang, Chenming & Bhat, Chandra R. & Lam, William H.K., 2020. "A bibliometric overview of Transportation Research Part B: Methodological in the past forty years (1979–2019)," Transportation Research Part B: Methodological, Elsevier, vol. 138(C), pages 268-291.
    18. Ron Boschma & Ernest Miguelez & Rosina Moreno & Diego B. Ocampo-Corrales, 2021. "Technological breakthroughs in European regions: the role of related and unrelated combinations," Papers in Evolutionary Economic Geography (PEEG) 2118, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Jun 2021.
    19. Jong-Hyun Kim & Yong-Gil Lee, 2020. "Patent Analysis on the Development of the Shale Petroleum Industry Based on a Network of Technological Indices," Energies, MDPI, vol. 13(24), pages 1-15, December.
    20. Adrián Kovács & Bart Looy & Bruno Cassiman, 2015. "Exploring the scope of open innovation: a bibliometric review of a decade of research," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 951-983, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:102:y:2015:i:1:d:10.1007_s11192-014-1444-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.