IDEAS home Printed from https://ideas.repec.org/a/inm/orinte/v41y2011i4p375-388.html
   My bibliography  Save this article

Evaluating OR/MS Journals via PageRank

Author

Listed:
  • Zhou Xu

    (Department of Logistics and Maritime Studies, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong)

  • Brenda Cheang

    (School of Management, Huazhong University of Science and Technology, 430074 Wuhan, China)

  • Andrew Lim

    (Department of Management Sciences, The City University of Hong Kong, Kowloon Tong, Hong Kong)

  • Qi Wen

    (Department of Management Sciences, The City University of Hong Kong, Kowloon Tong, Hong Kong)

Abstract

Scholars, practitioners, and students in operations research and management science (OR/MS) often hesitate to use traditional approaches to evaluate journal quality because of the inconsistency of these approaches to perceptions and other associated biases. We introduce an alternative approach, which is based on Google's PageRank, to evaluate 31 OR/MS journals. This approach enhances the impact factor method by considering both citation quantity and quality. When we apply our method to OR/MS journals, the results match survey opinions and significantly outperform rankings based on impact factors. In addition, we provide an extensive discussion of other methods that have been used to assess journal quality. Compared to these methods, our method is better able to discern quality differences for journals that are perceived to be of relatively higher quality. Most importantly, we integrate our method into a Web-based journal-ranking system.

Suggested Citation

  • Zhou Xu & Brenda Cheang & Andrew Lim & Qi Wen, 2011. "Evaluating OR/MS Journals via PageRank," Interfaces, INFORMS, vol. 41(4), pages 375-388, August.
    • Handle: RePEc:inm:orinte:v:41:y:2011:i:4:p:375-388
    DOI: 10.1287/inte.1110.0557
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/inte.1110.0557
    Download Restriction: no
    File URL: https://libkey.io/10.1287/inte.1110.0557?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Rik Pieters & Hans Baumgartner, 2002. "Who Talks to Whom? Intra- and Interdisciplinary Communication of Economics Journals," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 483-509, June.
    2. Goh, C. H. & Holsapple, C. W. & Johnson, L. E. & Tanner, J., 1996. "An empirical assessment of influences on POM research," Omega, Elsevier, vol. 24(3), pages 337-345, June.
    3. Loet Leydesdorff, 2008. "Caveats for the use of citation indicators in research and journal evaluations," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(2), pages 278-287, January.
    4. Ignacio Palacios-Huerta & Oscar Volij, 2004. "The Measurement of Intellectual Influence," Econometrica, Econometric Society, vol. 72(3), pages 963-977, May.
    5. Michael F. Gorman & J. J. Kanet, 2007. "Note--"OM Forum: Evaluating Operations Management-Related Journals via the Author Affiliation Index"--Do Professors at Top U.S. Business Schools Do What They Say?," Manufacturing & Service Operations Management, INFORMS, vol. 9(1), pages 51-53, March.
    6. Josephine E. Olson, 2005. "Top-25-Business-School Professors Rate Journals in Operations Management and Related Fields," Interfaces, INFORMS, vol. 35(4), pages 323-338, August.
    7. Michael F. Gorman & John J. Kanet, 2005. "Evaluating Operations Management--Related Journals via the Author Affiliation Index," Manufacturing & Service Operations Management, INFORMS, vol. 7(1), pages 3-19, February.
    8. Frank L DuBois & David Reeb, 2000. "Ranking the International Business Journals," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 31(4), pages 689-704, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Romero-Silva, Rodrigo & de Leeuw, Sander, 2021. "Learning from the past to shape the future: A comprehensive text mining analysis of OR/MS reviews," Omega, Elsevier, vol. 100(C).
    2. Brenda Cheang & Chongshou Li & Andrew Lim & Zhenzhen Zhang, 2015. "Identifying patterns and structural influences in the scientific communication of business knowledge," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(1), pages 159-189, April.
    3. Brenda Cheang & Samuel Kai Wah Chu & Chongshou Li & Andrew Lim, 2014. "OR/MS journals evaluation based on a refined PageRank method: an updated and more comprehensive review," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(2), pages 339-361, August.
    4. Venkata Mrudula Bhimavarapu & Shailesh Rastogi & Preeti Mulay, 2023. "A Bibliometric Study on Corporate Transparency and Disclosures," FIIB Business Review, , vol. 12(2), pages 138-157, June.
    5. Rosenthal, Edward C. & Weiss, Howard J., 2017. "A data envelopment analysis approach for ranking journals," Omega, Elsevier, vol. 70(C), pages 135-147.
    6. Liao, Huchang & Tang, Ming & Li, Zongmin & Lev, Benjamin, 2019. "Bibliometric analysis for highly cited papers in operations research and management science from 2008 to 2017 based on Essential Science Indicators," Omega, Elsevier, vol. 88(C), pages 223-236.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brenda Cheang & Samuel Kai Wah Chu & Chongshou Li & Andrew Lim, 2014. "OR/MS journals evaluation based on a refined PageRank method: an updated and more comprehensive review," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(2), pages 339-361, August.
    2. Brenda Cheang & Chongshou Li & Andrew Lim & Zhenzhen Zhang, 2015. "Identifying patterns and structural influences in the scientific communication of business knowledge," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(1), pages 159-189, April.
    3. Holsapple, Clyde W. & Lee-Post, Anita, 2010. "Behavior-based analysis of knowledge dissemination channels in operations management," Omega, Elsevier, vol. 38(3-4), pages 167-178, June.
    4. Rosenthal, Edward C. & Weiss, Howard J., 2017. "A data envelopment analysis approach for ranking journals," Omega, Elsevier, vol. 70(C), pages 135-147.
    5. Meredith, Jack R. & Steward, Michelle D. & Lewis, Bruce R., 2011. "Knowledge dissemination in operations management: Published perceptions versus academic reality," Omega, Elsevier, vol. 39(4), pages 435-446, August.
    6. Timothy D. Fry & Joan M. Donohue, 2014. "Exploring the Author Affiliation Index," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 1647-1667, March.
    7. Necmi Avkiran & Karen Alpert, 2015. "The influence of co-authorship on article impact in OR/MS/OM and the exchange of knowledge with Finance in the twenty-first century," Annals of Operations Research, Springer, vol. 235(1), pages 51-73, December.
    8. Walters, William H., 2017. "Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact?," Journal of Informetrics, Elsevier, vol. 11(3), pages 730-744.
    9. Hsieh, Pao-Nuan & Chang, Pao-Long, 2009. "An assessment of world-wide research productivity in production and operations management," International Journal of Production Economics, Elsevier, vol. 120(2), pages 540-551, August.
    10. Frederic S. Lee & Bruce C. Cronin & Scott McConnell & Erik Dean, 2010. "Research Quality Rankings of Heterodox Economic Journals in a Contested Discipline," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1409-1452, November.
    11. Klaus Ritzberger, 2008. "Eine invariante Bewertung wirtschaftswissenschaftlicher Fachzeitschriften," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 9(3), pages 267-285, August.
    12. Laura Vana & Ronald Hochreiter & Kurt Hornik, 2016. "Computing a journal meta-ranking using paired comparisons and adaptive lasso estimators," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 229-251, January.
    13. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    14. Wohlrabe, Klaus, 2016. "Taking the Temperature: A Meta-Ranking of Economics Journals," MPRA Paper 68933, University Library of Munich, Germany.
    15. repec:bla:germec:v:9:y:2008:i::p:402-430 is not listed on IDEAS
    16. Michael F. Gorman & J. J. Kanet, 2007. "Note--"OM Forum: Evaluating Operations Management-Related Journals via the Author Affiliation Index"--Do Professors at Top U.S. Business Schools Do What They Say?," Manufacturing & Service Operations Management, INFORMS, vol. 9(1), pages 51-53, March.
    17. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2015. "Towards a consolidation of worldwide journal rankings – A classification using random forests and aggregate rating via data envelopment analysis," Omega, Elsevier, vol. 51(C), pages 11-23.
    18. Ham, John C. & Wright, Julian & Ye, Ziqiu, 2023. "Documenting and Explaining the Dramatic Rise of the New Society Journals in Economics," IZA Discussion Papers 16337, Institute of Labor Economics (IZA).
    19. Azar, Ofer H., 2008. "The impact of economics on management," Journal of Economic Behavior & Organization, Elsevier, vol. 68(3-4), pages 667-675, December.
    20. Serenko, Alexander & Dohan, Michael, 2011. "Comparing the expert survey and citation impact journal ranking methods: Example from the field of Artificial Intelligence," Journal of Informetrics, Elsevier, vol. 5(4), pages 629-648.
    21. Gianfranco Di Vaio & Jacob Louis Weisdorf, 2010. "Ranking economic history journals: a citation-based impact-adjusted analysis," Cliometrica, Journal of Historical Economics and Econometric History, Association Française de Cliométrie (AFC), vol. 4(1), pages 1-17, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orinte:v:41:y:2011:i:4:p:375-388. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.