IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v76y2008i1d10.1007_s11192-007-1895-5.html
   My bibliography  Save this article

Ranking Taiwanese management journals: A case study

Author

Listed:
  • Chiang Kao

    (National Cheng Kung University)

  • Hsiou-Wei Lin

    (National Taiwan University)

  • San-Lin Chung

    (National Taiwan University)

  • Wei-Chi Tsai

    (National Cheng Chi University)

  • Jyh-Shen Chiou

    (National Cheng Chi University)

  • Yen-Liang Chen

    (National Central University)

  • Liang-Hsuan Chen

    (National Cheng Kung University)

  • Shih-Chieh Fang

    (National Cheng Kung University)

  • Hwei-Lan Pao

    (National Science Council)

Abstract

To improve the quality of journals in Taiwan, the National Science Council (NSC) of the Republic of China evaluates journals in the fields of humanities and social sciences periodically. This paper describes the evaluation of 46 management journals conducted by the authors, as authorized by the NSC. Both a subjective approach, with judgments solicited from 345 experts, and an objective approach, with data collected on four indicators: journal cross citation, dissertation citation, authors’ scholastic reputation, and author diversity, were used to make a comprehensive evaluation. Performance in the four indicators were aggregated using weights which were most favourable to all journals, in a compromise sense, to produce the composite indices. The subjective evaluation reflects the general image, or reputation, of journals while the objective evaluation discloses blind spots which have been overlooked by experts. The results show that using either approach alone would have produced results which are misleading, which suggests that both approaches should be used. All of the editors of the journals being evaluated agreed that the evaluation was appropriate and the results are reasonable.

Suggested Citation

  • Chiang Kao & Hsiou-Wei Lin & San-Lin Chung & Wei-Chi Tsai & Jyh-Shen Chiou & Yen-Liang Chen & Liang-Hsuan Chen & Shih-Chieh Fang & Hwei-Lan Pao, 2008. "Ranking Taiwanese management journals: A case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(1), pages 95-115, July.
  • Handle: RePEc:spr:scient:v:76:y:2008:i:1:d:10.1007_s11192-007-1895-5
    DOI: 10.1007/s11192-007-1895-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-007-1895-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-007-1895-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gunther Maier, 2006. "Impact factors and peer judgment: The case of regional science journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(3), pages 651-667, December.
    2. Gerard Pasterkamp & Joris I. Rotmans & Dominique V. P. Kleijn & Cornelius Borst, 2007. "Citation frequency: A biased measure of research impact significantly influenced by the geographical origin of research articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 70(1), pages 153-165, January.
    3. Thomas E. Nisonger, 1999. "JASIS and library and information science journal rankings: A review and analysis of the last half‐century," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 50(11), pages 1004-1019.
    4. Josephine E. Olson, 2005. "Top-25-Business-School Professors Rate Journals in Operations Management and Related Fields," Interfaces, INFORMS, vol. 35(4), pages 323-338, August.
    5. Ellen Bonnevie-Nebelong, 2006. "Journal citation identity, journal citation image and internationalisation: Methods for journal evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(2), pages 411-424, February.
    6. I Horowitz, 2003. "Preference-neutral attribute weights in the journal-ranking problem," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(5), pages 452-457, May.
    7. C Kao & H-T Hung, 2005. "Data envelopment analysis with common weights: the compromise solution approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 56(10), pages 1196-1203, October.
    8. Linda Butler, 2002. "Identifying "highly-rated" journals - an Australian case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 207-227, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Emanuel Kulczycki & Ewa A. Rozkosz, 2017. "Does an expert-based evaluation allow us to go beyond the Impact Factor? Experiences from building a ranking of national journals in Poland," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 417-442, April.
    2. Chiang Kao, 2009. "The authorship and internationality of Industrial Engineering journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(1), pages 123-136, October.
    3. Zahid Halim & Shafaq Khan, 2019. "A data science-based framework to categorize academic journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 393-423, April.
    4. Fu-Sheng Tsai & Chin-Chiung Kuo & Julia L. Lin, 2020. "Knowledge Heterogenization of the Franchising Literature Applying Transaction Cost Economics," Economies, MDPI, vol. 8(4), pages 1-27, November.
    5. Yi-Ching Liaw & Te-Yi Chan & Chin-Yuan Fan & Cheng-Hsin Chiang, 2014. "Can the technological impact of academic journals be evaluated? The practice of non-patent reference (NPR) analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 17-37, October.
    6. Serenko, Alexander & Dohan, Michael, 2011. "Comparing the expert survey and citation impact journal ranking methods: Example from the field of Artificial Intelligence," Journal of Informetrics, Elsevier, vol. 5(4), pages 629-648.
    7. Serenko, Alexander & Bontis, Nick, 2013. "First in, best dressed: The presence of order-effect bias in journal ranking surveys," Journal of Informetrics, Elsevier, vol. 7(1), pages 138-144.
    8. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2015. "Towards a consolidation of worldwide journal rankings – A classification using random forests and aggregate rating via data envelopment analysis," Omega, Elsevier, vol. 51(C), pages 11-23.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chiang Kao, 2009. "The authorship and internationality of Industrial Engineering journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(1), pages 123-136, October.
    2. Serenko, Alexander & Dohan, Michael, 2011. "Comparing the expert survey and citation impact journal ranking methods: Example from the field of Artificial Intelligence," Journal of Informetrics, Elsevier, vol. 5(4), pages 629-648.
    3. Chiang Kao & Hwei-Lan Pao, 2009. "An evaluation of research performance in management of 168 Taiwan universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(2), pages 261-277, February.
    4. Walters, William H., 2017. "Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact?," Journal of Informetrics, Elsevier, vol. 11(3), pages 730-744.
    5. Wen-Yau Cathy Lin, 2012. "Research status and characteristics of library and information science in Taiwan: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 7-21, July.
    6. Jingda Ding & Junping Qiu, 2011. "An approach to improve the indicator weights of scientific and technological competitiveness evaluation of Chinese universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(2), pages 285-297, February.
    7. Helmi Hammami & Thanh Ngo & David Tripe & Dinh-Tri Vo, 2022. "Ranking with a Euclidean common set of weights in data envelopment analysis: with application to the Eurozone banking sector," Annals of Operations Research, Springer, vol. 311(2), pages 675-694, April.
    8. Xianmei Wang & Hanhui Hu, 2017. "Sustainable Evaluation of Social Science Research in Higher Education Institutions Based on Data Envelopment Analysis," Sustainability, MDPI, vol. 9(4), pages 1-17, April.
    9. Fusco, Elisa, 2023. "Potential improvements approach in composite indicators construction: The Multi-directional Benefit of the Doubt model," Socio-Economic Planning Sciences, Elsevier, vol. 85(C).
    10. Dobos, Imre & Vörösmarty, Gyöngyi, 2014. "Green supplier selection and evaluation using DEA-type composite indicators," International Journal of Production Economics, Elsevier, vol. 157(C), pages 273-278.
    11. Hsieh, Pao-Nuan & Chang, Pao-Long, 2009. "An assessment of world-wide research productivity in production and operations management," International Journal of Production Economics, Elsevier, vol. 120(2), pages 540-551, August.
    12. Vassilios Babalos & Michael Doumpos & Nikolaos Philippas & Constantin Zopounidis, 2015. "Towards a Holistic Approach for Mutual Fund Performance Appraisal," Computational Economics, Springer;Society for Computational Economics, vol. 46(1), pages 35-53, June.
    13. Vicenç Hernández-González & Josep Maria Carné-Torrent & Carme Jové-Deltell & Álvaro Pano-Rodríguez & Joaquin Reverter-Masia, 2022. "The Top 100 Most Cited Scientific Papers in the Public, Environmental & Occupational Health Category of Web of Science: A Bibliometric and Visualized Analysis," IJERPH, MDPI, vol. 19(15), pages 1-24, August.
    14. Jesús Peiró-Palomino & Andrés J. Picazo-Tadeo, 2018. "Assessing well-being in European regions. Does government quality matter?," Working Papers 2018/06, Economics Department, Universitat Jaume I, Castellón (Spain).
    15. Alexander N. Larcombe & Sasha C. Voss, 2011. "Self-citation: comparison between Radiology, European Radiology and Radiology for 1997–1998," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(2), pages 347-356, May.
    16. Julián Martinez-Moya & Amparo Mestre-Alcover & Ramon Sala-Garrido, 2024. "Connectivity and competitiveness of the major Mediterranean container ports using ‘Benefit-of-the-Doubt’ and ‘Common Sets of Weights’ methods in Data Envelopment Analysis," Maritime Economics & Logistics, Palgrave Macmillan;International Association of Maritime Economists (IAME), vol. 26(2), pages 261-282, June.
    17. Xianmei Wang & Hanhui Hu, 2017. "Sustainability in Chinese Higher Educational Institutions’ Social Science Research: A Performance Interface toward Efficiency," Sustainability, MDPI, vol. 9(11), pages 1-18, October.
    18. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    19. Stéphane Blancard & Maximin Bonnet & Jean-François Hoarau, 2020. "The specific role of agriculture for economic vulnerability of small island spaces," Working Papers hal-02441237, HAL.
    20. Lei Chen & Fei-Mei Wu & Feng Feng & Fujun Lai & Ying-Ming Wang, 2018. "A Common Set of Weights for Ranking Decision-Making Units with Undesirable Outputs: A Double Frontiers Data Envelopment Analysis Approach," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 35(06), pages 1-25, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:76:y:2008:i:1:d:10.1007_s11192-007-1895-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.