IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v28y2000i1p17-36.html
   My bibliography  Save this article

A multi-method evaluation of journals in the decision and management sciences by US academics

Author

Listed:
  • Donohue, Joan M.
  • Fox, Jeremy B.

Abstract

Numerous studies published in the academic literature address the issue of journal quality. However, little has been done to evaluate the broad set of journals pertinent to academic research in the decision and management sciences. This study examines the quality of such journals from a US point of view using both survey- and citation-based measures of journal quality. The survey-based measure is the perceived quality ratings assigned by US academics in the management science field. The citation-based measure is the impact factor, an indication of how often the articles in a journal are cited. This study finds that perceived quality ratings of the journals are positively correlated with citation impact factors. Also, both of these quality measures are found to be positively correlated with journal circulation and negatively correlated with acceptance rate. Journal quality ratings appear to vary across reviewers with different research interest areas and reviewers seem to rate journals higher if they have published in them.

Suggested Citation

  • Donohue, Joan M. & Fox, Jeremy B., 2000. "A multi-method evaluation of journals in the decision and management sciences by US academics," Omega, Elsevier, vol. 28(1), pages 17-36, February.
    • Handle: RePEc:eee:jomega:v:28:y:2000:i:1:p:17-36
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305-0483(99)00024-9
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Richard Ormerod & Ioannis Kiossis, 1997. "OR/MS Publications: Extension of the Analysis of U.S. Flagship Journals to the United Kingdom," Operations Research, INFORMS, vol. 45(2), pages 178-187, April.
    2. Jones, M. J. & Brinn, T. & Pendlebury, M., 1996. "Judging the quality of research in business schools: A comment from accounting," Omega, Elsevier, vol. 24(5), pages 597-602, October.
    3. Goh, C. H. & Holsapple, C. W. & Johnson, L. E. & Tanner, J., 1996. "An empirical assessment of influences on POM research," Omega, Elsevier, vol. 24(3), pages 337-345, June.
    4. Ormerod, R. J., 1997. "An observation on publication habits based on the analysis of MS/OR journals," Omega, Elsevier, vol. 25(5), pages 599-603, October.
    5. Eom, S. B., 1995. "Decision support systems research: Reference disciplines and a cumulative tradition," Omega, Elsevier, vol. 23(5), pages 511-523, October.
    6. Brown, Ld & Gardner, Jc, 1985. "Using Citation Analysis To Assess The Impact Of Journals And Articles On Contemporary Accounting Research (Car)," Journal of Accounting Research, Wiley Blackwell, vol. 23(1), pages 84-109.
    7. Niemi, Albert W, Jr, 1987. "Institutional Contributions to the Leading Finance Journals, 1975 through 1986: A Note," Journal of Finance, American Finance Association, vol. 42(5), pages 1389-1397, December.
    8. Lawrence D. Brown & Ronald J. Huefner, 1994. "The Familiarity with and Perceived Quality of Accounting Journals: Views of Senior Accounting Faculty in Leading U.S. MBA Programs," Contemporary Accounting Research, John Wiley & Sons, vol. 11(1), pages 223-250, June.
    9. Uma G. Gupta, 1997. "Using Citation Analysis to Explore the Intellectual Base, Knowledge Dissemination, and Research Impact of Interfaces (1970–1992)," Interfaces, INFORMS, vol. 27(2), pages 85-101, April.
    10. Bush, Winston C & Hamelman, Paul W & Staaf, Robert J, 1974. "A Quality Index for Economic Journals," The Review of Economics and Statistics, MIT Press, vol. 56(1), pages 123-125, February.
    11. Mitchell, George, 1996. "Judging research quality and journals: A call for debate," Omega, Elsevier, vol. 24(5), pages 613-613, October.
    12. Ian C. Macmillan & Ilene Stern, 1987. "Delineating a forum for business policy scholars," Strategic Management Journal, Wiley Blackwell, vol. 8(2), pages 183-186, March.
    13. Doyle, J. R. & Arthurs, A. J. & Green, R. H. & McAulay, L. & Pitt, M. R. & Bottomley, P. A. & Evans, W., 1996. "The judge, the model of the judge, and the model of the judged as judge: Analyses of the UK 1992 research assessment exercise data for business and management studies," Omega, Elsevier, vol. 24(1), pages 13-28, February.
    14. Ederington, Louis H, 1979. "Aspects of the Production of Significant Financial Research," Journal of Finance, American Finance Association, vol. 34(3), pages 777-786, June.
    15. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    16. Michael H. Rothkopf, 1996. "Editorial: Which Universities Contribute to the Practice Literature? The First Interfaces Ranking," Interfaces, INFORMS, vol. 26(2), pages 16-21, April.
    17. William J. Moore, 1972. "The Relative Quality Of Economics Journals: A Suggested Rating System," Economic Inquiry, Western Economic Association International, vol. 10(2), pages 156-169, June.
    18. Doyle, J. R. & Arthurs, A. J., 1995. "Judging the quality of research in business schools: The UK as a case study," Omega, Elsevier, vol. 23(3), pages 257-270, June.
    19. Arthur M. Diamond Jr., 1986. "What is a Citation Worth?," Journal of Human Resources, University of Wisconsin Press, vol. 21(2), pages 200-215.
    20. Holsapple, CW & Johnson, LE & Manakyan, H & Tanner, J, 1994. "Business computing system research: Structuring the field," Omega, Elsevier, vol. 22(1), pages 69-81, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gohar Feroz Khan & Junghoon Moon & Han Woo Park & Bobby Swar & Jae Jeung Rho, 2011. "A socio-technical perspective on e-government issues in developing countries: a scientometrics approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(2), pages 267-286, May.
    2. Merigó, José M. & Yang, Jian-Bo, 2017. "A bibliometric analysis of operations research and management science," Omega, Elsevier, vol. 73(C), pages 37-48.
    3. Walters, William H., 2017. "Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact?," Journal of Informetrics, Elsevier, vol. 11(3), pages 730-744.
    4. Reyes Gonzalez & Juan Llopis & Jose Gasco, 2010. "What do we know about outsourcing in hotels?," The Service Industries Journal, Taylor & Francis Journals, vol. 31(10), pages 1669-1682, March.
    5. Thelwall, Mike & Fairclough, Ruth, 2015. "Geometric journal impact factors correcting for individual highly cited articles," Journal of Informetrics, Elsevier, vol. 9(2), pages 263-272.
    6. Michael F. Gorman & John J. Kanet, 2005. "Evaluating Operations Management--Related Journals via the Author Affiliation Index," Manufacturing & Service Operations Management, INFORMS, vol. 7(1), pages 3-19, February.
    7. Holsapple, Clyde W. & Lee-Post, Anita, 2010. "Behavior-based analysis of knowledge dissemination channels in operations management," Omega, Elsevier, vol. 38(3-4), pages 167-178, June.
    8. Bhimani, Hardik & Mention, Anne-Laure & Barlatier, Pierre-Jean, 2019. "Social media and innovation: A systematic literature review and future research directions," Technological Forecasting and Social Change, Elsevier, vol. 144(C), pages 251-269.
    9. Xiaoyan Liang & Xiwei Zhang & Renee Paulet & Leven Jianwen Zheng, 2022. "A Literature Review of the COVID-19 Pandemic’s Effect on Sustainable HRM," Sustainability, MDPI, vol. 14(5), pages 1-26, February.
    10. Bana e Costa, Carlos A. & Oliveira, Mónica D., 2012. "A multicriteria decision analysis model for faculty evaluation," Omega, Elsevier, vol. 40(4), pages 424-436.
    11. Wei, Yi-Ming & Mi, Zhi-Fu & Huang, Zhimin, 2015. "Climate policy modeling: An online SCI-E and SSCI based literature review," Omega, Elsevier, vol. 57(PA), pages 70-84.
    12. Meredith, Jack R. & Steward, Michelle D. & Lewis, Bruce R., 2011. "Knowledge dissemination in operations management: Published perceptions versus academic reality," Omega, Elsevier, vol. 39(4), pages 435-446, August.
    13. Forgionne, Guisseppi A. & Kohli, Rajiv & Jennings, Darniet, 2002. "An AHP analysis of quality in AI and DSS journals," Omega, Elsevier, vol. 30(3), pages 171-183, June.
    14. I Horowitz, 2003. "Preference-neutral attribute weights in the journal-ranking problem," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(5), pages 452-457, May.
    15. Alfaro, José A. & Montes, María J., 2002. "Lagging behind versus advancing too fast? identifying gaps research in supply chain," DEE - Working Papers. Business Economics. WB wb021409, Universidad Carlos III de Madrid. Departamento de Economía de la Empresa.
    16. Biehl, Markus & Kim, Henry & Wade, Michael, 2006. "Relationships among the academic business disciplines: a multi-method citation analysis," Omega, Elsevier, vol. 34(4), pages 359-371, August.
    17. Rose Baker & Dan Jackson, 2006. "Using Journal Impact Factors to Correct for the Publication Bias of Medical Studies," Biometrics, The International Biometric Society, vol. 62(3), pages 785-792, September.
    18. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    19. Serenko, Alexander & Dohan, Michael, 2011. "Comparing the expert survey and citation impact journal ranking methods: Example from the field of Artificial Intelligence," Journal of Informetrics, Elsevier, vol. 5(4), pages 629-648.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mitchell, George, 1996. "Judging research quality and journals: A call for debate," Omega, Elsevier, vol. 24(5), pages 613-613, October.
    2. Jones, Michael John, 1999. "Critically evaluating an applications vs theory framework for research quality," Omega, Elsevier, vol. 27(3), pages 397-401, June.
    3. Holsapple, Clyde W. & Lee-Post, Anita, 2010. "Behavior-based analysis of knowledge dissemination channels in operations management," Omega, Elsevier, vol. 38(3-4), pages 167-178, June.
    4. Jones, M. J. & Brinn, T. & Pendlebury, M., 1996. "Journal evaluation methodologies: A balanced response," Omega, Elsevier, vol. 24(5), pages 607-612, October.
    5. Vastag, Gyula & Montabon, Frank, 2002. "Journal characteristics, rankings and social acculturation in operations management," Omega, Elsevier, vol. 30(2), pages 109-126, April.
    6. Ormerod, R. J., 2000. "Is content analysis either practical or desirable for research evaluation?," Omega, Elsevier, vol. 28(2), pages 241-245, April.
    7. Jones, M. J. & Brinn, T. & Pendlebury, M., 1996. "Judging the quality of research in business schools: A comment from accounting," Omega, Elsevier, vol. 24(5), pages 597-602, October.
    8. Doyle, J. R. & Arthurs, A. J. & Mcaulay, L. & Osborne, P. G., 1996. "Citation as effortful voting: A reply to ones, Brinn and Pendlebury," Omega, Elsevier, vol. 24(5), pages 603-606, October.
    9. Wohlrabe, Klaus, 2016. "Taking the Temperature: A Meta-Ranking of Economics Journals," MPRA Paper 68933, University Library of Munich, Germany.
    10. Doyle, John R., 1999. "Evaluating OR/MS research," Omega, Elsevier, vol. 27(3), pages 403-405, June.
    11. Claudio Romano & Janek Ratnatunga, 1996. "A Citation Analysis of the Impact of Journals on Contemporary Small Enterprise Research," Entrepreneurship Theory and Practice, , vol. 20(3), pages 7-21, April.
    12. Ratnatunga, Janek & Romano, Claudio, 1997. "A "citation classics" analysis of articles in contemporary small enterprise research," Journal of Business Venturing, Elsevier, vol. 12(3), pages 197-212, May.
    13. Pedro Cosme Vieira & Aurora A. C. Teixeira, 2010. "Are finance, management, and marketing autonomous fields of scientific research? An analysis based on journal citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 627-646, December.
    14. Rodney H. Mabry & Arthur D. Sharplin, 1985. "The Relative Importance Of Journals Used In Finance Research," Journal of Financial Research, Southern Finance Association;Southwestern Finance Association, vol. 8(4), pages 287-296, December.
    15. Fang Xu & Wenbin Liu & Ronald Rousseau, 2015. "Introducing sub-impact factor (SIF-) sequences and an aggregated SIF-indicator for journal ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1577-1593, February.
    16. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    17. David Figlio, 1994. "Trends in the Publication of Empirical Economics," Journal of Economic Perspectives, American Economic Association, vol. 8(3), pages 179-187, Summer.
    18. Meltem Denizel & Behlul Usdiken & Deniz Tuncalp, 2003. "Drift or Shift? Continuity, Change, and International Variation in Knowledge Production in OR/MS," Operations Research, INFORMS, vol. 51(5), pages 711-720, October.
    19. Ignacio Palacios-Huerta & Oscar Volij, 2004. "The Measurement of Intellectual Influence," Econometrica, Econometric Society, vol. 72(3), pages 963-977, May.
    20. Chiang Kao, 2009. "The authorship and country spread of Operation Research journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(3), pages 397-407, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:28:y:2000:i:1:p:17-36. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.