IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-02567479.html
   My bibliography  Save this paper

The journal quality perception gap

Author

Listed:
  • Cormac Bryce

    (Cass Business School - City University London)

  • Michael Dowling

    (ESC [Rennes] - ESC Rennes School of Business)

  • Brian Lucey

    (Trinity College Dublin)

Abstract

We explore the drivers of researchers' perceptions around journal quality, and how these perceptions converge or diverge with national journal ranking systems. Prior to the release of the Academic Journal Guide (AJG) 2018 rankings list, we surveyed UK business school researchers, resulting in 19,597 individual journal rankings. We find a notable journal quality perception gap, with 39% of subjective rankings from the business and management community differing from the AJG 2018 rankings. We show that measures of personal connection to the AJG system have strong explanatory power. These factors include the usage of, and sentiment towards, the AJG list, as well as individual research success as measured by AJG rankings. Consistently, we find that high values for these factors narrow the quality perception gap, whereas low values widen it. We also find an increase in the quality perception gap for journals that a respondent has submitted to or reviewed for. Our research, thus, provides new insights into how researchers interact with journal ranking systems. We propose how researchers, business schools, and ranking bodies can incorporate these findings to improve stakeholders' consensus on research quality assessment.

Suggested Citation

  • Cormac Bryce & Michael Dowling & Brian Lucey, 2020. "The journal quality perception gap," Post-Print hal-02567479, HAL.
    • Handle: RePEc:hal:journl:hal-02567479
    DOI: 10.1016/j.respol.2020.103957
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Andreas G. F. Hoepner & Jeffrey Unerman, 2012. "Explicit and Implicit Subject Bias in the ABS Journal Quality Guide," Accounting Education, Taylor & Francis Journals, vol. 21(1), pages 3-15, December.
    2. Celsi, Richard L & Olson, Jerry C, 1988. "The Role of Involvement in Attention and Comprehension Processes," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 15(2), pages 210-224, September.
    3. Loewenstein, George, 1996. "Out of Control: Visceral Influences on Behavior," Organizational Behavior and Human Decision Processes, Elsevier, vol. 65(3), pages 272-292, March.
    4. Joseph S. Valacich & Mark A. Fuller & Christoph Schneider & Alan R. Dennis, 2006. "Issues and Opinions---Publication Opportunities in Premier Business Outlets: How Level Is the Playing Field?," Information Systems Research, INFORMS, vol. 17(2), pages 107-125, June.
    5. Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
    6. James J. Heckman & Sidharth Moktan, 2020. "Publishing and Promotion in Economics: The Tyranny of the Top Five," Journal of Economic Literature, American Economic Association, vol. 58(2), pages 419-470, June.
    7. Serenko, Alexander & Dohan, Michael, 2011. "Comparing the expert survey and citation impact journal ranking methods: Example from the field of Artificial Intelligence," Journal of Informetrics, Elsevier, vol. 5(4), pages 629-648.
    8. Alice Lam, 2007. "Knowledge Networks and Careers: Academic Scientists in Industry–University Links," Journal of Management Studies, Wiley Blackwell, vol. 44(6), pages 993-1016, September.
    9. Bryce, Cormac & Cheevers, Carly & Webb, Rob, 2013. "Operational risk escalation: An empirical analysis of UK call centres," International Review of Financial Analysis, Elsevier, vol. 30(C), pages 298-307.
    10. Brooks, Chris & Fenton, Evelyn M. & Walker, James T., 2014. "Gender and the evaluation of research," Research Policy, Elsevier, vol. 43(6), pages 990-1001.
    11. repec:bla:jfinan:v:53:y:1998:i:6:p:1839-1885 is not listed on IDEAS
    12. Vogel, Rick & Hattke, Fabian & Petersen, Jessica, 2017. "Journal rankings in management and business studies: What rules do we play by?," Research Policy, Elsevier, vol. 46(10), pages 1707-1722.
    13. Steenkamp, Jan-Benedict E. M., 1990. "Conceptual model of the quality perception process," Journal of Business Research, Elsevier, vol. 21(4), pages 309-333, December.
    14. Chavarro, Diego & Tang, Puay & Ràfols, Ismael, 2017. "Why researchers publish in non-mainstream journals: Training, knowledge bridging, and gap filling," Research Policy, Elsevier, vol. 46(9), pages 1666-1680.
    15. Cormac Bryce & Thorsten Chmura & Rob Webb & Joel Stiebale & Carly Cheevers, 2019. "Internally Reporting Risk in Financial Services: An Empirical Analysis," Journal of Business Ethics, Springer, vol. 156(2), pages 493-512, May.
    16. Kostas Axarloglou & Vasilis Theoharakis, 2003. "Diversity in Economics: An Analysis of Journal Quality Perceptions," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1402-1423, December.
    17. Gloria Agyemang & Jane Broadbent, 2015. "Management control systems and research management in universities," Accounting, Auditing & Accountability Journal, Emerald Group Publishing Limited, vol. 28(7), pages 1018-1046, September.
    18. John Hudson & David N. Laband, 2013. "Using and Interpreting Journal Rankings: Introduction," Economic Journal, Royal Economic Society, vol. 0, pages 199-201, August.
    19. Simon Hussain, 2011. "Food for Thought on the ABS Academic Journal Quality Guide," Accounting Education, Taylor & Francis Journals, vol. 20(6), pages 545-559, June.
    20. Violina P. Rindova & Charles J. Fombrun, 1999. "Constructing competitive advantage: the role of firm–constituent interactions," Strategic Management Journal, Wiley Blackwell, vol. 20(8), pages 691-710, August.
    21. Hussain, Simon, 2010. "Accounting journals and the ABS quality ratings," The British Accounting Review, Elsevier, vol. 42(1), pages 1-16.
    22. Samuelson, William & Zeckhauser, Richard, 1988. "Status Quo Bias in Decision Making," Journal of Risk and Uncertainty, Springer, vol. 1(1), pages 7-59, March.
    23. Vivien Beattie & Alan Goodacre, 2012. "Publication records of accounting and finance faculty promoted to professor: evidence from the UK," Accounting and Business Research, Taylor & Francis Journals, vol. 42(2), pages 197-231, June.
    24. Diana Hicks & Paul Wouters & Ludo Waltman & Sarah de Rijcke & Ismael Rafols, 2015. "Bibliometrics: The Leiden Manifesto for research metrics," Nature, Nature, vol. 520(7548), pages 429-431, April.
    25. Rao, Akshay R & Monroe, Kent B, 1988. "The Moderating Effect of Prior Knowledge on Cue Utilization in Product Evaluations," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 15(2), pages 253-264, September.
    26. Alan Sangster, 2015. "You Cannot Judge a Book by Its Cover: The Problems with Journal Rankings," Accounting Education, Taylor & Francis Journals, vol. 24(3), pages 175-186, June.
    27. Salter, Ammon & Salandra, Rossella & Walker, James, 2017. "Exploring preferences for impact versus publications among UK business and management academics," Research Policy, Elsevier, vol. 46(10), pages 1769-1782.
    28. Claire-France Picard & Sylvain Durocher & Yves Gendron, 2019. "Desingularization and Dequalification: A Foray Into Ranking Production and Utilization Processes," European Accounting Review, Taylor & Francis Journals, vol. 28(4), pages 737-765, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zeynep Didem Unutmaz Durmuşoğlu & Alptekin Durmuşoğlu, 2021. "A TOPSIS model for understanding the authors choice of journal selection," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 521-543, January.
    2. Domingo Docampo & Vicente Safón, 2021. "Journal ratings: a paper affiliation methodology," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 8063-8090, September.
    3. Berninger, Marc & Kiesel, Florian & Schiereck, Dirk & Gaar, Eduard, 2021. "Citations and the readers’ information-extracting costs of finance articles," Journal of Banking & Finance, Elsevier, vol. 131(C).
    4. Thelwall, Mike & Kousha, Kayvan & Stuart, Emma & Makita, Meiko & Abdoli, Mahshid & Wilson, Paul & Levitt, Jonathan, 2023. "Do bibliometrics introduce gender, institutional or interdisciplinary biases into research evaluations?," Research Policy, Elsevier, vol. 52(8).
    5. Piotr Śpiewanowski & Oleksandr Talavera, 2021. "Journal rankings and publication strategy," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3227-3242, April.
    6. Auschra, Carolin & Bartosch, Julia & Lohmeyer, Nora, 2022. "Differences in female representation in leading management and organization journals: Establishing a benchmark," Research Policy, Elsevier, vol. 51(3).
    7. Tian, Jinfang & Zhang, Mingxuan & Xue, Rui & Cao, Wei & Shan, Yuli, 2022. "The face of achievement: Editors' facial structure and journal performance," International Review of Financial Analysis, Elsevier, vol. 84(C).
    8. Brooks, Chris & Schopohl, Lisa & Walker, James T., 2023. "Comparing perceptions of the impact of journal rankings between fields," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 90(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brooks, Chris & Schopohl, Lisa & Walker, James T., 2023. "Comparing perceptions of the impact of journal rankings between fields," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 90(C).
    2. Drivas, Kyriakos & Kremmydas, Dimitris, 2020. "The Matthew effect of a journal's ranking," Research Policy, Elsevier, vol. 49(4).
    3. Simon Hussain & Lana Liu & Yue Wang & Lingyan Zuo, 2015. "Journal Rankings, Collaborative Research and Publication Strategies: Evidence from China," Accounting Education, Taylor & Francis Journals, vol. 24(3), pages 233-255, June.
    4. Argento, Daniela & van Helden, Jan, 2023. "Are public sector accounting researchers going through an identity shift due to the increasing importance of journal rankings?," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 96(C).
    5. Gebreiter, Florian, 2022. "A profession in peril? University corporatization, performance measurement and the sustainability of accounting academia," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 87(C).
    6. Domingo Docampo & Vicente Safón, 2021. "Journal ratings: a paper affiliation methodology," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 8063-8090, September.
    7. W. Verbeke & I. Vermeir & Z. Pieniak & K. Brunsø, 2005. "Consumers’ quality perception as a basis for fish market segmentation in Belgium," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 05/351, Ghent University, Faculty of Economics and Business Administration.
    8. Hussain, Simon & Liu, Lana Yan Jun & Miller, Anthony D., 2020. "Accounting as a dichotomised discipline: An analysis of the source materials used in the construction of accounting articles," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 66(C).
    9. Osterloh, Margit & Frey, Bruno S., 2020. "How to avoid borrowed plumes in academia," Research Policy, Elsevier, vol. 49(1).
    10. Piotr Śpiewanowski & Oleksandr Talavera, 2021. "Journal rankings and publication strategy," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3227-3242, April.
    11. Mario Fernandes & Andreas Walter, 2023. "The times they are a-changin’: profiling newly tenured business economics professors in Germany over the past thirty years," Journal of Business Economics, Springer, vol. 93(5), pages 929-971, July.
    12. Eliseo Reategui & Alause Pires & Michel Carniato & Sergio Roberto Kieling Franco, 2020. "Evaluation of Brazilian research output in education: confronting international and national contexts," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 427-444, October.
    13. Schmal, W. Benedikt & Haucap, Justus & Knoke, Leon, 2023. "The role of gender and coauthors in academic publication behavior," Research Policy, Elsevier, vol. 52(10).
    14. Gosnell, Greer K., 2018. "Communicating Resourcefully: A Natural Field Experiment on Environmental Framing and Cognitive Dissonance in Going Paperless," Ecological Economics, Elsevier, vol. 154(C), pages 128-144.
    15. Colleen E. McClure & Justin M. Lawrence & Todd J. Arnold & Lisa K. Scheer, 2023. "The opportunities and costs of highly involved organizational buyers," Journal of the Academy of Marketing Science, Springer, vol. 51(2), pages 480-501, March.
    16. Erich Battistin & Marco Ovidi, 2022. "Rising Stars: Expert Reviews and Reputational Yardsticks in the Research Excellence Framework," Economica, London School of Economics and Political Science, vol. 89(356), pages 830-848, October.
    17. de Bont, Cees J. P. M. & Schoormans, Jan P. L., 1995. "The effects of product expertise on consumer evaluations of new-product concepts," Journal of Economic Psychology, Elsevier, vol. 16(4), pages 599-615, December.
    18. Justus Haucap, 2020. "Wirtschaftswissenschaftliche Politikberatung in Deutschland: Stärken, Schwächen, Optimierungspotenzial," Springer Books, in: Dirk Loerwald (ed.), Ökonomische Erkenntnisse verständlich vermitteln, pages 45-78, Springer.
    19. Carlo D'Ippoliti, 2021. "“Many‐Citedness”: Citations Measure More Than Just Scientific Quality," Journal of Economic Surveys, Wiley Blackwell, vol. 35(5), pages 1271-1301, December.
    20. On Amir & Dan Ariely & Alan Cooke & David Dunning & Nicholas Epley & Uri Gneezy & Botond Koszegi & Donald Lichtenstein & Nina Mazar & Sendhil Mullainathan & Drazen Prelec & Eldar Shafir & Jose Silva, 2005. "Psychology, Behavioral Economics, and Public Policy," Marketing Letters, Springer, vol. 16(3), pages 443-454, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-02567479. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.