IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v67y2014i5p998-1006.html
   My bibliography  Save this article

How to derive consensus among various marketing journal rankings?

Author

Listed:
  • Theuβl, Stefan
  • Reutterer, Thomas
  • Hornik, Kurt

Abstract

Despite the increasing popularity of journal rankings to evaluate the quality of research contributions, the individual rankings for journals that ranked below the top tier of publications usually feature only modest agreement. Attempts to merge rankings into meta-rankings suffer from some methodological issues, such as mixed measurement scales and incomplete data. This paper addresses the issue of how to construct suitable aggregates of individual journal rankings, using an optimization-based consensus ranking approach. The authors apply the proposed method to a subset of marketing-related journals from a list of collected journal rankings. Next, the paper studies the stability of the derived consensus solution, and the degeneration effects that occur when excluding journals and/or rankings. Finally, the authors investigate the similarities/dissimilarities of the consensus with a naive meta-ranking and with individual rankings. The results show that, even though journals are not uniformly ranked, one may derive a consensus ranking with considerably high agreement with the individual rankings.

Suggested Citation

  • Theuβl, Stefan & Reutterer, Thomas & Hornik, Kurt, 2014. "How to derive consensus among various marketing journal rankings?," Journal of Business Research, Elsevier, vol. 67(5), pages 998-1006.
    • Handle: RePEc:eee:jbrese:v:67:y:2014:i:5:p:998-1006
    DOI: 10.1016/j.jbusres.2013.08.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0148296313003032
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jbusres.2013.08.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bancroft, Diccon R. E. & Gopinath, C. & Kovacs, Agnes M. & Rejto, Lidia K., 1999. "A new methodology for aggregating tables: Summarizing journal quality data," Journal of Business Venturing, Elsevier, vol. 14(3), pages 311-319, May.
    2. Cook, Wade D., 2006. "Distance-based and ad hoc consensus models in ordinal preference ranking," European Journal of Operational Research, Elsevier, vol. 172(2), pages 369-385, July.
    3. Pieters, R. & Baumgartner, H. & Vermunt, J.K. & Bijmolt, T.H.A., 1999. "Importance and similarity in the evolving citation network of the International Journal of Research in Marketing," Other publications TiSEM e2c16930-bf58-49ae-8cc9-f, Tilburg University, School of Economics and Management.
    4. Ofer H. Azar & David M. Brock, 2008. "A Citation‐Based Ranking of Strategic Management Journals," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 17(3), pages 781-802, September.
    5. Frank L DuBois & David Reeb, 2000. "Ranking the International Business Journals," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 31(4), pages 689-704, December.
    6. de Leeuw, Jan & Mair, Patrick, 2009. "Multidimensional Scaling Using Majorization: SMACOF in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 31(i03).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ruturaj Baber & Yogesh Upadhyay & Prerana Baber & Rahul Pratap Singh Kaurav, 2023. "Three Decades of Consumer Ethnocentrism Research: A Bibliometric Analysis," Business Perspectives and Research, , vol. 11(1), pages 137-158, January.
    2. Rishikesh Bhaiswar & N. Meenakshi & Deepak Chawla, 2021. "Evolution of Electronic Word of Mouth: A Systematic Literature Review Using Bibliometric Analysis of 20 Years (2000–2020)," FIIB Business Review, , vol. 10(3), pages 215-231, September.
    3. Chris Wagner, 2020. "Deducing a state-of-the-art presentation of the Eclectic Paradigm from four decades of development: a systematic literature review," Management Review Quarterly, Springer, vol. 70(1), pages 51-96, February.
    4. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2016. "Revisiting the standing of international business journals in the competitive landscape," Journal of World Business, Elsevier, vol. 51(4), pages 487-498.
    5. Gianfranco Ennas & Battista Biggio & Maria Chiara Di Guardo, 2015. "Data-driven journal meta-ranking in business and management," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1911-1929, December.
    6. Zahoor, Nadia & Al-Tabbaa, Omar, 2020. "Inter-organizational collaboration and SMEs’ innovation: A systematic review and future research directions," Scandinavian Journal of Management, Elsevier, vol. 36(2).
    7. Laura Vana & Ronald Hochreiter & Kurt Hornik, 2016. "Computing a journal meta-ranking using paired comparisons and adaptive lasso estimators," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 229-251, January.
    8. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2015. "Towards a consolidation of worldwide journal rankings – A classification using random forests and aggregate rating via data envelopment analysis," Omega, Elsevier, vol. 51(C), pages 11-23.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jessica Petersen & Fabian Hattke & Rick Vogel, 2017. "Editorial governance and journal impact: a study of management and business journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1593-1614, September.
    2. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2015. "Towards a consolidation of worldwide journal rankings – A classification using random forests and aggregate rating via data envelopment analysis," Omega, Elsevier, vol. 51(C), pages 11-23.
    3. Yadong Luo & Huan Zhang & Juan Bu, 2019. "Developed country MNEs investing in developing economies: Progress and prospect," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 50(4), pages 633-667, June.
    4. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2011. "An updated ranking of academic journals in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 44(4), pages 1525-1538, November.
    5. Dimitris Tsintsaris & Milan Tsompanoglou & Evangelos Ioannidis, 2024. "Dynamics of Social Influence and Knowledge in Networks: Sociophysics Models and Applications in Social Trading, Behavioral Finance and Business," Mathematics, MDPI, vol. 12(8), pages 1-27, April.
    6. Qi Wei & Rui Wang & Chuan-Yang Ruan, 2024. "Similarity Measures of Probabilistic Interval Preference Ordering Sets and Their Applications in Decision-Making," Mathematics, MDPI, vol. 12(20), pages 1-26, October.
    7. Andrea Aveni & Ludovico Crippa & Giulio Principi, 2024. "On the Weighted Top-Difference Distance: Axioms, Aggregation, and Approximation," Papers 2403.15198, arXiv.org, revised Mar 2024.
    8. Fujun Hou, 2015. "A Consensus Gap Indicator and Its Application to Group Decision Making," Group Decision and Negotiation, Springer, vol. 24(3), pages 415-428, May.
    9. Walesiak Marek & Dudek Andrzej, 2017. "Selecting the Optimal Multidimensional Scaling Procedure for Metric Data With R Environment," Statistics in Transition New Series, Statistics Poland, vol. 18(3), pages 521-540, September.
    10. Frederic S. Lee & Bruce C. Cronin & Scott McConnell & Erik Dean, 2010. "Research Quality Rankings of Heterodox Economic Journals in a Contested Discipline," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1409-1452, November.
    11. Wu, Zhibin & Huang, Shuai & Xu, Jiuping, 2019. "Multi-stage optimization models for individual consistency and group consensus with preference relations," European Journal of Operational Research, Elsevier, vol. 275(1), pages 182-194.
    12. Pongou, Roland & Tchantcho, Bertrand & Tedjeugang, Narcisse, 2014. "Power theories for multi-choice organizations and political rules: Rank-order equivalence," Operations Research Perspectives, Elsevier, vol. 1(1), pages 42-49.
    13. Jabeur, Khaled & Martel, Jean-Marc, 2007. "An ordinal sorting method for group decision-making," European Journal of Operational Research, Elsevier, vol. 180(3), pages 1272-1289, August.
    14. Akbari, Sina & Escobedo, Adolfo R., 2023. "Beyond kemeny rank aggregation: A parameterizable-penalty framework for robust ranking aggregation with ties," Omega, Elsevier, vol. 119(C).
    15. Zhang, Hengjie & Dong, Yucheng & Chiclana, Francisco & Yu, Shui, 2019. "Consensus efficiency in group decision making: A comprehensive comparative study and its optimal design," European Journal of Operational Research, Elsevier, vol. 275(2), pages 580-598.
    16. Pisani, Niccolò & Kourula, Arno & Kolk, Ans & Meijer, Renske, 2017. "How global is international CSR research? Insights and recommendations from a systematic review," Journal of World Business, Elsevier, vol. 52(5), pages 591-614.
    17. Agnieszka Chidlow & Pervez N. Ghauri, 2014. "What incentives are being used by International Business Researchers in Their Surveys? A Review," William Davidson Institute Working Papers Series wp1086, William Davidson Institute at the University of Michigan.
    18. Dzemyda, Gintautas & Sabaliauskas, Martynas, 2021. "Geometric multidimensional scaling: A new approach for data dimensionality reduction," Applied Mathematics and Computation, Elsevier, vol. 409(C).
    19. Dafnis Coudounaris & Olga Kvasova & Leonidas C. Leonidou & Leyland F. Pitt & Deon Nel, 2009. "Fifteen Good Years," Management International Review, Springer, vol. 49(5), pages 671-684, October.
    20. Zhan, Ge, 2013. "Statistical power in international business research: Study levels and data types," International Business Review, Elsevier, vol. 22(4), pages 678-686.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:67:y:2014:i:5:p:998-1006. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.