IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v48y2019i6p1513-1522.html
   My bibliography  Save this article

The influence of editorial decisions and the academic network on self-citations and journal impact factors

Author

Listed:
  • Wilhite, Allen
  • Fong, Eric A.
  • Wilhite, Seth

Abstract

There are many means by which editors can inappropriately manipulate journal impact factors, but questions remain as to whether these potentially inappropriate behaviors actually influence these scores to an empirically meaningful degree, and which academic disciplines are most culpable. In this manuscript, we propose a game-theoretic/information-asymmetry model that suggests manipulation is reinforced by a feedback loop that creates incentives for manipulation to spread and for disciplines to specialize in the type of manipulation used. We empirically investigate these hypotheses for four different manipulation strategies; coercive citation, self-serving review articles, editorials, and online queuing. Results show that all four of these techniques are effective, they inflate JIF scores and the h-index, and a significant part of that effect is due to inflated self-citations. We also find journals within disciplines tend to specialize in which technique they most frequently employ. Moreover, we show that disciplines are also interconnected, tied together by a journal cross-discipline content network and that disciplines that share more content also tend to rely more heavily on the same JIF influencing behaviors. Effective policy needs to change the editorial decision calculation by removing the benefits of manipulation; removing self-citations from journal metric calculations drastically reduces those benefits.

Suggested Citation

  • Wilhite, Allen & Fong, Eric A. & Wilhite, Seth, 2019. "The influence of editorial decisions and the academic network on self-citations and journal impact factors," Research Policy, Elsevier, vol. 48(6), pages 1513-1522.
    • Handle: RePEc:eee:respol:v:48:y:2019:i:6:p:1513-1522
    DOI: 10.1016/j.respol.2019.03.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733319300642
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.respol.2019.03.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hall, Jeremy & Martin, Ben R., 2019. "Towards a taxonomy of research misconduct: The case of business school research," Research Policy, Elsevier, vol. 48(2), pages 414-427.
    2. Björk, Bo-Christer & Solomon, David, 2013. "The publishing delay in scholarly peer-reviewed journals," Journal of Informetrics, Elsevier, vol. 7(4), pages 914-923.
    3. E. Garfield & I. H. Sher, 1963. "New factors in the evaluation of scientific literature through citation indexing," American Documentation, Wiley Blackwell, vol. 14(3), pages 195-201, July.
    4. Fred Glover, 1989. "Tabu Search---Part I," INFORMS Journal on Computing, INFORMS, vol. 1(3), pages 190-206, August.
    5. Seeber, Marco & Cattaneo, Mattia & Meoli, Michele & Malighetti, Paolo, 2019. "Self-citations as strategic response to the use of metrics for career decisions," Research Policy, Elsevier, vol. 48(2), pages 478-491.
    6. H. F. Moed & Th. N. Van Leeuwen, 1995. "Improving the accuracy of institute for scientific information's journal impact factors," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 46(6), pages 461-467, July.
    7. Tobias Kiesslich & Silke B Weineck & Dorothea Koelblinger, 2016. "Reasons for Journal Impact Factor Changes: Influence of Changing Source Items," PLOS ONE, Public Library of Science, vol. 11(4), pages 1-12, April.
    8. Peter A. Lawrence, 2003. "The politics of publication," Nature, Nature, vol. 422(6929), pages 259-261, March.
    9. Suits, Daniel B, 1984. "Dummy Variables: Mechanics v. Interpretation," The Review of Economics and Statistics, MIT Press, vol. 66(1), pages 177-180, February.
    10. Hopp, Christian & Hoover, Gary A., 2017. "How prevalent is academic misconduct in management research?," Journal of Business Research, Elsevier, vol. 80(C), pages 73-81.
    11. Jeremy Hall & Ben R. Martin, 2019. "Towards a Taxonomy of Academic Misconduct: The Case of Business School Research," SPRU Working Paper Series 2019-02, SPRU - Science Policy Research Unit, University of Sussex Business School.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rabishankar Giri & Sabuj Kumar Chaudhuri, 2021. "Ranking journals through the lens of active visibility," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2189-2208, March.
    2. Karel Hrazdil & Jeong-Bon Kim & Frederick H. Willeboordse, 2024. "Systematic bias in citing practices: evidence from accounting journal additions to the FT list," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(11), pages 6947-6973, November.
    3. Guo, Xiaolong & Li, Xiaoxiao & Yu, Yugang, 2021. "Publication delay adjusted impact factor: The effect of publication delay of articles on journal impact factor," Journal of Informetrics, Elsevier, vol. 15(1).
    4. M. Ryan Haley, 2020. "Combining the weighted and unweighted Euclidean indices: a graphical approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 103-111, April.
    5. Tian, Jinfang & Zhang, Mingxuan & Xue, Rui & Cao, Wei & Shan, Yuli, 2022. "The face of achievement: Editors' facial structure and journal performance," International Review of Financial Analysis, Elsevier, vol. 84(C).
    6. Haley, M. Ryan & McGee, M. Kevin, 2020. "Jointly valuing journal visibility and author citation count: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 14(1).
    7. Siler, Kyle & Larivière, Vincent, 2022. "Who games metrics and rankings? Institutional niches and journal impact factor inflation," Research Policy, Elsevier, vol. 51(10).
    8. Fong, Eric A. & Patnayakuni, Ravi & Wilhite, Allen W., 2023. "Accommodating coercion: Authors, editors, and citations," Research Policy, Elsevier, vol. 52(5).
    9. Sandro Serpa & Maria José Sá & Ana Isabel Santos & Carlos Miguel Ferreira, 2020. "Challenges for the Academic Editor in the Scientific Publication," Academic Journal of Interdisciplinary Studies, Richtmann Publishing Ltd, vol. 9, May.
    10. Chen, Kun & Ren, Xian-tong & Yang, Guo-liang, 2021. "A novel approach for assessing academic journals: Application of integer DEA model for management science and operations research field," Journal of Informetrics, Elsevier, vol. 15(3).
    11. Xiomara S. Q. Chacon & Thiago C. Silva & Diego R. Amancio, 2020. "Comparing the impact of subfields in scientific journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 625-639, October.
    12. Yangping Zhou, 2021. "Self-citation and citation of top journal publishers and their interpretation in the journal-discipline context," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6013-6040, July.
    13. Salim Moussa, 2021. "Are FT50 journals really leading? A comment on Fassin," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9613-9622, December.
    14. Fong, Eric A. & Wilhite, Allen W., 2021. "The Impact of False Investigators on Grant Funding," Research Policy, Elsevier, vol. 50(10).
    15. M. Ryan Haley & M. Kevin McGee, 2023. "A flexible functional method for jointly valuing journal visibility and author citation count," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3337-3346, June.
    16. repec:zib:zbesmy:v:3:y:2022:i:2:p:81-84 is not listed on IDEAS

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guo, Xiaolong & Li, Xiaoxiao & Yu, Yugang, 2021. "Publication delay adjusted impact factor: The effect of publication delay of articles on journal impact factor," Journal of Informetrics, Elsevier, vol. 15(1).
    2. Bruns, Stephan B. & Asanov, Igor & Bode, Rasmus & Dunger, Melanie & Funk, Christoph & Hassan, Sherif M. & Hauschildt, Julia & Heinisch, Dominik & Kempa, Karol & König, Johannes & Lips, Johannes & Verb, 2019. "Reporting errors and biases in published empirical findings: Evidence from innovation research," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    3. Siler, Kyle & Larivière, Vincent, 2022. "Who games metrics and rankings? Institutional niches and journal impact factor inflation," Research Policy, Elsevier, vol. 51(10).
    4. Sovacool, Benjamin K. & Martiskainen, Mari & Furszyfer Del Rio, Dylan D., 2021. "Knowledge, energy sustainability, and vulnerability in the demographics of smart home technology diffusion," Energy Policy, Elsevier, vol. 153(C).
    5. Ryan, James C. & A Tipu, Syed A., 2022. "Business and management research: Low instances of replication studies and a lack of author independence in replications," Research Policy, Elsevier, vol. 51(1).
    6. Andrei V. Grinëv & Daria S. Bylieva & Victoria V. Lobatyuk, 2021. "Russian University Teachers’ Perceptions of Scientometrics," Publications, MDPI, vol. 9(2), pages 1-16, May.
    7. Rubin, Amir & Rubin, Eran & Segal, Dan, 2023. "Editor home bias?," Research Policy, Elsevier, vol. 52(6).
    8. Glenna, Leland & Bruce, Analena, 2021. "Suborning science for profit: Monsanto, glyphosate, and private science research misconduct," Research Policy, Elsevier, vol. 50(7).
    9. Salandra, Rossella & Criscuolo, Paola & Salter, Ammon, 2021. "Directing scientists away from potentially biased publications: the role of systematic reviews in health care," Research Policy, Elsevier, vol. 50(1).
    10. Fong, Eric A. & Patnayakuni, Ravi & Wilhite, Allen W., 2023. "Accommodating coercion: Authors, editors, and citations," Research Policy, Elsevier, vol. 52(5).
    11. Lu Liu & Benjamin F. Jones & Brian Uzzi & Dashun Wang, 2023. "Data, measurement and empirical methods in the science of science," Nature Human Behaviour, Nature, vol. 7(7), pages 1046-1058, July.
    12. Khezr, Peyman & Mohan, Vijay, 2022. "The vexing but persistent problem of authorship misconduct in research," Research Policy, Elsevier, vol. 51(3).
    13. Craig, Russell & Cox, Adam & Tourish, Dennis & Thorpe, Alistair, 2020. "Using retracted journal articles in psychology to understand research misconduct in the social sciences: What is to be done?," Research Policy, Elsevier, vol. 49(4).
    14. Martin Szomszor & David A. Pendlebury & Jonathan Adams, 2020. "How much is too much? The difference between research influence and self-citation excess," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 1119-1147, May.
    15. Mohan, Vijay, 2019. "On the use of blockchain-based mechanisms to tackle academic misconduct," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    16. Marianov, Vladimir & Serra, Daniel & ReVelle, Charles, 1999. "Location of hubs in a competitive environment," European Journal of Operational Research, Elsevier, vol. 114(2), pages 363-371, April.
    17. Rabishankar Giri & Sabuj Kumar Chaudhuri, 2021. "Ranking journals through the lens of active visibility," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2189-2208, March.
    18. Chiara Gruden & Irena Ištoka Otković & Matjaž Šraml, 2020. "Neural Networks Applied to Microsimulation: A Prediction Model for Pedestrian Crossing Time," Sustainability, MDPI, vol. 12(13), pages 1-22, July.
    19. Thibaud Deguilhem & Juliette Schlegel & Jean-Philippe Berrou & Ousmane Djibo & Alain Piveteau, 2024. "Too many options: How to identify coalitions in a policy network?," Post-Print hal-04689665, HAL.
    20. Helena Ramalhinho-Lourenço & Olivier C. Martin & Thomas Stützle, 2000. "Iterated local search," Economics Working Papers 513, Department of Economics and Business, Universitat Pompeu Fabra.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:48:y:2019:i:6:p:1513-1522. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.