IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v110y2017i2d10.1007_s11192-016-2197-6.html
   My bibliography  Save this article

A multivariate model for evaluating emergency medicine journals

Author

Listed:
  • Antonio Fernandez-Cano

    (University of Granada)

  • Inés M. Fernández-Guerrero

    (General University Hospital “Virgen de las Nieves”)

Abstract

This paper proposes a multivariate model for the evaluation of international emergency medicine journals using the most widely used, efficient and representative productivity and citation indicators. This is a descriptive observational evaluation study based on a sample of 24 journals included in the emergency medicine category of the Journal Citation Reports 2015. The sample is evaluated based on seven evaluation indicators: Journal Citation Reports impact factor, three H-indices (Web of Science, Scimago and Google Scholar), the Scimago Journal Rank and two altmetric scores (3-month and any time). The bivariate correlations between the diverse distributions of evaluation indicators and a multivariate metric reliability index are calculated. The factorial structure of the indicators is explored and clusters of journals are defined. A factor score is assigned to each journal. The correlations between the seven evaluation indicators are high and statistically significant. The metric reliability of the multivariate analysis calculated using Cronbach’s alpha is .97. A general factor explains the 84.64% variance of the factor space of the seven evaluation indicators, representing the ‘quality of EM journals’ construct. The most well-represented indicator, the one with the highest communality, is H_Index_WoS (h = .922), which is also the indicator with the greatest weight in the general factor (a = .96). The journals can be classified in four clusters according to their quality. A factor score is generated for each journal that could be used as a multivariate meta-index to evaluate journal quality and to define a ranking of journals.

Suggested Citation

  • Antonio Fernandez-Cano & Inés M. Fernández-Guerrero, 2017. "A multivariate model for evaluating emergency medicine journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 991-1003, February.
    • Handle: RePEc:spr:scient:v:110:y:2017:i:2:d:10.1007_s11192-016-2197-6
    DOI: 10.1007/s11192-016-2197-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-016-2197-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-016-2197-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mario Marchi & Edoardo Lorenzetti, 2016. "Measuring the impact of scholarly journals in the humanities field," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 253-261, January.
    2. J. E. Hirsch, 2010. "An index to quantify an individual’s scientific research output that takes into account the effect of multiple coauthorship," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 741-754, December.
    3. Lutz Bornmann & Rüdiger Mutz & Hans‐Dieter Daniel, 2008. "Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(5), pages 830-837, March.
    4. Antonio Fernández-Cano & Ángel Bueno, 2002. "Multivariate evaluation of Spanish educational research journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 55(1), pages 87-102, September.
    5. David Adam, 2002. "The counting house," Nature, Nature, vol. 415(6873), pages 726-729, February.
    6. Yi-Ching Liaw & Te-Yi Chan & Chin-Yuan Fan & Cheng-Hsin Chiang, 2014. "Can the technological impact of academic journals be evaluated? The practice of non-patent reference (NPR) analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 17-37, October.
    7. Brian Haynes, 2007. "Reliance on bibliometric databases can let you down," Nature, Nature, vol. 446(7137), pages 725-725, April.
    8. Gianfranco Ennas & Battista Biggio & Maria Chiara Di Guardo, 2015. "Data-driven journal meta-ranking in business and management," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1911-1929, December.
    9. Kun Lu & Isola Ajiferuke & Dietmar Wolfram, 2014. "Extending citer analysis to journal impact evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(1), pages 245-260, July.
    10. Geoffrey S. Shideler & Rafael J. Araújo, 2016. "Measures of scholarly journal quality are not universally applicable to determining value of advertised annual subscription price," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 963-973, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Angel Meseguer-Martinez & Alejandro Ros-Galvez & Alfonso Rosa-Garcia & Jose Antonio Catalan-Alarcon, 2019. "Online video impact of world class universities," Electronic Markets, Springer;IIM University of St. Gallen, vol. 29(3), pages 519-532, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Deming Lin & Tianhui Gong & Wenbin Liu & Martin Meyer, 2020. "An entropy-based measure for the evolution of h index research," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2283-2298, December.
    2. Jiang Wu, 2013. "Geographical knowledge diffusion and spatial diversity citation rank," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 181-201, January.
    3. Perc, Matjaž, 2010. "Zipf’s law and log-normal distributions in measures of scientific output across fields and institutions: 40 years of Slovenia’s research as an example," Journal of Informetrics, Elsevier, vol. 4(3), pages 358-364.
    4. M. Ausloos, 2013. "A scientometrics law about co-authors and their ranking: the co-author core," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 895-909, June.
    5. Lathabai, Hiran H., 2020. "ψ-index: A new overall productivity index for actors of science and technology," Journal of Informetrics, Elsevier, vol. 14(4).
    6. Serge Galam, 2011. "Tailor based allocations for multiple authorship: a fractional gh-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(1), pages 365-379, October.
    7. Rotundo, Giulia, 2014. "Black–Scholes–Schrödinger–Zipf–Mandelbrot model framework for improving a study of the coauthor core score," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 404(C), pages 296-301.
    8. Du Jian & Tang Xiaoli, 2013. "Perceptions of author order versus contribution among researchers with different professional ranks and the potential of harmonic counts for encouraging ethical co-authorship practices," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 277-295, July.
    9. Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
    10. Marcel Ausloos, 2014. "Binary scientific star coauthors core size," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 331-351, May.
    11. Ausloos, M., 2015. "Assessing the true role of coauthors in the h-index measure of an author scientific impact," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 422(C), pages 136-142.
    12. Madiha Ameer & Muhammad Tanvir Afzal, 2019. "Evaluation of h-index and its qualitative and quantitative variants in Neuroscience," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 653-673, November.
    13. J. E. Hirsch, 2019. "hα: An index to quantify an individual’s scientific leadership," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(2), pages 673-686, February.
    14. Miśkiewicz, Janusz, 2013. "Effects of publications in proceedings on the measure of the core size of coauthors," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(20), pages 5119-5131.
    15. Deise Deolindo Silva & Maria Cláudia Cabrini Grácio, 2021. "Dispersion measures for h-index: a study of the Brazilian researchers in the field of mathematics," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 1983-2011, March.
    16. Siying Li & Huawei Shen & Peng Bao & Xueqi Cheng, 2021. "$$h_u$$ h u -index: a unified index to quantify individuals across disciplines," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3209-3226, April.
    17. Christopher McCarty & James W. Jawitz & Allison Hopkins & Alex Goldman, 2013. "Predicting author h-index using characteristics of the co-author network," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(2), pages 467-483, August.
    18. Asma Hammami & Nabil Semmar, 2022. "The simplex simulation as a tool to reveal publication strategies and citation factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 319-350, January.
    19. Jingda Ding & Chao Liu & Goodluck Asobenie Kandonga, 2020. "Exploring the limitations of the h-index and h-type indexes in measuring the research performance of authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1303-1322, March.
    20. Maurice Poirrier & Sebastián Moreno & Gonzalo Huerta-Cánepa, 2021. "Robust h-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 1969-1981, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:110:y:2017:i:2:d:10.1007_s11192-016-2197-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.