IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v3y2009i4p304-311.html
   My bibliography  Save this article

Research on the evaluation of academic journals based on structural equation modeling

Author

Listed:
  • Liping, Yu
  • Yuqing, Chen
  • Yuntao, Pan
  • Yishan, Wu

Abstract

This paper classifies common journal evaluation indicators into three categories, namely three first-level indicators. They are respectively the indicators on journal impact, on timeliness, and on journal characteristics. The data used here is drawn from the medical journals in CSTPCD, a citation database built by the Institute of Scientific and Technical Information of China. The three categories of indicators are correlated with one another, so a structural equation may be established. Then we calculate the value of three first-level indicators and give subjective weights to the indicators. The comprehensive evaluation upon the medical journals yields satisfactory results. By simulating the complex relationship among journal indicators, the structural equation can be used for the estimation of some implicit indicators and the screening of indicators. This approach provides a new perspective for scientific and technological evaluation in general sense. It should be noted that the availability of basic data and the rationality of modeling bear much upon the evaluation results.

Suggested Citation

  • Liping, Yu & Yuqing, Chen & Yuntao, Pan & Yishan, Wu, 2009. "Research on the evaluation of academic journals based on structural equation modeling," Journal of Informetrics, Elsevier, vol. 3(4), pages 304-311.
    • Handle: RePEc:eee:infome:v:3:y:2009:i:4:p:304-311
    DOI: 10.1016/j.joi.2009.04.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157709000340
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2009.04.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Michela Nardo & Michaela Saisana & Andrea Saltelli & Stefano Tarantola & Anders Hoffman & Enrico Giovannini, 2005. "Handbook on Constructing Composite Indicators: Methodology and User Guide," OECD Statistics Working Papers 2005/3, OECD Publishing.
    2. Weiping Yue & Concepción S. Wilson, 2004. "Measuring the citation impact of research journals in clinical neurology: A structural equation modelling analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 60(3), pages 317-332, August.
    3. Thed N. Van Leeuwen & Martijn S. Visser & Henk F. Moed & Ton J. Nederhof & Anthony F. J. Van Raan, 2003. "The Holy Grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 57(2), pages 257-280, June.
    4. Sagar, Ambuj D. & Najam, Adil, 1998. "The human development index: a critical review," Ecological Economics, Elsevier, vol. 25(3), pages 249-264, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Civera, Alice & Lehmann, Erik E. & Paleari, Stefano & Stockinger, Sarah A.E., 2020. "Higher education policy: Why hope for quality when rewarding quantity?," Research Policy, Elsevier, vol. 49(8).
    2. Rajesh Kr Singh & Sachin Kumar Mangla & Manjot Singh Bhatia & Sunil Luthra, 2022. "Integration of green and lean practices for sustainable business management," Business Strategy and the Environment, Wiley Blackwell, vol. 31(1), pages 353-370, January.
    3. Gouri Ginde & Snehanshu Saha & Archana Mathur & Sukrit Venkatagiri & Sujith Vadakkepat & Anand Narasimhamurthy & B. S. Daya Sagar, 2016. "ScientoBASE: a framework and model for computing scholastic indicators of non-local influence of journals via native data acquisition algorithms," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1479-1529, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christoph Dörffel & Sebastian Schuhmann, 2020. "What is Inclusive Development? Introducing the Multidimensional Inclusiveness Index," Jena Economics Research Papers 2020-015, Friedrich-Schiller-University Jena.
    2. Yu, Liping & Shen, Xiaoming & Pan, Yuntao & Wu, Yishan, 2009. "Scholarly journal evaluation based on panel data analysis," Journal of Informetrics, Elsevier, vol. 3(4), pages 312-320.
    3. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    4. Laurens Cherchye & Erwin Ooghe & Tom Puyenbroeck, 2008. "Robust human development rankings," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 6(4), pages 287-321, December.
    5. Diogo Ferraz & Enzo B. Mariano & Daisy Rebelatto & Dominik Hartmann, 2020. "Linking Human Development and the Financial Responsibility of Regions: Combined Index Proposals Using Methods from Data Envelopment Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 150(2), pages 439-478, July.
    6. Ernest Reig, 2012. "Building an Enlarged Human Development Indicator: Europe and the Southern Mediterranean Basin," Working Papers 1203, Department of Applied Economics II, Universidad de Valencia.
    7. Ernest Reig-Martínez, 2013. "Social and Economic Wellbeing in Europe and the Mediterranean Basin: Building an Enlarged Human Development Indicator," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 111(2), pages 527-547, April.
    8. Sabina Alkire, James Foster, 2010. "Designing the Inequality-Adjusted Human Development Index (HDI)," OPHI Working Papers 37, Queen Elizabeth House, University of Oxford.
    9. Hatefi, S.M. & Torabi, S.A., 2010. "A common weight MCDA-DEA approach to construct composite indicators," Ecological Economics, Elsevier, vol. 70(1), pages 114-120, November.
    10. Stelios Gialis & Michael Taylor, 2016. "A Regional Account of Flexibilization Across the EU: The ‘Flexible Contractual Arrangements’ Composite Index and the Impact of Recession," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 128(3), pages 1121-1146, September.
    11. Lee Stapleton & Guy Garrod, 2007. "Keeping things simple: why the Human Development Index should not diverge from its equal weights assumption," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 84(2), pages 179-188, November.
    12. Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
    13. Domingo Docampo & Lawrence Cram, 2019. "Highly cited researchers: a moving target," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1011-1025, March.
    14. Andrea Saltelli, 2007. "Composite Indicators between Analysis and Advocacy," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 81(1), pages 65-77, March.
    15. Jeni Klugman & Francisco Rodríguez & Hyung-Jin Choi, 2011. "The HDI 2010: new controversies, old critiques," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 9(2), pages 249-288, June.
    16. Sten F Odenwald, 2020. "A citation study of earth science projects in citizen science," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-26, July.
    17. Hertrich Markus, 2019. "A Novel Housing Price Misalignment Indicator for Germany," German Economic Review, De Gruyter, vol. 20(4), pages 759-794, December.
    18. Rui Fragoso & Vladimir Bushenkov & Carlos Marques, 2012. "Integrated Water Management Using Feasible Goals Method and Interactive Decision Maps: The Case of Odivelas Irrigation," CEFAGE-UE Working Papers 2012_07, University of Evora, CEFAGE-UE (Portugal).
    19. Albino Prada-Blanco & Patricio Sanchez-Fernandez, 2017. "Empirical Analysis of the Transformation of Economic Growth into Social Development at an International Level," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 130(3), pages 983-1003, February.
    20. Drago, Carlo & Ginesti, Gianluca & Pongelli, Claudia & Sciascia, Salvatore, 2018. "Reporting strategies: What makes family firms beat around the bush? Family-related antecedents of annual report readability," Journal of Family Business Strategy, Elsevier, vol. 9(2), pages 142-150.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:3:y:2009:i:4:p:304-311. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.