IDEAS home Printed from https://ideas.repec.org/a/gam/jchals/v12y2021i1p6-d507379.html
   My bibliography  Save this article

Purposeful Evaluation of Scholarship in the Open Science Era

Author

Listed:
  • Mario Pagliaro

    (Istituto per lo Studio dei Materiali Nanostrutturati, CNR, via U. La Malfa 153, 90146 Palermo, Italy)

Abstract

In most of the world’s countries, scholarship evaluation for tenure and promotion continues to rely on conventional criteria of publications in journals of high impact factor and achievements in securing research funds. Continuing to hire and promote scholars based on these criteria exposes universities to risk because students, directly and indirectly through government funds, are the main source of revenues for academic institutions. At the same time, talented young researchers increasingly look for professors renowned for excellence in mentoring doctoral students and early career researchers. Purposeful scholarship evaluation in the open science era needs to include all three areas of scholarly activity: research, teaching and mentoring, and service to society.

Suggested Citation

  • Mario Pagliaro, 2021. "Purposeful Evaluation of Scholarship in the Open Science Era," Challenges, MDPI, vol. 12(1), pages 1-11, February.
    • Handle: RePEc:gam:jchals:v:12:y:2021:i:1:p:6-:d:507379
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2078-1547/12/1/6/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2078-1547/12/1/6/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Elizabeth Gadd, 2020. "University rankings need a rethink," Nature, Nature, vol. 587(7835), pages 523-523, November.
    2. Mikael Laakso, 2014. "Green open access policies of scholarly journal publishers: a study of what, when, and where self-archiving is allowed," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 475-494, May.
    3. Richard Van Noorden, 2013. "Open access: The true cost of science publishing," Nature, Nature, vol. 495(7442), pages 426-429, March.
    4. Didegah, Fereshteh & Thelwall, Mike, 2013. "Which factors help authors produce the highest impact research? Collaboration, journal and document properties," Journal of Informetrics, Elsevier, vol. 7(4), pages 861-873.
    5. Lutz Bornmann & Werner Marx, 2014. "How to evaluate individual researchers working in the natural and life sciences meaningfully? A proposal of methods based on percentiles of citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 487-509, January.
    6. Jonathan Iyandemye & Marshall P Thomas, 2019. "Low income countries have the highest percentages of open access publication: A systematic computational analysis of the biomedical literature," PLOS ONE, Public Library of Science, vol. 14(7), pages 1-11, July.
    7. Per O. Seglen, 1992. "The skewness of science," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 43(9), pages 628-638, October.
    8. Mario Pagliaro, 2021. "Preprints in Chemistry: An Exploratory Analysis of Differences with Journal Articles," Publications, MDPI, vol. 9(1), pages 1-8, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mario Pagliaro, 2021. "Did You Ask for Citations? An Insight into Preprint Citations en route to Open Science," Publications, MDPI, vol. 9(3), pages 1-10, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mario Pagliaro, 2021. "Did You Ask for Citations? An Insight into Preprint Citations en route to Open Science," Publications, MDPI, vol. 9(3), pages 1-10, June.
    2. Kong, Ling & Wang, Dongbo, 2020. "Comparison of citations and attention of cover and non-cover papers," Journal of Informetrics, Elsevier, vol. 14(4).
    3. Sergio Jimenez & Youlin Avila & George Dueñas & Alexander Gelbukh, 2020. "Automatic prediction of citability of scientific articles by stylometry of their titles and abstracts," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 3187-3232, December.
    4. Thelwall, Mike & Wilson, Paul, 2014. "Regression for citation data: An evaluation of different methods," Journal of Informetrics, Elsevier, vol. 8(4), pages 963-971.
    5. Péter Vinkler, 2019. "Core journals and elite subsets in scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 241-259, October.
    6. Thelwall, Mike & Sud, Pardeep, 2016. "National, disciplinary and temporal variations in the extent to which articles with more authors have more impact: Evidence from a geometric field normalised citation indicator," Journal of Informetrics, Elsevier, vol. 10(1), pages 48-61.
    7. Lutz Bornmann & Klaus Wohlrabe, 2019. "Normalisation of citation impact in economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 841-884, August.
    8. Thelwall, Mike, 2016. "Are there too many uncited articles? Zero inflated variants of the discretised lognormal and hooked power law distributions," Journal of Informetrics, Elsevier, vol. 10(2), pages 622-633.
    9. Loet Leydesdorff & Paul Wouters & Lutz Bornmann, 2016. "Professional and citizen bibliometrics: complementarities and ambivalences in the development and use of indicators—a state-of-the-art report," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2129-2150, December.
    10. Péter Vinkler, 2023. "Impact of the number and rank of coauthors on h-index and π-index. The part-impact method," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2349-2369, April.
    11. Vîiu, Gabriel-Alexandru, 2017. "Disaggregated research evaluation through median-based characteristic scores and scales: a comparison with the mean-based approach," Journal of Informetrics, Elsevier, vol. 11(3), pages 748-765.
    12. Bornmann, Lutz & Williams, Richard, 2017. "Can the journal impact factor be used as a criterion for the selection of junior researchers? A large-scale empirical study based on ResearcherID data," Journal of Informetrics, Elsevier, vol. 11(3), pages 788-799.
    13. Yves Fassin, 2020. "The HF-rating as a universal complement to the h-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 965-990, November.
    14. Koh Yamamoto & Takuo Yasunaga, 2022. "A percentile rank score of group productivity: an evaluation of publication productivity for researchers from various fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1737-1754, April.
    15. Pentti Riikonen & Mauno Vihinen, 2008. "National research contributions: A case study on Finnish biomedical research," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(2), pages 207-222, November.
    16. Stephan Puehringer & Johanna Rath & Teresa Griesebner, 2021. "The political economy of academic publishing: On the commodification of a public good," PLOS ONE, Public Library of Science, vol. 16(6), pages 1-21, June.
    17. Per O. Seglen & Dag W. Aksnes, 2000. "Scientific Productivity and Group Size: A Bibliometric Analysis of Norwegian Microbiological Research," Scientometrics, Springer;Akadémiai Kiadó, vol. 49(1), pages 125-143, August.
    18. Juan A Crespo & Ignacio Ortuño-Ortín & Javier Ruiz-Castillo, 2012. "The Citation Merit of Scientific Publications," PLOS ONE, Public Library of Science, vol. 7(11), pages 1-9, November.
    19. J. A. Garcia & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia, 2021. "The interplay between the reviewer’s incentives and the journal’s quality standard," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3041-3061, April.
    20. Bornmann, Lutz & Mutz, Rüdiger & Daniel, Hans-Dieter, 2010. "The h index research output measurement: Two approaches to enhance its accuracy," Journal of Informetrics, Elsevier, vol. 4(3), pages 407-414.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jchals:v:12:y:2021:i:1:p:6-:d:507379. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.