IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v127y2022i10d10.1007_s11192-022-04490-8.html
   My bibliography  Save this article

Use of bibliometrics for research evaluation in emerging markets economies: a review and discussion of bibliometric indicators

Author

Listed:
  • Hamdi A. Al-Jamimi

    (Research Institute, King Fahd University of Petroleum & Minerals)

  • Galal M. BinMakhashen

    (Research Institute, King Fahd University of Petroleum & Minerals)

  • Lutz Bornmann

    (Max Planck Institute for Solid State Research
    Administrative Headquarters of the Max Planck Society)

Abstract

The governments of most ‘emerging market’ (EM) countries (e.g., India, Mexico, and Brazil) have invested significantly in scientific research over the past decades. These investments are reflected in the countries’ research volume, impact, and international collaboration activities. The EMs’ research support justification delivers the need to evaluate their research performance at multi-levels (country, institution, and scholar), e.g., by using indicators of research application inclinations. Bibliometric studies are increasingly requested by research and development (R&D) policymakers, funding agencies, and other relevant actors in these countries. The results of the studies are used to develop research directions, set research policies, and satisfy management needs (at universities). In this paper, we review the contributions of previous (bibliometric) studies to measuring research performance in EM countries. We identified 132 indicators used in the studies and classified them into three categories: productivity, impact, and collaboration. Some indicators have been more frequently used than others for measuring the performance of EM countries. These indicators might be the most important ones. For example, research leadership indicators (focusing on corresponding authors of publications) might be more important than other indicators measuring the research productivity of EM countries since they highlight the ‘actual’ contribution of national scientists. Collaboration indicators measuring national/international collaborative publications are also especially relevant for EM countries; their results can be used to sharpen expertise and exchange of professional knowledge. The overview presented in this paper can be used for the planning and realization of future studies on research in EM countries.

Suggested Citation

  • Hamdi A. Al-Jamimi & Galal M. BinMakhashen & Lutz Bornmann, 2022. "Use of bibliometrics for research evaluation in emerging markets economies: a review and discussion of bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(10), pages 5879-5930, October.
  • Handle: RePEc:spr:scient:v:127:y:2022:i:10:d:10.1007_s11192-022-04490-8
    DOI: 10.1007/s11192-022-04490-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-022-04490-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-022-04490-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kearney, Colm, 2012. "Emerging markets research: Trends, issues and future directions," Emerging Markets Review, Elsevier, vol. 13(2), pages 159-183.
    2. Jun-Ying Fu & Xu Zhang & Yun-Hua Zhao & Mu-Hsuan Huang & Dar-Zen Chen, 2011. "Bibliometric analysis of complementary and alternative medicine research over three decades," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(2), pages 617-626, August.
    3. Hagedoorn, John & Link, Albert N. & Vonortas, Nicholas S., 2000. "Research partnerships1," Research Policy, Elsevier, vol. 29(4-5), pages 567-586, April.
    4. Lutz Bornmann, 2014. "How are excellent (highly cited) papers defined in bibliometrics? A quantitative analysis of the literature," Research Evaluation, Oxford University Press, vol. 23(2), pages 166-173.
    5. Marcin Kozak & Lutz Bornmann & Loet Leydesdorff, 2015. "How have the Eastern European countries of the former Warsaw Pact developed since 1990? A bibliometric study," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1101-1117, February.
    6. Gangan Prathap, 2011. "The Energy–Exergy–Entropy (or EEE) sequences in bibliometric assessment," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 515-524, June.
    7. Muhammad Farooq & Muhammad Asim & Muhammad Imran & Shahid Imran & Jameel Ahmad & Muhammad Rizwan Younis, 2018. "Mapping past, current and future energy research trend in Pakistan: a scientometric assessment," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1733-1753, December.
    8. V. A. Markusova & A. N. Libkind & A. E. Varshavsly & C. N. M. Jansz, 2012. "Research performance and collaboration in the Novosibirsk region," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 513-526, May.
    9. Adams, Jonathan, 2018. "Information and misinformation in bibliometric time-trend analysis," Journal of Informetrics, Elsevier, vol. 12(4), pages 1063-1071.
    10. Hamid Darvish & Yaşar Tonta, 2016. "Diffusion of nanotechnology knowledge in Turkey and its network structure," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 569-592, May.
    11. Bárbara S. Lancho-Barrantes & Francisco J. Cantú-Ortiz, 2019. "Science in Mexico: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(2), pages 499-517, February.
    12. Elio Atenógenes Villaseñor & Ricardo Arencibia-Jorge & Humberto Carrillo-Calvet, 2017. "Multiparametric characterization of scientometric performance profiles assisted by neural networks: a study of Mexican higher education institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 77-104, January.
    13. Michel Zitt & Suzy Ramanana-Rahary & Elise Bassecoulard, 2003. "Correcting glasses help fair comparisons in international science landscape: Country indicators as a function of ISI database delineation," Scientometrics, Springer;Akadémiai Kiadó, vol. 56(2), pages 259-282, February.
    14. Har Kaur & B. M. Gupta, 2010. "Mapping of dental science research in India: a scientometric analysis of India’s research output, 1999–2008," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 361-376, October.
    15. Luo, Yadong & Zhang, Huan, 2016. "Emerging Market MNEs: Qualitative Review and Theoretical Directions," Journal of International Management, Elsevier, vol. 22(4), pages 333-350.
    16. Veronica Perez-Cabezas & Carmen Ruiz-Molinero & Ines Carmona-Barrientos & Enrique Herrera-Viedma & Manuel J. Cobo & Jose A. Moral-Munoz, 2018. "Highly cited papers in rheumatology: identification and conceptual analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 555-568, July.
    17. Liang Zhang & Sisi Li & Hugo A. Loáiciga & Yanhua Zhuang & Yun Du, 2015. "Opportunities and challenges of interbasin water transfers: a literature review with bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(1), pages 279-294, October.
    18. Zaida Chinchilla-Rodríguez & Grisel Zacca-González & Benjamín Vargas-Quesada & Félix Moya-Anegón, 2015. "Latin American scientific output in Public Health: combined analysis using bibliometric, socioeconomic and health indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 609-628, January.
    19. Abdulkader A. Murad & Dimitar T. Tomov, 2012. "Institutionalization and internationalization of research on the applications of the geographical information systems in health planning," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(1), pages 143-158, April.
    20. Leydesdorff, Loet & Wagner, Caroline, 2009. "Macro-level indicators of the relations between research funding and research output," Journal of Informetrics, Elsevier, vol. 3(4), pages 353-362.
    21. Bronwyn H. Hall & Albert N. Link & John T. Scott, 2003. "Universities as Research Partners," The Review of Economics and Statistics, MIT Press, vol. 85(2), pages 485-491, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hamdi A. Al-Jamimi & Galal M. BinMakhashen & Lutz Bornmann & Yousif Ahmed Al Wajih, 2023. "Saudi Arabia research: academic insights and trend analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5595-5627, October.
    2. Mohammed Abdul Fasi, 2024. "Triple Helix Collaboration: Uncovering Research Opportunities Among Industry, Academia, and Researchers—A Case Study of Saudi Aramco’s Patent Portfolio Analysis," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(3), pages 14486-14520, September.
    3. Fadian Nur Aziz & Ali Roziqin & M. Jafar Loilatu & Tri Sulistyaningsih & Yana S. Hijri & Kismartini, 2024. "Research Trends of Creative Industries in Indonesia: A Bibliometric Analysis," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(1), pages 2571-2588, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hamdi A. Al-Jamimi & Galal M. BinMakhashen & Lutz Bornmann & Yousif Ahmed Al Wajih, 2023. "Saudi Arabia research: academic insights and trend analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5595-5627, October.
    2. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    3. Brito, Ricardo & Rodríguez-Navarro, Alonso, 2018. "Research assessment by percentile-based double rank analysis," Journal of Informetrics, Elsevier, vol. 12(1), pages 315-329.
    4. Zaida Chinchilla-Rodríguez & Cassidy R Sugimoto & Vincent Larivière, 2019. "Follow the leader: On the relationship between leadership and scholarly impact in international collaborations," PLOS ONE, Public Library of Science, vol. 14(6), pages 1-18, June.
    5. Barbara S. Lancho-Barrantes & Hector G. Ceballos-Cancino & Francisco J. Cantu-Ortiz, 2021. "Comparing the efficiency of countries to assimilate and apply research investment," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(4), pages 1347-1369, August.
    6. Camil Demetrescu & Irene Finocchi & Andrea Ribichini & Marco Schaerf, 2022. "On computer science research and its temporal evolution," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4913-4938, August.
    7. Tamara Krajna & Jelka Petrak, 2019. "Croatian Highly Cited Papers," Interdisciplinary Description of Complex Systems - scientific journal, Croatian Interdisciplinary Society Provider Homepage: http://indecs.eu, vol. 17(3-B), pages 684-696.
    8. Nobuko Miyairi & Han-Wen Chang, 2012. "Bibliometric characteristics of highly cited papers from Taiwan, 2000–2009," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 197-205, July.
    9. André Frazão Helene & Pedro Leite Ribeiro, 2011. "Brazilian scientific production, financial support, established investigators and doctoral graduates," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(2), pages 677-686, November.
    10. Vivek Kumar Singh & Sumit Kumar Banshal & Khushboo Singhal & Ashraf Uddin, 2015. "Scientometric mapping of research on ‘Big Data’," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(2), pages 727-741, November.
    11. Tanel Hirv, 2022. "The interplay of the size of the research system, ways of collaboration, level, and method of funding in determining bibliometric outputs," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1295-1316, March.
    12. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    13. Ernesto Galbán-Rodríguez & Deborah Torres-Ponjuán & Ricardo Arencibia-Jorge, 2021. "Multidimensional quantitative analysis of the Cuban scientific output and its regional context," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2643-2665, March.
    14. Weishu Liu & Yishan Ding & Mengdi Gu, 2017. "Book reviews in academic journals: patterns and dynamics," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 355-364, January.
    15. Lutz Bornmann & Alexander Tekles & Loet Leydesdorff, 2019. "How well does I3 perform for impact measurement compared to other bibliometric indicators? The convergent validity of several (field-normalized) indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1187-1205, May.
    16. Jiancheng Guan & Xia Gao, 2008. "Comparison and evaluation of Chinese research performance in the field of bioinformatics," Scientometrics, Springer;Akadémiai Kiadó, vol. 75(2), pages 357-379, May.
    17. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Di Costa, Flavia, 2022. "Revealing the scientific comparative advantage of nations: Common and distinctive features," Journal of Informetrics, Elsevier, vol. 16(1).
    18. Tahamtan, Iman & Bornmann, Lutz, 2018. "Creativity in science and the link to cited references: Is the creative potential of papers reflected in their cited references?," Journal of Informetrics, Elsevier, vol. 12(3), pages 906-930.
    19. Tian-Yuan Huang & Liying Yang, 2022. "Superior identification index: Quantifying the capability of academic journals to recognize good research," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 4023-4043, July.
    20. Hou, Jianhua & Yang, Xiucai, 2020. "Social media-based sleeping beauties: Defining, identifying and features," Journal of Informetrics, Elsevier, vol. 14(2).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:127:y:2022:i:10:d:10.1007_s11192-022-04490-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.