IDEAS home Printed from https://ideas.repec.org/a/spr/empeco/v58y2020i3d10.1007_s00181-018-1546-0.html
   My bibliography  Save this article

Network analysis to measure academic performance in economics

Author

Listed:
  • José Alberto Molina

    (University of Zaragoza
    Institute for Biocomputation and Physics of Complex Systems (BIFI)
    Institute for the Study of Labor-IZA)

  • Alfredo Ferrer

    (Institute for Biocomputation and Physics of Complex Systems (BIFI)
    Kampal Data Solutions S.L.)

  • David Iñiguez

    (ARAID Foundation, Government of Aragón
    Institute for Biocomputation and Physics of Complex Systems (BIFI)
    Kampal Data Solutions S.L.)

  • Alejandro Rivero

    (Institute for Biocomputation and Physics of Complex Systems (BIFI)
    Kampal Data Solutions S.L.)

  • Gonzalo Ruiz

    (Institute for Biocomputation and Physics of Complex Systems (BIFI)
    Kampal Data Solutions S.L.)

  • Alfonso Tarancón

    (University of Zaragoza
    Institute for Biocomputation and Physics of Complex Systems (BIFI)
    Kampal Data Solutions S.L.)

Abstract

Network analysis allows us to introduce different metrics that complement the traditional indicators to measure academic performance, generally based on individual production. In this paper, we show how the use of these techniques provides a more global point of view, introducing indicators that, beyond individual merits, measure the capacity of researchers to generate more intangible assets. We focus on collaboration among groups that can enrich the potential of the research ecosystem as a whole. We present not only numerical indicators, but also several visualisation schemes to see how this approach can help in the academic evaluation and decision-making process of research managers. We have used, as a case study, the research ecosystem formed by more than five thousand economists from Spanish institutions.

Suggested Citation

  • José Alberto Molina & Alfredo Ferrer & David Iñiguez & Alejandro Rivero & Gonzalo Ruiz & Alfonso Tarancón, 2020. "Network analysis to measure academic performance in economics," Empirical Economics, Springer, vol. 58(3), pages 995-1018, March.
  • Handle: RePEc:spr:empeco:v:58:y:2020:i:3:d:10.1007_s00181-018-1546-0
    DOI: 10.1007/s00181-018-1546-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00181-018-1546-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00181-018-1546-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bordons, María & Aparicio, Javier & González-Albo, Borja & Díaz-Faes, Adrián A., 2015. "The relationship between the research performance of scientists and their position in co-authorship networks in three fields," Journal of Informetrics, Elsevier, vol. 9(1), pages 135-144.
    2. Liliana Arroyo Moliner & Eva Gallardo-Gallardo & Pedro Gallo de Puelles, 2017. "Understanding scientific communities: a social network approach to collaborations in Talent Management research," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1439-1462, December.
    3. Letina, Srebrenka, 2016. "Network and actor attribute effects on the performance of researchers in two fields of social science in a small peripheral community," Journal of Informetrics, Elsevier, vol. 10(2), pages 571-595.
    4. Albarrán, Pedro, 2014. "The elite in economics," UC3M Working papers. Economics we1414, Universidad Carlos III de Madrid. Departamento de Economía.
    5. André Andrian Padial & João Carlos Nabout & Tadeu Siqueira & Luis Mauricio Bini & José Alexandre Felizola Diniz-Filho, 2010. "Weak evidence for determinants of citation frequency in ecological articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 1-12, October.
    6. Araújo, Tanya & Fontainha, Elsa, 2017. "The specific shapes of gender imbalance in scientific authorships: A network approach," Journal of Informetrics, Elsevier, vol. 11(1), pages 88-102.
    7. Katharina Rath & Klaus Wohlrabe, 2016. "Recent trends in co-authorship in economics: evidence from RePEc," Applied Economics Letters, Taylor & Francis Journals, vol. 23(12), pages 897-902, August.
    8. Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision‐Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, February.
    9. M.J. Cobo & A.G. López-Herrera & E. Herrera-Viedma & F. Herrera, 2011. "Science mapping software tools: Review, analysis, and cooperative study among tools," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(7), pages 1382-1402, July.
    10. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2011. "An updated ranking of academic journals in economics," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 44(4), pages 1525-1538, November.
    11. Cliff Nowell & Therese Grijalva, 2011. "Trends in co-authorship in economics since 1985," Applied Economics, Taylor & Francis Journals, vol. 43(28), pages 4369-4375.
    12. Sanjeev Goyal & Marco J. van der Leij & José Luis Moraga-Gonzalez, 2006. "Economics: An Emerging Small World," Journal of Political Economy, University of Chicago Press, vol. 114(2), pages 403-432, April.
    13. Matthias Sutter & Martin Kocher, 2004. "Patterns of co-authorship among economics departments in the USA," Applied Economics, Taylor & Francis Journals, vol. 36(4), pages 327-333.
    14. Maksym Polyakov & Serhiy Polyakov & Md Sayed Iftekhar, 2017. "Does academic collaboration equally benefit impact of research across topics? The case of agricultural, resource, environmental and ecological economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1385-1405, December.
    15. M.J. Cobo & A.G. López‐Herrera & E. Herrera‐Viedma & F. Herrera, 2011. "Science mapping software tools: Review, analysis, and cooperative study among tools," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(7), pages 1382-1402, July.
    16. Richard Dusansky & Clayton J. Vernon, 1998. "Rankings of U.S. Economics Departments," Journal of Economic Perspectives, American Economic Association, vol. 12(1), pages 157-170, Winter.
    17. Ying Ding & Erjia Yan & Arthur Frazho & James Caverlee, 2009. "PageRank for ranking authors in co‐citation networks," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(11), pages 2229-2243, November.
    18. Kalaitzidakis, Pantelis & Mamuneas, Theofanis P. & Stengos, Thanasis, 1999. "European economics: An analysis based on publications in the core journals," European Economic Review, Elsevier, vol. 43(4-6), pages 1150-1168, April.
    19. David Card & Stefano DellaVigna, 2013. "Nine Facts about Top Journals in Economics," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 144-161, March.
    20. Daniel S. Hamermesh, 2018. "Citations in Economics: Measurement, Uses, and Impacts," Journal of Economic Literature, American Economic Association, vol. 56(1), pages 115-156, March.
    21. Stelios Katranidis & Theodore Panagiotidis & Costas Zontanos, 2017. "Economists, Research Performance and National Inbreeding: North Versus South," Economic Notes, Banca Monte dei Paschi di Siena SpA, vol. 46(1), pages 145-163, February.
    22. Joseph Macri & Dipendra Sinha, 2006. "Rankings Methodology for International Comparisons of Institutions and Individuals: an Application to Economics in Australia and New Zealand," Journal of Economic Surveys, Wiley Blackwell, vol. 20(1), pages 111-156, February.
    23. Gustavo Bergantiños & José María Da Rocha & Philippe Polomé, 2002. "La investigación española en Economía 1995-1999," Investigaciones Economicas, Fundación SEPI, vol. 26(2), pages 373-392, May.
    24. Micael Rosa Parreira & Karine Borges Machado & Ramiro Logares & José Alexandre Felizola Diniz-Filho & João Carlos Nabout, 2017. "The roles of geographic distance and socioeconomic factors on international collaboration among ecologists," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1539-1550, December.
    25. Oriana Rainho Brás & Jean-Philippe Cointet & Alberto Cambrosio & Leonor David & João Arriscado Nunes & Fátima Cardoso & Carmen Jerónimo, 2017. "Oncology research in late twentieth century and turn of the century Portugal: a scientometric approach to its institutional and semantic dimensions," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 867-888, November.
    26. Raquel Carrasco & Javier Ruiz-Castillo, 2014. "The Evolution Of The Scientific Productivity Of Highly Productive Economists," Economic Inquiry, Western Economic Association International, vol. 52(1), pages 1-16, January.
    27. R. Álvarez & E. Cahué & J. Clemente-Gallardo & A. Ferrer & D. Íñiguez & X. Mellado & A. Rivero & G. Ruiz & F. Sanz & E. Serrano & A. Tarancón & Y. Vergara, 2015. "Analysis of academic productivity based on Complex Networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 651-672, September.
    28. Perc, Matjaž, 2010. "Growth and structure of Slovenia’s scientific collaboration network," Journal of Informetrics, Elsevier, vol. 4(4), pages 475-482.
    29. Kalaitzidakis, P. & Mamuneas, T.P. & Stengos, T., 2003. "Rankings of Academic Journals and Institutions," Working Papers 2003-8, University of Guelph, Department of Economics and Finance.
    30. Muh-Chyun Tang & Yun Jen Cheng & Kuang Hua Chen, 2017. "A longitudinal study of intellectual cohesion in digital humanities using bibliometric analyses," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 985-1008, November.
    31. András Schubert, 2014. "Sentences to remember from the first 100 volumes of the journal Scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(1), pages 1-13, July.
    32. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    33. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
    34. Stelios Katranidis & Theodore Panagiotidis & Costas Zontanos, 2014. "An Evaluation Of The Greek Universities’ Economics Departments," Bulletin of Economic Research, Wiley Blackwell, vol. 66(2), pages 173-182, April.
    35. Bornmann, Lutz & Stefaner, Moritz & de Moya Anegón, Felix & Mutz, Rüdiger, 2016. "Excellence networks in science: A Web-based application based on Bayesian multilevel logistic regression (BMLR) for the identification of institutions collaborating successfully," Journal of Informetrics, Elsevier, vol. 10(1), pages 312-327.
    36. Perianes-Rodriguez, Antonio & Waltman, Ludo & van Eck, Nees Jan, 2016. "Constructing bibliometric networks: A comparison between full and fractional counting," Journal of Informetrics, Elsevier, vol. 10(4), pages 1178-1195.
    37. Giovanni Colavizza, 2017. "The structural role of the core literature in history," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1787-1809, December.
    38. Annamária Inzelt & András Schubert & Mihály Schubert, 2009. "Incremental citation impact due to international co-authorship in Hungarian higher education institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(1), pages 37-43, January.
    39. Svein Kyvik & Ingvild Reymert, 2017. "Research collaboration in groups and networks: differences across academic fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 951-967, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gutierrez-Lythgoe, Antonio, 2023. "Redes y autoempleo: Evidencia con datos de Facebook [Networks and self-employment: Evidence from Facebook data]," MPRA Paper 116656, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. José Alberto Molina & David Iñiguez & Gonzalo Ruiz & Alfonso Tarancón, 2018. "The Nobel Prize in Economics: individual or collective merits?," Boston College Working Papers in Economics 966, Boston College Department of Economics.
    2. José Alberto Molina & Alberto Alcolea & Alfredo Ferrer & Alberto Alcolea & David Iñiguez & Alejandro Rivero & Gonzalo Ruiz & Alfonso Tarancón, 2016. "Co-authorship and Academic Productivity in Economics: Interaction Maps from the Complex Networks Approach," Boston College Working Papers in Economics 914, Boston College Department of Economics.
    3. José Alberto Molina & David Iñiguez & Gonzalo Ruiz & Alfonso Tarancón, 2021. "Leaders among the leaders in Economics: a network analysis of the Nobel Prize laureates," Applied Economics Letters, Taylor & Francis Journals, vol. 28(7), pages 584-589, April.
    4. David L. Anderson & John Tressler, 2017. "Researcher rank stability across alternative output measurement schemes in the context of a time limited research evaluation: the New Zealand case," Applied Economics, Taylor & Francis Journals, vol. 49(45), pages 4542-4553, September.
    5. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    6. David L. Anderson & John Tressler, 2008. "Research Output in New Zealand Economics Department 2000-2006," Working Papers in Economics 08/05, University of Waikato.
    7. David Anderson & John Tressler, 2008. "Research output in New Zealand economics departments 2000-2006: A stock approach," New Zealand Economic Papers, Taylor & Francis Journals, vol. 42(2), pages 155-189.
    8. David L. Anderson & John Tressler, 2013. "The Relevance of the “h-” and “g-” Index to Economics in the Context of A Nation-Wide Research Evaluation Scheme: The New Zealand Case," Economic Papers, The Economic Society of Australia, vol. 32(1), pages 81-94, March.
    9. John Gibson & David L. Anderson & John Tressler, 2014. "Which Journal Rankings Best Explain Academic Salaries? Evidence From The University Of California," Economic Inquiry, Western Economic Association International, vol. 52(4), pages 1322-1340, October.
    10. Joseph Macri & Michael McAleer & Dipendra Sinha, 2010. "On the robustness of alternative rankings methodologies: Australian and New Zealand economics departments, 1988 to 2002," Applied Economics, Taylor & Francis Journals, vol. 42(10), pages 1257-1268.
    11. Stelios Katranidis & Theodore Panagiotidis & Costas Zontanos, 2017. "Economists, Research Performance and National Inbreeding: North Versus South," Economic Notes, Banca Monte dei Paschi di Siena SpA, vol. 46(1), pages 145-163, February.
    12. Konstantinos Chatzimichael & Pantelis Kalaitzidakis & Vangelis Tzouvelekas, 2017. "Measuring the publishing productivity of economics departments in Europe," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 889-908, November.
    13. Joseph Macri & Michael McAleer & Dipendra Sinha, 2009. "On the Robustness of Alternative Rankings Methodologies For Australian and New Zealand Economics Departments," CIRJE F-Series CIRJE-F-660, CIRJE, Faculty of Economics, University of Tokyo.
    14. Joseph Macri & Dipendra Sinha, 2006. "Rankings Methodology for International Comparisons of Institutions and Individuals: an Application to Economics in Australia and New Zealand," Journal of Economic Surveys, Wiley Blackwell, vol. 20(1), pages 111-156, February.
    15. Michael Bräuninger & Justus Haucap & Johannes Muck, 2011. "Was lesen und schätzen deutschsprachige Ökonomen heute?," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 12(4), pages 339-371, November.
    16. Johannes König & David I. Stern & Richard S.J. Tol, 2022. "Confidence Intervals for Recursive Journal Impact Factors," Tinbergen Institute Discussion Papers 22-038/III, Tinbergen Institute.
    17. Vera Sommer & Klaus Wohlrabe, 2017. "Citations, journal ranking and multiple authorships reconsidered: evidence from almost one million articles," Applied Economics Letters, Taylor & Francis Journals, vol. 24(11), pages 809-814, June.
    18. Javier Ruiz-Castillo, 2008. "Economics research in Spain during the 1990s: a literature review," Spanish Economic Review, Springer;Spanish Economic Association, vol. 10(3), pages 221-249, September.
    19. ÇOKGEZEN , Murat, 2013. "Publication performance of economists and economics departments in Turkey (2006–2011): An Update and Comparison," Regional and Sectoral Economic Studies, Euro-American Association of Economic Development, vol. 13(3), pages 95-106.
    20. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.

    More about this item

    Keywords

    Academic performance; Co-authorship; Economists; Interaction maps; Complex networks;
    All these keywords.

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • A30 - General Economics and Teaching - - Multisubject Collective Works - - - General
    • O30 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:empeco:v:58:y:2020:i:3:d:10.1007_s00181-018-1546-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.