IDEAS home Printed from https://ideas.repec.org/a/eee/soceps/v71y2020ics0038012119300990.html
   My bibliography  Save this article

The strange case of the Matthew effect and beauty contests: Research evaluation and specialisation in Italian universities

Author

Listed:
  • Migheli, Matteo
  • Zotti, Roberto

Abstract

The paper aims to determine whether the distribution of funds that prizes the best-performing institutions relatively more has the effect of replicating the Matthew effect within them in terms of personnel policies and allocating proportionally more resources to the best departments to strengthen their output considering the prospect of future assessments. Data from the Italian public university system between 2011 and 2016 as well as the outcomes of the national evaluation of research produced between 2004 and 2010 and between 2011 and 2014 in 14 disciplinary research areas are used. The empirical evidence shows that Italian universities have tended to increase their specialisation in the research areas in which they ranked below or slightly above the national mean, revealing that they chose to try to strengthen the weak sectors through both promotions and new recruitments. The results suggest the existence of a dual policy. When the Ministry of Education, University and Research tries to foster a Matthew effect mechanism, allocating more resources to the best-performing universities, the latter seem to opt to implement a beauty contest strategy to make their weak areas converge towards the national mean. When considering the effects of the recruiting strategies following the national evaluation of research, the results indicate the existence of some Matthew effects, showing that increasing specialisation is more fruitful for the best than for the worst universities.

Suggested Citation

  • Migheli, Matteo & Zotti, Roberto, 2020. "The strange case of the Matthew effect and beauty contests: Research evaluation and specialisation in Italian universities," Socio-Economic Planning Sciences, Elsevier, vol. 71(C).
    • Handle: RePEc:eee:soceps:v:71:y:2020:i:c:s0038012119300990
    DOI: 10.1016/j.seps.2019.100749
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0038012119300990
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.seps.2019.100749?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Francesco Lissoni & Jacques Mairesse & Fabio Montobbio & Michele Pezzoni, 2011. "Scientific productivity and academic promotion: a study on French and Italian physicists," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 20(1), pages 253-294, February.
    2. Auranen, Otto & Nieminen, Mika, 2010. "University research funding and publication performance--An international comparison," Research Policy, Elsevier, vol. 39(6), pages 822-834, July.
    3. Giovanni Abramo & Ciriaco Andrea D’Angelo, 2011. "Evaluating research: from informed peer review to bibliometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 499-514, June.
    4. Muscio, Alessandro & Quaglione, Davide & Vallanti, Giovanna, 2013. "Does government funding complement or substitute private research funding to universities?," Research Policy, Elsevier, vol. 42(1), pages 63-75.
    5. Aldo Geuna, 2001. "The Changing Rationale for European University Research Funding: Are There Negative Unintended Consequences?," Journal of Economic Issues, Taylor & Francis Journals, vol. 35(3), pages 607-632, September.
    6. Francesco Lissoni & Jacques Mairesse & Fabio Montobbio & Michele Pezzoni, 2011. "Scientific productivity and academic promotion: a study on French and Italian physicists," Industrial and Corporate Change, Oxford University Press, vol. 20(1), pages 253-294, February.
    7. Tol, Richard S.J., 2013. "The Matthew effect for cohorts of economists," Journal of Informetrics, Elsevier, vol. 7(2), pages 522-527.
    8. Mattia Cattaneo & Michele Meoli & Andrea Signori, 2016. "Performance-based funding and university research productivity: the moderating effect of university legitimacy," The Journal of Technology Transfer, Springer, vol. 41(1), pages 85-104, February.
    9. Wang, Jian, 2014. "Unpacking the Matthew effect in citations," Journal of Informetrics, Elsevier, vol. 8(2), pages 329-339.
    10. Birkmaier, Daniel & Wohlrabe, Klaus, 2014. "The Matthew effect in economics reconsidered," Journal of Informetrics, Elsevier, vol. 8(4), pages 880-889.
    11. Benner, Mats & Sandstrom, Ulf, 2000. "Institutionalizing the triple helix: research funding and norms in the academic system," Research Policy, Elsevier, vol. 29(2), pages 291-301, February.
    12. Richard S.J. Tol, 2009. "The Matthew effect defined and tested for the 100 most prolific economists," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(2), pages 420-426, February.
    13. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Caprasecca, Alessandro, 2009. "Allocative efficiency in public research funding: Can bibliometrics help?," Research Policy, Elsevier, vol. 38(1), pages 206-215, February.
    14. Giovanni Abramo & Ciriaco Andrea D’Angelo & Francesco Rosati, 2015. "The determinants of academic career advancement: Evidence from Italy," Science and Public Policy, Oxford University Press, vol. 42(6), pages 761-774.
    15. Wu, Jiang, 2015. "Distributions of scientific funding across universities and research disciplines," Journal of Informetrics, Elsevier, vol. 9(1), pages 183-196.
    16. Franceschini, Fiorenzo & Maisano, Domenico, 2017. "Critical remarks on the Italian research assessment exercise VQR 2011–2014," Journal of Informetrics, Elsevier, vol. 11(2), pages 337-357.
    17. Björn Hammarfelt & Gustaf Nelhans & Pieta Eklund & Fredrik Åström, 2016. "The heterogeneous landscape of bibliometric indicators: Evaluating models for allocating resources at Swedish universities," Research Evaluation, Oxford University Press, vol. 25(3), pages 292-305.
    18. Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jayaraman, Aishwarya & Rajan, Sudhir Chella & Ramu, Palaniappan, 2024. "Food system resilience: Unraveling power relations and the Matthew effect in farmers networks," Technological Forecasting and Social Change, Elsevier, vol. 200(C).
    2. Pei Chen & Shan Gao & Fan Jiang & Yifang Ma, 2024. "Measuring the labor market outcomes of universities: evidence from China’s listed company executives," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(9), pages 5715-5730, September.
    3. Filandri, Marianna & Pasqua, Silvia & Priori, Eleonora, 2023. "Breaking through the glass ceiling. Simulating policies to close the gender gap in the Italian academia," Socio-Economic Planning Sciences, Elsevier, vol. 88(C).
    4. Matteo Migheli & Giovanni B. Ramello, 2021. "The unbearable lightness of scientometric indices," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 42(8), pages 1933-1944, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniele Rotolo & Michael Hopkins & Nicola Grassano, 2023. "Do funding sources complement or substitute? Examining the impact of cancer research publications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(1), pages 50-66, January.
    2. Liao, Chien Hsiang, 2021. "The Matthew effect and the halo effect in research funding," Journal of Informetrics, Elsevier, vol. 15(1).
    3. Katchanov, Yurij L. & Markova, Yulia V. & Shmatko, Natalia A., 2023. "Empirical demonstration of the Matthew effect in scientific research careers," Journal of Informetrics, Elsevier, vol. 17(4).
    4. Byeongwoo Kang & Kazuyuki Motohashi, 2020. "Academic contribution to industrial innovation by funding type," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 169-193, July.
    5. Daniel Birkmaier & Klaus Wohlrabe, 2014. "Der Matthäus-Effekt in der Ökonomie," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 67(17), pages 38-42, September.
    6. Yu, Nannan & Dong, Yueyan & de Jong, Martin, 2022. "A helping hand from the government? How public research funding affects academic output in less-prestigious universities in China," Research Policy, Elsevier, vol. 51(10).
    7. Chen, Zhuo & Yang, Zhenbing & Yang, Lili, 2020. "How to optimize the allocation of research resources? An empirical study based on output and substitution elasticities of universities in Chinese provincial level," Socio-Economic Planning Sciences, Elsevier, vol. 69(C).
    8. Abramo, Giovanni & D’Angelo, Ciriaco Andrea & Di Costa, Flavia, 2019. "When research assessment exercises leave room for opportunistic behavior by the subjects under evaluation," Journal of Informetrics, Elsevier, vol. 13(3), pages 830-840.
    9. Domenico A. Maisano & Luca Mastrogiacomo & Fiorenzo Franceschini, 2020. "Short-term effects of non-competitive funding to single academic researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(3), pages 1261-1280, June.
    10. Wenjing Wang & Yiwei Liu, 2022. "Industrial funding and university technology transfer: the moderating role of intellectual property rights enforcement," The Journal of Technology Transfer, Springer, vol. 47(5), pages 1549-1572, October.
    11. Civera, Alice & Lehmann, Erik E. & Paleari, Stefano & Stockinger, Sarah A.E., 2020. "Higher education policy: Why hope for quality when rewarding quantity?," Research Policy, Elsevier, vol. 49(8).
    12. Jürgen Janger & Anna Strauss-Kollin & David Campbell, 2013. "Academic Careers: A Cross-country Perspective. WWWforEurope Working Paper No. 37," WIFO Studies, WIFO, number 46923, January.
    13. D. Checchi & S. Cicognani & N. Kulic, 2015. "Gender quotas or girls networks? Towards an understanding of recruitment in the research profession in Italy," Working Papers wp1047, Dipartimento Scienze Economiche, Universita' di Bologna.
    14. Benedetto, Lepori & Geuna, Aldo & Veglio, Valerio, 2017. "A Typology of European Universities. Differentiation and resource distribution," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201705, University of Turin.
    15. Joonha Jeon & So Young Kim, 2018. "Is the gap widening among universities? On research output inequality and its measurement in the Korean higher education system," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(2), pages 589-606, March.
    16. Yumei Fu, 2023. "The impact of government funding on research innovation: An empirical analysis of Chinese universities," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 44(1), pages 285-296, January.
    17. Hamid Bouabid, 2014. "Science and technology metrics for research policy evaluation: some insights from a Moroccan experience," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 899-915, October.
    18. Jianping Li & Yongjia Xie & Dengsheng Wu & Yuanping Chen, 2017. "Underestimating or overestimating the distribution inequality of research funding? The influence of funding sources and subdivision," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 55-74, July.
    19. Leila Jabrane, 2022. "Individual excellence funding: effects on research autonomy and the creation of protected spaces," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-9, December.
    20. Seeber, Marco & Cattaneo, Mattia & Meoli, Michele & Malighetti, Paolo, 2019. "Self-citations as strategic response to the use of metrics for career decisions," Research Policy, Elsevier, vol. 48(2), pages 478-491.

    More about this item

    Keywords

    Matthew effect; Academic research evaluation; Academic staff specialisation; Distribution of scientific funding;
    All these keywords.

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy
    • H52 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceps:v:71:y:2020:i:c:s0038012119300990. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/seps .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.