IDEAS home Printed from https://ideas.repec.org/p/hig/wpaper/221-ec-2019.html
   My bibliography  Save this paper

The Causal Impact Of Performance-Based Funding On University Performance: Quasi-Experimental Evidence From A Policy In Russian Higher Education

Author

Listed:
  • Tommaso Agasisti

    (National Research University Higher School of Economics)

  • Ekaterina Abalmasova

    (National Research University Higher School of Economics)

  • Ekaterina Shibanova

    (National Research University Higher School of Economics)

  • Aleksei Egorov

    (National Research University Higher School of Economics)

Abstract

In most countries which experience structural transformation of their higher education system, a crucial goal of policy makers is to tie the amount of university public funding to their performance. This research analyzes the Russian performance-based funding (PBF) reform to provide a quasi-experimental assessment of its effects on Russian universities’ performance. Data comes from the Monitoring for HEIs performance and covers the period between 2014/2015 and 2017/2018. To evaluate the causal effect of the PBF policy on university performance, in a first step we define the treatment and the control groups by distinguishing universities on the basis of the trend in their performance-based allocations. In a second step, we estimated the causal effect of the redistribution of public funds across universities as a result of PBF policy. Results indicate that the performance of universities is actually affected by getting extra funding after the reform, although heterogeneity is at play. The short-run effect is related with the impact on average national exam scores, indicating that the policy forced universities to be more selective.

Suggested Citation

  • Tommaso Agasisti & Ekaterina Abalmasova & Ekaterina Shibanova & Aleksei Egorov, 2019. "The Causal Impact Of Performance-Based Funding On University Performance: Quasi-Experimental Evidence From A Policy In Russian Higher Education," HSE Working papers WP BRP 221/EC/2019, National Research University Higher School of Economics.
  • Handle: RePEc:hig:wpaper:221/ec/2019
    as

    Download full text from publisher

    File URL: https://wp.hse.ru/data/2019/12/06/1520936349/221EC2019.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Alberto Abadie, 2005. "Semiparametric Difference-in-Differences Estimators," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(1), pages 1-19.
    2. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    3. Robert Kelchen, 2018. "Do Performance-Based Funding Policies Affect Underrepresented Student Enrollment?," The Journal of Higher Education, Taylor & Francis Journals, vol. 89(5), pages 702-727, September.
    4. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    5. Philippe Aghion & Mathias Dewatripont & Caroline Hoxby & Andreu Mas-Colell & André Sapir, 2010. "The governance and performance of universities: evidence from Europe and the US [Distance to frontier, selection, and economic growth]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 25(61), pages 7-59.
    6. Ben Jongbloed & Hans Vossensteyn, 2016. "University funding and student funding: international comparisons," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 32(4), pages 576-595.
    7. Wang, Derek D., 2019. "Performance-based resource allocation for higher education institutions in China," Socio-Economic Planning Sciences, Elsevier, vol. 65(C), pages 66-75.
    8. Hugo Horta & Jeroen Huisman & Manuel Heitor, 2008. "Does competitive research funding encourage diversity in higher education?," Science and Public Policy, Oxford University Press, vol. 35(3), pages 146-158, April.
    9. Bolli, Thomas & Olivares, Maria & Bonaccorsi, Andrea & Daraio, Cinzia & Aracil, Adela Garcia & Lepori, Benedetto, 2016. "The differential effects of competitive funding on the production frontier and the efficiency of universities," Economics of Education Review, Elsevier, vol. 52(C), pages 91-104.
    10. Montero, Pablo & Vilar, José A., 2014. "TSclust: An R Package for Time Series Clustering," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 62(i01).
    11. Francisco Pedraja-Chaparro & Daniel Santín & Rosa Simancas, 2016. "The impact of immigrant concentration in schools on grade retention in Spain: a difference-in-differences approach," Applied Economics, Taylor & Francis Journals, vol. 48(21), pages 1978-1990, May.
    12. Nicholas W. Hillman & David A. Tandberg & Jacob P. K. Gross, 2014. "Performance Funding in Higher Education: Do Financial Incentives Impact College Completions?," The Journal of Higher Education, Taylor & Francis Journals, vol. 85(6), pages 826-857, November.
    13. Parker, Lee, 2011. "University corporatisation: Driving redefinition," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 22(4), pages 434-450.
    14. Tommaso Agasisti & Geraint Johnes, 2009. "Beyond frontiers: comparing the efficiency of higher education decision-making units across more than one country," Education Economics, Taylor & Francis Journals, vol. 17(1), pages 59-79.
    15. Cohn, Elchanan & Rhine, Sherrie L W & Santos, Maria C, 1989. "Institutions of Higher Education as Multi-product Firms: Economies of Scale and Scope," The Review of Economics and Statistics, MIT Press, vol. 71(2), pages 284-290, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tommaso Agasisti & Aleksei Egorov & Pavel Serebrennikov, 2020. "How Do The Characteristics Of The Environment Influence University Efficiency? Evidence From A Conditional Efficiency Approach," HSE Working papers WP BRP 238/EC/2020, National Research University Higher School of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tommaso Agasisti & Giuseppe Munda, 2017. "Efficiency of investment in compulsory education: An Overview of Methodological Approaches," JRC Research Reports JRC106681, Joint Research Centre.
    2. Tommaso Agasisti & Ralph Hippe & Giuseppe Munda, 2017. "Efficiency of investment in compulsory education: empirical analyses in Europe," JRC Research Reports JRC106678, Joint Research Centre.
    3. Tommaso Agasisti & Sabine Gralka, 2019. "The transient and persistent efficiency of Italian and German universities: a stochastic frontier analysis," Applied Economics, Taylor & Francis Journals, vol. 51(46), pages 5012-5030, October.
    4. Herberholz, Lars & Wigger, Berthold U., 2021. "Efficiency of European universities: A comparison of peers," Research Policy, Elsevier, vol. 50(9).
    5. Lars Herberholz & Berthold U. Wigger, 2020. "Efficiency of European Universities: A Comparison of Peers," CESifo Working Paper Series 8044, CESifo.
    6. Tommaso Agasisti & Aleksei Egorov & Pavel Serebrennikov, 2020. "How Do The Characteristics Of The Environment Influence University Efficiency? Evidence From A Conditional Efficiency Approach," HSE Working papers WP BRP 238/EC/2020, National Research University Higher School of Economics.
    7. Gralka, Sabine, 2018. "Stochastic frontier analysis in higher education: A systematic review," CEPIE Working Papers 05/18, Technische Universität Dresden, Center of Public and International Economics (CEPIE).
    8. Agasisti, Tommaso & Barra, Cristian & Zotti, Roberto, 2016. "Evaluating the efficiency of Italian public universities (2008–2011) in presence of (unobserved) heterogeneity," Socio-Economic Planning Sciences, Elsevier, vol. 55(C), pages 47-58.
    9. Sabine Gralka & Klaus Wohlrabe & Lutz Bornmann, 2018. "How to Measure Research Efficiency in Higher Education? Research Grants vs. Publication Output," CESifo Working Paper Series 7055, CESifo.
    10. Jan Morten Dyrstad & Mia Marie Wallgren Sohlman & Tor Henrik Teigen, 2024. "Government funding incentives and study program capacities in public universities: theory and evidence," Oxford Economic Papers, Oxford University Press, vol. 76(2), pages 585-607.
    11. Cantner, Uwe & Grashof, Nils & Grebel, Thomas & Zhang, Xijie, 2023. "When Excellence is not Excellent: The Impact of the Excellence Initiative on the Relative Productivity of German Universities," MPRA Paper 118139, University Library of Munich, Germany.
    12. Jan Morten Dyrstad & Mia Marie Wallgren Sohlman & Tor Henrik Teigen, 2021. "Government funding incentives and study program capacities in public universities: theory and evidence," Working Paper Series 19021, Department of Economics, Norwegian University of Science and Technology.
    13. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    14. Xiaodan Hu & Pedro Villarreal, 2019. "Public Tuition on the Rise: Estimating the Effects of Louisiana’s Performance-Based Funding Policy on Institutional Tuition Levels," Research in Higher Education, Springer;Association for Institutional Research, vol. 60(5), pages 636-669, August.
    15. Wolszczak-Derlacz, Joanna, 2017. "An evaluation and explanation of (in)efficiency in higher education institutions in Europe and the U.S. with the application of two-stage semi-parametric DEA," Research Policy, Elsevier, vol. 46(9), pages 1595-1605.
    16. Alexandre Belloni & Victor Chernozhukov & Denis Chetverikov & Christian Hansen & Kengo Kato, 2018. "High-dimensional econometrics and regularized GMM," CeMMAP working papers CWP35/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    17. Matias Busso & Patrick Kline, 2008. "Do Local Economic Development Programs Work? Evidence from the Federal Empowerment Zone Program," Cowles Foundation Discussion Papers 1639, Cowles Foundation for Research in Economics, Yale University.
    18. Malerba, Daniele, 2020. "Poverty alleviation and local environmental degradation: An empirical analysis in Colombia," World Development, Elsevier, vol. 127(C).
    19. Pablo Lavado & Gonzalo Rivera, 2016. "Identifying Treatment Effects with Data Combination and Unobserved Heterogeneity," Working Papers 79, Peruvian Economic Association.
    20. James Roumasset & Christopher Wada, 2012. "The Economics of Groundwater," Working Papers 201211, University of Hawaii at Manoa, Department of Economics.

    More about this item

    Keywords

    performance-based funding; higher education funding; policy evaluation; difference-in-differences;
    All these keywords.

    JEL classification:

    • I22 - Health, Education, and Welfare - - Education - - - Educational Finance; Financial Aid
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hig:wpaper:221/ec/2019. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Shamil Abdulaev or Shamil Abdulaev (email available below). General contact details of provider: https://edirc.repec.org/data/hsecoru.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.