IDEAS home Printed from https://ideas.repec.org/p/vuw/vuwcpf/20924.html
   My bibliography  Save this paper

The 'Disciplinary Effect' of the Performance-based Research Fund Process in New Zealand

Author

Listed:
  • Buckle, Robert A
  • Creedy, John

Abstract

This paper examines how the research quality of academic disciplines within New Zealand universities has evolved since the first Performance-based Research Fund (PBRF) assessment in 2003. The analysis uses a database consisting of an anonymous ‘quality category’ (QC) for each person assessed in the 2003 and 2012 PBRF assessment rounds. Individual researchers are assigned to academic discipline groups and the paper measures the distribution of researchers across disciplines and the discipline composition of universities. There has been little change in the distribution and their concentration within and across universities. However, exceptions are increases in the shares of medicine and agriculture, and a reduction in the share of education. Research Average Quality Scores are derived for discipline groups. All groups substantially increased their scores. Transition matrices show that there are significant differences in the dynamics of the various disciplines during the PBRF process. The paper shows that changes in the discipline composition of universities explains little of the proportional improvement of research quality among New Zealand universities.

Suggested Citation

  • Buckle, Robert A & Creedy, John, 2019. "The 'Disciplinary Effect' of the Performance-based Research Fund Process in New Zealand," Working Paper Series 20924, Victoria University of Wellington, Chair in Public Finance.
    • Handle: RePEc:vuw:vuwcpf:20924
    as

    Download full text from publisher

    File URL: https://ir.wgtn.ac.nz/handle/123456789/20924
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. John Creedy, 2017. "Alternative Distributions for Inequality Comparisons," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 50(4), pages 484-497, December.
    2. Ehrenberg, Ronald & Kasper, Hirschel & Rees, Daniel, 1991. "Faculty turnover at American colleges and universities: Analyses of AAUP data," Economics of Education Review, Elsevier, vol. 10(2), pages 99-110, June.
    3. Anthony Shorrocks, 2013. "Decomposition procedures for distributional analysis: a unified framework based on the Shapley value," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 11(1), pages 99-126, March.
    4. Olivier Bargain, 2012. "Decomposition analysis of distributive policies using behavioural simulations," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 19(5), pages 708-731, October.
    5. Peter Woelert & Lachlan McKenzie, 2018. "Follow the money? How Australian universities replicate national performance-based funding mechanisms," Research Evaluation, Oxford University Press, vol. 27(3), pages 184-195.
    6. Jung Cheol Shin & William K. Cummings, 2010. "Multilevel analysis of academic publishing across disciplines: research preference, collaboration, and time on research," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 581-594, November.
    7. Boyle Glenn, 2008. "Pay Peanuts and Get Monkeys? Evidence from Academia," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 8(1), pages 1-26, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Robert A. Buckle & John Creedy & Ashley Ball, 2021. "Fifteen Years of a PBRFS in New Zealand: Incentives and Outcomes," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 54(2), pages 208-230, June.
    2. Robert A. Buckle & John Creedy & Norman Gemmell, 2022. "Sources of convergence and divergence in university research quality: evidence from the performance-based research funding system in New Zealand," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3021-3047, June.
    3. Buckle, Robert A. & Creedy, John & Ball, Ashley, 2020. "A Schumpeterian Gale: Using Longitudinal Data to Evaluate Responses to Performance-Based Research Funding Systems," Working Paper Series 9447, Victoria University of Wellington, Chair in Public Finance.
    4. Buckle, Robert A. & Creedy, John & Ball, Ashley, 2020. "A Schumpeterian Gale: Using Longitudinal Data to Evaluate Responses to Performance-Based Research Funding Systems," Working Paper Series 21104, Victoria University of Wellington, Chair in Public Finance.
    5. Robert A. Buckle & John Creedy, 2022. "Methods to evaluate institutional responses to performance‐based research funding systems," Australian Economic Papers, Wiley Blackwell, vol. 61(3), pages 615-634, September.
    6. Buckle, Robert A & Creedy, John, 2022. "The Performance Based Research Fund in NZ: Taking Stock and Looking Forward," Working Paper Series 21354, Victoria University of Wellington, Chair in Public Finance.
    7. Robert A. Buckle & John Creedy & Ashley Ball, 2021. "Fifteen Years of a PBRFS in New Zealand: Incentives and Outcomes," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 54(2), pages 208-230, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert A. Buckle & John Creedy, 2020. "The ‘disciplinary effect’ of the performance-based research fund process in New Zealand," New Zealand Economic Papers, Taylor & Francis Journals, vol. 54(2), pages 107-126, May.
    2. Buckle, Robert A. & Creedy, John & Ball, Ashley, 2020. "A Schumpeterian Gale: Using Longitudinal Data to Evaluate Responses to Performance-Based Research Funding Systems," Working Paper Series 21104, Victoria University of Wellington, Chair in Public Finance.
    3. Buckle, Robert A. & Creedy, John & Ball, Ashley, 2020. "A Schumpeterian Gale: Using Longitudinal Data to Evaluate Responses to Performance-Based Research Funding Systems," Working Paper Series 9447, Victoria University of Wellington, Chair in Public Finance.
    4. Robert A. Buckle & John Creedy & Ashley Ball, 2021. "Fifteen Years of a PBRFS in New Zealand: Incentives and Outcomes," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 54(2), pages 208-230, June.
    5. Robert A. Buckle & John Creedy, 2022. "Methods to evaluate institutional responses to performance‐based research funding systems," Australian Economic Papers, Wiley Blackwell, vol. 61(3), pages 615-634, September.
    6. Robert A. Buckle & John Creedy & Ashley Ball, 2021. "Fifteen Years of a PBRFS in New Zealand: Incentives and Outcomes," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 54(2), pages 208-230, June.
    7. Robert A. Buckle & John Creedy & Norman Gemmell, 2022. "Sources of convergence and divergence in university research quality: evidence from the performance-based research funding system in New Zealand," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3021-3047, June.
    8. Robert A. Buckle & John Creedy & Norman Gemmell, 2022. "Sources of convergence and divergence in university research quality: evidence from the performance-based research funding system in New Zealand," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3021-3047, June.
    9. SOLOGON Denisa & ALMEIDA Vanda & VAN KERM Philippe, 2019. "Accounting for the distributional effects of the 2007-2008 crisis and the Economic Adjustment Program in Portugal," LISER Working Paper Series 2019-05, Luxembourg Institute of Socio-Economic Research (LISER).
    10. Robert A. Buckle & John Creedy & Norman Gemmell, 2020. "Is external research assessment associated with convergence or divergence of research quality across universities and disciplines? Evidence from the PBRF process in New Zealand," Applied Economics, Taylor & Francis Journals, vol. 52(36), pages 3919-3932, July.
    11. Nerijus Černiauskas & Denisa M. Sologon & Cathal O’Donoghue & Linas Tarasonis, 2022. "Income Inequality and Redistribution in Lithuania: The Role of Policy, Labor Market, Income, and Demographics," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 68(S1), pages 131-166, April.
    12. Robert A. Buckle & John Creedy & Norman Gemmell, 2020. "Is external research assessment associated with convergence or divergence of research quality across universities and disciplines? Evidence from the PBRF process in New Zealand," Applied Economics, Taylor & Francis Journals, vol. 52(36), pages 3919-3932, July.
    13. Thor O. Thoresen & Zhiyang Jia & Peter J. Lambert, 2013. "Distributional benchmarking in tax policy evaluations," Discussion Papers 765, Statistics Norway, Research Department.
    14. Nerijus Cerniauskas & Denisa M. Sologon & Cathal O’Donoghue & Linas Tarasonis, 2020. "Changes in income inequality in Lithuania: the role of policy, labour market structure, returns and demographics," Bank of Lithuania Working Paper Series 71, Bank of Lithuania.
    15. Nicolas Hérault & Guyonne Kalb, 2022. "Understanding the rising trend in female labour force participation," Fiscal Studies, John Wiley & Sons, vol. 43(4), pages 341-363, December.
    16. Christian Schneijderberg & Nicolai Götze & Lars Müller, 2022. "A study of 25 years of publication outputs in the German academic profession," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 1-28, January.
    17. SOLOGON Denisa & VAN KERM Philippe & LI Jinjing & O'DONOGHUE Cathal, 2018. "Accounting for Differences in Income Inequality across Countries: Ireland and the United Kingdom," LISER Working Paper Series 2018-01, Luxembourg Institute of Socio-Economic Research (LISER).
    18. Makarski, Krzysztof & Tyrowicz, Joanna, 2023. "Preference for redistribution during structural change with labor mobility frictions," European Journal of Political Economy, Elsevier, vol. 77(C).
    19. Gintare Mazeikaite & Cathal O’Donoghue & Denisa M. Sologon, 2021. "What Drives Cross-Country Health Inequality in the EU? Unpacking the Role of Socio-economic Factors," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 155(1), pages 117-155, May.
    20. Thor O. Thoresen & Zhiyang Jia & Peter J. Lambert, 2016. "Is there More Redistribution Now? A Review of Methods for Evaluating Tax Redistributional Effects," FinanzArchiv: Public Finance Analysis, Mohr Siebeck, Tübingen, vol. 72(3), pages 302-333, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vuw:vuwcpf:20924. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Library Technology Services (email available below). General contact details of provider: https://edirc.repec.org/data/fcvuwnz.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.