IDEAS home Printed from https://ideas.repec.org/p/hub/wpecon/200921.html
   My bibliography  Save this paper

Robust benevolent evaluations of teaching performance

Author

Listed:
  • Rogge, Nicky

    (Hogeschool-Universiteit Brussel (HUB), Belgium; Katholieke Universiteit Leuven (KULeuven) Faculty of Business and Economics, 3000 Leuven (Belgium);)

Abstract

Although benevolent (BoD) weighting has some appealing features for the construction of evaluation scores of teacher performance (i.e., SET-scores), it still suffers from an important drawback in its basic form: the sensitivity of its outcomes to the influence of potential outliers, extreme values, and potential measurement error in the data. The robust order-m BoD approach provides a solution for this problem as it no longer puts central the traditional assumption that all observations (thus also potential outliers or observations infected by measurement errors) should be considered in the computation of the SETscores. As a result, teacher evaluations become less affected by outliers and incorrectness in the data. The main purpose of this paper is to present this order-m BoD approach as a robust alternative to basic BoD and discuss some of its advantages to evaluate teachers. The method is illustrated using data collected at the Hogeschool Universiteit Brussel (Belgium).

Suggested Citation

  • Rogge, Nicky, 2009. "Robust benevolent evaluations of teaching performance," Working Papers 2009/21, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
  • Handle: RePEc:hub:wpecon:200921
    as

    Download full text from publisher

    File URL: https://lirias.hubrussel.be/bitstream/123456789/2492/1/09HRP21.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kristof DE WITTE & Mika KORTELAINEN, 2008. "Blaming the exogenous environment? Conditional efficiency estimation with continuous and discrete environmental variables," Working Papers of Department of Economics, Leuven ces0833, KU Leuven, Faculty of Economics and Business (FEB), Department of Economics, Leuven.
    2. Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, September.
    3. Knox Lovell, C. A. & Pastor, Jesus T. & Turner, Judi A., 1995. "Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries," European Journal of Operational Research, Elsevier, vol. 87(3), pages 507-518, December.
    4. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    5. Daraio, Cinzia & Simar, Leopold, 2006. "A robust nonparametric approach to evaluate and explain the performance of mutual funds," European Journal of Operational Research, Elsevier, vol. 175(1), pages 516-542, November.
    6. Laurens Cherchye & & Timo Kuosmanen, 2002. "Benchmarking Sustainable Development: A Synthetic Meta-index Approach," Others 0210001, University Library of Munich, Germany, revised 04 Dec 2002.
    7. De Witte, K. & Rogge, N., 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Working Papers 15, Top Institute for Evidence Based Education Research.
    8. Cinzia Daraio & Léopold Simar, 2007. "Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach," Journal of Productivity Analysis, Springer, vol. 28(1), pages 13-32, October.
    9. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    10. Daouia, Abdelaati & Simar, Leopold, 2007. "Nonparametric efficiency analysis: A multivariate conditional quantile approach," Journal of Econometrics, Elsevier, vol. 140(2), pages 375-400, October.
    11. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kristof Witte & Nicky Rogge, 2010. "To publish or not to publish? On the aggregation and drivers of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 657-680, December.
    2. Rogge, Nicky, 2009. "Granting teachers the 'benefit of the doubt' in performance evaluations," Working Papers 2009/17, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    3. Cordero Ferrera, Jose Manuel & Alonso Morán, Edurne & Nuño Solís, Roberto & Orueta, Juan F. & Souto Arce, Regina, 2013. "Efficiency assessment of primary care providers: A conditional nonparametric approach," MPRA Paper 51926, University Library of Munich, Germany.
    4. Fusco, Elisa & Vidoli, Francesco & Sahoo, Biresh K., 2018. "Spatial heterogeneity in composite indicator: A methodological proposal," Omega, Elsevier, vol. 77(C), pages 1-14.
    5. De Witte, Kristof & Rogge, Nicky, 2009. "Accounting for exogenous influences in a benevolent performance evaluation of teachers," Working Papers 2009/15, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    6. Cordero, José Manuel & Alonso-Morán, Edurne & Nuño-Solinis, Roberto & Orueta, Juan F. & Arce, Regina Sauto, 2015. "Efficiency assessment of primary care providers: A conditional nonparametric approach," European Journal of Operational Research, Elsevier, vol. 240(1), pages 235-244.
    7. De Witte, Kristof & Mika, Kortelainen, 2009. "Blaming the exogenous environment? Conditional efficiency estimation with continuous and discrete exogenous variables," MPRA Paper 14034, University Library of Munich, Germany.
    8. De Witte, Kristof & Schiltz, Fritz, 2018. "Measuring and explaining organizational effectiveness of school districts: Evidence from a robust and conditional Benefit-of-the-Doubt approach," European Journal of Operational Research, Elsevier, vol. 267(3), pages 1172-1181.
    9. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators," European Journal of Operational Research, Elsevier, vol. 278(3), pages 942-960.
    10. Sofia KOURTESI & Panos FOUSEKIS & Apostolos POLYMEROS, 2012. "Conditional Efficiency Estimation With Environmental Variables: Evidence From Greek Cereal Farms," Scientific Bulletin - Economic Sciences, University of Pitesti, vol. 11(1), pages 43-52.
    11. Luiza Bădin & Cinzia Daraio & Léopold Simar, 2014. "Explaining inefficiency in nonparametric production models: the state of the art," Annals of Operations Research, Springer, vol. 214(1), pages 5-30, March.
    12. Fabio Pammolli & Francesco Porcelli & Francesco Vidoli & Guido Borà, 2014. "La spesa sanitaria delle Regioni in Italia - Saniregio 3," Working Papers CERM 02-2014, Competitività, Regole, Mercati (CERM).
    13. Amparo Soler Domínguez & Juan Carlos Matallín Sáez & Emili Tortosa Ausina, 2011. "On the informativeness of persistence for mutual funds' performance evaluation using partial frontiers," Working Papers. Serie EC 2011-08, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    14. Calogero Guccio & Domenico Lisi & Marco Martorana & Anna Mignosa, 2017. "On the role of cultural participation in tourism destination performance: an assessment using robust conditional efficiency approach," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 41(2), pages 129-154, May.
    15. Halkos, George & Tzeremes, Nickolaos, 2011. "The effect of energy consumption on countries’ economic efficiency: a conditional robust non parametric approach," MPRA Paper 28692, University Library of Munich, Germany.
    16. Alda A. Henriques & Milton Fontes & Ana S. Camanho & Giovanna D’Inverno & Pedro Amorim & Jaime Gabriel Silva, 2022. "Performance evaluation of problematic samples: a robust nonparametric approach for wastewater treatment plants," Annals of Operations Research, Springer, vol. 315(1), pages 193-220, August.
    17. Bădin, Luiza & Daraio, Cinzia & Simar, Léopold, 2012. "How to measure the impact of environmental factors in a nonparametric production model," European Journal of Operational Research, Elsevier, vol. 223(3), pages 818-833.
    18. Amir Moradi-Motlagh & Ali Emrouznejad, 2022. "The origins and development of statistical approaches in non-parametric frontier models: a survey of the first two decades of scholarly literature (1998–2020)," Annals of Operations Research, Springer, vol. 318(1), pages 713-741, November.
    19. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    20. Giovanni Dosi & Marco Grazzi & Luigi Marengo & Simona Settepanella, 2016. "Production Theory: Accounting for Firm Heterogeneity and Technical Change," Journal of Industrial Economics, Wiley Blackwell, vol. 64(4), pages 875-907, December.

    More about this item

    Keywords

    Teacher performance; Data envelopment analysis; Composite indicators; Robust order-m estimation; Expert opinion;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions; Probabilities
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hub:wpecon:200921. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sabine Janssens (email available below). General contact details of provider: https://edirc.repec.org/data/emhubbe.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.