IDEAS home Printed from https://ideas.repec.org/a/eee/juipol/v66y2020ics0957178720300771.html
   My bibliography  Save this article

Performance benchmarking using composite indicators to support regulation of the Portuguese wastewater sector

Author

Listed:
  • Henriques, Alda A.
  • Camanho, Ana S.
  • Amorim, Pedro
  • Silva, Jaime G.

Abstract

This paper develops a benchmarking framework to support performance-based sunshine regulation in the water sector. It uses benefit-of-the-doubt composite indicators formulated with a directional distance function. Weight restrictions are incorporated in the model to account for different perspectives in the performance assessment. The framework is tested using data of the Portuguese regulation authority concerning the activity of wastewater operators. The information obtained using this framework reflects overall performance at the firm level and complements traditional evaluations of regulatory authorities based on the analysis of individual indicators. The results can be used to disseminate best practices, motivate continuous improvement, and foster enhancements in the governance of regulated utilities.

Suggested Citation

  • Henriques, Alda A. & Camanho, Ana S. & Amorim, Pedro & Silva, Jaime G., 2020. "Performance benchmarking using composite indicators to support regulation of the Portuguese wastewater sector," Utilities Policy, Elsevier, vol. 66(C).
    • Handle: RePEc:eee:juipol:v:66:y:2020:i:c:s0957178720300771
    DOI: 10.1016/j.jup.2020.101082
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0957178720300771
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jup.2020.101082?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Molinos-Senante, María & Hernández-Sancho, Francesc & Mocholí-Arce, Manuel & Sala-Garrido, Ramón, 2014. "Economic and environmental performance of wastewater treatment plants: Potential reductions in greenhouse gases emissions," Resource and Energy Economics, Elsevier, vol. 38(C), pages 125-140.
    2. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    3. Aragon, Y. & Daouia, A. & Thomas-Agnan, C., 2005. "Nonparametric Frontier Estimation: A Conditional Quantile-Based Approach," Econometric Theory, Cambridge University Press, vol. 21(2), pages 358-389, April.
    4. Pinto, F.S. & Costa, A.S. & Figueira, J.R. & Marques, R.C., 2017. "The quality of service: An overall performance assessment for water utilities," Omega, Elsevier, vol. 69(C), pages 115-125.
    5. Marques, Rui Cunha & Pinto, Francisco Silva, 2018. "How to watch the watchmen? The role and measurement of regulatory governance," Utilities Policy, Elsevier, vol. 51(C), pages 73-81.
    6. Aude Le Lannier & Simon Porcher, 2014. "Efficiency in the public and private French water utilities: prospects for benchmarking," Applied Economics, Taylor & Francis Journals, vol. 46(5), pages 556-572, February.
    7. Luiza Bădin & Cinzia Daraio & Léopold Simar, 2014. "Explaining inefficiency in nonparametric production models: the state of the art," Annals of Operations Research, Springer, vol. 214(1), pages 5-30, March.
    8. Giannakis, Dimitrios & Jamasb, Tooraj & Pollitt, Michael, 2005. "Benchmarking and incentive regulation of quality of service: an application to the UK electricity distribution networks," Energy Policy, Elsevier, vol. 33(17), pages 2256-2271, November.
    9. D’Inverno, Giovanna & Carosi, Laura & Romano, Giulia & Guerrini, Andrea, 2018. "Water pollution in wastewater treatment plants: An efficiency analysis with undesirable output," European Journal of Operational Research, Elsevier, vol. 269(1), pages 24-34.
    10. Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, September.
    11. Léopold Simar, 2003. "Detecting Outliers in Frontier Models: A Simple Approach," Journal of Productivity Analysis, Springer, vol. 20(3), pages 391-424, November.
    12. Kristof Witte & Rui Marques, 2010. "Influential observations in frontier models, a robust non-oriented approach to the water sector," Annals of Operations Research, Springer, vol. 181(1), pages 377-392, December.
    13. Cinzia Daraio & Léopold Simar, 2007. "Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach," Journal of Productivity Analysis, Springer, vol. 28(1), pages 13-32, October.
    14. Akhmouch, Aziza & Correia, Francisco Nunes, 2016. "The 12 OECD principles on water governance – When science meets policy," Utilities Policy, Elsevier, vol. 43(PA), pages 14-20.
    15. Vilanova, Mateus Ricardo Nogueira & Magalhães Filho, Paulo & Balestieri, José Antônio Perrella, 2015. "Performance measurement and indicators for water supply management: Review and international cases," Renewable and Sustainable Energy Reviews, Elsevier, vol. 43(C), pages 1-12.
    16. Thompson, Russell G. & Langemeier, Larry N. & Lee, Chih-Tah & Lee, Euntaik & Thrall, Robert M., 1990. "The role of multiplier bounds in efficiency analysis with application to Kansas farming," Journal of Econometrics, Elsevier, vol. 46(1-2), pages 93-108.
    17. Berg, Sanford V., 2016. "Seven elements affecting governance and performance in the water sector," Utilities Policy, Elsevier, vol. 43(PA), pages 4-13.
    18. A. Zanella & A. Camanho & T. Dias, 2015. "The assessment of cities’ livability integrating human wellbeing and environmental impact," Annals of Operations Research, Springer, vol. 226(1), pages 695-726, March.
    19. R. Cunha Marques & Kristof De Witte, 2010. "Towards a benchmarking paradigm in European water utilities," Public Money & Management, Taylor & Francis Journals, vol. 30(1), pages 42-48, January.
    20. Abbott, Malcolm & Cohen, Bruce, 2009. "Productivity and efficiency in the water industry," Utilities Policy, Elsevier, vol. 17(3-4), pages 233-244, September.
    21. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    22. Guerrini, Andrea & Romano, Giulia & Mancuso, Fabrizio & Carosi, Laura, 2016. "Identifying the performance drivers of wastewater treatment plants through conditional order-m efficiency analysis," Utilities Policy, Elsevier, vol. 42(C), pages 20-31.
    23. Romano, Giulia & Molinos-Senante, María & Guerrini, Andrea, 2017. "Water utility efficiency assessment in Italy by accounting for service quality: An empirical investigation," Utilities Policy, Elsevier, vol. 45(C), pages 97-108.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pereira, Miguel Alves & Camanho, Ana Santos & Figueira, José Rui & Marques, Rui Cunha, 2021. "Incorporating preference information in a range directional composite indicator: The case of Portuguese public hospitals," European Journal of Operational Research, Elsevier, vol. 294(2), pages 633-650.
    2. Mosnier, Claire & Boukhriss, Sanae & Minviel, Jean-Joseph, 2023. "Does pig production improves cattle farm sustainability in the French massif central? A hierarchical constrained directional benefit-of-the-doubt approach," Agricultural Systems, Elsevier, vol. 210(C).
    3. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "The measurement of asset management performance of water companies," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    4. Martina Novotná & Ivana Faltová Leitmanová & Jiří Alina & Tomáš Volek, 2020. "Capital Intensity and Labour Productivity in Waste Companies," Sustainability, MDPI, vol. 12(24), pages 1-15, December.
    5. Tourinho, Marco & Barbosa, Flávia & Santos, Paulo Rosa & Pinto, Francisco Taveira & Camanho, Ana S., 2023. "Productivity change in Brazilian water services: A benchmarking study of national and regional trends," Socio-Economic Planning Sciences, Elsevier, vol. 86(C).
    6. Pereira, Miguel Alves & Marques, Rui Cunha, 2022. "Is sunshine regulation the new prescription to brighten up public hospitals in Portugal?," Socio-Economic Planning Sciences, Elsevier, vol. 84(C).
    7. Mergoni, Anna & D'Inverno, Giovanna & Carosi, Laura, 2022. "A composite indicator for measuring the environmental performance of water, wastewater, and solid waste utilities," Utilities Policy, Elsevier, vol. 74(C).
    8. Vilarinho, Hermilio & Pereira, Miguel Alves & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2024. "Water Utility Service Quality Index: A customer-centred approach for assessing the quality of service in the water sector," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).
    9. Pereira, Miguel Alves & Vilarinho, Hermilio & D’Inverno, Giovanna & Camanho, Ana S., 2023. "A regulatory robust conditional approach to measuring the efficiency of wholesale water supply and wastewater treatment services," Utilities Policy, Elsevier, vol. 83(C).
    10. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "Performance analytics for regulation in retail water utilities: Guiding asset management by identifying peers and targets," Utilities Policy, Elsevier, vol. 82(C).
    11. Amaral, António L. & Martins, Rita & Dias, Luís C., 2023. "Operational drivers of water reuse efficiency in Portuguese wastewater service providers," Utilities Policy, Elsevier, vol. 83(C).
    12. Fang, Wei & Liu, Zhen & Surya Putra, Ahmad Romadhoni, 2022. "Role of research and development in green economic growth through renewable energy development: Empirical evidence from South Asia," Renewable Energy, Elsevier, vol. 194(C), pages 1142-1152.
    13. Afsharian, Mohsen & Ahn, Heinz & Harms, Sören Guntram, 2021. "A review of DEA approaches applying a common set of weights: The perspective of centralized management," European Journal of Operational Research, Elsevier, vol. 294(1), pages 3-15.
    14. Tourinho, Marco & Santos, Paulo Rosa & Pinto, Francisco Taveira & Camanho, Ana S., 2022. "Performance assessment of water services in Brazilian municipalities: An integrated view of efficiency and access," Socio-Economic Planning Sciences, Elsevier, vol. 79(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alda A. Henriques & Milton Fontes & Ana S. Camanho & Giovanna D’Inverno & Pedro Amorim & Jaime Gabriel Silva, 2022. "Performance evaluation of problematic samples: a robust nonparametric approach for wastewater treatment plants," Annals of Operations Research, Springer, vol. 315(1), pages 193-220, August.
    2. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "The measurement of asset management performance of water companies," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    3. Pereira, Miguel Alves & Vilarinho, Hermilio & D’Inverno, Giovanna & Camanho, Ana S., 2023. "A regulatory robust conditional approach to measuring the efficiency of wholesale water supply and wastewater treatment services," Utilities Policy, Elsevier, vol. 83(C).
    4. D’Inverno, Giovanna & Carosi, Laura & Romano, Giulia, 2021. "Environmental sustainability and service quality beyond economic and financial indicators: A performance evaluation of Italian water utilities," Socio-Economic Planning Sciences, Elsevier, vol. 75(C).
    5. Cinzia Daraio & Léopold Simar & Paul W. Wilson, 2020. "Fast and efficient computation of directional distance estimators," Annals of Operations Research, Springer, vol. 288(2), pages 805-835, May.
    6. Amir Moradi-Motlagh & Ali Emrouznejad, 2022. "The origins and development of statistical approaches in non-parametric frontier models: a survey of the first two decades of scholarly literature (1998–2020)," Annals of Operations Research, Springer, vol. 318(1), pages 713-741, November.
    7. Ramon Sala-Garrido & Manuel Mocholí-Arce & María Molinos-Senante, 2021. "Assessing the Quality of Service of Water Companies: a ‘Benefit of the Doubt’ Composite Indicator," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 155(1), pages 371-387, May.
    8. Tourinho, Marco & Santos, Paulo Rosa & Pinto, Francisco Taveira & Camanho, Ana S., 2022. "Performance assessment of water services in Brazilian municipalities: An integrated view of efficiency and access," Socio-Economic Planning Sciences, Elsevier, vol. 79(C).
    9. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "Performance analytics for regulation in retail water utilities: Guiding asset management by identifying peers and targets," Utilities Policy, Elsevier, vol. 82(C).
    10. Amparo Soler Domínguez & Juan Carlos Matallín Sáez & Emili Tortosa Ausina, 2011. "On the informativeness of persistence for mutual funds' performance evaluation using partial frontiers," Working Papers. Serie EC 2011-08, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    11. Nolwenn Roudaut & Anne Vanhems, 2012. "Explaining firms efficiency in the Ivorian manufacturing sector: a robust nonparametric approach," Journal of Productivity Analysis, Springer, vol. 37(2), pages 155-169, April.
    12. Bădin, Luiza & Daraio, Cinzia & Simar, Léopold, 2019. "A bootstrap approach for bandwidth selection in estimating conditional efficiency measures," European Journal of Operational Research, Elsevier, vol. 277(2), pages 784-797.
    13. Marc Aliana & Diego Prior & Emili Tortosa-Ausina, 2024. "Assessing the impact of environmental factors on emergency healthcare quality: Implications for budget allocation," Working Papers 2024/04, Economics Department, Universitat Jaume I, Castellón (Spain).
    14. Léopold Simar & Paul W. Wilson, 2015. "Statistical Approaches for Non-parametric Frontier Models: A Guided Tour," International Statistical Review, International Statistical Institute, vol. 83(1), pages 77-110, April.
    15. D’Inverno, Giovanna & De Witte, Kristof, 2020. "Service level provision in municipalities: A flexible directional distance composite indicator," European Journal of Operational Research, Elsevier, vol. 286(3), pages 1129-1141.
    16. Mergoni, Anna & D'Inverno, Giovanna & Carosi, Laura, 2022. "A composite indicator for measuring the environmental performance of water, wastewater, and solid waste utilities," Utilities Policy, Elsevier, vol. 74(C).
    17. Carlucci, Fabio & Corcione, Carlo & Mazzocchi, Paolo & Trincone, Barbara, 2021. "The role of logistics in promoting Italian agribusiness: The Belt and Road Initiative case study," Land Use Policy, Elsevier, vol. 108(C).
    18. Saastamoinen, Antti & Bjørndal, Endre & Bjørndal, Mette, 2017. "Specification of merger gains in the Norwegian electricity distribution industry," Energy Policy, Elsevier, vol. 102(C), pages 96-107.
    19. Ferreira, D.C. & Marques, R.C. & Nunes, A.M., 2018. "Economies of scope in the health sector: The case of Portuguese hospitals," European Journal of Operational Research, Elsevier, vol. 266(2), pages 716-735.
    20. de la Higuera-Molina, Emilio José & Campos-Alba, Cristina María & López-Pérez, Germán & Zafra-Gómez, José Luis, 2023. "Efficiency of water service management alternatives in Spain considering environmental factors," Utilities Policy, Elsevier, vol. 84(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:juipol:v:66:y:2020:i:c:s0957178720300771. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.sciencedirect.com/journal/utilities-policy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.