IDEAS home Printed from https://ideas.repec.org/a/eee/ecolec/v136y2017icp77-85.html
   My bibliography  Save this article

The Choice of the Sustainability Assessment Tool Matters: Differences in Thematic Scope and Assessment Results

Author

Listed:
  • de Olde, Evelien M.
  • Bokkers, Eddie A.M.
  • de Boer, Imke J.M.

Abstract

While the number of farm-level sustainability assessment tools is growing rapidly, concerns are raised on whether the assessment results of different tools present similar and valid conclusions about the sustainability performance of farms. In this paper we analysed the thematic scope of sustainability assessment tools, and compared assessment results from sustainability assessment tools. A coverage analysis of four tools (RISE, SAFA, PG and IDEA) demonstrated the diversity in approaches to assess sustainability at farm level. Tool developers select different (sub)themes and indicators, and apply different methods for measurement and aggregation of scores. This variability in approaches results not only in different tools, but can also result in different conclusions on the sustainability performance of farms. Decisions made in the development of a sustainability assessment tool need to be transparent to understand and explain the results of a tool and support farmers in a sustainable development of their farm. To improve the transparency in sustainability assessment tools we presented a framework describing decisions made in the development of a tool. An increased transparency in sustainability assessment tools can reduce the risk on distorted assessment results and actions, and contribute to the trust and relevance of future sustainability assessments.

Suggested Citation

  • de Olde, Evelien M. & Bokkers, Eddie A.M. & de Boer, Imke J.M., 2017. "The Choice of the Sustainability Assessment Tool Matters: Differences in Thematic Scope and Assessment Results," Ecological Economics, Elsevier, vol. 136(C), pages 77-85.
    • Handle: RePEc:eee:ecolec:v:136:y:2017:i:c:p:77-85
    DOI: 10.1016/j.ecolecon.2017.02.015
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S092180091630249X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ecolecon.2017.02.015?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bockstaller, C. & Girardin, P., 2003. "How to validate environmental indicators," Agricultural Systems, Elsevier, vol. 76(2), pages 639-653, May.
    2. Munda, Giuseppe, 1996. "Cost-benefit analysis in integrated environmental assessment: some methodological issues," Ecological Economics, Elsevier, vol. 19(2), pages 157-168, November.
    3. van Calker, K.J. & Berentsen, P.B.M. & Romero, C. & Giesen, G.W.J. & Huirne, R.B.M., 2006. "Development and application of a multi-attribute sustainability function for Dutch dairy farming systems," Ecological Economics, Elsevier, vol. 57(4), pages 640-658, June.
    4. Evelien M. De Olde & Frank W. Oudshoorn & Eddie A. M. Bokkers & Anke Stubsgaard & Claus A. G. Sørensen & Imke J. M. De Boer, 2016. "Assessing the Sustainability Performance of Organic Farms in Denmark," Sustainability, MDPI, vol. 8(9), pages 1-20, September.
    5. Sala, Serenella & Ciuffo, Biagio & Nijkamp, Peter, 2015. "A systemic framework for sustainability assessment," Ecological Economics, Elsevier, vol. 119(C), pages 314-325.
    6. Martinez-Alier, Joan & Munda, Giuseppe & O'Neill, John, 1998. "Weak comparability of values as a foundation for ecological economics," Ecological Economics, Elsevier, vol. 26(3), pages 277-286, September.
    7. Hani, Fritz & Braga, Francesco S. & Stampfli, Andreas & Keller, Thomas & Fischer, Matthew & Porsche, Hans, 2003. "RISE, a Tool for Holistic Sustainability Assessment at the Farm Level," International Food and Agribusiness Management Review, International Food and Agribusiness Management Association, vol. 6(4), pages 1-13.
    8. Reed, Mark S. & Fraser, Evan D.G. & Dougill, Andrew J., 2006. "An adaptive learning process for developing and applying sustainability indicators with local communities," Ecological Economics, Elsevier, vol. 59(4), pages 406-418, October.
    9. Hansen, J. W., 1996. "Is agricultural sustainability a useful concept?," Agricultural Systems, Elsevier, vol. 50(2), pages 117-143.
    10. Paul Thompson, 1992. "The varieties of sustainability," Agriculture and Human Values, Springer;The Agriculture, Food, & Human Values Society (AFHVS), vol. 9(3), pages 11-19, June.
    11. Frédéric Zahm & Philippe Viaux & Lionel Vilain & Philippe Girardin & Christian Mouchet, 2008. "Assessing farm sustainability with the IDEA method - from the concept of agriculture sustainability to case studies on farms," Sustainable Development, John Wiley & Sons, Ltd., vol. 16(4), pages 271-281.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Francisco J. López‐Arceiz & Cristina Del Río & Ana J. Bellostas, 2020. "Sustainability performance indicators: Definition, interaction, and influence of contextual characteristics," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 27(6), pages 2615-2630, November.
    2. Kira J. Cooper & Robert B. Gibson, 2022. "A Novel Framework for Inner-Outer Sustainability Assessment," Challenges, MDPI, vol. 13(2), pages 1-27, December.
    3. Lhermie, Guillaume & Wernli, Didier & Jørgensen, Peter Søgaard & Kenkel, Donald & Lin Lawell, C.-Y. Cynthia & Tauer, Loren William & Gröhn, Yrjo Tapio, 2019. "Tradeoffs between resistance to antimicrobials in public health and their use in agriculture: Moving towards sustainability assessment," Ecological Economics, Elsevier, vol. 166(C), pages 1-1.
    4. Irene Tzouramani & Stamatis Mantziaris & Pavlos Karanikolas, 2020. "Assessing Sustainability Performance at the Farm Level: Examples from Greek Agricultural Systems," Sustainability, MDPI, vol. 12(7), pages 1-22, April.
    5. Antonia Katharina Ruckli & Stefan Josef Hörtenhuber & Paolo Ferrari & Jonathan Guy & Juliane Helmerichs & Robert Hoste & Carmen Hubbard & Nadja Kasperczyk & Christine Leeb & Agata Malak-Rawlikowska & , 2022. "Integrative Sustainability Analysis of European Pig Farms: Development of a Multi-Criteria Assessment Tool," Sustainability, MDPI, vol. 14(10), pages 1-26, May.
    6. Bonisoli, Lorenzo & Piedra-Muñoz, Laura & Galdeano-Gómez, Emilio & Pérez Mesa, Juan Carlos, 2019. "Benchmarking agri-food sustainability certifications: evidences from applying SAFA in the Ecuadorian banana agri-system," MPRA Paper 119956, University Library of Munich, Germany.
    7. Stan Selbonne & Loïc Guindé & François Causeret & Pierre Chopin & Jorge Sierra & Régis Tournebize & Jean-Marc Blazy, 2023. "How to Measure the Performance of Farms with Regard to Climate-Smart Agriculture Goals? A Set of Indicators and Its Application in Guadeloupe," Agriculture, MDPI, vol. 13(2), pages 1-21, January.
    8. Florian Findler, 2021. "Toward a sustainability assessment framework of research impacts: Contributions of a business school," Sustainable Development, John Wiley & Sons, Ltd., vol. 29(6), pages 1190-1203, November.
    9. Mehrbakhsh Nilashi & Shahla Asadi & Rabab Ali Abumalloh & Sarminah Samad & Fahad Ghabban & Eko Supriyanto & Reem Osman, 2021. "Sustainability Performance Assessment Using Self-Organizing Maps (SOM) and Classification and Ensembles of Regression Trees (CART)," Sustainability, MDPI, vol. 13(7), pages 1-24, March.
    10. Ana Lúcia Hanisch & Raquel R. B. Negrelle & Rafael Araújo Bonatto & Evelyn Roberta Nimmo & André Eduardo Biscaia Lacerda, 2019. "Evaluating Sustainability in Traditional Silvopastoral Systems (caívas): Looking Beyond the Impact of Animals on Biodiversity," Sustainability, MDPI, vol. 11(11), pages 1-16, June.
    11. Veronika Hannus & Johannes Sauer, 2021. "Understanding Farmers’ Intention to Use a Sustainability Standard: The Role of Economic Rewards, Knowledge, and Ease of Use," Sustainability, MDPI, vol. 13(19), pages 1-21, September.
    12. Ambrogio Zanzi & Valentina Vaglia & Roberto Spigarolo & Stefano Bocchi, 2021. "Assessing Agri-Food Start-Ups Sustainability in Peri-Urban Agriculture Context," Land, MDPI, vol. 10(4), pages 1-20, April.
    13. Naoum Tsolakis & Foivos Anastasiadis & Jagjit Singh Srai, 2018. "Sustainability Performance in Food Supply Networks: Insights from the UK Industry," Sustainability, MDPI, vol. 10(9), pages 1-13, September.
    14. de Olde, Evelien M. & Valentinov, Vladislav, 2019. "The moral complexity of agriculture: A challenge for corporate social responsibility," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 32(3), pages 413-430.
    15. Joseph MacPherson & Carsten Paul & Katharina Helming, 2020. "Linking Ecosystem Services and the SDGs to Farm-Level Assessment Tools and Models," Sustainability, MDPI, vol. 12(16), pages 1-19, August.
    16. Evangelos Alexandropoulos & Vasileios Anestis & Federico Dragoni & Anja Hansen & Saoirse Cummins & Donal O’Brien & Barbara Amon & Thomas Bartzanas, 2023. "Decision Support Systems Based on Gaseous Emissions and Their Impact on the Sustainability Assessment at the Livestock Farm Level: An Evaluation from the User’s Side," Sustainability, MDPI, vol. 15(17), pages 1-29, August.
    17. Karlsson, Johan O. & Robling, Helena & Cederberg, Christel & Spörndly, Rolf & Lindberg, Mikaela & Martiin, Carin & Ardfors, Elsa & Tidåker, Pernilla, 2023. "What can we learn from the past? Tracking sustainability indicators for the Swedish dairy sector over 30 years," Agricultural Systems, Elsevier, vol. 212(C).
    18. Kouchner, Coline & Ferrus, Cécile & Blanchard, Samuel & Decourtye, Axel & Basso, Benjamin & Le Conte, Yves & Tchamitchian, Marc, 2019. "Bee farming system sustainability: An assessment framework in metropolitan France," Agricultural Systems, Elsevier, vol. 176(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ranjan Roy & Ngai Weng Chan, 2012. "An assessment of agricultural sustainability indicators in Bangladesh: review and synthesis," Environment Systems and Decisions, Springer, vol. 32(1), pages 99-110, March.
    2. Paula Trivino-Tarradas & Manuel R. Gomez-Ariza & Gottlieb Basch & Emilio J. Gonzalez-Sanchez, 2019. "Sustainability Assessment of Annual and Permanent Crops: The Inspia Model," Sustainability, MDPI, vol. 11(3), pages 1-21, January.
    3. Lairez, Juliette & Lopez-Ridaura, Santiago & Jourdain, Damien & Falconnier, Gatien N. & Lienhard, Pascal & Striffler, Bruno & Syfongxay, Chanthaly & Affholder, François, 2020. "Context matters: Agronomic field monitoring and participatory research to identify criteria of farming system sustainability in South-East Asia," Agricultural Systems, Elsevier, vol. 182(C).
    4. Shamsheer Haq & Ismet Boz, 2020. "Measuring environmental, economic, and social sustainability index of tea farms in Rize Province, Turkey," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 22(3), pages 2545-2567, March.
    5. Ionuț-Alexandru Spânu & Alexandru Ozunu & Dacinia Crina Petrescu & Ruxandra Malina Petrescu-Mag, 2022. "A Comparative View of Agri-Environmental Indicators and Stakeholders’ Assessment of Their Quality," Agriculture, MDPI, vol. 12(4), pages 1-23, March.
    6. Paolo Cupo & Rinalda Alberta Di Cerbo, 2016. "The determinants of ranking in sustainable efficiency of Italian farms," RIVISTA DI STUDI SULLA SOSTENIBILITA', FrancoAngeli Editore, vol. 2016(2), pages 141-159.
    7. Paula Triviño-Tarradas & Pilar Carranza-Cañadas & Francisco-Javier Mesas-Carrascosa & Emilio J. Gonzalez-Sanchez, 2020. "Evaluation of Agricultural Sustainability on a Mixed Vineyard and Olive-Grove Farm in Southern Spain through the INSPIA Model," Sustainability, MDPI, vol. 12(3), pages 1-22, February.
    8. Abdallah Alaoui & Moritz Hallama & Roger Bär & Ioanna Panagea & Felicitas Bachmann & Carola Pekrun & Luuk Fleskens & Ellen Kandeler & Rudi Hessel, 2022. "A New Framework to Assess Sustainability of Soil Improving Cropping Systems in Europe," Land, MDPI, vol. 11(5), pages 1-15, May.
    9. van Calker, K.J. & Berentsen, P.B.M. & de Boer, I.J.M. & Giesen, G.W.J. & Huirne, R.B.M., 2007. "Modelling worker physical health and societal sustainability at farm level: An application to conventional and organic dairy farming," Agricultural Systems, Elsevier, vol. 94(2), pages 205-219, May.
    10. Ogawa, Keishi & Garrod, Guy & Yagi, Hironori, 2023. "Sustainability strategies and stakeholder management for upland farming," Land Use Policy, Elsevier, vol. 131(C).
    11. Garmendia, Eneko & Stagl, Sigrid, 2010. "Public participation for sustainability and social learning: Concepts and lessons from three case studies in Europe," Ecological Economics, Elsevier, vol. 69(8), pages 1712-1722, June.
    12. Thanh Ngo & Hai‐Dang Nguyen & Huong Ho & Vo‐Kien Nguyen & Thuy T. T. Dao & Hai T. H. Nguyen, 2021. "Assessing the important factors of sustainable agriculture development: An Indicateurs de Durabilité des Exploitations Agricoles‐Analytic Hierarchy Process study in the northern region of Vietnam," Sustainable Development, John Wiley & Sons, Ltd., vol. 29(2), pages 327-338, March.
    13. Olfa Gharsallah & Claudio Gandolfi & Arianna Facchi, 2021. "Methodologies for the Sustainability Assessment of Agricultural Production Systems, with a Focus on Rice: A Review," Sustainability, MDPI, vol. 13(19), pages 1-16, October.
    14. Frédéric Zahm & Philippe Viaux & Lionel Vilain & Philippe Girardin & Christian Mouchet, 2008. "Assessing farm sustainability with the IDEA method - from the concept of agriculture sustainability to case studies on farms," Sustainable Development, John Wiley & Sons, Ltd., vol. 16(4), pages 271-281.
    15. Norman Siebrecht, 2020. "Sustainable Agriculture and Its Implementation Gap—Overcoming Obstacles to Implementation," Sustainability, MDPI, vol. 12(9), pages 1-27, May.
    16. Charlotte Glennie, 2020. "Growing Together: Community Coalescence and the Social Dimensions of Urban Sustainability," Sustainability, MDPI, vol. 12(22), pages 1-25, November.
    17. Etxano, Iker & Villalba-Eguiluz, Unai, 2021. "Twenty-five years of social multi-criteria evaluation (SMCE) in the search for sustainability: Analysis of case studies," Ecological Economics, Elsevier, vol. 188(C).
    18. Matthew Cohen, 2017. "A Systematic Review of Urban Sustainability Assessment Literature," Sustainability, MDPI, vol. 9(11), pages 1-16, November.
    19. Madlener, Reinhard & Stagl, Sigrid, 2005. "Sustainability-guided promotion of renewable electricity generation," Ecological Economics, Elsevier, vol. 53(2), pages 147-167, April.
    20. Agata Malak-Rawlikowska & Monika Gębska & Robert Hoste & Christine Leeb & Claudio Montanari & Michael Wallace & Kees de Roest, 2021. "Developing a Methodology for Aggregated Assessment of the Economic Sustainability of Pig Farms," Energies, MDPI, vol. 14(6), pages 1-25, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecolec:v:136:y:2017:i:c:p:77-85. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ecolecon .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.