IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v12y2020i20p8568-d429230.html
   My bibliography  Save this article

How Can I Help You? Questioning the Role of Evaluation Techniques in Democratic Decision-Making Processes

Author

Listed:
  • Isabella M. Lami

    (Department of Regional and Urban Studies and Planning (DIST), Politecnico di Torino, Viale Mattioli 39, 10122 Turin, Italy)

  • Stefano Moroni

    (Department of Architecture and Urban Studies, Polytechnic University of Milan, via Bonardi 3, 20133 Milan, Italy)

Abstract

In the past, evaluation techniques were considered to be “decisional techniques”, “decisional tools”. There was a rough idea that, after the important data had been collected, the technique in question would, by itself, indicate the best decision. Evaluations of this kind clearly depended on the more or less implicit adoption of a “rational-comprehensive model”, which tended to downplay the ethical and political dimension of decisions, while stressing the role of both technique and technicians. This approach has been widely criticized. Partly as a result of such criticism, many evaluation techniques are now considered to be not “decisional tools” but forms of “decision aid”. The problem is that the expression “decision aid ” lacks clarity and is by no means unequivocal in urban decisional situations. We believe in this regard that there is a gap in research and in the academic literature. Starting from this conviction, the article presents an investigation of what being a “decision aid” might mean for a technical evaluation today. The aim is to provide a conceptual framework within which to critically revisit and rediscuss the question, with particular regard to urban sustainability issues.

Suggested Citation

  • Isabella M. Lami & Stefano Moroni, 2020. "How Can I Help You? Questioning the Role of Evaluation Techniques in Democratic Decision-Making Processes," Sustainability, MDPI, vol. 12(20), pages 1-17, October.
    • Handle: RePEc:gam:jsusta:v:12:y:2020:i:20:p:8568-:d:429230
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/12/20/8568/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/12/20/8568/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. repec:lib:000cis:v:5:y:2017:i:2:p:11-22 is not listed on IDEAS
    2. Elena Tavella & Isabella Lami, 2019. "Negotiating perspectives and values through soft OR in the context of urban renewal," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 70(1), pages 136-161, January.
    3. Wendy Proctor & Martin Drechsler, 2006. "Deliberative Multicriteria Evaluation," Environment and Planning C, , vol. 24(2), pages 169-190, April.
    4. JosÉ Figueira & Salvatore Greco & Matthias Ehrogott, 2005. "Multiple Criteria Decision Analysis: State of the Art Surveys," International Series in Operations Research and Management Science, Springer, number 978-0-387-23081-8, March.
    5. Valerie Belton & Theodor Stewart, 2010. "Problem Structuring and Multiple Criteria Decision Analysis," International Series in Operations Research & Management Science, in: Matthias Ehrgott & José Rui Figueira & Salvatore Greco (ed.), Trends in Multiple Criteria Decision Analysis, chapter 0, pages 209-239, Springer.
    6. Edoardo Fregonese & Isabella M. Lami & Elena Todella, 2020. "Aesthetic Perspectives in Group Decision and Negotiation Practice," Group Decision and Negotiation, Springer, vol. 29(6), pages 993-1019, December.
    7. Saaty, Thomas L. & Shang, Jennifer S., 2011. "An innovative orders-of-magnitude approach to AHP-based mutli-criteria decision making: Prioritizing divergent intangible humane acts," European Journal of Operational Research, Elsevier, vol. 214(3), pages 703-715, November.
    8. Iva Mrak, 2013. "A Methodological Framework Based on the Dynamic-Evolutionary View of Heritage," Sustainability, MDPI, vol. 5(9), pages 1-32, September.
    9. Millet, Ido & Saaty, Thomas L., 2000. "On the relativity of relative measures - accommodating both rank preservation and rank reversals in the AHP," European Journal of Operational Research, Elsevier, vol. 121(1), pages 205-212, February.
    10. Van Dooren, Wouter & Noordegraaf, Mirko, 2020. "Staging Science: Authoritativeness and Fragility of Models and Measurement in the COVID-19 Crisis," SocArXiv nfm5j, Center for Open Science.
    11. Lami, Isabella M. & Tavella, Elena, 2019. "On the usefulness of soft OR models in decision making: A comparison of Problem Structuring Methods supported and self-organized workshops," European Journal of Operational Research, Elsevier, vol. 275(3), pages 1020-1036.
    12. Lucia Della Spina, 2020. "Adaptive Sustainable Reuse for Cultural Heritage: A Multiple Criteria Decision Aiding Approach Supporting Urban Development Processes," Sustainability, MDPI, vol. 12(4), pages 1-20, February.
    13. Steve Rayner, 2003. "Democracy in the age of assessment: Reflections on the roles of expertise and democracy in public-sector decision making," Science and Public Policy, Oxford University Press, vol. 30(3), pages 163-170, June.
    14. Elena Todella & Isabella Maria Lami & Alessandro Armando, 2018. "Experimental Use of Strategic Choice Approach (SCA) by Individuals as an Architectural Design Tool," Group Decision and Negotiation, Springer, vol. 27(5), pages 811-826, October.
    15. John Sutton, 1986. "Non-Cooperative Bargaining Theory: An Introduction," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(5), pages 709-724.
    16. Susan Owens & Tim Rayner & Olivia Bina, 2004. "New Agendas for Appraisal: Reflections on Theory, Practice, and Research," Environment and Planning A, , vol. 36(11), pages 1943-1959, November.
    17. Barthelemy, J. P. & Bisdorff, R. & Coppin, G., 2002. "Human centered processes and decision support systems," European Journal of Operational Research, Elsevier, vol. 136(2), pages 233-252, January.
    18. Saaty, Thomas L., 1990. "How to make a decision: The analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 48(1), pages 9-26, September.
    19. Mingers, John & Rosenhead, Jonathan, 2004. "Problem structuring methods in action," European Journal of Operational Research, Elsevier, vol. 152(3), pages 530-554, February.
    20. Katarzyna Nosal Hoy & Katarzyna Solecka & Andrzej Szarata, 2019. "The Application of the Multiple Criteria Decision Aid to Assess Transport Policy Measures Focusing on Innovation," Sustainability, MDPI, vol. 11(5), pages 1-23, March.
    21. Spilsbury, M.J. & Norgbey, S. & Battaglino, C., 2014. "Priority setting for evaluation: Developing a strategic evaluation portfolio," Evaluation and Program Planning, Elsevier, vol. 46(C), pages 47-57.
    22. John M Bryson, 2004. "What to do when Stakeholders matter," Public Management Review, Taylor & Francis Journals, vol. 6(1), pages 21-53, March.
    23. Kim, Deok-Hwan & Kim, Kwang-Jae & Sam Park, K., 2010. "Compromising prioritization from pairwise comparisons considering type I and II errors," European Journal of Operational Research, Elsevier, vol. 204(2), pages 285-293, July.
    24. Barfod, Michael Bruhn, 2012. "An MCDA approach for the selection of bike projects based on structuring and appraising activities," European Journal of Operational Research, Elsevier, vol. 218(3), pages 810-818.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lami, Isabella M. & Todella, Elena, 2023. "A multi-methodological combination of the strategic choice approach and the analytic network process: From facts to values and vice versa," European Journal of Operational Research, Elsevier, vol. 307(2), pages 802-812.
    2. Massoomeh Hedayati Marzbali & Aldrin Abdullah & Mohammad Javad Maghsoodi Tilaki & Mina Safizadeh, 2021. "Moving the 2030 Agenda Ahead: Exploring the Role of Multiple Mediators toward Perceived Environment and Social Sustainability in Residential Neighbourhoods," Land, MDPI, vol. 10(10), pages 1-18, October.
    3. Isabella M. Lami & Beatrice Mecca, 2020. "Assessing Social Sustainability for Achieving Sustainable Architecture," Sustainability, MDPI, vol. 13(1), pages 1-21, December.
    4. Federica Rotondo & Francesca Abastante & Giancarlo Cotella & Isabella Maria Lami, 2020. "Questioning Low-Carbon Transition Governance: A Comparative Analysis of European Case Studies," Sustainability, MDPI, vol. 12(24), pages 1-17, December.
    5. Sawassi, Aymen & Ottomano Palmisano, Giovanni & Crookston, Brian & Khadra, Roula, 2022. "The Dominance-based Rough Set Approach for analysing patterns of flexibility allocation and design-cost criteria in large-scale irrigation systems," Agricultural Water Management, Elsevier, vol. 272(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lami, Isabella M. & Todella, Elena, 2023. "A multi-methodological combination of the strategic choice approach and the analytic network process: From facts to values and vice versa," European Journal of Operational Research, Elsevier, vol. 307(2), pages 802-812.
    2. Alexandre de A. Gomes Júnior & Vanessa B. Schramm, 2022. "Problem Structuring Methods: A Review of Advances Over the Last Decade," Systemic Practice and Action Research, Springer, vol. 35(1), pages 55-88, February.
    3. Edoardo Fregonese & Isabella M. Lami & Elena Todella, 2020. "Aesthetic Perspectives in Group Decision and Negotiation Practice," Group Decision and Negotiation, Springer, vol. 29(6), pages 993-1019, December.
    4. Marleau Donais, Francis & Abi-Zeid, Irène & Waygood, E. Owen D. & Lavoie, Roxane, 2019. "Assessing and ranking the potential of a street to be redesigned as a Complete Street: A multi-criteria decision aiding approach," Transportation Research Part A: Policy and Practice, Elsevier, vol. 124(C), pages 1-19.
    5. Kik, M.C. & Claassen, G.D.H. & Meuwissen, M.P.M. & Smit, A.B. & Saatkamp, H.W., 2021. "Actor analysis for sustainable soil management – A case study from the Netherlands," Land Use Policy, Elsevier, vol. 107(C).
    6. Tsoukias, Alexis, 2008. "From decision theory to decision aiding methodology," European Journal of Operational Research, Elsevier, vol. 187(1), pages 138-161, May.
    7. Maria Franca Norese & Diana Rolando & Rocco Curto, 2023. "DIKEDOC: a multicriteria methodology to organise and communicate knowledge," Annals of Operations Research, Springer, vol. 325(2), pages 1049-1082, June.
    8. Sward, Jeffrey A. & Nilson, Roberta S. & Katkar, Venktesh V. & Stedman, Richard C. & Kay, David L. & Ifft, Jennifer E. & Zhang, K. Max, 2021. "Integrating social considerations in multicriteria decision analysis for utility-scale solar photovoltaic siting," Applied Energy, Elsevier, vol. 288(C).
    9. Ioannis Sitaridis & Fotis Kitsios, 2020. "Competitiveness analysis and evaluation of entrepreneurial ecosystems: a multi-criteria approach," Annals of Operations Research, Springer, vol. 294(1), pages 377-399, November.
    10. Carayannis, Elias G. & Goletsis, Yorgos & Grigoroudis, Evangelos, 2018. "Composite innovation metrics: MCDA and the Quadruple Innovation Helix framework," Technological Forecasting and Social Change, Elsevier, vol. 131(C), pages 4-17.
    11. Vieira, Fabiana C. & Ferreira, Fernando A.F. & Govindan, Kannan & Ferreira, Neuza C.M.Q.F. & Banaitis, Audrius, 2022. "Measuring urban digitalization using cognitive mapping and the best worst method (BWM)," Technology in Society, Elsevier, vol. 71(C).
    12. Yael Grushka-Cockayne & Bert De Reyck & Zeger Degraeve, 2008. "An Integrated Decision-Making Approach for Improving European Air Traffic Management," Management Science, INFORMS, vol. 54(8), pages 1395-1409, August.
    13. AlSabbagh, Maha & Siu, Yim Ling & Guehnemann, Astrid & Barrett, John, 2017. "Integrated approach to the assessment of CO2e-mitigation measures for the road passenger transport sector in Bahrain," Renewable and Sustainable Energy Reviews, Elsevier, vol. 71(C), pages 203-215.
    14. Mingers, John, 2011. "Soft OR comes of age--but not everywhere!," Omega, Elsevier, vol. 39(6), pages 729-741, December.
    15. Hermano Bernardo & Adélio Gaspar & Carlos Henggeler Antunes, 2018. "A Combined Value Focused Thinking-Soft Systems Methodology Approach to Structure Decision Support for Energy Performance Assessment of School Buildings," Sustainability, MDPI, vol. 10(7), pages 1-19, July.
    16. Dyckhoff, Harald & Souren, Rainer, 2022. "Integrating multiple criteria decision analysis and production theory for performance evaluation: Framework and review," European Journal of Operational Research, Elsevier, vol. 297(3), pages 795-816.
    17. Antonio Nesticò & Piera Somma, 2019. "Comparative Analysis of Multi-Criteria Methods for the Enhancement of Historical Buildings," Sustainability, MDPI, vol. 11(17), pages 1-19, August.
    18. Alicja Lenarczyk & Marcin Jaskólski & Paweł Bućko, 2022. "The Application of a Multi-Criteria Decision-Making for Indication of Directions of the Development of Renewable Energy Sources in the Context of Energy Policy," Energies, MDPI, vol. 15(24), pages 1-21, December.
    19. Stefano Capolongo & Leopoldo Sdino & Marta Dell’Ovo & Rossella Moioli & Stefano Della Torre, 2019. "How to Assess Urban Regeneration Proposals by Considering Conflicting Values," Sustainability, MDPI, vol. 11(14), pages 1-15, July.
    20. Etxano, Iker & Villalba-Eguiluz, Unai, 2021. "Twenty-five years of social multi-criteria evaluation (SMCE) in the search for sustainability: Analysis of case studies," Ecological Economics, Elsevier, vol. 188(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:12:y:2020:i:20:p:8568-:d:429230. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.