IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v267y2018i1p273-287.html
   My bibliography  Save this article

Stakeholder interviews with two MAVT preference elicitation philosophies in a Swiss water infrastructure decision: Aggregation using SWING-weighting and disaggregation using UTAGMS

Author

Listed:
  • Zheng, Jun
  • Lienert, Judit

Abstract

We used two types of preference elicitation methods based on multi-attribute value theory (MAVT) for a wastewater infrastructure decision in Switzerland. We aimed to register the implementation impacts of two preference elicitation philosophies (aggregation, disaggregation) in a large, real-world case and give guidance on these elicitation approaches for practitioners. We conducted two series of face-to-face interviews with the same ten. The first interview set used direct aggregation preference elicitation methods, which decomposed an additive value model into the elicitation of weights (SMART/SWING-variant) and marginal value functions (bi-section method). In the second interview series, indirect disaggregation was used, based on UTAGMS. The weights and marginal value functions for 19 objectives were later simultaneously inferred with linear programming from pairwise comparisons of hypothetical alternatives. One aim was to design the UTAGMS comparisons for many objectives. Further, we aimed to identify differences and commonalities of the two methods concerning the elicited preferences, the MAVT evaluation results of six real-world wastewater infrastructure alternatives, and the stakeholders’ and analysts’ feedbacks. Similar best alternatives indicate convergence of the two elicitation methods. This demonstrates the applicability of the UTAGMS elicitation procedure to a very complex decision problem. However, the two elicitation methods were perceived differently by the respondents and required different effort from the analysts. For individual stakeholders, preferences were sometimes rather different between the interviews, which could be largely explained by the constructive nature of preference formation. This indicates the importance of supporting stakeholder learning in the application of MCDA.

Suggested Citation

  • Zheng, Jun & Lienert, Judit, 2018. "Stakeholder interviews with two MAVT preference elicitation philosophies in a Swiss water infrastructure decision: Aggregation using SWING-weighting and disaggregation using UTAGMS," European Journal of Operational Research, Elsevier, vol. 267(1), pages 273-287.
  • Handle: RePEc:eee:ejores:v:267:y:2018:i:1:p:273-287
    DOI: 10.1016/j.ejor.2017.11.018
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221717310299
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2017.11.018?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bous, Géraldine & Fortemps, Philippe & Glineur, François & Pirlot, Marc, 2010. "ACUTA: A novel method for eliciting additive value functions on the basis of holistic preference statements," European Journal of Operational Research, Elsevier, vol. 206(2), pages 435-444, October.
    2. Jacquet-Lagreze, E. & Siskos, J., 1982. "Assessing a set of additive utility functions for multicriteria decision-making, the UTA method," European Journal of Operational Research, Elsevier, vol. 10(2), pages 151-164, June.
    3. Greco, Salvatore & Mousseau, Vincent & Słowiński, Roman, 2014. "Robust ordinal regression for value functions handling interacting criteria," European Journal of Operational Research, Elsevier, vol. 239(3), pages 711-730.
    4. Schaafsma, Marije & Brouwer, Roy & Liekens, Inge & De Nocker, Leo, 2014. "Temporal stability of preferences and willingness to pay for natural areas in choice experiments: A test–retest," Resource and Energy Economics, Elsevier, vol. 38(C), pages 243-260.
    5. Spyridakos, A. & Siskos, Y. & Yannacopoulos, D. & Skouris, A., 2001. "Multicriteria job evaluation for large organizations," European Journal of Operational Research, Elsevier, vol. 130(2), pages 375-387, April.
    6. Kadziński, Miłosz & Tervonen, Tommi, 2013. "Robust multi-criteria ranking with additive value models and holistic pair-wise preference statements," European Journal of Operational Research, Elsevier, vol. 228(1), pages 169-180.
    7. Hurson, Christian & Siskos, Yannis, 2014. "A synergy of multicriteria techniques to assess additive value models," European Journal of Operational Research, Elsevier, vol. 238(2), pages 540-551.
    8. Greco, Salvatore & Mousseau, Vincent & Slowinski, Roman, 2008. "Ordinal regression revisited: Multiple criteria ranking using a set of additive value functions," European Journal of Operational Research, Elsevier, vol. 191(2), pages 416-436, December.
    9. Payne, John W & Bettman, James R & Schkade, David A, 1999. "Measuring Constructed Preferences: Towards a Building Code," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 243-270, December.
    10. Ciomek, Krzysztof & Kadziński, Miłosz & Tervonen, Tommi, 2017. "Heuristics for selecting pair-wise elicitation questions in multiple criteria choice problems," European Journal of Operational Research, Elsevier, vol. 262(2), pages 693-707.
    11. Ulf Liebe & Jürgen Meyerhoff & Volkmar Hartje, 2012. "Test–Retest Reliability of Choice Experiments in Environmental Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 53(3), pages 389-407, November.
    12. Franco, L. Alberto & Hämäläinen, Raimo P., 2016. "Behavioural operational research: Returning to the roots of the OR profession," European Journal of Operational Research, Elsevier, vol. 249(3), pages 791-795.
    13. Beuthe, Michel & Scannella, Giuseppe, 2001. "Comparative analysis of UTA multicriteria methods," European Journal of Operational Research, Elsevier, vol. 130(2), pages 246-262, April.
    14. Doumpos, Michael & Zopounidis, Constantin, 2011. "Preference disaggregation and statistical learning for multicriteria decision support: A review," European Journal of Operational Research, Elsevier, vol. 209(3), pages 203-214, March.
    15. Deparis, Stéphane & Mousseau, Vincent & Öztürk, Meltem & Pallier, Christophe & Huron, Caroline, 2012. "When conflict induces the expression of incomplete preferences," European Journal of Operational Research, Elsevier, vol. 221(3), pages 593-602.
    16. Figueira, José Rui & Greco, Salvatore & Slowinski, Roman, 2009. "Building a set of additive value functions representing a reference preorder and intensities of preference: GRIP method," European Journal of Operational Research, Elsevier, vol. 195(2), pages 460-486, June.
    17. Ciomek, Krzysztof & Kadziński, Miłosz & Tervonen, Tommi, 2017. "Heuristics for prioritizing pair-wise elicitation questions with additive multi-attribute value models," Omega, Elsevier, vol. 71(C), pages 27-45.
    18. Richard M. Anderson & Robert Clemen, 2013. "Toward an Improved Methodology to Construct and Reconcile Decision Analytic Preference Judgments," Decision Analysis, INFORMS, vol. 10(2), pages 121-134, June.
    19. Scholten, Lisa & Schuwirth, Nele & Reichert, Peter & Lienert, Judit, 2015. "Tackling uncertainty in multi-criteria decision analysis – An application to water supply infrastructure planning," European Journal of Operational Research, Elsevier, vol. 242(1), pages 243-260.
    20. Paul Goodwin & George Wright, 2001. "Enhancing Strategy Evaluation in Scenario Planning: a Role for Decision Analysis," Journal of Management Studies, Wiley Blackwell, vol. 38(1), pages 1-16, January.
    21. Greco, Salvatore & Matarazzo, Benedetto & Slowinski, Roman, 2001. "Rough sets theory for multicriteria decision analysis," European Journal of Operational Research, Elsevier, vol. 129(1), pages 1-47, February.
    22. Katrin Borcherding & Thomas Eppel & Detlof von Winterfeldt, 1991. "Comparison of Weighting Judgments in Multiattribute Utility Measurement," Management Science, INFORMS, vol. 37(12), pages 1603-1619, December.
    23. Weber, Martin & Borcherding, Katrin, 1993. "Behavioral influences on weight judgments in multiattribute decision making," European Journal of Operational Research, Elsevier, vol. 67(1), pages 1-12, May.
    24. Hämäläinen, Raimo P. & Luoma, Jukka & Saarinen, Esa, 2013. "On the importance of behavioral operational research: The case of understanding and communicating about dynamic systems," European Journal of Operational Research, Elsevier, vol. 228(3), pages 623-634.
    25. Kurt A. Carlson & Samuel D. Bond, 2006. "Improving Preference Assessment: Limiting the Effect of Context Through Pre-exposure to Attribute Levels," Management Science, INFORMS, vol. 52(3), pages 410-421, March.
    26. Lienert, Judit & Duygan, Mert & Zheng, Jun, 2016. "Preference stability over time with multiple elicitation methods to support wastewater infrastructure decision-making," European Journal of Operational Research, Elsevier, vol. 253(3), pages 746-760.
    27. Bertrand Mareschal & Jean Pierre Brans & Philippe Vincke, 1986. "How to select and how to rank projects: the Prométhée method," ULB Institutional Repository 2013/9307, ULB -- Universite Libre de Bruxelles.
    28. Brans, J. P. & Vincke, Ph. & Mareschal, B., 1986. "How to select and how to rank projects: The method," European Journal of Operational Research, Elsevier, vol. 24(2), pages 228-238, February.
    29. Subimal Chatterjee & Timothy B. Heath, 1996. "Conflict and Loss Aversion in Multiattribute Choice: The Effects of Trade-Off Size and Reference Dependence on Decision Difficulty," Post-Print hal-00670460, HAL.
    30. Keeney, Ralph L., 1996. "Value-focused thinking: Identifying decision opportunities and creating alternatives," European Journal of Operational Research, Elsevier, vol. 92(3), pages 537-549, August.
    31. Carlos A. Bana e Costa & Jean-Marie De Corte & Jean-Claude Vansnick, 2016. "On the Mathematical Foundations of MACBETH," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 421-463, Springer.
    32. Schuwirth, N. & Reichert, P. & Lienert, J., 2012. "Methodological aspects of multi-criteria decision analysis for policy support: A case study on pharmaceutical removal from hospital wastewater," European Journal of Operational Research, Elsevier, vol. 220(2), pages 472-483.
    33. Belton, Valerie, 1986. "A comparison of the analytic hierarchy process and a simple multi-attribute value function," European Journal of Operational Research, Elsevier, vol. 26(1), pages 7-21, July.
    34. Vetschera, Rudolf & Weitzl, Wolfgang & Wolfsteiner, Elisabeth, 2014. "Implausible alternatives in eliciting multi-attribute value functions," European Journal of Operational Research, Elsevier, vol. 234(1), pages 221-230.
    35. Jacquet-Lagreze, Eric & Siskos, Yannis, 2001. "Preference disaggregation: 20 years of MCDA experience," European Journal of Operational Research, Elsevier, vol. 130(2), pages 233-245, April.
    36. Behzadian, Majid & Kazemzadeh, R.B. & Albadvi, A. & Aghdasi, M., 2010. "PROMETHEE: A comprehensive literature review on methodologies and applications," European Journal of Operational Research, Elsevier, vol. 200(1), pages 198-215, January.
    37. Chatterjee, Subimal & Heath, Timothy B., 1996. "Conflict and Loss Aversion in Multiattribute Choice: The Effects of Trade-Off Size and Reference Dependence on Decision Difficulty," Organizational Behavior and Human Decision Processes, Elsevier, vol. 67(2), pages 144-155, August.
    38. Diakoulaki, D. & Zopounidis, C. & Mavrotas, G. & Doumpos, M., 1999. "The use of a preference disaggregation method in energy analysis and policy making," Energy, Elsevier, vol. 24(2), pages 157-166.
    39. James E. Smith & Detlof von Winterfeldt, 2004. "Anniversary Article: Decision Analysis in Management Science," Management Science, INFORMS, vol. 50(5), pages 561-574, May.
    40. van Valkenhoef, Gert & Tervonen, Tommi, 2016. "Entropy-optimal weight constraint elicitation with additive multi-attribute utility models," Omega, Elsevier, vol. 64(C), pages 1-12.
    41. Stefan Hajkowicz & Kerry Collins, 2007. "A Review of Multiple Criteria Analysis for Water Resource Planning and Management," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 21(9), pages 1553-1566, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gasparini, Gaia & Brunelli, Matteo & Chiriac, Marius Dan, 2022. "Multi-period portfolio decision analysis: A case study in the infrastructure management sector," Operations Research Perspectives, Elsevier, vol. 9(C).
    2. Kuller, M. & Beutler, P. & Lienert, J., 2023. "Preference change in stakeholder group-decision processes in the public sector: Extent, causes and implications," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1268-1285.
    3. Marttunen, Mika & Haag, Fridolin & Belton, Valerie & Mustajoki, Jyri & Lienert, Judit, 2019. "Methods to inform the development of concise objectives hierarchies in multi-criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 277(2), pages 604-620.
    4. Aubert, Alice H. & Esculier, Fabien & Lienert, Judit, 2020. "Recommendations for online elicitation of swing weights from citizens in environmental decision-making," Operations Research Perspectives, Elsevier, vol. 7(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kadziński, Miłosz & Wójcik, Michał & Ciomek, Krzysztof, 2022. "Review and experimental comparison of ranking and choice procedures for constructing a univocal recommendation in a preference disaggregation setting," Omega, Elsevier, vol. 113(C).
    2. Marttunen, Mika & Belton, Valerie & Lienert, Judit, 2018. "Are objectives hierarchy related biases observed in practice? A meta-analysis of environmental and energy applications of Multi-Criteria Decision Analysis," European Journal of Operational Research, Elsevier, vol. 265(1), pages 178-194.
    3. Lienert, Judit & Duygan, Mert & Zheng, Jun, 2016. "Preference stability over time with multiple elicitation methods to support wastewater infrastructure decision-making," European Journal of Operational Research, Elsevier, vol. 253(3), pages 746-760.
    4. Ciomek, Krzysztof & Kadziński, Miłosz & Tervonen, Tommi, 2017. "Heuristics for selecting pair-wise elicitation questions in multiple criteria choice problems," European Journal of Operational Research, Elsevier, vol. 262(2), pages 693-707.
    5. Cinelli, Marco & Kadziński, Miłosz & Miebs, Grzegorz & Gonzalez, Michael & Słowiński, Roman, 2022. "Recommending multiple criteria decision analysis methods with a new taxonomy-based decision support system," European Journal of Operational Research, Elsevier, vol. 302(2), pages 633-651.
    6. Ghaderi, Mohammad & Ruiz, Francisco & Agell, Núria, 2017. "A linear programming approach for learning non-monotonic additive value functions in multiple criteria decision aiding," European Journal of Operational Research, Elsevier, vol. 259(3), pages 1073-1084.
    7. Wachowicz, Tomasz & Roszkowska, Ewa, 2022. "Can holistic declaration of preferences improve a negotiation offer scoring system?," European Journal of Operational Research, Elsevier, vol. 299(3), pages 1018-1032.
    8. Ghaderi, Mohammad & Kadziński, Miłosz, 2021. "Incorporating uncovered structural patterns in value functions construction," Omega, Elsevier, vol. 99(C).
    9. Doumpos, Michael & Zopounidis, Constantin, 2011. "Preference disaggregation and statistical learning for multicriteria decision support: A review," European Journal of Operational Research, Elsevier, vol. 209(3), pages 203-214, March.
    10. Vetschera, Rudolf, 2017. "Deriving rankings from incomplete preference information: A comparison of different approaches," European Journal of Operational Research, Elsevier, vol. 258(1), pages 244-253.
    11. Hurson, Christian & Siskos, Yannis, 2014. "A synergy of multicriteria techniques to assess additive value models," European Journal of Operational Research, Elsevier, vol. 238(2), pages 540-551.
    12. Bous, Géraldine & Fortemps, Philippe & Glineur, François & Pirlot, Marc, 2010. "ACUTA: A novel method for eliciting additive value functions on the basis of holistic preference statements," European Journal of Operational Research, Elsevier, vol. 206(2), pages 435-444, October.
    13. Marinakis, Vangelis & Doukas, Haris & Xidonas, Panos & Zopounidis, Constantin, 2017. "Multicriteria decision support in local energy planning: An evaluation of alternative scenarios for the Sustainable Energy Action Plan," Omega, Elsevier, vol. 69(C), pages 1-16.
    14. Kadziński, Miłosz & Cinelli, Marco & Ciomek, Krzysztof & Coles, Stuart R. & Nadagouda, Mallikarjuna N. & Varma, Rajender S. & Kirwan, Kerry, 2018. "Co-constructive development of a green chemistry-based model for the assessment of nanoparticles synthesis," European Journal of Operational Research, Elsevier, vol. 264(2), pages 472-490.
    15. Marttunen, Mika & Haag, Fridolin & Belton, Valerie & Mustajoki, Jyri & Lienert, Judit, 2019. "Methods to inform the development of concise objectives hierarchies in multi-criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 277(2), pages 604-620.
    16. Haag, Fridolin & Lienert, Judit & Schuwirth, Nele & Reichert, Peter, 2019. "Identifying non-additive multi-attribute value functions based on uncertain indifference statements," Omega, Elsevier, vol. 85(C), pages 49-67.
    17. Bouchery, Yann & Ghaffari, Asma & Jemai, Zied & Dallery, Yves, 2012. "Including sustainability criteria into inventory models," European Journal of Operational Research, Elsevier, vol. 222(2), pages 229-240.
    18. Ciomek, Krzysztof & Ferretti, Valentina & Kadzinski, Milosz, 2018. "Predictive analytics and disused railways requalification: insights from a Post Factum Analysis perspective," LSE Research Online Documents on Economics 85922, London School of Economics and Political Science, LSE Library.
    19. Francis Marleau Donais & Irène Abi-Zeid & E. Owen D. Waygood & Roxane Lavoie, 2021. "A Framework for Post-Project Evaluation of Multicriteria Decision Aiding Processes from the Stakeholders’ Perspective: Design and Application," Group Decision and Negotiation, Springer, vol. 30(5), pages 1161-1191, October.
    20. Kadziński, Miłosz & Greco, Salvatore & Słowiński, Roman, 2012. "Selection of a representative value function in robust multiple criteria ranking and choice," European Journal of Operational Research, Elsevier, vol. 217(3), pages 541-553.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:267:y:2018:i:1:p:273-287. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.