IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2012.13816.html
   My bibliography  Save this paper

Value of agreement in decision analysis: Concept, measures and application

Author

Listed:
  • Tom Pape

Abstract

In multi-criteria decision analysis workshops, participants often appraise the options individually before discussing the scoring as a group. The individual appraisals lead to score ranges within which the group then seeks the necessary agreement to identify their preferred option. Preference programming enables some options to be identified as dominated even before the group agrees on a precise scoring for them. Workshop participants usually face time pressure to make a decision. Decision support can be provided by flagging options for which further agreement on their scores seems particularly valuable. By valuable, we mean the opportunity to identify other options as dominated (using preference programming) without having their precise scores agreed beforehand. The present paper quantifies this Value of Agreement and extends the concept to portfolio decision analysis and criterion weights. The new concept is validated through a case study in recruitment.

Suggested Citation

  • Tom Pape, 2020. "Value of agreement in decision analysis: Concept, measures and application," Papers 2012.13816, arXiv.org.
    • Handle: RePEc:arx:papers:2012.13816
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2012.13816
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Craig W. Kirkwood & Rakesh K. Sarin, 1985. "Ranking with Partial Information: A Method and an Application," Operations Research, INFORMS, vol. 33(1), pages 38-48, February.
    2. Salo, Ahti A., 1995. "Interactive decision aiding for group decision support," European Journal of Operational Research, Elsevier, vol. 84(1), pages 134-149, July.
    3. Weber, Martin, 1987. "Decision making with incomplete information," European Journal of Operational Research, Elsevier, vol. 28(1), pages 44-57, January.
    4. Bonner, Bryan L. & Sillito, Sheli D. & Baumann, Michael R., 2007. "Collective estimation: Accuracy, expertise, and extroversion as sources of intra-group influence," Organizational Behavior and Human Decision Processes, Elsevier, vol. 103(1), pages 121-133, May.
    5. Saaty, Thomas L., 1990. "How to make a decision: The analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 48(1), pages 9-26, September.
    6. Julie Stal-Le Cardinal & Vincent Mousseau & Jun Zheng, 2011. "An Application of Constrained Multicriteria Sorting to Student Selection," International Series in Operations Research & Management Science, in: Ahti Salo & Jeffrey Keisler & Alec Morton (ed.), Portfolio Decision Analysis, chapter 0, pages 213-240, Springer.
    7. Edwards, Ward & Barron, F. Hutton, 1994. "SMARTS and SMARTER: Improved Simple Methods for Multiattribute Utility Measurement," Organizational Behavior and Human Decision Processes, Elsevier, vol. 60(3), pages 306-325, December.
    8. Arbel, Ami & Vargas, Luis G., 1993. "Preference simulation and preference programming: robustness issues in priority derivation," European Journal of Operational Research, Elsevier, vol. 69(2), pages 200-209, September.
    9. Nutt, Paul C, 1980. "Comparing methods for weighting decision criteria," Omega, Elsevier, vol. 8(2), pages 163-172.
    10. Parks, Craig D. & Kerr, Norbert L., 1999. "Twenty-Five Years of Social Decision Scheme Theory," Organizational Behavior and Human Decision Processes, Elsevier, vol. 80(1), pages 1-2, October.
    11. Salo, Ahti A. & Hamalainen, Raimo P., 1995. "Preference programming through approximate ratio comparisons," European Journal of Operational Research, Elsevier, vol. 82(3), pages 458-475, May.
    12. Jeffrey Keisler, 2004. "Value of Information in Portfolio Decision Analysis," Decision Analysis, INFORMS, vol. 1(3), pages 177-189, September.
    13. Ahti Salo & Jeffrey Keisler & Alec Morton, 2011. "An Invitation to Portfolio Decision Analysis," International Series in Operations Research & Management Science, in: Ahti Salo & Jeffrey Keisler & Alec Morton (ed.), Portfolio Decision Analysis, chapter 0, pages 3-27, Springer.
    14. Gordon B. Hazen, 1986. "Partial Information, Dominance, and Potential Optimality in Multiattribute Utility Theory," Operations Research, INFORMS, vol. 34(2), pages 296-310, April.
    15. Lahdelma, Risto & Hokkanen, Joonas & Salminen, Pekka, 1998. "SMAA - Stochastic multiobjective acceptability analysis," European Journal of Operational Research, Elsevier, vol. 106(1), pages 137-143, April.
    16. Liesiö, Juuso & Mild, Pekka & Salo, Ahti, 2008. "Robust portfolio modeling with incomplete cost information and project interdependencies," European Journal of Operational Research, Elsevier, vol. 190(3), pages 679-695, November.
    17. Ralph L. Keeney, 1982. "Feature Article—Decision Analysis: An Overview," Operations Research, INFORMS, vol. 30(5), pages 803-838, October.
    18. Kim, Soung Hie & Ahn, Byeong Seok, 1999. "Interactive group decision making procedure under incomplete information," European Journal of Operational Research, Elsevier, vol. 116(3), pages 498-507, August.
    19. Vaidya, Omkarprasad S. & Kumar, Sushil, 2006. "Analytic hierarchy process: An overview of applications," European Journal of Operational Research, Elsevier, vol. 169(1), pages 1-29, February.
    20. Liesio, Juuso & Mild, Pekka & Salo, Ahti, 2007. "Preference programming for robust portfolio modeling and project selection," European Journal of Operational Research, Elsevier, vol. 181(3), pages 1488-1505, September.
    21. R.C. Van den Honert, 2001. "Decisional Power in Group Decision Making: A Note on the Allocation of Group Members' Weights in the Multiplicative AHP and SMART," Group Decision and Negotiation, Springer, vol. 10(3), pages 275-286, May.
    22. Dias, Luis C. & Climaco, Joao N., 2005. "Dealing with imprecise information in group multicriteria decisions: a methodology and a GDSS architecture," European Journal of Operational Research, Elsevier, vol. 160(2), pages 291-307, January.
    23. Jyri Mustajoki & Raimo P. Hämäläinen, 2005. "A Preference Programming Approach to Make the Even Swaps Method Even Easier," Decision Analysis, INFORMS, vol. 2(2), pages 110-123, June.
    24. Eeva Vilkkumaa & Ahti Salo & Juuso Liesiö, 2014. "Multicriteria Portfolio Modeling for the Development of Shared Action Agendas," Group Decision and Negotiation, Springer, vol. 23(1), pages 49-70, January.
    25. Punkka, Antti & Salo, Ahti, 2013. "Preference Programming with incomplete ordinal information," European Journal of Operational Research, Elsevier, vol. 231(1), pages 141-150.
    26. Peter C. Fishburn, 1967. "Methods of Estimating Additive Utilities," Management Science, INFORMS, vol. 13(7), pages 435-453, March.
    27. Ralph L. Keeney, 2013. "Foundations for Group Decision Analysis," Decision Analysis, INFORMS, vol. 10(2), pages 103-120, June.
    28. Luis C. Dias & Paula Sarabando, 2012. "A Note on a Group Preference Axiomatization with Cardinal Utility," Decision Analysis, INFORMS, vol. 9(3), pages 231-237, September.
    29. Arbel, Ami, 1989. "Approximate articulation of preference and priority derivation," European Journal of Operational Research, Elsevier, vol. 43(3), pages 317-326, December.
    30. Fasolo, Barbara & Bana e Costa, Carlos A., 2014. "Tailoring value elicitation to decision makers' numeracy and fluency: Expressing value judgments in numbers or words," Omega, Elsevier, vol. 44(C), pages 83-90.
    31. Jessop, Alan, 2004. "Minimally biased weight determination in personnel selection," European Journal of Operational Research, Elsevier, vol. 153(2), pages 433-444, March.
    32. Ahti A. Salo & Raimo P. Hämäläinen, 1992. "Preference Assessment by Imprecise Ratio Statements," Operations Research, INFORMS, vol. 40(6), pages 1053-1061, December.
    33. Matsatsinis, Nikolaos F. & Samaras, Andreas P., 2001. "MCDA and preference disaggregation in group decision support systems," European Journal of Operational Research, Elsevier, vol. 130(2), pages 414-429, April.
    34. Lawrence Phillips & Carlos Bana e Costa, 2007. "Transparent prioritisation, budgeting and resource allocation with multi-criteria decision analysis and decision conferencing," Annals of Operations Research, Springer, vol. 154(1), pages 51-68, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pape, Tom, 2017. "Value of agreement in decision analysis: concept, measures and application," LSE Research Online Documents on Economics 68682, London School of Economics and Political Science, LSE Library.
    2. Antti Punkka & Ahti Salo, 2014. "Scale Dependence and Ranking Intervals in Additive Value Models Under Incomplete Preference Information," Decision Analysis, INFORMS, vol. 11(2), pages 83-104, June.
    3. Liesio, Juuso & Mild, Pekka & Salo, Ahti, 2007. "Preference programming for robust portfolio modeling and project selection," European Journal of Operational Research, Elsevier, vol. 181(3), pages 1488-1505, September.
    4. Harju, Mikko & Liesiö, Juuso & Virtanen, Kai, 2019. "Spatial multi-attribute decision analysis: Axiomatic foundations and incomplete preference information," European Journal of Operational Research, Elsevier, vol. 275(1), pages 167-181.
    5. Salo, Ahti & Punkka, Antti, 2005. "Rank inclusion in criteria hierarchies," European Journal of Operational Research, Elsevier, vol. 163(2), pages 338-356, June.
    6. Ahn, Byeong Seok, 2017. "Approximate weighting method for multiattribute decision problems with imprecise parameters," Omega, Elsevier, vol. 72(C), pages 87-95.
    7. Mancuso, A. & Compare, M. & Salo, A. & Zio, E. & Laakso, T., 2016. "Risk-based optimization of pipe inspections in large underground networks with imprecise information," Reliability Engineering and System Safety, Elsevier, vol. 152(C), pages 228-238.
    8. de Almeida, Jonatas Araujo & Costa, Ana Paula Cabral Seixas & de Almeida-Filho, Adiel Teixeira, 2016. "A new method for elicitation of criteria weights in additive models: Flexible and interactive tradeoffAuthor-Name: de Almeida, Adiel Teixeira," European Journal of Operational Research, Elsevier, vol. 250(1), pages 179-191.
    9. Jyri Mustajoki & Raimo P. Hämäläinen, 2005. "A Preference Programming Approach to Make the Even Swaps Method Even Easier," Decision Analysis, INFORMS, vol. 2(2), pages 110-123, June.
    10. Fliedner, Thomas & Liesiö, Juuso, 2016. "Adjustable robustness for multi-attribute project portfolio selection," European Journal of Operational Research, Elsevier, vol. 252(3), pages 931-946.
    11. Mustajoki, Jyri & Hamalainen, Raimo P. & Lindstedt, Mats R.K., 2006. "Using intervals for global sensitivity and worst-case analyses in multiattribute value trees," European Journal of Operational Research, Elsevier, vol. 174(1), pages 278-292, October.
    12. Juho Kokkala & Kimmo Berg & Kai Virtanen & Jirka Poropudas, 2019. "Rationalizable strategies in games with incomplete preferences," Theory and Decision, Springer, vol. 86(2), pages 185-204, March.
    13. Salo, Ahti A., 1995. "Interactive decision aiding for group decision support," European Journal of Operational Research, Elsevier, vol. 84(1), pages 134-149, July.
    14. Kim, Soung Hie & Han, Chang Hee, 2000. "Establishing dominance between alternatives with incomplete information in a hierarchically structured attribute tree," European Journal of Operational Research, Elsevier, vol. 122(1), pages 79-90, April.
    15. Marttunen, Mika & Haara, Arto & Hjerppe, Turo & Kurttila, Mikko & Liesiö, Juuso & Mustajoki, Jyri & Saarikoski, Heli & Tolvanen, Anne, 2023. "Parallel and comparative use of three multicriteria decision support methods in an environmental portfolio problem," European Journal of Operational Research, Elsevier, vol. 307(2), pages 842-859.
    16. Liesiö, Juuso & Andelmin, Juho & Salo, Ahti, 2020. "Efficient allocation of resources to a portfolio of decision making units," European Journal of Operational Research, Elsevier, vol. 286(2), pages 619-636.
    17. Tom Pape, 2020. "Prioritising data items for business analytics: Framework and application to human resources," Papers 2012.13813, arXiv.org.
    18. Sam Park, Kyung & Sang Lee, Kyung & Seong Eum, Yun & Park, Kwangtae, 2001. "Extended methods for identifying dominance and potential optimality in multi-criteria analysis with imprecise information," European Journal of Operational Research, Elsevier, vol. 134(3), pages 557-563, November.
    19. Salo, Ahti & Doumpos, Michalis & Liesiö, Juuso & Zopounidis, Constantin, 2024. "Fifty years of portfolio optimization," European Journal of Operational Research, Elsevier, vol. 318(1), pages 1-18.
    20. Vetschera, Rudolf, 2017. "Deriving rankings from incomplete preference information: A comparison of different approaches," European Journal of Operational Research, Elsevier, vol. 258(1), pages 244-253.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2012.13816. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.