IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v52y2006i9p1394-1408.html
   My bibliography  Save this article

Methodologies and Algorithms for Group-Rankings Decision

Author

Listed:
  • Dorit S. Hochbaum

    (Department of Industrial Engineering and Operations Research, and Walter A. Haas School of Business, University of California, Berkeley, Berkeley, California 94720)

  • Asaf Levin

    (Department of Statistics, The Hebrew University, Jerusalem 91905, Israel)

Abstract

The problem of group ranking, also known as rank aggregation, has been studied in contexts varying from sports, to multicriteria decision making, to machine learning, to ranking Web pages, and to behavioral issues. The dynamics of the group aggregation of individual decisions has been a subject of central importance in decision theory. We present here a new paradigm using an optimization framework that addresses major shortcomings that exist in current models of group ranking. Moreover, the framework provides a specific performance measure for the quality of the aggregate ranking as per its deviations from the individual decision-makers' rankings. The new model for the group-ranking problem presented here is based on rankings provided with intensity--that is, the degree of preference is quantified. The model allows for flexibility in decision protocols and can take into consideration imprecise beliefs, less than full confidence in some of the rankings, and differentiating between the expertise of the reviewers. Our approach relaxes frequently made assumptions of: certain beliefs in pairwise rankings; homogeneity implying equal expertise of all decision makers with respect to all evaluations; and full list requirement according to which each decision maker evaluates and ranks all objects. The option of preserving the ranks in certain subsets is also addressed in the model here. Significantly, our model is a natural extension and generalization of existing models, yet it is solvable in polynomial time. The group-rankings models are linked to network flow techniques.

Suggested Citation

  • Dorit S. Hochbaum & Asaf Levin, 2006. "Methodologies and Algorithms for Group-Rankings Decision," Management Science, INFORMS, vol. 52(9), pages 1394-1408, September.
  • Handle: RePEc:inm:ormnsc:v:52:y:2006:i:9:p:1394-1408
    DOI: 10.1287/mnsc.1060.0540
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.1060.0540
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.1060.0540?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Wade D. Cook & Boaz Golany & Moshe Kress & Michal Penn & Tal Raviv, 2005. "Optimal Allocation of Proposals to Reviewers to Facilitate Effective Ranking," Management Science, INFORMS, vol. 51(4), pages 655-661, April.
    2. Iqbal Ali & Wade D. Cook & Moshe Kress, 1986. "Note---Ordinal Ranking and Intensity of Preference: A Linear Programming Approach," Management Science, INFORMS, vol. 32(12), pages 1642-1647, December.
    3. Ravindra K. Ahuja & Dorit S. Hochbaum & James B. Orlin, 2003. "Solving the Convex Cost Integer Dual Network Flow Problem," Management Science, INFORMS, vol. 49(7), pages 950-964, July.
    4. Thomas L. Saaty & Luis G. Vargas, 1998. "Diagnosis with Dependent Symptoms: Bayes Theorem and the Analytic Hierarchy Process," Operations Research, INFORMS, vol. 46(4), pages 491-502, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kannan, Devika, 2021. "Sustainable procurement drivers for extended multi-tier context: A multi-theoretical perspective in the Danish supply chain," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 146(C).
    2. Xia Liu & Yejun Xu & Yao Ge & Weike Zhang & Francisco Herrera, 2019. "A Group Decision Making Approach Considering Self-Confidence Behaviors and Its Application in Environmental Pollution Emergency Management," IJERPH, MDPI, vol. 16(3), pages 1-15, January.
    3. Wu, Siqi & Wu, Meng & Dong, Yucheng & Liang, Haiming & Zhao, Sihai, 2020. "The 2-rank additive model with axiomatic design in multiple attribute decision making," European Journal of Operational Research, Elsevier, vol. 287(2), pages 536-545.
    4. Li-Ching Ma, 2018. "Discovering Consensus Preferences Visually Based on Gower Plots," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 17(03), pages 741-761, May.
    5. Hengjie Zhang & Fang Wang & Huali Tang & Yucheng Dong, 2019. "An Optimization-Based Approach to Social Network Group Decision Making with an Application to Earthquake Shelter-Site Selection," IJERPH, MDPI, vol. 16(15), pages 1-16, July.
    6. Karol Flores-Szwagrzak & Rafael Treibich, 2020. "Teamwork and Individual Productivity," Management Science, INFORMS, vol. 66(6), pages 2523-2544, June.
    7. Zhang, Hengjie & Dong, Yucheng & Chiclana, Francisco & Yu, Shui, 2019. "Consensus efficiency in group decision making: A comprehensive comparative study and its optimal design," European Journal of Operational Research, Elsevier, vol. 275(2), pages 580-598.
    8. Tomashevskii, I.L., 2015. "Eigenvector ranking method as a measuring tool: Formulas for errors," European Journal of Operational Research, Elsevier, vol. 240(3), pages 774-780.
    9. Paulo Cesar Schotten & Leydiana Sousa Pereira & Danielle Costa Morais, 2022. "Credit granting sorting model for financial organizations," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-24, December.
    10. Gong, Zaiwu & Guo, Weiwei & Słowiński, Roman, 2021. "Transaction and interaction behavior-based consensus model and its application to optimal carbon emission reduction," Omega, Elsevier, vol. 104(C).
    11. Dorit S. Hochbaum & Erick Moreno-Centeno & Phillip Yelland & Rodolfo A. Catena, 2011. "Rating Customers According to Their Promptness to Adopt New Products," Operations Research, INFORMS, vol. 59(5), pages 1171-1183, October.
    12. Hengjie Zhang & Wenfeng Zhu & Xin Chen & Yuzhu Wu & Haiming Liang & Cong-Cong Li & Yucheng Dong, 2024. "Managing flexible linguistic expression and ordinal classification-based consensus in large-scale multi-attribute group decision making," Annals of Operations Research, Springer, vol. 341(1), pages 95-148, October.
    13. Xuyuan Zhang & Hailin Liang & Shaojian Qu, 2024. "Robust Consensus Modeling: Concerning Consensus Fairness and Efficiency with Uncertain Costs," Mathematics, MDPI, vol. 12(8), pages 1-31, April.
    14. Ma, Li-Ching, 2010. "Visualizing preferences on spheres for group decisions based on multiplicative preference relations," European Journal of Operational Research, Elsevier, vol. 203(1), pages 176-184, May.
    15. Cheng, Li-Chen & Chen, Yen-Liang & Chiang, Yu-Chia, 2016. "Identifying conflict patterns to reach a consensus – A novel group decision approach," European Journal of Operational Research, Elsevier, vol. 254(2), pages 622-631.
    16. Sha Fan & Hengjie Zhang & Huali Tang, 2019. "A Linguistic Hierarchy Model with Self-Confidence Preference Relations and Its Application in Co-Regulation of Food Safety in China," IJERPH, MDPI, vol. 16(16), pages 1-21, August.
    17. Roemer, Thomas A. & Ahmadi, Reza, 2010. "Models for concurrent product and process design," European Journal of Operational Research, Elsevier, vol. 203(3), pages 601-613, June.
    18. Bianchi, Federico & Grimaldo, Francisco & Squazzoni, Flaminio, 2019. "The F3-index. Valuing reviewers for scholarly journals," Journal of Informetrics, Elsevier, vol. 13(1), pages 78-86.
    19. Chen, Yen-Liang & Cheng, Li-Chen, 2009. "Mining maximum consensus sequences from group ranking data," European Journal of Operational Research, Elsevier, vol. 198(1), pages 241-251, October.
    20. Fu, Yelin & Lu, Yihe & Yu, Chen & Lai, Kin Keung, 2022. "Inter-country comparisons of energy system performance with the energy trilemma index: An ensemble ranking methodology based on the half-quadratic theory," Energy, Elsevier, vol. 261(PA).
    21. Marco Marozzi, 2016. "Construction, Robustness Assessment and Application of an Index of Perceived Level of Socio-Economic Threat from Immigrants: A Study of 47 European Countries and Regions," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 128(1), pages 413-437, August.
    22. Tianjiao Wang & Yelin Fu, 2020. "Constructing Composite Indicators with Individual Judgements and Best–Worst Method: An Illustration of Value Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 149(1), pages 1-14, May.
    23. Yoo, Yeawon & Escobedo, Adolfo R. & Skolfield, J. Kyle, 2020. "A new correlation coefficient for comparing and aggregating non-strict and incomplete rankings," European Journal of Operational Research, Elsevier, vol. 285(3), pages 1025-1041.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nathan Atkinson & Scott C. Ganz & Dorit S. Hochbaum & James B. Orlin, 2023. "The Strong Maximum Circulation Algorithm: A New Method for Aggregating Preference Rankings," Papers 2307.15702, arXiv.org, revised Oct 2024.
    2. Fernandez Martinez, Roberto & Lostado Lorza, Ruben & Santos Delgado, Ana Alexandra & Piedra, Nelson, 2021. "Use of classification trees and rule-based models to optimize the funding assignment to research projects: A case study of UTPL," Journal of Informetrics, Elsevier, vol. 15(1).
    3. Tsai, Wen-Hsien & Hsu, Jui-Ling, 2008. "Corporate social responsibility programs choice and costs assessment in the airline industry—A hybrid model," Journal of Air Transport Management, Elsevier, vol. 14(4), pages 188-196.
    4. Lo, Huai-Wei & Liou, James J.H. & Huang, Chun-Nen & Chuang, Yen-Ching & Tzeng, Gwo-Hshiung, 2020. "A new soft computing approach for analyzing the influential relationships of critical infrastructures," International Journal of Critical Infrastructure Protection, Elsevier, vol. 28(C).
    5. Bürgy, Reinhard & Bülbül, Kerem, 2018. "The job shop scheduling problem with convex costs," European Journal of Operational Research, Elsevier, vol. 268(1), pages 82-100.
    6. Chia-Liang Lin & Jwu-Jenq Chen & Yu-Yu Ma, 2023. "Ranking of Service Quality Solution for Blended Design Teaching Using Fuzzy ANP and TOPSIS in the Post-COVID-19 Era," Mathematics, MDPI, vol. 11(5), pages 1-28, March.
    7. Thomas Feliciani & Junwen Luo & Lai Ma & Pablo Lucas & Flaminio Squazzoni & Ana Marušić & Kalpana Shankar, 2019. "A scoping review of simulation models of peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 555-594, October.
    8. Juan Carlos Leyva-López, 2024. "A consistency and consensus model for group decision support based on the outranking approach," Operational Research, Springer, vol. 24(2), pages 1-29, June.
    9. Lin, Yi-Kuei, 2006. "Evaluate the performance of a stochastic-flow network with cost attribute in terms of minimal cuts," Reliability Engineering and System Safety, Elsevier, vol. 91(5), pages 539-545.
    10. Ma, Li-Ching, 2010. "Visualizing preferences on spheres for group decisions based on multiplicative preference relations," European Journal of Operational Research, Elsevier, vol. 203(1), pages 176-184, May.
    11. Cheng, Li-Chen & Chen, Yen-Liang & Chiang, Yu-Chia, 2016. "Identifying conflict patterns to reach a consensus – A novel group decision approach," European Journal of Operational Research, Elsevier, vol. 254(2), pages 622-631.
    12. Partovi, Fariborz Y. & Corredoira, Rafael A., 2002. "Quality function deployment for the good of soccer," European Journal of Operational Research, Elsevier, vol. 137(3), pages 642-656, March.
    13. Chen, Yen-Liang & Cheng, Li-Chen, 2009. "Mining maximum consensus sequences from group ranking data," European Journal of Operational Research, Elsevier, vol. 198(1), pages 241-251, October.
    14. W. Wey & W. Wei, 2016. "Urban Street Environment Design for Quality of Urban Life," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 126(1), pages 161-186, March.
    15. David Wu & Viet Hung Nguyen & Michel Minoux & Hai Tran, 2022. "Optimal deterministic and robust selection of electricity contracts," Journal of Global Optimization, Springer, vol. 82(4), pages 993-1013, April.
    16. Pendharkar, Parag C., 2010. "Valuing interdependent multi-stage IT investments: A real options approach," European Journal of Operational Research, Elsevier, vol. 201(3), pages 847-859, March.
    17. Bachelet, Bruno & Duhamel, Christophe, 2009. "Aggregation approach for the minimum binary cost tension problem," European Journal of Operational Research, Elsevier, vol. 197(2), pages 837-841, September.
    18. Mehdi Ghiyasvand, 2019. "An $$O(n(m+n\log n)\log n)$$O(n(m+nlogn)logn) time algorithm to solve the minimum cost tension problem," Journal of Combinatorial Optimization, Springer, vol. 37(3), pages 957-969, April.
    19. Muhammad Mohsin & Yin Hengbin & Zhang Luyao & Li Rui & Qian Chong & Ana Mehak, 2022. "An Application of Multiple-Criteria Decision Analysis for Risk Prioritization and Management: A Case Study of the Fisheries Sector in Pakistan," Sustainability, MDPI, vol. 14(14), pages 1-21, July.
    20. Ling-Zhong Lin & Tsuen-Ho Hsu, 2008. "The Qualitative and Quantitative Models for Performance Measurement Systems: The Agile Service Development," Quality & Quantity: International Journal of Methodology, Springer, vol. 42(4), pages 445-476, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:52:y:2006:i:9:p:1394-1408. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.