IDEAS home Printed from https://ideas.repec.org/a/inm/ordeca/v9y2012i3p253-273.html
   My bibliography  Save this article

Sharing Rewards Among Strangers Based on Peer Evaluations

Author

Listed:
  • Arthur Carvalho

    (Cheriton School of Computer Science, University of Waterloo, Waterloo, Ontario N2L 3G1, Canada)

  • Kate Larson

    (Cheriton School of Computer Science, University of Waterloo, Waterloo, Ontario N2L 3G1, Canada)

Abstract

We study a problem where a new, unfamiliar group of agents has to decide how a joint reward should be shared among them. We focus on settings where the share that each agent receives depends on the evaluations of its peers concerning that agent's contribution to the group. We introduce a mechanism to elicit and aggregate evaluations as well as for determining agents' shares. The intuition behind the proposed mechanism is that each agent has its expected share maximized to the extent that it is well evaluated by its peers and that it is truthfully reporting its evaluations. For promoting truthfulness, the proposed mechanism uses a peer-prediction method built on strictly proper scoring rules. Under the assumption that agents are Bayesian decision makers, we show that our mechanism is incentive compatible and budget balanced. We also provide sufficient conditions under which the proposed mechanism is individually rational, resistant to some kinds of collusion, and fair.

Suggested Citation

  • Arthur Carvalho & Kate Larson, 2012. "Sharing Rewards Among Strangers Based on Peer Evaluations," Decision Analysis, INFORMS, vol. 9(3), pages 253-273, September.
    • Handle: RePEc:inm:ordeca:v:9:y:2012:i:3:p:253-273
    DOI: 10.1287/deca.1120.0247
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/deca.1120.0247
    Download Restriction: no
    File URL: https://libkey.io/10.1287/deca.1120.0247?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hervé Moulin & Scott Shenker, 2001. "Strategyproof sharing of submodular costs:budget balance versus efficiency," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 18(3), pages 511-533.
    2. Nolan Miller & Paul Resnick & Richard Zeckhauser, 2005. "Eliciting Informative Feedback: The Peer-Prediction Method," Management Science, INFORMS, vol. 51(9), pages 1359-1373, September.
    3. de Clippel, Geoffroy & Moulin, Herve & Tideman, Nicolaus, 2008. "Impartial division of a dollar," Journal of Economic Theory, Elsevier, vol. 139(1), pages 176-191, March.
    4. T. Tideman & Florenz Plassmann, 2008. "Paying the partners," Public Choice, Springer, vol. 136(1), pages 19-37, July.
    5. Martin J. Osborne & Ariel Rubinstein, 1994. "A Course in Game Theory," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262650401, April.
    6. Boaz Golany & Moshe Kress & Michal Penn & Uriel G. Rothblum, 2012. "Network Optimization Models for Resource Allocation in Developing Military Countermeasures," Operations Research, INFORMS, vol. 60(1), pages 48-63, February.
    7. Knoblauch, Vicki, 2009. "Three-agent peer evaluation," Economics Letters, Elsevier, vol. 105(3), pages 312-314, December.
    8. Herve Moulin, 2004. "Fair Division and Collective Welfare," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262633116, April.
    9. Nash, John, 1950. "The Bargaining Problem," Econometrica, Econometric Society, vol. 18(2), pages 155-162, April.
    10. John Winsor Pratt & Richard Jay Zeckhauser, 1990. "The Fair and Efficient Division of the Winsor Family Silver," Management Science, INFORMS, vol. 36(11), pages 1293-1301, November.
    11. D. Marc Kilgour & Yigal Gerchak, 2004. "Elicitation of Probabilities Using Competitive Scoring Rules," Decision Analysis, INFORMS, vol. 1(2), pages 108-113, June.
    12. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    13. Reinhard Selten, 1998. "Axiomatic Characterization of the Quadratic Scoring Rule," Experimental Economics, Springer;Economic Science Association, vol. 1(1), pages 43-61, June.
    14. HervÊ Moulin, 1999. "Incremental cost sharing: Characterization by coalition strategy-proofness," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 16(2), pages 279-320.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. L. Robin Keller & Kelly M. Kophazi, 2012. "From the Editors ---Copulas, Group Preferences, Multilevel Defenders, Sharing Rewards, and Communicating Analytics," Decision Analysis, INFORMS, vol. 9(3), pages 213-218, September.
    2. repec:cup:judgdm:v:10:y:2015:i:1:p:86-96 is not listed on IDEAS
    3. Arthur Carvalho, 2015. "Tailored proper scoring rules elicit decision weights," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 10(1), pages 86-96, January.
    4. Rakesh K. Sarin & L. Robin Keller, 2013. "From the Editors: Probability Approximations, Anti-Terrorism Strategy, and Bull's-Eye Display for Performance Feedback," Decision Analysis, INFORMS, vol. 10(1), pages 1-5, March.
    5. Arthur Carvalho & Stanko Dimitrov & Kate Larson, 2018. "On proper scoring rules and cumulative prospect theory," EURO Journal on Decision Processes, Springer;EURO - The Association of European Operational Research Societies, vol. 6(3), pages 343-376, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shiran Rachmilevitch, 2022. "Reasonable Nash demand games," Theory and Decision, Springer, vol. 93(2), pages 319-330, September.
    2. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    3. D. J. Johnstone, 2011. "Economic Interpretation of Probabilities Estimated by Maximum Likelihood or Score," Management Science, INFORMS, vol. 57(2), pages 308-314, February.
    4. Donald N. Stengel, 2013. "Aggregating Incomplete Individual Ratings in Group Resource Allocation Decisions," Group Decision and Negotiation, Springer, vol. 22(2), pages 235-258, March.
    5. Christopher P. Chambers & Nicolas S. Lambert, 2021. "Dynamic Belief Elicitation," Econometrica, Econometric Society, vol. 89(1), pages 375-414, January.
    6. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    7. Boudreau, James W. & Knoblauch, Vicki, 2011. "Dividing profits three ways: Exactness vs. consensuality," Mathematical Social Sciences, Elsevier, vol. 62(2), pages 79-86, September.
    8. Peysakhovich, Alexander & Plagborg-Møller, Mikkel, 2012. "A note on proper scoring rules and risk aversion," Economics Letters, Elsevier, vol. 117(1), pages 357-361.
    9. Gantner, Anita & Horn, Kristian & Kerschbamer, Rudolf, 2019. "The role of communication in fair division with subjective claims," Journal of Economic Behavior & Organization, Elsevier, vol. 167(C), pages 72-89.
    10. Jacob Engwerda & Davoud Mahmoudinia & Rahim Dalali Isfahani, 2016. "Government and Central Bank Interaction under Uncertainty: A Differential Games Approach," Iranian Economic Review (IER), Faculty of Economics,University of Tehran.Tehran,Iran, vol. 20(2), pages 225-259, Spring.
    11. Chen, Violet Xinying & Hooker, J.N., 2022. "Combining leximax fairness and efficiency in a mathematical programming model," European Journal of Operational Research, Elsevier, vol. 299(1), pages 235-248.
    12. Hanato, Shunsuke, 2019. "Simultaneous-offers bargaining with a mediator," Games and Economic Behavior, Elsevier, vol. 117(C), pages 361-379.
    13. Charness, Gary & Gneezy, Uri & Rasocha, Vlastimil, 2021. "Experimental methods: Eliciting beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 234-256.
    14. Michel Le Breton & Juan Moreno-Ternero & Alexei Savvateev & Shlomo Weber, 2013. "Stability and fairness in models with a multiple membership," International Journal of Game Theory, Springer;Game Theory Society, vol. 42(3), pages 673-694, August.
    15. Masanori Mitsutsune & Takanori Adachi, 2014. "Estimating noncooperative and cooperative models of bargaining: an empirical comparison," Empirical Economics, Springer, vol. 47(2), pages 669-693, September.
    16. Saša Zorc & Ilia Tsetlin, 2020. "Deadlines, Offer Timing, and the Search for Alternatives," Operations Research, INFORMS, vol. 68(3), pages 927-948, May.
    17. Sherrill Shaffer, 2011. "Strategic risk aversion," Applied Financial Economics, Taylor & Francis Journals, vol. 21(13), pages 949-956.
    18. Yusuke Samejima, 2005. "A Note on Implementation of Bargaining Solutions," Theory and Decision, Springer, vol. 59(3), pages 175-191, November.
    19. Knoblauch, Vicki, 2009. "Three-agent peer evaluation," Economics Letters, Elsevier, vol. 105(3), pages 312-314, December.
    20. Ruben Juarez & Rajnish Kumar, 2013. "Implementing efficient graphs in connection networks," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 54(2), pages 359-403, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ordeca:v:9:y:2012:i:3:p:253-273. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.