IDEAS home Printed from https://ideas.repec.org/a/spr/sochwe/v20y2003i3p443-456.html
   My bibliography  Save this article

Exclusion of self evaluations in peer ratings: An impossibility and some proposals

Author

Listed:
  • Yew-Kwang Ng
  • Guang-Zhen Sun
  • Guang-Zhen Sun

Abstract

In the popularly used ranking method of peer rating, the exclusion of the evaluations/marks given to oneselves is intuitively appealing and has been actually practiced, since a person/university/country typically is biased in favor of itself. This short paper shows that this apparently reasonable principle of self-exclusion may give unacceptable rankings. In particular, it may rank B over A despite the fact that everyone including B ranks A over B. An impossibility theorem (in two versions) is proved, showing that, if the self-awarded marks are excluded, no method of ranking can satisfy some compelling conditions like monotonicity, neutrality, and weak unanimity. Some proposals to overcome the difficulty are discussed. While no ideal proposal has been discovered, some may be practically acceptable in most cases. Copyright Springer-Verlag Berlin Heidelberg 2003

Suggested Citation

  • Yew-Kwang Ng & Guang-Zhen Sun & Guang-Zhen Sun, 2003. "Exclusion of self evaluations in peer ratings: An impossibility and some proposals," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 20(3), pages 443-456, June.
    • Handle: RePEc:spr:sochwe:v:20:y:2003:i:3:p:443-456
    DOI: 10.1007/s003550200191
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s003550200191
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s003550200191?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Amorós, Pablo, 2016. "Subgame perfect implementation of the deserving winner of a competition with natural mechanisms," Mathematical Social Sciences, Elsevier, vol. 83(C), pages 44-57.
    2. Ohseto, Shinji, 2007. "A characterization of the Borda rule in peer ratings," Mathematical Social Sciences, Elsevier, vol. 54(2), pages 147-151, September.
    3. Mackenzie, Andrew, 2015. "Symmetry and impartial lotteries," Games and Economic Behavior, Elsevier, vol. 94(C), pages 15-28.
    4. Matthew Olckers & Toby Walsh, 2022. "Manipulation and Peer Mechanisms: A Survey," Papers 2210.01984, arXiv.org, revised May 2024.
    5. Shinji Ohseto, 2012. "Exclusion of self evaluations in peer ratings: monotonicity versus unanimity on finitely restricted domains," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 38(1), pages 109-119, January.
    6. Ascensión Andina Díaz & José A. García-Martínez, 2015. "A theory of media self-silence," Working Papers 2015-05, Universidad de Málaga, Department of Economic Theory, Málaga Economic Theory Research Center.
    7. Amorós, Pablo, 2019. "Choosing the winner of a competition using natural mechanisms: Conditions based on the jury," Mathematical Social Sciences, Elsevier, vol. 98(C), pages 26-38.
    8. Pablo Amorós, 2014. "Conditions on the jury for the natural implementation of the deserving winner of a contest," Working Papers 2014-01, Universidad de Málaga, Department of Economic Theory, Málaga Economic Theory Research Center.
    9. Shohei Tamura & Shinji Ohseto, 2014. "Impartial nomination correspondences," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 43(1), pages 47-54, June.
    10. Andrew Mackenzie, 2020. "An axiomatic analysis of the papal conclave," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 69(3), pages 713-743, April.
    11. Mackenzie, Andrew, 2018. "A Game of the Throne of Saint Peter," Research Memorandum 015, Maastricht University, Graduate School of Business and Economics (GSBE).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:sochwe:v:20:y:2003:i:3:p:443-456. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.