IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0240997.html
   My bibliography  Save this article

Utility and use of accuracy cues in social learning of crowd preferences

Author

Listed:
  • Jaeseob Lim
  • Sang-Hun Lee

Abstract

Despite limited information and knowledge, we personally form beliefs about certain properties of objects encountered in our daily life—popularity of a newly released movie, for example. Since such beliefs are prone to error, we often revise our initial beliefs according to the beliefs of others to improve accuracy. Optimal revision requires modulating the degree of accepting others’ beliefs based on various cues for accuracy—number of opinions, for example—such that the more accurate others’ beliefs are, the more we accept them. Although previous studies have shown that such accuracy cues can influence the degree of acceptance during social revision, they primarily investigated problems with ‘factually correct’ answers, and rarely problems with ‘socially correct’ answers. Here we examined which accuracy cues are objectively useful (utility of cues), and how those cues are used (use of cues), in the social revision of people’s beliefs about problems with ‘socially correct’ answers. We asked people to estimate the ‘shared preferences (SPs)’ for sociocultural items, the answers to which are determined by socially aggregated beliefs—how popular an abstract painting will be among a large crowd, for example—and then to revise their initial estimates after being exposed to other people’s estimates about the same items. We considered ‘confidence’, ‘agreement among estimates’, and ‘number of estimates’ as accuracy cues. We found that, while all three cues validly signaled the accuracy of SP estimates, only the ‘number’ cue has a significant utility, but the other cues are much less useful for optimal revision. Nevertheless, people used the cues of ‘agreement’ and their own 'confidence’ to the extent comparable to that of the 'number' cue. Our findings suggest that the utility and use of accuracy cues for problems with ‘socially correct’ answers differ from those with ‘factually correct’ answers, as follows: (i) confidence does not have a significant utility and (ii) but people use their own confidence while ignoring others’ confidence.

Suggested Citation

  • Jaeseob Lim & Sang-Hun Lee, 2020. "Utility and use of accuracy cues in social learning of crowd preferences," PLOS ONE, Public Library of Science, vol. 15(10), pages 1-25, October.
    • Handle: RePEc:plo:pone00:0240997
    DOI: 10.1371/journal.pone.0240997
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0240997
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0240997&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0240997?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Sniezek, Janet A. & Van Swol, Lyn M., 2001. "Trust, Confidence, and Expertise in a Judge-Advisor System," Organizational Behavior and Human Decision Processes, Elsevier, vol. 84(2), pages 288-307, March.
    2. Soll, Jack B. & Mannes, Albert E., 2011. "Judgmental aggregation strategies depend on whether the self is involved," International Journal of Forecasting, Elsevier, vol. 27(1), pages 81-102, January.
    3. Van Swol, Lyn M., 2011. "Forecasting another’s enjoyment versus giving the right answer: Trust, shared values, task effects, and confidence in improving the acceptance of advice," International Journal of Forecasting, Elsevier, vol. 27(1), pages 103-120.
    4. Yaniv, Ilan, 1997. "Weighting and Trimming: Heuristics for Aggregating Judgments under Uncertainty," Organizational Behavior and Human Decision Processes, Elsevier, vol. 69(3), pages 237-249, March.
    5. Albert E. Mannes, 2009. "Are We Wise About the Wisdom of Crowds? The Use of Group Judgments in Belief Revision," Management Science, INFORMS, vol. 55(8), pages 1267-1279, August.
    6. Robert L. Winkler, 1981. "Combining Probability Distributions from Dependent Information Sources," Management Science, INFORMS, vol. 27(4), pages 479-488, April.
    7. Harvey, Nigel & Fischer, Ilan, 1997. "Taking Advice: Accepting Help, Improving Judgment, and Sharing Responsibility," Organizational Behavior and Human Decision Processes, Elsevier, vol. 70(2), pages 117-133, May.
    8. repec:cup:judgdm:v:10:y:2015:i:3:p:265-276 is not listed on IDEAS
    9. Soll, Jack B. & Mannes, Albert E., 2011. "Judgmental aggregation strategies depend on whether the self is involved," International Journal of Forecasting, Elsevier, vol. 27(1), pages 81-102.
    10. Van Swol, Lyn M., 2011. "Forecasting another's enjoyment versus giving the right answer: Trust, shared values, task effects, and confidence in improving the acceptance of advice," International Journal of Forecasting, Elsevier, vol. 27(1), pages 103-120, January.
    11. Yaniv, Ilan & Milyavsky, Maxim, 2007. "Using advice from multiple sources to revise and improve judgments," Organizational Behavior and Human Decision Processes, Elsevier, vol. 103(1), pages 104-120, May.
    12. Bonaccio, Silvia & Dalal, Reeshad S., 2006. "Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences," Organizational Behavior and Human Decision Processes, Elsevier, vol. 101(2), pages 127-151, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bertrand Jayles & Clément Sire & Ralf H J M Kurvers, 2021. "Crowd control: Reducing individual estimation bias by sharing biased social information," PLOS Computational Biology, Public Library of Science, vol. 17(11), pages 1-28, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Philipp Ecken & Richard Pibernik, 2016. "Hit or Miss: What Leads Experts to Take Advice for Long-Term Judgments?," Management Science, INFORMS, vol. 62(7), pages 2002-2021, July.
    2. Önkal, Dilek & Sinan Gönül, M. & Goodwin, Paul & Thomson, Mary & Öz, Esra, 2017. "Evaluating expert advice in forecasting: Users’ reactions to presumed vs. experienced credibility," International Journal of Forecasting, Elsevier, vol. 33(1), pages 280-297.
    3. Ilan Yaniv & Shoham Choshen-Hillel, 2012. "When guessing what another person would say is better than giving your own opinion: Using perspective-taking to improve advice-taking," Discussion Paper Series dp622, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    4. Kausel, Edgar E. & Culbertson, Satoris S. & Leiva, Pedro I. & Slaughter, Jerel E. & Jackson, Alexander T., 2015. "Too arrogant for their own good? Why and when narcissists dismiss advice," Organizational Behavior and Human Decision Processes, Elsevier, vol. 131(C), pages 33-50.
    5. repec:cup:judgdm:v:10:y:2015:i:3:p:265-276 is not listed on IDEAS
    6. repec:cup:judgdm:v:11:y:2016:i:4:p:401-415 is not listed on IDEAS
    7. Mandy Hütter & Fabian Ache, 2016. "Seeking advice: A sampling approach to advice taking," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 11(4), pages 401-415, July.
    8. Peter Bednarik & Thomas Schultze, 2015. "The effectiveness of imperfect weighting in advice taking," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 10(3), pages 265-276, May.
    9. Logg, Jennifer M. & Minson, Julia A. & Moore, Don A., 2019. "Algorithm appreciation: People prefer algorithmic to human judgment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 90-103.
    10. repec:cup:judgdm:v:14:y:2019:i:3:p:349-363 is not listed on IDEAS
    11. Albert E. Mannes, 2009. "Are We Wise About the Wisdom of Crowds? The Use of Group Judgments in Belief Revision," Management Science, INFORMS, vol. 55(8), pages 1267-1279, August.
    12. Wright, George & Rowe, Gene, 2011. "Group-based judgmental forecasting: An integration of extant knowledge and the development of priorities for a new research agenda," International Journal of Forecasting, Elsevier, vol. 27(1), pages 1-13, January.
    13. repec:cup:judgdm:v:10:y:2015:i:2:p:144-171 is not listed on IDEAS
    14. Rader, Christina A. & Soll, Jack B. & Larrick, Richard P., 2015. "Pushing away from representative advice: Advice taking, anchoring, and adjustment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 130(C), pages 26-43.
    15. Thomas Schultze & Anne-Fernandine Rakotoarisoa & Stefan Schulz-Hardt, 2015. "Effects of distance between initial estimates and advice on advice utilization," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 10(2), pages 144-171, March.
    16. repec:eee:intfor:v:27:y:2011:i:1:p:1-13 is not listed on IDEAS
    17. Sah, Sunita & Moore, Don A. & MacCoun, Robert J., 2013. "Cheap talk and credibility: The consequences of confidence and accuracy on advisor credibility and persuasiveness," Organizational Behavior and Human Decision Processes, Elsevier, vol. 121(2), pages 246-255.
    18. Soll, Jack B. & Mannes, Albert E., 2011. "Judgmental aggregation strategies depend on whether the self is involved," International Journal of Forecasting, Elsevier, vol. 27(1), pages 81-102.
    19. Soll, Jack B. & Mannes, Albert E., 2011. "Judgmental aggregation strategies depend on whether the self is involved," International Journal of Forecasting, Elsevier, vol. 27(1), pages 81-102, January.
    20. Thomas Schultze & Andreas Mojzisch & Stefan Schulz-Hardt, 2019. "Why dyads heed advice less than individuals do," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 14(3), pages 349-363, May.
    21. Alison Wood Brooks & Francesca Gino & Maurice E. Schweitzer, 2015. "Smart People Ask for (My) Advice: Seeking Advice Boosts Perceptions of Competence," Management Science, INFORMS, vol. 61(6), pages 1421-1435, June.
    22. Robert M. Gillenkirch & Julia Ortner & Sebastian Robert & Louis Velthuis, 2023. "Designing incentives and performance measurement for advisors: How to make decision-makers listen to advice," Working Papers 2304, Gutenberg School of Management and Economics, Johannes Gutenberg-Universität Mainz.
    23. Chen Li & Ning Liu, 2021. "What to tell? Wise communication and wise crowd," Theory and Decision, Springer, vol. 90(2), pages 279-299, March.
    24. Johannes Müller-Trede & Shoham Choshen-Hillel & Meir Barneron & Ilan Yaniv, 2018. "The Wisdom of Crowds in Matters of Taste," Management Science, INFORMS, vol. 64(4), pages 1779-1803, April.
    25. Spassova, Gerri & Palmeira, Mauricio & Andrade, Eduardo B., 2018. "A ratings pattern heuristic in judgments of expertise: When being right Looks wrong," Organizational Behavior and Human Decision Processes, Elsevier, vol. 147(C), pages 26-47.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0240997. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.