IDEAS home Printed from https://ideas.repec.org/a/eee/gamebe/v141y2023icp261-285.html
   My bibliography  Save this article

Increasing the external validity of social preference games by reducing measurement error

Author

Listed:
  • Wang, Xinghua
  • Navarro-Martinez, Daniel

Abstract

An increasing number of studies call into question the external validity of social preference games. In this paper, we show that these games have a low correlation with single pro-social behaviors in the field, but this correlation can be substantially increased by aggregating behaviors to reduce measurement error. We tracked people's daily pro-social behaviors for 14 days using a day reconstruction method; the same people played three different social preference games on seven different occasions. We show that, as more pro-social behaviors and game rounds are aggregated, the games become much better predictors of pro-sociality. This predictive power is further increased by using statistical methods designed to better account for measurement error. These findings suggest that social preference games capture important underlying dispositions of real-world pro-sociality, and they can be successfully used to predict aggregated pro-social inclinations. This has crucial implications for the external validity and applicability of economic games.

Suggested Citation

  • Wang, Xinghua & Navarro-Martinez, Daniel, 2023. "Increasing the external validity of social preference games by reducing measurement error," Games and Economic Behavior, Elsevier, vol. 141(C), pages 261-285.
  • Handle: RePEc:eee:gamebe:v:141:y:2023:i:c:p:261-285
    DOI: 10.1016/j.geb.2023.06.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S089982562300088X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.geb.2023.06.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ernst Fehr & Simon Gächter, 2000. "Fairness and Retaliation: The Economics of Reciprocity," Journal of Economic Perspectives, American Economic Association, vol. 14(3), pages 159-181, Summer.
    2. Hoffman Elizabeth & McCabe Kevin & Shachat Keith & Smith Vernon, 1994. "Preferences, Property Rights, and Anonymity in Bargaining Games," Games and Economic Behavior, Elsevier, vol. 7(3), pages 346-380, November.
    3. Dirk Engelmann & Martin Strobel, 2004. "Inequality Aversion, Efficiency, and Maximin Preferences in Simple Distribution Experiments," American Economic Review, American Economic Association, vol. 94(4), pages 857-869, September.
    4. Gary Charness & Matthew Rabin, 2002. "Understanding Social Preferences with Simple Tests," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 817-869.
    5. Burnham, Terence & McCabe, Kevin & Smith, Vernon L., 2000. "Friend-or-foe intentionality priming in an extensive form trust game," Journal of Economic Behavior & Organization, Elsevier, vol. 43(1), pages 57-73, September.
    6. Eckel, Catherine C. & Grossman, Philip J., 1996. "Altruism in Anonymous Dictator Games," Games and Economic Behavior, Elsevier, vol. 16(2), pages 181-191, October.
    7. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    8. Joseph Henrich, 2001. "In Search of Homo Economicus: Behavioral Experiments in 15 Small-Scale Societies," American Economic Review, American Economic Association, vol. 91(2), pages 73-78, May.
    9. Dufwenberg, Martin & Gächter, Simon & Hennig-Schmidt, Heike, 2011. "The framing of games and the psychology of play," Games and Economic Behavior, Elsevier, vol. 73(2), pages 459-478.
    10. John A. List, 2007. "On the Interpretation of Giving in Dictator Games," Journal of Political Economy, University of Chicago Press, vol. 115(3), pages 482-493.
    11. Anke Becker & Thomas Deckers & Thomas Dohmen & Armin Falk & Fabian Kosse, 2012. "The Relationship Between Economic Preferences and Psychological Personality Measures," Annual Review of Economics, Annual Reviews, vol. 4(1), pages 453-478, July.
    12. Ben Gillen & Erik Snowberg & Leeat Yariv, 2019. "Experimenting with Measurement Error: Techniques with Applications to the Caltech Cohort Study," Journal of Political Economy, University of Chicago Press, vol. 127(4), pages 1826-1863.
    13. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    14. Ernst Fehr & Simon Gächter, 2002. "Altruistic punishment in humans," Nature, Nature, vol. 415(6868), pages 137-140, January.
    15. Anke Becker & Thomas Deckers & Thomas Dohmen & Armin Falk & Fabian Kosse, 2012. "The Relationship Between Economic Preferences and Psychological Personality Measures," Annual Review of Economics, Annual Reviews, vol. 4(1), pages 453-478, July.
    16. John A. List, 2020. "Non est Disputandum de Generalizability? A Glimpse into The External Validity Trial," NBER Working Papers 27535, National Bureau of Economic Research, Inc.
    17. Daruvala, Dinky, 2010. "Would the right social preference model please stand up!," Journal of Economic Behavior & Organization, Elsevier, vol. 73(2), pages 199-208, February.
    18. Matthias Benz & Stephan Meier, 2008. "Do people behave in experiments as in the field?—evidence from donations," Experimental Economics, Springer;Economic Science Association, vol. 11(3), pages 268-281, September.
    19. David G. Rand & Joshua D. Greene & Martin A. Nowak, 2012. "Spontaneous giving and calculated greed," Nature, Nature, vol. 489(7416), pages 427-430, September.
    20. Christoph Graf & Rudolf Vetschera & Yingchao Zhang, 2013. "Parameters of social preference functions: measurement and external validity," Theory and Decision, Springer, vol. 74(3), pages 357-382, March.
    21. Nicholas Bardsley, 2008. "Dictator game giving: altruism or artefact?," Experimental Economics, Springer;Economic Science Association, vol. 11(2), pages 122-133, June.
    22. Andreoni, James, 1990. "Impure Altruism and Donations to Public Goods: A Theory of Warm-Glow Giving?," Economic Journal, Royal Economic Society, vol. 100(401), pages 464-477, June.
    23. Axel Ockenfels & Gary E. Bolton, 2000. "ERC: A Theory of Equity, Reciprocity, and Competition," American Economic Review, American Economic Association, vol. 90(1), pages 166-193, March.
    24. Rabin, Matthew, 1993. "Incorporating Fairness into Game Theory and Economics," American Economic Review, American Economic Association, vol. 83(5), pages 1281-1302, December.
    25. Jonathan P. Beauchamp & David Cesarini & Magnus Johannesson, 2017. "The psychometric and empirical properties of measures of risk preferences," Journal of Risk and Uncertainty, Springer, vol. 54(3), pages 203-237, June.
    26. Patrick E. Shrout & Gertraud Stadler & Sean P. Lane & M. Joy McClure & Grace L. Jackson & Frederick D. Clavél & Masumi Iida & Marci E. J. Gleason & Joy H. Xu & Niall Bolger, 2018. "Initial elevation bias in subjective reports," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 115(1), pages 15-23, January.
    27. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    28. Noah J. Goldstein & Robert B. Cialdini & Vladas Griskevicius, 2008. "A Room with a Viewpoint: Using Social Norms to Motivate Environmental Conservation in Hotels," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 35(3), pages 472-482, March.
    29. Yan Chen & Sherry Xin Li, 2009. "Group Identity and Social Preferences," American Economic Review, American Economic Association, vol. 99(1), pages 431-457, March.
    30. Charness, Gary & Gneezy, Uri, 2008. "What's in a name? Anonymity and social distance in dictator and ultimatum games," Journal of Economic Behavior & Organization, Elsevier, vol. 68(1), pages 29-35, October.
    31. Hoffman, Elizabeth & McCabe, Kevin & Smith, Vernon L, 1996. "Social Distance and Other-Regarding Behavior in Dictator Games," American Economic Review, American Economic Association, vol. 86(3), pages 653-660, June.
    32. repec:cup:judgdm:v:15:y:2020:i:3:p:330-345 is not listed on IDEAS
    33. James Andreoni & John Miller, 2002. "Giving According to GARP: An Experimental Test of the Consistency of Preferences for Altruism," Econometrica, Econometric Society, vol. 70(2), pages 737-753, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    2. Erik O. Kimbrough & Alexander Vostroknutov, 2016. "Norms Make Preferences Social," Journal of the European Economic Association, European Economic Association, vol. 14(3), pages 608-638, June.
    3. Thorsten Chmura & Christoph Engel & Markus Englerth, 2013. "Selfishness As a Potential Cause of Crime. A Prison Experiment," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2013_05, Max Planck Institute for Research on Collective Goods.
    4. Murnighan, J. Keith & Wang, Long, 2016. "The social world as an experimental game," Organizational Behavior and Human Decision Processes, Elsevier, vol. 136(C), pages 80-94.
    5. Emin Karagözoğlu & Elif Tosun, 2022. "Endogenous Game Choice and Giving Behavior in Distribution Games," Games, MDPI, vol. 13(6), pages 1-32, November.
    6. Dimant, Eugen, 2015. "On Peer Effects: Behavioral Contagion of (Un)Ethical Behavior and the Role of Social Identity," MPRA Paper 68732, University Library of Munich, Germany.
    7. Crawford, Ian & Harris, Donna, 2018. "Social interactions and the influence of “extremists”," Journal of Economic Behavior & Organization, Elsevier, vol. 153(C), pages 238-266.
    8. Eckel, Catherine & Gintis, Herbert, 2010. "Blaming the messenger: Notes on the current state of experimental economics," Journal of Economic Behavior & Organization, Elsevier, vol. 73(1), pages 109-119, January.
    9. Jeannette Brosig-Koch & Thomas Riechmann & Joachim Weimann, 2017. "The dynamics of behavior in modified dictator games," PLOS ONE, Public Library of Science, vol. 12(4), pages 1-18, April.
    10. Martin G. Kocher & Odile Poulsen & Daniel J. Zizzo, 2017. "Social preferences, accountability, and wage bargaining," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 48(3), pages 659-678, March.
    11. Bharat Chandar & Uri Gneezy & John A. List & Ian Muir, 2019. "The Drivers of Social Preferences: Evidence from a Nationwide Tipping Field Experiment," NBER Working Papers 26380, National Bureau of Economic Research, Inc.
    12. Korenok, Oleg & Millner, Edward L. & Razzolini, Laura, 2018. "Taking aversion," Journal of Economic Behavior & Organization, Elsevier, vol. 150(C), pages 397-403.
      • Korenok Oleg & Edward L. Millner & Laura Razzolini, 2017. "Taking Aversion," Working Papers 1702, VCU School of Business, Department of Economics.
    13. Kerschbamer, Rudolf, 2015. "The geometry of distributional preferences and a non-parametric identification approach: The Equality Equivalence Test," European Economic Review, Elsevier, vol. 76(C), pages 85-103.
    14. Breitmoser, Yves & Vorjohann, Pauline, 2018. "Welfare-Based Altruism," Rationality and Competition Discussion Paper Series 89, CRC TRR 190 Rationality and Competition.
    15. Rudolf Kerschbamer, 2013. "The Geometry of Distributional Preferences and a Non-Parametric Identification Approach," Working Papers 2013-25, Faculty of Economics and Statistics, Universität Innsbruck.
    16. Thorsten Chmura & Christoph Engel & Markus Englerth & Thomas Pitz, 2010. "At the Mercy of the Prisoner Next Door. Using an Experimental Measure of Selfishness as a Criminological Tool," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2010_27, Max Planck Institute for Research on Collective Goods.
    17. Pamela Jakiela, 2013. "Equity vs. efficiency vs. self-interest: on the use of dictator games to measure distributional preferences," Experimental Economics, Springer;Economic Science Association, vol. 16(2), pages 208-221, June.
    18. Luis José Blas Moreno Garrido, 2015. "Relative Injustice Aversion," Working Papers. Serie AD 2015-08, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    19. Dorian Jullien, 2018. "Under Risk, Over Time, Regarding Other People: Language and Rationality within Three Dimensions," Research in the History of Economic Thought and Methodology, in: Including a Symposium on Latin American Monetary Thought: Two Centuries in Search of Originality, volume 36, pages 119-155, Emerald Group Publishing Limited.
    20. Delavande, Adeline & Zafar, Basit, 2015. "Stereotypes and Madrassas: Experimental evidence from Pakistan," Journal of Economic Behavior & Organization, Elsevier, vol. 118(C), pages 247-267.

    More about this item

    Keywords

    Social preference games; External validity; Field behavior; Measurement error; Aggregation; Day reconstruction method;
    All these keywords.

    JEL classification:

    • C92 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Group Behavior
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:gamebe:v:141:y:2023:i:c:p:261-285. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622836 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.