IDEAS home Printed from https://ideas.repec.org/p/diw/diwsop/diw_sp167.html
   My bibliography  Save this paper

Measuring Trust: Experiments and Surveys in Contrast and Combination

Author

Listed:
  • Michael Naef
  • Jürgen Schupp

Abstract

Trust is a concept that has attracted - significant attention in economic theory and research within the last two decades: it has been applied in a number of contexts and has been investigated both as an explanatory and as a dependent variable. In this paper, we explore the questions of what exactly is measured by the diverse survey-derived scales and experiments claiming to measure trust, and how these different measures are related. Using nationally representative data, we test a commonly used experimental measure of trust for robustness to a number of interferences, finding it to be mostly unsusceptible to stake size, the extent of strategy space, the use of the strategy method, and the characteristics of the experimenters. Inspired by criticism of the widespread trust question used in many surveys, we created a new, improved survey trust scale consisting of three short statements. We show that the dimension of this scale is distinct from trust in institutions and trust in known others. Our new scale is a valid and reliable measure of trust in strangers. The scale is valid in the sense that it correlates with trusting behaviour in the experiment. Furthermore, we demonstrate that the test-retest reliability of six weeks is high. The experimental measure of trust is, on the other hand, not significantly correlated with trust in institutions nor with trust in known others. We therefore conclude that the experimental measure of trust refers not to trust in a general sense, but specifically to trust in strangers.

Suggested Citation

  • Michael Naef & Jürgen Schupp, 2009. "Measuring Trust: Experiments and Surveys in Contrast and Combination," SOEPpapers on Multidisciplinary Panel Data Research 167, DIW Berlin, The German Socio-Economic Panel (SOEP).
  • Handle: RePEc:diw:diwsop:diw_sp167
    as

    Download full text from publisher

    File URL: https://www.diw.de/documents/publikationen/73/diw_01.c.96389.de/diw_sp0167.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hoffman, Elizabeth & McCabe, Kevin A & Smith, Vernon L, 1998. "Behavioral Foundations of Reciprocity: Experimental Economics and Evolutionary Psychology," Economic Inquiry, Western Economic Association International, vol. 36(3), pages 335-352, July.
    2. Gachter, Simon & Herrmann, Benedikt & Thoni, Christian, 2004. "Trust, voluntary cooperation, and socio-economic background: survey and experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 55(4), pages 505-531, December.
    3. Ernst Fehr & Urs Fischbacher & Bernhard von Rosenbladt & J�rgen Schupp & Gert G. Wagner, "undated". "A Nation-Wide Laboratory: Examining trust and trustworthiness by integrating behavioral experiments into representative surveys," IEW - Working Papers 141, Institute for Empirical Research in Economics - University of Zurich.
    4. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    5. Ernst Fehr & Michael Naef & Klaus M. Schmidt, 2006. "Inequality Aversion, Efficiency, and Maximin Preferences in Simple Distribution Experiments: Comment," American Economic Review, American Economic Association, vol. 96(5), pages 1912-1917, December.
    6. Guiso, Luigi & Sapienza, Paola & Zingales, Luigi, 2003. "People's opium? Religion and economic attitudes," Journal of Monetary Economics, Elsevier, vol. 50(1), pages 225-282, January.
    7. Edward L. Glaeser & David I. Laibson & José A. Scheinkman & Christine L. Soutter, 2000. "Measuring Trust," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(3), pages 811-846.
      • Glaeser, Edward Ludwig & Laibson, David I. & Scheinkman, Jose A. & Soutter, Christine L., 2000. "Measuring Trust," Scholarly Articles 4481497, Harvard University Department of Economics.
    8. Ernst Fehr & Urs Fischbacher & Elena Tougareva, "undated". "Do High Stakes and Competition Undermine Fairness? Evidence from Russia," IEW - Working Papers 120, Institute for Empirical Research in Economics - University of Zurich.
    9. Falk, Armin & Fischbacher, Urs, 2006. "A theory of reciprocity," Games and Economic Behavior, Elsevier, vol. 54(2), pages 293-315, February.
    10. Sutter, Matthias & Kocher, Martin G., 2007. "Trust and trustworthiness across different age groups," Games and Economic Behavior, Elsevier, vol. 59(2), pages 364-382, May.
    11. Haile, Daniel & Sadrieh, Karim & Verbon, Harrie, 2006. "Cross-racial Envy and Underinvestment in South Africa," 2006 Annual meeting, July 23-26, Long Beach, CA 21269, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    12. Luigi Guiso & Paola Sapienza & Luigi Zingales, 2008. "Trusting the Stock Market," Journal of Finance, American Finance Association, vol. 63(6), pages 2557-2600, December.
    13. Bellemare, Charles & Kroger, Sabine, 2007. "On representative social capital," European Economic Review, Elsevier, vol. 51(1), pages 183-202, January.
    14. Jordi Brandts & Gary Charness, 2000. "Hot vs. Cold: Sequential Responses and Preference Stability in Experimental Games," Experimental Economics, Springer;Economic Science Association, vol. 2(3), pages 227-238, March.
    15. Holm, Håkan & Nystedt, Paul, 2008. "Trust in surveys and games - A methodological contribution on the influence of money and location," Journal of Economic Psychology, Elsevier, vol. 29(4), pages 522-542, August.
    16. Glenn W. Harrison & Morten I. Lau & Melonie B. Williams, 2002. "Estimating Individual Discount Rates in Denmark: A Field Experiment," American Economic Review, American Economic Association, vol. 92(5), pages 1606-1617, December.
    17. Todd L. Cherry & Peter Frykblom & Jason F. Shogren, 2002. "Hardnose the Dictator," American Economic Review, American Economic Association, vol. 92(4), pages 1218-1221, September.
    18. Guth, Werner & Huck, Steffen & Muller, Wieland, 2001. "The Relevance of Equal Splits in Ultimatum Games," Games and Economic Behavior, Elsevier, vol. 37(1), pages 161-169, October.
    19. Vyrastekova, J. & Garikipati, S., 2005. "Beliefs and Trust : An Experiment," Discussion Paper 2005-88, Tilburg University, Center for Economic Research.
    20. Schotter Andrew & Weigelt Keith & Wilson Charles, 1994. "A Laboratory Investigation of Multiperson Rationality and Presentation Effects," Games and Economic Behavior, Elsevier, vol. 6(3), pages 445-468, May.
    21. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
    22. Bertrand Munier & Costin Zaharia, 2002. "High Stakes and Acceptance Behavior in Ultimatum Bargaining:," Theory and Decision, Springer, vol. 53(3), pages 187-207, November.
    23. Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2007. "Estimating Risk Attitudes in Denmark: A Field Experiment," Scandinavian Journal of Economics, Wiley Blackwell, vol. 109(2), pages 341-368, June.
    24. Johansson-Stenman, Olof & Mahmud, Minhaj & Martinsson, Peter, 2013. "Trust, trust games and stated trust: Evidence from rural Bangladesh," Journal of Economic Behavior & Organization, Elsevier, vol. 95(C), pages 286-298.
    25. Alesina, Alberto & La Ferrara, Eliana, 2002. "Who trusts others?," Journal of Public Economics, Elsevier, vol. 85(2), pages 207-234, August.
    26. Rainer, Helmut & Siedler, Thomas, 2009. "Does democracy foster trust?," Journal of Comparative Economics, Elsevier, vol. 37(2), pages 251-269, June.
    27. John Ermisch & Diego Gambetta & Heather Laurie & Thomas Siedler & S. C. Noah Uhrig, 2009. "Measuring people's trust," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(4), pages 749-769, October.
    28. List, John A. & Cherry, Todd L., 2008. "Examining the role of fairness in high stakes allocation decisions," Journal of Economic Behavior & Organization, Elsevier, vol. 65(1), pages 1-8, January.
    29. Ashraf, Nava & Bohnet, Iris & Piankov, Nikita, 2003. "Is Trust a Bad Investment?," Working Paper Series rwp03-047, Harvard University, John F. Kennedy School of Government.
    30. Jeffrey Carpenter & Cristina Connolly & Caitlin Myers, 2008. "Altruistic behavior in a representative dictator experiment," Experimental Economics, Springer;Economic Science Association, vol. 11(3), pages 282-298, September.
    31. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2005. "Individual Risk Attitudes: New Evidence from a Large, Representative, Experimentally-Validated Survey," Discussion Papers of DIW Berlin 511, DIW Berlin, German Institute for Economic Research.
    32. Luigi Guiso & Paola Sapienza & Luigi Zingales, 2006. "Does Culture Affect Economic Outcomes?," Journal of Economic Perspectives, American Economic Association, vol. 20(2), pages 23-48, Spring.
    33. Dirk Engelmann & Martin Strobel, 2006. "Inequality Aversion, Efficiency, and Maximin Preferences in Simple Distribution Experiments: Reply," American Economic Review, American Economic Association, vol. 96(5), pages 1918-1923, December.
    34. Johansson-Stenman, Olof & Mahmud, Minhaj & Martinsson, Peter, 2005. "Does stake size matter in trust games?," Economics Letters, Elsevier, vol. 88(3), pages 365-369, September.
    35. Cameron, Lisa A, 1999. "Raising the Stakes in the Ultimatum Game: Experimental Evidence from Indonesia," Economic Inquiry, Western Economic Association International, vol. 37(1), pages 47-59, January.
    36. Hoffman, Elizabeth & McCabe, Kevin A & Smith, Vernon L, 1996. "On Expectations and the Monetary Stakes in Ultimatum Games," International Journal of Game Theory, Springer;Game Theory Society, vol. 25(3), pages 289-301.
    37. Daniel Haile & Abdolkarim Sadrieh & Harrie A. A. Verbon, 2008. "Cross-racial envy and underinvestment in South African partnerships," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 32(5), pages 703-724, September.
    38. Martin Spieß & Martin Kroh, 2008. "Documentation of Sample Sizes and Panel Attrition in the German Socio Economic Panel (SOEP) (1984 until 2006)," Data Documentation 27, DIW Berlin, German Institute for Economic Research.
    39. Niels Winkler & Martin Kroh & Martin Spieß, 2006. "Entwicklung einer deutschen Kurzskala zur zweidimensionalen Messung von sozialer Erwünschtheit," Discussion Papers of DIW Berlin 579, DIW Berlin, German Institute for Economic Research.
    40. Carpenter, Jeffrey & Verhoogen, Eric & Burks, Stephen, 2005. "The effect of stakes in distribution experiments," Economics Letters, Elsevier, vol. 86(3), pages 393-398, March.
    41. Forsythe Robert & Horowitz Joel L. & Savin N. E. & Sefton Martin, 1994. "Fairness in Simple Bargaining Experiments," Games and Economic Behavior, Elsevier, vol. 6(3), pages 347-369, May.
    42. Gert G. Wagner & Joachim R. Frick & Jürgen Schupp, 2007. "The German Socio-Economic Panel Study (SOEP) – Scope, Evolution and Enhancements," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 127(1), pages 139-169.
    43. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    44. Tim Reeskens & Marc Hooghe, 2008. "Cross-cultural measurement equivalence of generalized trust. Evidence from the European Social Survey (2002 and 2004)," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 85(3), pages 515-532, February.
    45. Robert Slonim & Alvin E. Roth, 1998. "Learning in High Stakes Ultimatum Games: An Experiment in the Slovak Republic," Econometrica, Econometric Society, vol. 66(3), pages 569-596, May.
    46. Berg Joyce & Dickhaut John & McCabe Kevin, 1995. "Trust, Reciprocity, and Social History," Games and Economic Behavior, Elsevier, vol. 10(1), pages 122-142, July.
    47. Jeannette Brosig & Joachim Weimann & Chun-Lei Yang, 2003. "The Hot Versus Cold Effect in a Simple Bargaining Experiment," Experimental Economics, Springer;Economic Science Association, vol. 6(1), pages 75-90, June.
    48. Martin Kroh & Martin Spieß, 2008. "Documentation of Sample Sizes and Panel Attrition in the German Socio Economic Panel (SOEP) (1984 until 2007)," Data Documentation 39, DIW Berlin, German Institute for Economic Research.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    2. Emin Karagözoğlu & Ümit Barış Urhan, 2017. "The Effect of Stake Size in Experimental Bargaining and Distribution Games: A Survey," Group Decision and Negotiation, Springer, vol. 26(2), pages 285-325, March.
    3. Martijn J. van den Assem & Dennie van Dolder & Richard H. Thaler, 2012. "Split or Steal? Cooperative Behavior When the Stakes Are Large," Management Science, INFORMS, vol. 58(1), pages 2-20, January.
    4. Barmettler, Franziska & Fehr, Ernst & Zehnder, Christian, 2012. "Big experimenter is watching you! Anonymity and prosocial behavior in the laboratory," Games and Economic Behavior, Elsevier, vol. 75(1), pages 17-34.
    5. Martin G. Kocher, 2015. "How Trust in Social Dilemmas Evolves with Age," CESifo Working Paper Series 5447, CESifo.
    6. Johnson, Noel D. & Mislin, Alexandra A., 2011. "Trust games: A meta-analysis," Journal of Economic Psychology, Elsevier, vol. 32(5), pages 865-889.
    7. Murnighan, J. Keith & Wang, Long, 2016. "The social world as an experimental game," Organizational Behavior and Human Decision Processes, Elsevier, vol. 136(C), pages 80-94.
    8. Larney, Andrea & Rotella, Amanda & Barclay, Pat, 2019. "Stake size effects in ultimatum game and dictator game offers: A meta-analysis," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 61-72.
    9. Julie Novakova & Jaroslav Flegr, 2013. "How Much Is Our Fairness Worth? The Effect of Raising Stakes on Offers by Proposers and Minimum Acceptable Offers in Dictator and Ultimatum Games," PLOS ONE, Public Library of Science, vol. 8(4), pages 1-9, April.
    10. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    11. Tamás Kovács & Marc Willinger, 2010. "Is there a relation between trust and trustworthiness?," Working Papers 10-03, LAMETA, Universtiy of Montpellier, revised Mar 2010.
    12. Fehr, Ernst & Schmidt, Klaus M., 2005. "The Economics of Fairness, Reciprocity and Altruism – Experimental Evidence and New Theories," Discussion Paper Series of SFB/TR 15 Governance and the Efficiency of Economic Systems 66, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich.
    13. Johansson-Stenman, Olof & Mahmud, Minhaj & Martinsson, Peter, 2005. "Does stake size matter in trust games?," Economics Letters, Elsevier, vol. 88(3), pages 365-369, September.
    14. Sun-Ki Chai & Dolgorsuren Dorj & Katerina Sherstyuk, 2018. "Cultural Values and Behavior in Dictator, Ultimatum, and Trust Games: An Experimental Study," Research in Experimental Economics, in: Experimental Economics and Culture, volume 20, pages 89-166, Emerald Group Publishing Limited.
    15. Bellemare, Charles & Kroger, Sabine, 2007. "On representative social capital," European Economic Review, Elsevier, vol. 51(1), pages 183-202, January.
    16. Güth, Werner & Kocher, Martin G., 2014. "More than thirty years of ultimatum bargaining experiments: Motives, variations, and a survey of the recent literature," Journal of Economic Behavior & Organization, Elsevier, vol. 108(C), pages 396-409.
    17. Sutter, Matthias & Kocher, Martin G., 2007. "Trust and trustworthiness across different age groups," Games and Economic Behavior, Elsevier, vol. 59(2), pages 364-382, May.
    18. Greiner, Ben & Ockenfels, Axel & Werner, Peter, 2012. "The dynamic interplay of inequality and trust—An experimental study," Journal of Economic Behavior & Organization, Elsevier, vol. 81(2), pages 355-365.
    19. Ashraf, Nava & Bohnet, Iris & Piankov, Nikita, 2003. "Is Trust a Bad Investment?," Working Paper Series rwp03-047, Harvard University, John F. Kennedy School of Government.
    20. Grund Christian & Harbring Christine, 2013. "Trust and Control at the Workplace: Evidence from Representative Samples of Employees in Europe," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 233(5-6), pages 619-637, October.

    More about this item

    Keywords

    Trust; experiment; survey; representativity; SOEP;
    All these keywords.

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D63 - Microeconomics - - Welfare Economics - - - Equity, Justice, Inequality, and Other Normative Criteria and Measurement
    • Z13 - Other Special Topics - - Cultural Economics - - - Economic Sociology; Economic Anthropology; Language; Social and Economic Stratification

    NEP fields

    This paper has been announced in the following NEP Reports:

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. SOEP based publications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:diw:diwsop:diw_sp167. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Bibliothek (email available below). General contact details of provider: https://edirc.repec.org/data/sodiwde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.