IDEAS home Printed from https://ideas.repec.org/p/crs/wpaper/2022-13.html
   My bibliography  Save this paper

Should we trust measures of trust?

Author

Listed:
  • Héloise Cloléry

    (CREST-Ecole polytechnique, IP Paris)

  • Guillaume Hollard

    (CREST-Ecole polytechnique, IP Paris and CNRS)

  • Fabien Perez

    (CREST-Ensae, IP Paris)

  • Inès Picard

    (CREST-Genes, IP Paris)

Abstract

Trust is an important economic variable that may however be subject to measurement error, leading to econometric issues such as attenuation bias or spurious correlations. We use a test/retest protocol to assess the measurement error in the two main tasks that are used to elicit trust, namely survey questions and experimental games. We find that trust measures based on the trust game entail substantial measurement error (with up to 15% of noise), while there is virtually no noise in stated trust measures. Given the specificity of our subject pool (students in a top Engineering school) and the short period of time between the test and the retest, we consider these percentages of noise as lower bounds. We also provide a sub-group analysis based on measures of cognitive ability and effort. We find substantial heterogeneity across sub-groups in trust-game behavior, but none for the survey questions. We finally discuss which measure of trust should be used, and the estimation strategies that can be applied to limit the effect of measurement error.

Suggested Citation

  • Héloise Cloléry & Guillaume Hollard & Fabien Perez & Inès Picard, 2022. "Should we trust measures of trust?," Working Papers 2022-13, Center for Research in Economics and Statistics.
    • Handle: RePEc:crs:wpaper:2022-13
    as

    Download full text from publisher

    File URL: http://crest.science/RePEc/wpstorage/2022-13.pdf
    File Function: CREST working paper version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fabien Perez & Guillaume Hollard & Radu Vranceanu, 2021. "How serious is the measurement-error problem in risk-aversion tasks?," Journal of Risk and Uncertainty, Springer, vol. 63(3), pages 319-342, December.
    2. Zak, Paul J & Knack, Stephen, 2001. "Trust and Growth," Economic Journal, Royal Economic Society, vol. 111(470), pages 295-321, April.
    3. Ernst Fehr & Urs Fischbacher & Bernhard von Rosenbladt & J�rgen Schupp & Gert G. Wagner, "undated". "A Nation-Wide Laboratory: Examining trust and trustworthiness by integrating behavioral experiments into representative surveys," IEW - Working Papers 141, Institute for Empirical Research in Economics - University of Zurich.
    4. Sangnier, Marc, 2013. "Does trust favor macroeconomic stability?," Journal of Comparative Economics, Elsevier, vol. 41(3), pages 653-668.
    5. Yu, Shu & Beugelsdijk, Sjoerd & de Haan, Jakob, 2015. "Trade, trust and the rule of law," European Journal of Political Economy, Elsevier, vol. 37(C), pages 102-115.
    6. Armin Falk & Anke Becker & Thomas Dohmen & David Huffman & Uwe Sunde, 2023. "The Preference Survey Module: A Validated Instrument for Measuring Risk, Time, and Social Preferences," Management Science, INFORMS, vol. 69(4), pages 1935-1950, April.
    7. Thöni, Christian & Tyran, Jean-Robert & Wengström, Erik, 2012. "Microfoundations of social capital," Journal of Public Economics, Elsevier, vol. 96(7-8), pages 635-643.
    8. La Porta, Rafael, et al, 1997. "Trust in Large Organizations," American Economic Review, American Economic Association, vol. 87(2), pages 333-338, May.
    9. Bellemare, Charles & Kroger, Sabine, 2007. "On representative social capital," European Economic Review, Elsevier, vol. 51(1), pages 183-202, January.
    10. Stephen Knack & Philip Keefer, 1997. "Does Social Capital Have an Economic Payoff? A Cross-Country Investigation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(4), pages 1251-1288.
    11. Algan, Yann & Cahuc, Pierre & Sangnier, Marc, 2011. "Efficient and Inefficient Welfare States," IZA Discussion Papers 5445, Institute of Labor Economics (IZA).
    12. Brañas-Garza, Pablo & Kujal, Praveen & Lenkei, Balint, 2019. "Cognitive reflection test: Whom, how, when," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 82(C).
    13. Lisa Anderson & Jennifer Mellor, 2009. "Are risk preferences stable? Comparing an experimental measure with a validated survey-based measure," Journal of Risk and Uncertainty, Springer, vol. 39(2), pages 137-160, October.
    14. Yann Algan & Pierre Cahuc, 2010. "Inherited Trust and Growth," American Economic Review, American Economic Association, vol. 100(5), pages 2060-2092, December.
    15. Ben Gillen & Erik Snowberg & Leeat Yariv, 2019. "Experimenting with Measurement Error: Techniques with Applications to the Caltech Cohort Study," Journal of Political Economy, University of Chicago Press, vol. 127(4), pages 1826-1863.
    16. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    17. Banerjee, Ritwik, 2018. "On the interpretation of World Values Survey trust question - Global expectations vs. local beliefs," European Journal of Political Economy, Elsevier, vol. 55(C), pages 491-510.
    18. J. R. Lockwood & Daniel F. McCaffrey, 2020. "Recommendations about estimating errors-in-variables regression in Stata," Stata Journal, StataCorp LP, vol. 20(1), pages 116-130, March.
    19. Ashraf, Nava & Bohnet, Iris & Piankov, Nikita, 2003. "Is Trust a Bad Investment?," Working Paper Series rwp03-047, Harvard University, John F. Kennedy School of Government.
    20. Billur Aksoy & Haley Harwell & Ada Kovaliukaite & Catherine Eckel, 2018. "Measuring trust: A reinvestigation," Southern Economic Journal, John Wiley & Sons, vol. 84(4), pages 992-1000, April.
    21. Greiner, Ben, 2004. "An Online Recruitment System for Economic Experiments," MPRA Paper 13513, University Library of Munich, Germany.
    22. Johnson, Noel D. & Mislin, Alexandra A., 2011. "Trust games: A meta-analysis," Journal of Economic Psychology, Elsevier, vol. 32(5), pages 865-889.
    23. Yann Algan & Pierre Cahuc & Marc Sangnier, 2016. "Trust and the Welfare State: the Twin Peaks Curve," Economic Journal, Royal Economic Society, vol. 126(593), pages 861-883, June.
    24. Amador-Hidalgo, Luis & Brañas-Garza, Pablo & Espín, Antonio M. & García-Muñoz, Teresa & Hernández-Román, Ana, 2021. "Cognitive abilities and risk-taking: Errors, not preferences," European Economic Review, Elsevier, vol. 134(C).
    25. Nicholas J. Cox, 2008. "Speaking Stata: Correlation with confidence, or Fisher's z revisited," Stata Journal, StataCorp LP, vol. 8(3), pages 413-439, September.
    26. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    27. repec:hal:spmain:info:hdl:2441/432sbils8u9t7qa99cii5psht1 is not listed on IDEAS
    28. Chen, Daniel L. & Schonger, Martin & Wickens, Chris, 2016. "oTree—An open-source platform for laboratory, online, and field experiments," Journal of Behavioral and Experimental Finance, Elsevier, vol. 9(C), pages 88-97.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Martin G. Kocher, 2015. "How Trust in Social Dilemmas Evolves with Age," CESifo Working Paper Series 5447, CESifo.
    2. Thöni, Christian & Tyran, Jean-Robert & Wengström, Erik, 2012. "Microfoundations of social capital," Journal of Public Economics, Elsevier, vol. 96(7-8), pages 635-643.
    3. Kim, Jeongbin & Putterman, Louis & Zhang, Xinyi, 2022. "Trust, Beliefs and Cooperation: Excavating a Foundation of Strong Economies," European Economic Review, Elsevier, vol. 147(C).
    4. Kocher, Martin G. & Martinsson, Peter & Matzat, Dominik & Wollbrant, Conny, 2015. "The role of beliefs, trust, and risk in contributions to a public good," Journal of Economic Psychology, Elsevier, vol. 51(C), pages 236-244.
    5. Sofianos, Andis, 2022. "Self-reported & revealed trust: Experimental evidence," Journal of Economic Psychology, Elsevier, vol. 88(C).
    6. Sangnier, Marc, 2013. "Does trust favor macroeconomic stability?," Journal of Comparative Economics, Elsevier, vol. 41(3), pages 653-668.
    7. Algan, Yann & Cahuc, Pierre, 2014. "Trust, Growth, and Well-Being: New Evidence and Policy Implications," Handbook of Economic Growth, in: Philippe Aghion & Steven Durlauf (ed.), Handbook of Economic Growth, edition 1, volume 2, chapter 2, pages 49-120, Elsevier.
    8. Banerjee, Ritwik, 2018. "On the interpretation of World Values Survey trust question - Global expectations vs. local beliefs," European Journal of Political Economy, Elsevier, vol. 55(C), pages 491-510.
    9. Avtonomov, Y. & Elizarova, E., 2016. "Trust, Expectations and Optimism Bias: an Experimental Study," Journal of the New Economic Association, New Economic Association, vol. 29(1), pages 27-53.
    10. Weber, Martin & Germann, Maximilian & Loos, Benjamin, 2018. "Trust and Delegated Investing: A Money Doctors Experiment," CEPR Discussion Papers 12984, C.E.P.R. Discussion Papers.
    11. Bohdan Kukharskyy & Michael Pflüger, 2011. "Relational Contracts and the Economic Well-Being of Nations," Working Papers 095, Bavarian Graduate Program in Economics (BGPE).
    12. Armin Falk & Anke Becker & Thomas Dohmen & Benjamin Enke & David Huffman & Uwe Sunde, 2018. "Global Evidence on Economic Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(4), pages 1645-1692.
    13. Anger, Silke & Christoph, Bernhard & Galkiewicz, Agata & Margaryan, Shushanik & Peter, Frauke & Sandner, Malte & Siedler, Thomas, 2024. "War, international spillovers, and adolescents: Evidence from Russia's invasion of Ukraine in 2022," Journal of Economic Behavior & Organization, Elsevier, vol. 224(C), pages 181-193.
    14. Houser, Daniel & Schunk, Daniel & Winter, Joachim, 2010. "Distinguishing trust from risk: An anatomy of the investment game," Journal of Economic Behavior & Organization, Elsevier, vol. 74(1-2), pages 72-81, May.
    15. Jalan, Akanksha & Matkovskyy, Roman & Urquhart, Andrew & Yarovaya, Larisa, 2023. "The role of interpersonal trust in cryptocurrency adoption," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 83(C).
    16. Hong, Kessely & Bohnet, Iris, 2007. "Status and distrust: The relevance of inequality and betrayal aversion," Journal of Economic Psychology, Elsevier, vol. 28(2), pages 197-213, April.
    17. Arnstein Aassve & Pierluigi Conzo & Francesco Mattioli, 2021. "Was Banfield right? New insights from a nationwide laboratory experiment," Journal of Regional Science, Wiley Blackwell, vol. 61(5), pages 1029-1064, November.
    18. Ludek Kouba & Hans Pitlik, 2014. "I wanna live my life: Locus of Control and Support for the Welfare State," MENDELU Working Papers in Business and Economics 2014-46, Mendel University in Brno, Faculty of Business and Economics.
    19. Guillermo Alves & Pablo Blanchard & Gabriel Burdin & Mariana Chávez & Andrés Dean, 2019. "The Economic Preferences of Cooperative Managers," Documentos de Trabajo (working papers) 19-08, Instituto de Economía - IECON.
    20. repec:spo:wpmain:info:hdl:2441/3gpul0a2209cuatfpgqv8qt14j is not listed on IDEAS
    21. Joseph Stiglitz & Jean-Paul Fitoussi & Martine Durand, 2018. "For Good Measure," Working Papers hal-03393118, HAL.

    More about this item

    Keywords

    Trust; Trust Game; Measurement Error; ORIV.;
    All these keywords.

    JEL classification:

    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation
    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:crs:wpaper:2022-13. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Secretariat General (email available below). General contact details of provider: https://edirc.repec.org/data/crestfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.