IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp14526.html
   My bibliography  Save this paper

Limited Self-Knowledge and Survey Response Behavior

Author

Listed:
  • Falk, Armin

    (University of Bonn)

  • Neuber, Thomas

    (affiliation not available)

  • Strack, Philipp

Abstract

We study response behavior in surveys and show how the explanatory power of self-reports can be improved. First, we develop a choice model of survey response behavior under the assumption that the respondent has imperfect self-knowledge about her individual characteristics. In panel data, the model predicts that the variance in responses for different characteristics increases in self-knowledge and that the variance for a given characteristic over time is non-monotonic in self-knowledge. Importantly, the ratio of these variances identifies an individual's level of self-knowledge, i.e., the latter can be inferred from observed response patterns. Second, we develop a consistent and unbiased estimator for self-knowledge based on the model. Third, we run an experiment to test the model's main predictions in a context where the researcher knows the true underlying characteristics. The data confirm the model's predictions as well as the estimator's validity. Finally, we turn to a large panel data set, estimate individual levels of self-knowledge, and show that accounting for differences in self-knowledge significantly increases the explanatory power of regression models. Using a median split in self-knowledge and regressing risky behaviors on self-reported risk attitudes, we find that the R2 can be multiple times larger for above- than below-median subjects. Similarly, gender differences in risk attitudes are considerably larger when restricting samples to subjects with high self-knowledge. These examples illustrate how using the estimator may improve inference from survey data.

Suggested Citation

  • Falk, Armin & Neuber, Thomas & Strack, Philipp, 2021. "Limited Self-Knowledge and Survey Response Behavior," IZA Discussion Papers 14526, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp14526
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp14526.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ulrike Malmendier & Geoffrey Tate, 2005. "CEO Overconfidence and Corporate Investment," Journal of Finance, American Finance Association, vol. 60(6), pages 2661-2700, December.
    2. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    3. Filip Matêjka & Alisdair McKay, 2015. "Rational Inattention to Discrete Choices: A New Foundation for the Multinomial Logit Model," American Economic Review, American Economic Association, vol. 105(1), pages 272-298, January.
    4. Heckman, James J. & Kautz, Tim, 2012. "Hard evidence on soft skills," Labour Economics, Elsevier, vol. 19(4), pages 451-464.
    5. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    6. Yuanyuan Chen & Shuaizhang Feng & James J. Heckman & Tim Kautz, 2020. "Sensitivity of self-reported noncognitive skills to survey administration conditions," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(2), pages 931-935, January.
    7. Thomas Dohmen & Armin Falk, 2011. "Performance Pay and Multidimensional Sorting: Productivity, Preferences, and Gender," American Economic Review, American Economic Association, vol. 101(2), pages 556-590, April.
    8. James J. Heckman & Jora Stixrud & Sergio Urzua, 2006. "The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 411-482, July.
    9. Muriel Niederle & Lise Vesterlund, 2007. "Do Women Shy Away From Competition? Do Men Compete Too Much?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1067-1101.
    10. Sutter, Matthias & Kocher, Martin G., 2007. "Trust and trustworthiness across different age groups," Games and Economic Behavior, Elsevier, vol. 59(2), pages 364-382, May.
    11. Fabian Kosse & Thomas Deckers & Pia Pinger & Hannah Schildberg-Hörisch & Armin Falk, 2020. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," Journal of Political Economy, University of Chicago Press, vol. 128(2), pages 434-467.
    12. Hyslop, Dean R & Imbens, Guido W, 2001. "Bias from Classical and Other Forms of Measurement Error," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 475-481, October.
    13. Almlund, Mathilde & Duckworth, Angela Lee & Heckman, James & Kautz, Tim, 2011. "Personality Psychology and Economics," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 4, chapter 0, pages 1-181, Elsevier.
    14. Andrew Caplin & Mark Dean, 2015. "Revealed Preference, Rational Inattention, and Costly Information Acquisition," American Economic Review, American Economic Association, vol. 105(7), pages 2183-2203, July.
    15. Jonathan P. Beauchamp & David Cesarini & Magnus Johannesson, 2017. "The psychometric and empirical properties of measures of risk preferences," Journal of Risk and Uncertainty, Springer, vol. 54(3), pages 203-237, June.
    16. Ben Gillen & Erik Snowberg & Leeat Yariv, 2019. "Experimenting with Measurement Error: Techniques with Applications to the Caltech Cohort Study," Journal of Political Economy, University of Chicago Press, vol. 127(4), pages 1826-1863.
    17. J.J. Heckman & E.E. Leamer (ed.), 2001. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 5, number 5.
    18. Goebel Jan & Grabka Markus M. & Liebig Stefan & Kroh Martin & Richter David & Schröder Carsten & Schupp Jürgen, 2019. "The German Socio-Economic Panel (SOEP)," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 239(2), pages 345-360, April.
    19. Jonathan P. Beauchamp & Daniel J. Benjamin & David I. Laibson & Christopher F. Chabris, 2020. "Measuring and controlling for the compromise effect when estimating risk preference parameters," Experimental Economics, Springer;Economic Science Association, vol. 23(4), pages 1069-1099, December.
    20. Drerup, Tilman & Enke, Benjamin & von Gaudecker, Hans-Martin, 2017. "The precision of subjective data and the explanatory power of economic models," Journal of Econometrics, Elsevier, vol. 200(2), pages 378-389.
    21. Armin Falk & Florian Zimmermann, 2013. "A Taste for Consistency and Survey Response Behavior," CESifo Economic Studies, CESifo Group, vol. 59(1), pages 181-193, March.
    22. Alan, Sule & Baydar, Nazli & Boneva, Teodora & Crossley, Thomas F. & Ertac, Seda, 2017. "Transmission of risk preferences from mothers to daughters," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 60-77.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mikhalishchev, Sergei, 2023. "Optimal menu when agents make mistakes," Research in Economics, Elsevier, vol. 77(1), pages 25-33.
    2. Jose Apesteguia & Miguel A. Ballester, 2023. "The rationalizability of survey responses," Economics Working Papers 1863, Department of Economics and Business, Universitat Pompeu Fabra.
    3. Jose Apesteguia & Miguel Ángel Ballester, 2023. "The Rationalizability of Survey Responses," Working Papers 1393, Barcelona School of Economics.
    4. Michelle Acampora & Francesco Capozza & Vahid Moghani, 2022. "Mental Health Literacy, Beliefs and Demand for Mental Health Support among University Students," Tinbergen Institute Discussion Papers 22-079/I, Tinbergen Institute.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Boneva, Teodora & Buser, Thomas & Falk, Armin & Kosse, Fabian, 2021. "The Origins of Gender Differences in Competitiveness and Earnings Expectations: Causal Evidence from a Mentoring Intervention," Rationality and Competition Discussion Paper Series 295, CRC TRR 190 Rationality and Competition.
    2. Breitkopf, Laura & Chowdhury, Shyamal K. & Priyam, Shambhavi & Schildberg-Hörisch, Hannah & Sutter, Matthias, 2020. "Do economic preferences of children predict behavior?," DICE Discussion Papers 342, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    3. Thomas Buser & Muriel Niederle & Hessel Oosterbeek, 2020. "Can competitiveness predict education and labor market outcomes? Evidence from incentivized choice and survey measures," Tinbergen Institute Discussion Papers 20-048/I, Tinbergen Institute.
    4. Zimmermann, Klaus F. & Chowdhury, Shyamal & Sutter, Matthias, 2020. "Economic preferences across generations and family clusters: A large-scale experiment," CEPR Discussion Papers 14998, C.E.P.R. Discussion Papers.
    5. Etienne Dagorn & David Masclet & Thierry Penard, 2022. "The Behavioral Determinants of School Achievement: A Lab in the Field Experiment in Middle School," Economics Working Paper Archive (University of Rennes & University of Caen) 2022-05, Center for Research in Economics and Management (CREM), University of Rennes, University of Caen and CNRS.
    6. Dasgupta, Utteeyo & Mani, Subha & Sharma, Smriti & Singhal, Saurabh, 2017. "Cognitive, Socioemotional and Behavioral Returns to College Quality," IZA Discussion Papers 10701, Institute of Labor Economics (IZA).
    7. Dohmen, Thomas, 2014. "Behavioral labor economics: Advances and future directions," Labour Economics, Elsevier, vol. 30(C), pages 71-85.
    8. Dasgupta, Utteeyo & Mani, Subha & Sharma, Smriti & Singhal, Saurabh, 2017. "Cognitive, Socioemotional and Behavioral Returns to College Quality," IZA Discussion Papers 10701, Institute of Labor Economics (IZA).
    9. Horn, Dániel & Kiss, Hubert János & Lénárd, Tünde, 2022. "Gender differences in preferences of adolescents: Evidence from a large-scale classroom experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 194(C), pages 478-522.
    10. John A. List & Ragan Petrie & Anya Samek, 2023. "How Experiments with Children Inform Economics," Journal of Economic Literature, American Economic Association, vol. 61(2), pages 504-564, June.
    11. Sutter, Matthias & Zoller, Claudia & Glätzle-Rützler, Daniela, 2019. "Economic behavior of children and adolescents – A first survey of experimental economics results," European Economic Review, Elsevier, vol. 111(C), pages 98-121.
    12. Leonora Risse & Lisa Farrell & Tim R L Fry, 2018. "Personality and pay: do gender gaps in confidence explain gender gaps in wages?," Oxford Economic Papers, Oxford University Press, vol. 70(4), pages 919-949.
    13. Salamanca, Nicolás & de Grip, Andries & Fouarge, Didier & Montizaan, Raymond, 2020. "Locus of control and investment in risky assets," Journal of Economic Behavior & Organization, Elsevier, vol. 177(C), pages 548-568.
    14. Heckman, James J. & Jagelka, Tomáš & Kautz, Tim, 2019. "Some Contributions of Economics to the Study of Personality," IZA Discussion Papers 12753, Institute of Labor Economics (IZA).
    15. Max Deter, 2020. "Prosociality and Risk Preferences in the Financial Sector," SOEPpapers on Multidisciplinary Panel Data Research 1075, DIW Berlin, The German Socio-Economic Panel (SOEP).
    16. Breitkopf, Laura & Chowdhury, Shyamal & Priyam, Shambhavi & Schildberg-Hörisch, Hannah & Sutter, Matthias, 2024. "Do Economic Preferences of Children Predict Behavior?," IZA Discussion Papers 16834, Institute of Labor Economics (IZA).
    17. Laura Breitkopf & Shyamal Chowdhury & Shambhavi Priyam & Hannah Schildberg-Hörisch & Matthias Sutter, 2024. "Do economic preferences of children predict behavior?," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2024_09, Max Planck Institute for Research on Collective Goods.
    18. Hvidman, Charlotte & Koch, Alexander K. & Nafziger, Julia & Nielsen, Søren Albeck & Rosholm, Michael, 2024. "An intensive, school-based learning camp targeting academic and non-cognitive skills evaluated in a randomized trial," Labour Economics, Elsevier, vol. 88(C).
    19. Kautz, Tim & Heckman, James J. & Diris, Ron & ter Weel, Bas & Borghans, Lex, 2014. "Fostering and Measuring Skills: Improving Cognitive and Non-Cognitive Skills to Promote Lifetime Success," IZA Discussion Papers 8696, Institute of Labor Economics (IZA).
    20. Falk, Armin & Kosse, Fabian & Schildberg-Hörisch, Hannah & Zimmermann, Florian, 2023. "Self-assessment: The role of the social environment," Journal of Public Economics, Elsevier, vol. 223(C).

    More about this item

    Keywords

    survey research; rational inattention; lab experiment; non-cognitive skills; preferences;
    All these keywords.

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp14526. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.