IDEAS home Printed from https://ideas.repec.org/p/tiu/tiucen/35714555-f654-4522-bcb1-b35ec93c5f4a.html
   My bibliography  Save this paper

Selection and Mode Effects in Risk Preference Elicitation Experiments

Author

Listed:
  • von Gaudecker, H.M.
  • van Soest, A.H.O.

    (Tilburg University, Center For Economic Research)

  • Wengstrom, E.

Abstract

We combine data from a risk preference elicitation experiment conducted on a representative sample via the Internet with laboratory data on students for the same experiment to investigate effects of implementation mode and of subject pool selection. We find that the frequency of errors in the lab experiment ist drastically below that of the representative sample in the Internet experiment, and average risk aversion is also lower. Considering the student-like subsample of the Internet subjects and comparing a tradtitional lab design with an Internet-like design in the lab gives two ways to decompose these differences into differences due to subject pool selection and differences due to implementation mode. Both lead to the conclusion that the differences are due to selection and not implementation mode. An analysis of the various steps leading to participation or non-participation in the Internet survey shows that these processes are selective in selecting subjects who make fewer errors, but do not lead to biased conclusions on risk preferences. These findings point a the usefulness of the Internet survey as an alternative to a student pool in the laboratory if the ambition is to use the experiments to draw inference on a broad population.
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)

(This abstract was borrowed from another version of this item.)

Suggested Citation

  • von Gaudecker, H.M. & van Soest, A.H.O. & Wengstrom, E., 2008. "Selection and Mode Effects in Risk Preference Elicitation Experiments," Discussion Paper 2008-11, Tilburg University, Center for Economic Research.
    • Handle: RePEc:tiu:tiucen:35714555-f654-4522-bcb1-b35ec93c5f4a
    as

    Download full text from publisher

    File URL: https://pure.uvt.nl/ws/portalfiles/portal/942573/2008-11.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Loomes, Graham & Moffatt, Peter G & Sugden, Robert, 2002. "A Microeconometric Test of Alternative Stochastic Theories of Risky Choice," Journal of Risk and Uncertainty, Springer, vol. 24(2), pages 103-130, March.
    2. repec:feb:framed:0074 is not listed on IDEAS
    3. Hans P. Binswanger, 1980. "Attitudes Toward Risk: Experimental Measurement in Rural India," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 62(3), pages 395-407.
    4. Bellemare, Charles & Kroger, Sabine, 2007. "On representative social capital," European Economic Review, Elsevier, vol. 51(1), pages 183-202, January.
    5. Werner Güth & Carsten Schmidt & Matthias Sutter, 2007. "Bargaining outside the lab - a newspaper experiment of a three-person ultimatum game," Economic Journal, Royal Economic Society, vol. 117(518), pages 449-469, March.
    6. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2005. "Individual Risk Attitudes: New Evidence from a Large, Representative, Experimentally-Validated Survey," Discussion Papers of DIW Berlin 511, DIW Berlin, German Institute for Economic Research.
    7. Ernst Fehr & Urs Fischbacher & Bernhard von Rosenbladt & J�rgen Schupp & Gert G. Wagner, "undated". "A Nation-Wide Laboratory: Examining trust and trustworthiness by integrating behavioral experiments into representative surveys," IEW - Working Papers 141, Institute for Empirical Research in Economics - University of Zurich.
    8. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    9. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    10. Glenn W Harrison & John A List & Charles Towe, 2007. "Naturally Occurring Preferences and Exogenous Laboratory Experiments: A Case Study of Risk Aversion," Econometrica, Econometric Society, vol. 75(2), pages 433-458, March.
    11. Ulrich Schmidt & Tibor Neugebauer, 2007. "Testing expected utility in the presence of errors," Economic Journal, Royal Economic Society, vol. 117(518), pages 470-485, March.
    12. John D. Hey, 2018. "Experimental investigations of errors in decision making under risk," World Scientific Book Chapters, in: Experiments in Economics Decision Making and Markets, chapter 17, pages 381-388, World Scientific Publishing Co. Pte. Ltd..
    13. Glenn W. Harrison & John A. List, 2008. "Naturally Occurring Markets and Exogenous Laboratory Experiments: A Case Study of the Winner's Curse," Economic Journal, Royal Economic Society, vol. 118(528), pages 822-843, April.
    14. Brigitte C. Madrian & Dennis F. Shea, 2001. "The Power of Suggestion: Inertia in 401(k) Participation and Savings Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(4), pages 1149-1187.
    15. David Lucking-Reiley, 1999. "Using Field Experiments to Test Equivalence between Auction Formats: Magic on the Internet," American Economic Review, American Economic Association, vol. 89(5), pages 1063-1080, December.
    16. Glenn W. Harrison & Morten I. Lau & Melonie B. Williams, 2002. "Estimating Individual Discount Rates in Denmark: A Field Experiment," American Economic Review, American Economic Association, vol. 92(5), pages 1606-1617, December.
    17. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    18. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    19. Donkers, Bas & Melenberg, Bertrand & Van Soest, Arthur, 2001. "Estimating Risk Attitudes Using Lotteries: A Large Sample Approach," Journal of Risk and Uncertainty, Springer, vol. 22(2), pages 165-195, March.
    20. repec:dgr:kubcen:200347 is not listed on IDEAS
    21. Han Bleichrodt & Jose Luis Pinto & Peter P. Wakker, 2001. "Making Descriptive Use of Prospect Theory to Improve the Prescriptive Use of Expected Utility," Management Science, INFORMS, vol. 47(11), pages 1498-1514, November.
    22. Steffen Andersen & Glenn Harrison & Morten Lau & Elisabet Rutstrom, 2004. "Preference heterogeneity in experiments: Comparing the field and lab," Artefactual Field Experiments 00004, The Field Experiments Website.
    23. Alessie, Rob & Hochguertel, Stefan & van Soest, Arthur, 2006. "Non-take-up of tax-favored savings plans: Evidence from Dutch employees," Journal of Economic Psychology, Elsevier, vol. 27(4), pages 483-501, August.
    24. Bellemare, Charles & Kroger, Sabine, 2007. "On representative social capital," European Economic Review, Elsevier, vol. 51(1), pages 183-202, January.
    25. Kreps, David M & Porteus, Evan L, 1978. "Temporal Resolution of Uncertainty and Dynamic Choice Theory," Econometrica, Econometric Society, vol. 46(1), pages 185-200, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Adam Booij & Bernard Praag & Gijs Kuilen, 2010. "A parametric analysis of prospect theory’s functionals for the general population," Theory and Decision, Springer, vol. 68(1), pages 115-148, February.
    2. Ola Andersson & Håkan J. Holm & Jean-Robert Tyran & Erik Wengström, 2020. "Robust inference in risk elicitation tasks," Journal of Risk and Uncertainty, Springer, vol. 61(3), pages 195-209, December.
    3. Golsteyn, B.H.H. & Grönqvist, H. & Lindahl, L., 2013. "Time preferences and lifetime outcomes," ROA Research Memorandum 019, Maastricht University, Research Centre for Education and the Labour Market (ROA).
    4. Booth, Alison & Cardona-Sosa, Lina & Nolen, Patrick, 2014. "Gender differences in risk aversion: Do single-sex environments affect their development?," Journal of Economic Behavior & Organization, Elsevier, vol. 99(C), pages 126-154.
    5. Steffen Huck & Wieland Müller, 2012. "Allais for all: Revisiting the paradox in a large representative sample," Journal of Risk and Uncertainty, Springer, vol. 44(3), pages 261-293, June.
    6. Hans-Martin von Gaudecker & Arthur van Soest & Erik Wengstrom, 2011. "Heterogeneity in Risky Choice Behavior in a Broad Population," American Economic Review, American Economic Association, vol. 101(2), pages 664-694, April.
    7. Lisa Anderson & Jennifer Mellor, 2009. "Are risk preferences stable? Comparing an experimental measure with a validated survey-based measure," Journal of Risk and Uncertainty, Springer, vol. 39(2), pages 137-160, October.
    8. Hans-Martin Gaudecker & Arthur Soest & Erik Wengström, 2012. "Experts in experiments," Journal of Risk and Uncertainty, Springer, vol. 45(2), pages 159-190, October.
    9. Stefan Zeisberger & Dennis Vrecko & Thomas Langer, 2012. "Measuring the time stability of Prospect Theory preferences," Theory and Decision, Springer, vol. 72(3), pages 359-386, March.
    10. Ola Andersson & Håkan J. Holm & Jean-Robert Tyran & Erik Wengström, 2016. "Risk Aversion Relates To Cognitive Ability: Preferences Or Noise?," Journal of the European Economic Association, European Economic Association, vol. 14(5), pages 1129-1154, October.
    11. Ola Andersson & Håkan J. Holm & Jean-Robert Tyran & Erik Wengström, 2016. "Deciding for Others Reduces Loss Aversion," Management Science, INFORMS, vol. 62(1), pages 29-36, January.
    12. Tyran, Jean-Robert & Andersson, Ola & Holm, Håkan J. & Wengström, Erik, 2013. "Risking Other People?s Money," CEPR Discussion Papers 9743, C.E.P.R. Discussion Papers.
    13. Tamás Csermely & Alexander Rabas, 2016. "How to reveal people’s preferences: Comparing time consistency and predictive power of multiple price list risk elicitation methods," Journal of Risk and Uncertainty, Springer, vol. 53(2), pages 107-136, December.
    14. Andersson, Ola & Tyran, Jean-Robert & Wengström, Erik & Holm, Håkan J., 2013. "Risk Aversion Relates to Cognitive Ability: Fact or Fiction?," Working Paper Series 964, Research Institute of Industrial Economics.
    15. Patrick Bell & Rozlyn Engel & Darren Hudson & Julian Jamison & William Skimmyhorn, 2018. "Risk preferences in future military leaders," Journal of Behavioral Economics for Policy, Society for the Advancement of Behavioral Economics (SABE), vol. 2(2), pages 11-24, September.
    16. Jon Anderson & Stephen Burks & Jeffrey Carpenter & Lorenz Götte & Karsten Maurer & Daniele Nosenzo & Ruth Potter & Kim Rocha & Aldo Rustichini, 2013. "Self-selection and variations in the laboratory measurement of other-regarding preferences across subject pools: evidence from one college student and two adult samples," Experimental Economics, Springer;Economic Science Association, vol. 16(2), pages 170-189, June.
    17. Andersson, Ola & Holm, Håkan J. & Tyran, Jean-Robert & Wengström, Erik, 2013. "Risking Other People’s Money: Experimental Evidence on Bonus Schemes, Competition, and Altruism," Working Paper Series 989, Research Institute of Industrial Economics.
    18. Booij, Adam S. & van de Kuilen, Gijs, 2009. "A parameter-free analysis of the utility of money for the general population under prospect theory," Journal of Economic Psychology, Elsevier, vol. 30(4), pages 651-666, August.
    19. Hans-Martin von Gaudecker & Arthur van Soest & Erik Wengstrom, 2011. "Heterogeneity in Risky Choice Behavior in a Broad Population," American Economic Review, American Economic Association, vol. 101(2), pages 664-694, April.
    20. Csermely, Tamás & Rabas, Alexander, 2014. "How to reveal people's preferences: Comparing time consistency and predictive power of multiple price list risk elicitation methods," Department of Economics Working Paper Series 185, WU Vienna University of Economics and Business.
    21. Chew, Soo Hong & Ebstein, Richard P. & Zhong, Songfa, 2013. "Sex-hormone genes and gender difference in ultimatum game: Experimental evidence from China and Israel," Journal of Economic Behavior & Organization, Elsevier, vol. 90(C), pages 28-42.
    22. Tamás Csermely & Alexander Rabas, 2014. "How to reveal people's preferences: Comparing time consistency and predictive power of multiple price list risk elicitation methods," Department of Economics Working Papers wuwp185, Vienna University of Economics and Business, Department of Economics.
    23. Lionel Page & Daniel G. Goldstein, 2016. "Subjective beliefs about the income distribution and preferences for redistribution," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 47(1), pages 25-61, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hans-Martin Gaudecker & Arthur Soest & Erik Wengström, 2012. "Experts in experiments," Journal of Risk and Uncertainty, Springer, vol. 45(2), pages 159-190, October.
    2. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    3. Booij, Adam S. & van Praag, Bernard M.S., 2009. "A simultaneous approach to the estimation of risk aversion and the subjective time discount rate," Journal of Economic Behavior & Organization, Elsevier, vol. 70(1-2), pages 374-388, May.
    4. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2012. "Opting-In: Participation Biases in the Lab," IZA Discussion Papers 6865, Institute of Labor Economics (IZA).
    5. Dohmen, Thomas, 2014. "Behavioral labor economics: Advances and future directions," Labour Economics, Elsevier, vol. 30(C), pages 71-85.
    6. Hans-Martin von Gaudecker & Arthur van Soest & Erik Wengstrom, 2011. "Heterogeneity in Risky Choice Behavior in a Broad Population," American Economic Review, American Economic Association, vol. 101(2), pages 664-694, April.
    7. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    8. Hakan J. Holm & Sonja Opper & Victor Nee, 2013. "Entrepreneurs Under Uncertainty: An Economic Experiment in China," Management Science, INFORMS, vol. 59(7), pages 1671-1687, July.
    9. Rachel Croson & Uri Gneezy, 2009. "Gender Differences in Preferences," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 448-474, June.
    10. Lex Borghans & Angela Lee Duckworth & James J. Heckman & Bas ter Weel, 2008. "The Economics and Psychology of Personality Traits," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    11. Croson, Rachel & Gächter, Simon, 2010. "The science of experimental economics," Journal of Economic Behavior & Organization, Elsevier, vol. 73(1), pages 122-131, January.
    12. Galizzi, Matteo M. & Machado, Sara R. & Miniaci, Raffaele, 2016. "Temporal stability, cross-validity, and external validity of risk preferences measures: experimental evidence from a UK representative sample," LSE Research Online Documents on Economics 67554, London School of Economics and Political Science, LSE Library.
    13. Naef, Michael & Schupp, Jürgen, 2009. "Measuring Trust: Experiments and Surveys in Contrast and Combination," IZA Discussion Papers 4087, Institute of Labor Economics (IZA).
    14. Bellemare, Charles & Kroger, Sabine, 2007. "On representative social capital," European Economic Review, Elsevier, vol. 51(1), pages 183-202, January.
    15. Tamás Csermely & Alexander Rabas, 2016. "How to reveal people’s preferences: Comparing time consistency and predictive power of multiple price list risk elicitation methods," Journal of Risk and Uncertainty, Springer, vol. 53(2), pages 107-136, December.
    16. Galizzi, Matteo M. & Miraldo, Marisa & Stavropoulou, Charitini & van der Pol, Marjon, 2016. "Doctor–patient differences in risk and time preferences: A field experiment," Journal of Health Economics, Elsevier, vol. 50(C), pages 171-182.
    17. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde, 2010. "Are Risk Aversion and Impatience Related to Cognitive Ability?," American Economic Review, American Economic Association, vol. 100(3), pages 1238-1260, June.
    18. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2013. "Opting-in: Participation bias in economic experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 90(C), pages 43-70.
    19. Holm, Håkan J. & Opper, Sonja & Nee, Victor, 2012. "Entrepreneurs under Uncertainty: An Economic Experiment," Working Papers 2012:4, Lund University, Department of Economics.
    20. Liu, Elaine M. & Huang, JiKun, 2013. "Risk preferences and pesticide use by cotton farmers in China," Journal of Development Economics, Elsevier, vol. 103(C), pages 202-215.

    More about this item

    Keywords

    Risk aversion; Internet surveys; Laboratory experiments;
    All these keywords.

    JEL classification:

    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tiu:tiucen:35714555-f654-4522-bcb1-b35ec93c5f4a. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Richard Broekman (email available below). General contact details of provider: http://center.uvt.nl .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.