IDEAS home Printed from https://ideas.repec.org/a/tpr/restat/v102y2020i3p552-568.html
   My bibliography  Save this article

Risk Attitudes, Sample Selection, and Attrition in a Longitudinal Field Experiment

Author

Listed:
  • Glenn W. Harrison

    (Georgia State University)

  • Morten I. Lau

    (Copenhagen Business School and Durham University Business School, Durham University)

  • Hong Il Yoo

    (Durham University Business School, Durham University)

Abstract

We evaluate the temporal stability of risk preferences using a remarkable data set that combines sociodemographic information from the Danish Civil Registry with information on risk attitudes from a longitudinal field experiment. Our econometric model accounts for endogenous sample selection and attrition processes that may confound inferences about temporal stability. Our experimental design builds in randomization on the incentives for participation that facilitates empirical identification of the model. In general, we find evidence consistent with temporal stability after correcting for the effects of selection and attrition. When neglected, these effects change our inferences in an economically and statistically significant manner.

Suggested Citation

  • Glenn W. Harrison & Morten I. Lau & Hong Il Yoo, 2020. "Risk Attitudes, Sample Selection, and Attrition in a Longitudinal Field Experiment," The Review of Economics and Statistics, MIT Press, vol. 102(3), pages 552-568, July.
    • Handle: RePEc:tpr:restat:v:102:y:2020:i:3:p:552-568
    as

    Download full text from publisher

    File URL: http://www.mitpressjournals.org/doi/pdf/10.1162/rest_a_00845
    Download Restriction: Access to PDF is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Astrid Grasdal, 2001. "The performance of sample selection estimators to control for attrition bias," Health Economics, John Wiley & Sons, Ltd., vol. 10(5), pages 385-398, July.
    2. Hausman, Jerry A & Wise, David A, 1979. "Attrition Bias in Experimental and Panel Data: The Gary Income Maintenance Experiment," Econometrica, Econometric Society, vol. 47(2), pages 455-473, March.
    3. Jose Apesteguia & Miguel A. Ballester, 2018. "Monotone Stochastic Choice Models: The Case of Risk and Time Preferences," Journal of Political Economy, University of Chicago Press, vol. 126(1), pages 74-106.
    4. Luc Behaghel & Bruno Crépon & Marc Gurgand & Thomas Le Barbanchon, 2009. "Sample attrition bias in randomized experiments: A tale of two surveys," Working Papers halshs-00566836, HAL.
    5. Meng, Chun-Lo & Schmidt, Peter, 1985. "On the Cost of Partial Observability in the Bivariate Probit Model," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 26(1), pages 71-85, February.
    6. Dasgupta, Utteeyo & Gangadharan, Lata & Maitra, Pushkar & Mani, Subha, 2017. "Searching for preference stability in a state dependent world," Journal of Economic Psychology, Elsevier, vol. 62(C), pages 17-32.
    7. Andersen, Steffen & Harrison, Glenn W. & Lau, Morten I. & Rutström, E. Elisabet, 2014. "Discounting behavior: A reconsideration," European Economic Review, Elsevier, vol. 71(C), pages 15-33.
    8. James J. Heckman, 1976. "The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 4, pages 475-492, National Bureau of Economic Research, Inc.
    9. Glenn W. Harrison, 2013. "Field experiments and methodological intolerance," Journal of Economic Methodology, Taylor & Francis Journals, vol. 20(2), pages 103-117, June.
    10. Lorenzo Cappellari & Stephen P. Jenkins, 2004. "Modelling low income transitions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 19(5), pages 593-610.
    11. Glenn W. Harrison & Morten I. Lau & Melonie B. Williams, 2002. "Estimating Individual Discount Rates in Denmark: A Field Experiment," American Economic Review, American Economic Association, vol. 92(5), pages 1606-1617, December.
    12. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    13. Quang Nguyen & Colin Camerer & Tomomi Tanaka, 2010. "Risk and Time Preferences Linking Experimental and Household Data from Vietnam," Post-Print halshs-00547090, HAL.
    14. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2012. "Opting-In: Participation Biases in the Lab," IZA Discussion Papers 6865, Institute of Labor Economics (IZA).
    15. Van de Ven, Wynand P. M. M. & Van Praag, Bernard M. S., 1981. "The demand for deductibles in private health insurance : A probit model with sample selection," Journal of Econometrics, Elsevier, vol. 17(2), pages 229-252, November.
    16. Glenn W. Harrison & Jia Min Ng, 2016. "Evaluating The Expected Welfare Gain From Insurance," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 83(1), pages 91-120, January.
    17. Jens Ludwig & Greg J. Duncan & Lisa A. Gennetian & Lawrence F. Katz & Ronald C. Kessler & Jeffrey R. Kling & Lisa Sanbonmatsu, 2013. "Long-Term Neighborhood Effects on Low-Income Families: Evidence from Moving to Opportunity," American Economic Review, American Economic Association, vol. 103(3), pages 226-231, May.
    18. Philipson, Tomas, 2001. "Data Markets, Missing Data, and Incentive Pay," Econometrica, Econometric Society, vol. 69(4), pages 1099-1111, July.
    19. Drazen Prelec, 1998. "The Probability Weighting Function," Econometrica, Econometric Society, vol. 66(3), pages 497-528, May.
    20. Harrison, Glenn W. & Lau, Morten I. & Elisabet Rutström, E., 2009. "Risk attitudes, randomization to treatment, and self-selection into experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 498-507, June.
    21. Tversky, Amos & Kahneman, Daniel, 1992. "Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
    22. Lee, Lung-fei, 1995. "Semiparametric maximum likelihood estimation of polychotomous and sequential choice models," Journal of Econometrics, Elsevier, vol. 65(2), pages 381-428, February.
    23. John D. Hey & Chris Orme, 2018. "Investigating Generalizations Of Expected Utility Theory Using Experimental Data," World Scientific Book Chapters, in: Experiments in Economics Decision Making and Markets, chapter 3, pages 63-98, World Scientific Publishing Co. Pte. Ltd..
    24. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    25. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
    26. Keane, Michael P, 1992. "A Note on Identification in the Multinomial Probit Model," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(2), pages 193-200, April.
    27. Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2007. "Estimating Risk Attitudes in Denmark: A Field Experiment," Scandinavian Journal of Economics, Wiley Blackwell, vol. 109(2), pages 341-368, June.
    28. Blair Cleave & Nikos Nikiforakis & Robert Slonim, 2013. "Is there selection bias in laboratory experiments? The case of social and risk preferences," Experimental Economics, Springer;Economic Science Association, vol. 16(3), pages 372-382, September.
    29. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, April.
    30. Wilcox, Nathaniel T., 2011. "'Stochastically more risk averse:' A contextual theory of stochastic discrete choice under risk," Journal of Econometrics, Elsevier, vol. 162(1), pages 89-104, May.
    31. Glenn W. Harrison, 2011. "Randomisation and Its Discontents," Journal of African Economies, Centre for the Study of African Economies, vol. 20(4), pages 626-652, August.
    32. repec:feb:artefa:00073 is not listed on IDEAS
    33. Steffen Andersen & Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2018. "Multiattribute Utility Theory, Intertemporal Utility, And Correlation Aversion," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 59(2), pages 537-555, May.
    34. Francis Vella, 1998. "Estimating Models with Sample Selection Bias: A Survey," Journal of Human Resources, University of Wisconsin Press, vol. 33(1), pages 127-169.
    35. Quiggin, John, 1982. "A theory of anticipated utility," Journal of Economic Behavior & Organization, Elsevier, vol. 3(4), pages 323-343, December.
    36. Catherine Eckel & Philip Grossman, 2000. "Volunteers and Pseudo-Volunteers: The Effect of Recruitment Method in Dictator Experiments," Experimental Economics, Springer;Economic Science Association, vol. 3(2), pages 107-120, October.
    37. Tomomi Tanaka & Colin F. Camerer & Quang Nguyen, 2010. "Risk and Time Preferences: Linking Experimental and Household Survey Data from Vietnam," American Economic Review, American Economic Association, vol. 100(1), pages 557-571, March.
    38. Tomas Philipson, 1997. "Data Markets and the Production of Surveys," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(1), pages 47-72.
    39. Manel Baucells & Antonio Villasís, 2010. "Stability of risk preferences and the reflection effect of prospect theory," Theory and Decision, Springer, vol. 68(1), pages 193-211, February.
    40. Steffen Andersen & Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2008. "Lost In State Space: Are Preferences Stable?," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 49(3), pages 1091-1112, August.
    41. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    42. Ale Smidts, 1997. "The Relationship Between Risk Attitude and Strength of Preference: A Test of Intrinsic Risk Attitude," Management Science, INFORMS, vol. 43(3), pages 357-370, March.
    43. Walter Kickert, 2013. "How the Danish government responded to financial crises," Public Money & Management, Taylor & Francis Journals, vol. 33(1), pages 55-62, January.
    44. Robert Picard, 2010. "GEODIST: Stata module to compute geographical distances," Statistical Software Components S457147, Boston College Department of Economics, revised 24 Jun 2019.
    45. James Heckman & Jeffrey Smith & Christopher Taber, 1998. "Accounting For Dropouts In Evaluations Of Social Programs," The Review of Economics and Statistics, MIT Press, vol. 80(1), pages 1-14, February.
    46. Chris Starmer, 2000. "Developments in Non-expected Utility Theory: The Hunt for a Descriptive Theory of Choice under Risk," Journal of Economic Literature, American Economic Association, vol. 38(2), pages 332-382, June.
    47. Steffen Andersen & Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2013. "Discounting Behaviour and the Magnitude Effect: Evidence from a Field Experiment in Denmark," Economica, London School of Economics and Political Science, vol. 80(320), pages 670-697, October.
    48. Daniel G. Goldstein & Eric J. Johnson & William F. Sharpe, 2008. "Choosing Outcomes versus Choosing Products: Consumer-Focused Retirement Investment Advice," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 35(3), pages 440-456, August.
    49. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2013. "Opting-in: Participation bias in economic experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 90(C), pages 43-70.
    50. Glenn W. Harrison & Don Ross, 2018. "Varieties of paternalism and the heterogeneity of utility structures," Journal of Economic Methodology, Taylor & Francis Journals, vol. 25(1), pages 42-67, January.
    51. Stefan Zeisberger & Dennis Vrecko & Thomas Langer, 2012. "Measuring the time stability of Prospect Theory preferences," Theory and Decision, Springer, vol. 72(3), pages 359-386, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Glenn W. Harrison & Andre Hofmeyr & Harold Kincaid & Brian Monroe & Don Ross & Mark Schneider & J. Todd Swarthout, 2022. "Subjective beliefs and economic preferences during the COVID-19 pandemic," Experimental Economics, Springer;Economic Science Association, vol. 25(3), pages 795-823, June.
    2. Armando N. Meier, 2021. "Emotions and Risk Attitudes," SOEPpapers on Multidisciplinary Panel Data Research 1118, DIW Berlin, The German Socio-Economic Panel (SOEP).
    3. Glenn W. Harrison, 2024. "Risk preferences and risk perceptions in insurance experiments: some methodological challenges," The Geneva Risk and Insurance Review, Palgrave Macmillan;International Association for the Study of Insurance Economics (The Geneva Association), vol. 49(1), pages 127-161, March.
    4. Mika Akesaka & Peter Eibich & Chie Hanaoka & Hitoshi Shigeoka, 2023. "Temporal Instability of Risk Preference among the Poor: Evidence from Payday Cycles," American Economic Journal: Applied Economics, American Economic Association, vol. 15(4), pages 68-99, October.
    5. Armando N. Meier, 2019. "Emotions, Risk Attitudes, and Patience," SOEPpapers on Multidisciplinary Panel Data Research 1041, DIW Berlin, The German Socio-Economic Panel (SOEP).
    6. Gu, Ariel & Yoo, Hong Il, 2021. "Prospect Theory and Mutual Fund Flows," Economics Letters, Elsevier, vol. 201(C).
    7. Villacis, Alexis H., 2023. "Inconsistent choices over prospect theory lottery games: Evidence from field experiments," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 103(C).
    8. Boschini, Anne & Dreber, Anna & von Essen, Emma & Muren, Astri & Ranehill, Eva, 2019. "Gender, risk preferences and willingness to compete in a random sample of the Swedish population✰," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 83(C).
    9. Andreas C. Drichoutis & Achilleas Vassilopoulos, 2021. "Intertemporal stability of survey‐based measures of risk and time preferences," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 30(3), pages 655-683, August.
    10. Andreas C. Drichoutis & Rodolfo M. Nayga, 2022. "On the stability of risk and time preferences amid the COVID-19 pandemic," Experimental Economics, Springer;Economic Science Association, vol. 25(3), pages 759-794, June.
    11. Nicholas Ingwersen & Elizabeth Frankenberg & Duncan Thomas, 2023. "Evolution of Risk Aversion over Five Years after a Major Natural Disaster," NBER Working Papers 31102, National Bureau of Economic Research, Inc.
    12. Glenn W. Harrison & Andre Hofmeyr & Harold Kincaid & Brian Monroe & Don Ross & Mark Schneider & J. Todd Swarthout, 2021. "A case study of an experiment during the COVID-19 pandemic: online elicitation of subjective beliefs and economic preferences," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 7(2), pages 194-209, December.
    13. Thiemann, Petra & Schulz, Jonathan & Sunde, Uwe & Thöni, Christian, 2022. "Selection into experiments: New evidence on the role of preferences, cognition, and recruitment protocols," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).
    14. David Scrogin, 2023. "Estimating risk and time preferences over public lotteries: Findings from the field and stream," Journal of Risk and Uncertainty, Springer, vol. 67(1), pages 73-106, August.
    15. Michele Garagnani, 2023. "The predictive power of risk elicitation tasks," Journal of Risk and Uncertainty, Springer, vol. 67(2), pages 165-192, October.
    16. Lisa R. Anderson & Beth A. Freeborn & Patrick McAlvanah & Andrew Turscak, 2023. "Pay every subject or pay only some?," Journal of Risk and Uncertainty, Springer, vol. 66(2), pages 161-188, April.
    17. Jose Apesteguia & Miguel A. Ballester & Ángelo Gutiérrez-Daza, 2024. "Random Discounted Expected Utility," Working Papers 2024-03, Banco de México.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Galizzi, Matteo M. & Machado, Sara R. & Miniaci, Raffaele, 2016. "Temporal stability, cross-validity, and external validity of risk preferences measures: experimental evidence from a UK representative sample," LSE Research Online Documents on Economics 67554, London School of Economics and Political Science, LSE Library.
    2. Hans-Martin Gaudecker & Arthur Soest & Erik Wengström, 2012. "Experts in experiments," Journal of Risk and Uncertainty, Springer, vol. 45(2), pages 159-190, October.
    3. Glenn W. Harrison, 2024. "Risk preferences and risk perceptions in insurance experiments: some methodological challenges," The Geneva Risk and Insurance Review, Palgrave Macmillan;International Association for the Study of Insurance Economics (The Geneva Association), vol. 49(1), pages 127-161, March.
    4. Kpegli, Yao Thibaut & Corgnet, Brice & Zylbersztejn, Adam, 2023. "All at once! A comprehensive and tractable semi-parametric method to elicit prospect theory components," Journal of Mathematical Economics, Elsevier, vol. 104(C).
    5. Andreas C. Drichoutis & Rodolfo M. Nayga, 2022. "On the stability of risk and time preferences amid the COVID-19 pandemic," Experimental Economics, Springer;Economic Science Association, vol. 25(3), pages 759-794, June.
    6. Glenn W. Harrison & J. Todd Swarthout, 2016. "Cumulative Prospect Theory in the Laboratory: A Reconsideration," Experimental Economics Center Working Paper Series 2016-04, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University.
    7. Bocqueho, Geraldine & Jacquet, Florence & Reynaud, Arnaud, 2011. "Expected Utility or Prospect Theory Maximizers? Results from a Structural Model based on Field-experiment Data," 2011 International Congress, August 30-September 2, 2011, Zurich, Switzerland 114257, European Association of Agricultural Economists.
    8. Galarza, Francisco, 2009. "Choices under Risk in Rural Peru," MPRA Paper 17708, University Library of Munich, Germany.
    9. Glenn W. Harrison, 2019. "The behavioral welfare economics of insurance," The Geneva Risk and Insurance Review, Palgrave Macmillan;International Association for the Study of Insurance Economics (The Geneva Association), vol. 44(2), pages 137-175, September.
    10. Glenn W. Harrison & Andre Hofmeyr & Harold Kincaid & Brian Monroe & Don Ross & Mark Schneider & J. Todd Swarthout, 2022. "Subjective beliefs and economic preferences during the COVID-19 pandemic," Experimental Economics, Springer;Economic Science Association, vol. 25(3), pages 795-823, June.
    11. Galizzi, Matteo M. & Miraldo, Marisa & Stavropoulou, Charitini & van der Pol, Marjon, 2016. "Doctor–patient differences in risk and time preferences: A field experiment," Journal of Health Economics, Elsevier, vol. 50(C), pages 171-182.
    12. Harrison, Glenn W. & Lau, Morten I. & Elisabet Rutström, E., 2009. "Risk attitudes, randomization to treatment, and self-selection into experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 498-507, June.
    13. Drichoutis, Andreas C. & Nayga, Rodolfo M., 2013. "Eliciting risk and time preferences under induced mood states," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 45(C), pages 18-27.
    14. Stephen G Dimmock & Roy Kouwenberg & Olivia S Mitchell & Kim Peijnenburg, 2021. "Household Portfolio Underdiversification and Probability Weighting: Evidence from the Field," The Review of Financial Studies, Society for Financial Studies, vol. 34(9), pages 4524-4563.
    15. Stephen L. Cheung, 2020. "Eliciting utility curvature in time preference," Experimental Economics, Springer;Economic Science Association, vol. 23(2), pages 493-525, June.
    16. Arjan Verschoor & Ben D’Exelle, 2022. "Probability weighting for losses and for gains among smallholder farmers in Uganda," Theory and Decision, Springer, vol. 92(1), pages 223-258, February.
    17. Ryan O. Murphy & Robert H. W. ten Brincke, 2018. "Hierarchical Maximum Likelihood Parameter Estimation for Cumulative Prospect Theory: Improving the Reliability of Individual Risk Parameter Estimates," Management Science, INFORMS, vol. 64(1), pages 308-328, January.
    18. Tamás Csermely & Alexander Rabas, 2016. "How to reveal people’s preferences: Comparing time consistency and predictive power of multiple price list risk elicitation methods," Journal of Risk and Uncertainty, Springer, vol. 53(2), pages 107-136, December.
    19. Ola Andersson & Håkan J. Holm & Jean-Robert Tyran & Erik Wengström, 2020. "Robust inference in risk elicitation tasks," Journal of Risk and Uncertainty, Springer, vol. 61(3), pages 195-209, December.
    20. Steffen Andersen & Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2013. "Discounting Behaviour and the Magnitude Effect: Evidence from a Field Experiment in Denmark," Economica, London School of Economics and Political Science, vol. 80(320), pages 670-697, October.

    More about this item

    JEL classification:

    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • D90 - Microeconomics - - Micro-Based Behavioral Economics - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tpr:restat:v:102:y:2020:i:3:p:552-568. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kelly McDougall (email available below). General contact details of provider: https://direct.mit.edu/journals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.