IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/gzt7a_v1.html
   My bibliography  Save this paper

How much can we learn from happiness data?

Author

Listed:
  • Kaiser, Caspar

    (University of Oxford)

  • Vendrik, Maarten C. M.

Abstract

Survey data on happiness, mental health, job satisfaction, and wellbeing are now widely used in economic research. They are also increasingly collected by government statistical agencies and bodies like the OECD. However, human feelings are measured on ordinal rather than cardinal scales. Hence, it has always been known that such data have to be handled with care. Some recent work has argued that, at least in principle, certain results in the research literature might be capable of being ‘reversed’ – turning estimated positive effects into negatives, and vice versa. How important are such theoretical possibilities? We show that self-reported wellbeing data can in most relevant circumstances be used safely. First, using several large-scale datasets from the US, Germany, and the Netherlands, we find that, in empirical practice, effect reversals are rare or even impossible for a number of core socio-economic variables, including people’s incomes and employment status. Second, we demonstrate that respondents would have to answer (numerical) happiness questions in a strongly non-linear fashion for reversals to actually appear. Yet, the evidence suggests approximately linear response behaviour. Third, as a more methodological contribution, we derive a simple and general non-reversal condition for regressions of ordinal data, and we derive bounds for ratios of coefficients. We finish with a set of suggested recommendations for appropriate practice in empirical research and sketch avenues for future research.

Suggested Citation

  • Kaiser, Caspar & Vendrik, Maarten C. M., 2019. "How much can we learn from happiness data?," SocArXiv gzt7a_v1, Center for Open Science.
  • Handle: RePEc:osf:socarx:gzt7a_v1
    DOI: 10.31219/osf.io/gzt7a_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/5d31cbfb835aff001a546fd1/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/gzt7a_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Oswald, Andrew J., 2008. "On the curvature of the reporting function from objective reality to subjective feelings," Economics Letters, Elsevier, vol. 100(3), pages 369-372, September.
    2. Clark, Andrew E & Oswald, Andrew J, 1994. "Unhappiness and Unemployment," Economic Journal, Royal Economic Society, vol. 104(424), pages 648-659, May.
    3. Levinson, Arik, 2012. "Valuing public goods using happiness data: The case of air quality," Journal of Public Economics, Elsevier, vol. 96(9-10), pages 869-880.
    4. Schröder, Carsten & Yitzhaki, Shlomo, 2017. "Revisiting the evidence for cardinal treatment of ordinal variables," European Economic Review, Elsevier, vol. 92(C), pages 337-358.
    5. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    6. Adler, Matthew D. & Dolan, Paul & Kavetsos, Georgios, 2017. "Would you choose to be happy? Tradeoffs between happiness and the other dimensions of life in a large population survey," Journal of Economic Behavior & Organization, Elsevier, vol. 139(C), pages 60-73.
    7. Timothy N. Bond & Kevin Lang, 2013. "The Evolution of the Black-White Test Score Gap in Grades K–3: The Fragility of Results," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1468-1479, December.
    8. Andrew E. Clark, 2018. "Four Decades of the Economics of Happiness: Where Next?," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 64(2), pages 245-269, June.
    9. Krueger, Alan B. & Schkade, David A., 2008. "The reliability of subjective well-being measures," Journal of Public Economics, Elsevier, vol. 92(8-9), pages 1833-1845, August.
    10. Viola Angelini & Danilo Cavapozzi & Luca Corazzini & Omar Paccagnella, 2014. "Do Danes and Italians Rate Life Satisfaction in the Same Way? Using Vignettes to Correct for Individual-Specific Scale Biases," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(5), pages 643-666, October.
    11. Van Praag, Bernard, 1971. "The welfare function of income in Belgium: An empirical investigation," European Economic Review, Elsevier, vol. 11(3), pages 337-369.
    12. Chen, Le-Yu & Oparina, Ekaterina & Powdthavee, Nattavudh & Srisuma, Sorawoot, 2022. "Robust Ranking of Happiness Outcomes: A Median Regression Perspective," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 672-686.
    13. Daniel J. Benjamin & Ori Heffetz & Miles S. Kimball & Alex Rees-Jones, 2012. "What Do You Think Would Make You Happier? What Do You Think You Would Choose?," American Economic Review, American Economic Association, vol. 102(5), pages 2083-2110, August.
    14. Daniel J Benjamin & Jakina Debnam Guzman & Marc Fleurbaey & Ori Heffetz & Miles Kimball, 2023. "What do Happiness Data Mean? Theory and Survey Evidence," Journal of the European Economic Association, European Economic Association, vol. 21(6), pages 2377-2412.
    15. Gupta, Prashant & Mishra, Tapas & O’Leary, Nigel & Parhi, Mamata, 2015. "The distributional effects of adaption and anticipation to ill health on subjective wellbeing," Economics Letters, Elsevier, vol. 136(C), pages 99-102.
    16. Perez-Truglia, Ricardo, 2015. "A Samuelsonian validation test for happiness data," Journal of Economic Psychology, Elsevier, vol. 49(C), pages 74-83.
    17. Reto Odermatt & Alois Stutzer, 2019. "(Mis-)Predicted Subjective Well-Being Following Life Events," Journal of the European Economic Association, European Economic Association, vol. 17(1), pages 245-283.
    18. Easterlin, Richard A. & O'Connor, Kelsey J., 2020. "The Easterlin Paradox," IZA Discussion Papers 13923, Institute of Labor Economics (IZA).
    19. Frijters, Paul & Clark, Andrew E. & Krekel, Christian & Layard, Richard, 2020. "A happy choice: wellbeing as the goal of government," Behavioural Public Policy, Cambridge University Press, vol. 4(2), pages 126-165, July.
    20. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    21. Richard Lucas & M. Brent Donnellan, 2012. "Estimating the Reliability of Single-Item Life Satisfaction Measures: Results from Four National Panel Studies," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(3), pages 323-331, February.
    22. Ng, Yew-Kwang, 1997. "A Case for Happiness, Cardinalism, and Interpersonal Comparability," Economic Journal, Royal Economic Society, vol. 107(445), pages 1848-1858, November.
    23. de Ree, Joppe & Alessie, Rob & Pradhan, Menno, 2013. "The price and utility dependence of equivalence scales: Evidence from Indonesia," Journal of Public Economics, Elsevier, vol. 97(C), pages 272-281.
    24. George MacKerron, 2012. "Happiness Economics From 35 000 Feet," Journal of Economic Surveys, Wiley Blackwell, vol. 26(4), pages 705-735, September.
    25. Melanie Borah & Carina Keldenich & Andreas Knabe, 2019. "Reference Income Effects in the Determination of Equivalence Scales Using Income Satisfaction Data," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 65(4), pages 736-770, December.
    26. Bertram, Christine & Rehdanz, Katrin, 2015. "The role of urban green space for human well-being," Ecological Economics, Elsevier, vol. 120(C), pages 139-152.
    27. Dolan, Paul & Kavetsos, Georgios & Krekel, Christian & Mavridis, Dimitris & Metcalfe, Robert & Senik, Claudia & Szymanski, Stefan & Ziebarth, Nicolas R., 2019. "Quantifying the intangible impact of the Olympics using subjective well-being data," Journal of Public Economics, Elsevier, vol. 177(C), pages 1-1.
    28. Kaiser, Caspar, 2022. "Using memories to assess the intrapersonal comparability of wellbeing reports," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 410-442.
    29. Clark, Andrew E. & Senik, Claudia & Yamada, Katsunori, 2017. "When experienced and decision utility concur: The case of income comparisons," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 70(C), pages 1-9.
    30. Easterlin, Richard A., 1974. "Does Economic Growth Improve the Human Lot? Some Empirical Evidence," MPRA Paper 111773, University Library of Munich, Germany.
    31. Binder, Martin & Coad, Alex, 2011. "From Average Joe's happiness to Miserable Jane and Cheerful John: using quantile regressions to analyze the full subjective well-being distribution," Journal of Economic Behavior & Organization, Elsevier, vol. 79(3), pages 275-290, August.
    32. Steven D Levitt, 2021. "Heads or Tails: The Impact of a Coin Toss on Major Life Decisions and Subsequent Happiness," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(1), pages 378-405.
    33. Betsey Stevenson & Justin Wolfers, 2008. "Happiness Inequality in the United States," The Journal of Legal Studies, University of Chicago Press, vol. 37(S2), pages 33-79, June.
    34. Ada Ferrer-i-Carbonell & Paul Frijters, 2004. "How Important is Methodology for the estimates of the determinants of Happiness?," Economic Journal, Royal Economic Society, vol. 114(497), pages 641-659, July.
    35. Oswald, Andrew J. & Wu, Stephen, 2010. "Objective Confirmation of Subjective Measures of Human Well-being: Evidence from the USA," IZA Discussion Papers 4695, Institute of Labor Economics (IZA).
    36. Kapteyn, Arie & Van Praag, Bernard M. S. & Van Herwaarden, Floor G., 1978. "Individual welfare functions and social reference spaces," Economics Letters, Elsevier, vol. 1(2), pages 173-177.
    37. Viscusi, W. Kip, 2020. "Wellbeing measures of mortality risks: life-cycle contradictions and ordinal index challenges," Behavioural Public Policy, Cambridge University Press, vol. 4(2), pages 245-253, July.
    38. Danzer, Alexander M. & Danzer, Natalia, 2016. "The long-run consequences of Chernobyl: Evidence on subjective well-being, mental health and welfare," Journal of Public Economics, Elsevier, vol. 135(C), pages 47-60.
    39. Diamond, Peter, 2008. "Behavioral economics," Journal of Public Economics, Elsevier, vol. 92(8-9), pages 1858-1862, August.
    40. Matthew D Adler & Nils Holtug, 2019. "Prioritarianism: A response to critics," Politics, Philosophy & Economics, , vol. 18(2), pages 101-144, May.
    41. Daniel J. Benjamin & Ori Heffetz & Miles S. Kimball & Alex Rees-Jones, 2014. "Can Marginal Rates of Substitution Be Inferred from Happiness Data? Evidence from Residency Choices," American Economic Review, American Economic Association, vol. 104(11), pages 3498-3528, November.
    42. Martin Biewen & Andos Juhasz, 2017. "Direct Estimation of Equivalence Scales and More Evidence on Independence of Base," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 79(5), pages 875-905, October.
    43. Blanchflower, David G. & Oswald, Andrew J., 2016. "Antidepressants and age: A new form of evidence for U-shaped well-being through life," Journal of Economic Behavior & Organization, Elsevier, vol. 127(C), pages 46-58.
    44. Mariano Rojas, 2007. "A Subjective Well-being Equivalence Scale for Mexico: Estimation and Poverty and Income-distribution Implications," Oxford Development Studies, Taylor & Francis Journals, vol. 35(3), pages 273-293.
    45. Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
    46. Vendrik, Maarten C.M. & Woltjer, Geert B., 2007. "Happiness and loss aversion: Is utility concave or convex in relative income?," Journal of Public Economics, Elsevier, vol. 91(7-8), pages 1423-1448, August.
    47. Reisinger, James, 2022. "Subjective well-being and social desirability," Journal of Public Economics, Elsevier, vol. 214(C).
    48. Daniel Kahneman & Peter P. Wakker & Rakesh Sarin, 1997. "Back to Bentham? Explorations of Experienced Utility," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 375-406.
    49. Simon Luechinger, 2009. "Valuing Air Quality Using the Life Satisfaction Approach," Economic Journal, Royal Economic Society, vol. 119(536), pages 482-515, March.
    50. Hadar, Josef & Russell, William R, 1969. "Rules for Ordering Uncertain Prospects," American Economic Review, American Economic Association, vol. 59(1), pages 25-34, March.
    51. Timothy N. Bond & Kevin Lang, 2019. "The Sad Truth about Happiness Scales," Journal of Political Economy, University of Chicago Press, vol. 127(4), pages 1629-1640.
    52. Leann Schneider & Ulrich Schimmack, 2009. "Self-Informant Agreement in Well-Being Ratings: A Meta-Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 94(3), pages 363-376, December.
    53. Rafael Di Tella & Robert MacCulloch, 2006. "Some Uses of Happiness Data in Economics," Journal of Economic Perspectives, American Economic Association, vol. 20(1), pages 25-46, Winter.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kaiser, Caspar, 2022. "Using memories to assess the intrapersonal comparability of wellbeing reports," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 410-442.
    2. Ferreira, Susana & Moro, Mirko & Welsch, Heinz, 2024. "Using Life Satisfaction and Happiness Data for Environmental Valuation: An Experienced Preference Approach," IZA Discussion Papers 16718, Institute of Labor Economics (IZA).
    3. Kaiser, Caspar F. & Vendrik, Maarten C.M., 2020. "How Threatening Are Transformations of Happiness Scales to Subjective Wellbeing Research?," IZA Discussion Papers 13905, Institute of Labor Economics (IZA).
    4. Daniel J. Benjamin & Kristen Cooper & Ori Heffetz & Miles S. Kimball, 2023. "From Happiness Data to Economic Conclusions," NBER Working Papers 31727, National Bureau of Economic Research, Inc.
    5. Marcus Klemm, 2022. "Well-being Changes from Year to Year: A Comparison of Current, Remembered and Predicted Life Satisfaction," Journal of Happiness Studies, Springer, vol. 23(4), pages 1669-1681, April.
    6. O'Donnell, Gus & Oswald, Andrew J., 2015. "National well-being policy and a weighted approach to human feelings," Ecological Economics, Elsevier, vol. 120(C), pages 59-70.
    7. Kaiser, Caspar, 2018. "People do not adapt to income changes: A re-evaluation of the dynamic effects of (reference) income on life satisfaction with GSOEP and UKHLS data," INET Oxford Working Papers 2018-07, Institute for New Economic Thinking at the Oxford Martin School, University of Oxford.
    8. Jan-Emmanuel De Neve & George Ward & Femke De Keulenaer & Bert Van Landeghem & Georgios Kavetsos & Michael I. Norton, 2018. "The Asymmetric Experience of Positive and Negative Economic Growth: Global Evidence Using Subjective Well-Being Data," The Review of Economics and Statistics, MIT Press, vol. 100(2), pages 362-375, May.
    9. Kaiser, Caspar & Vendrik, Maarten C. M., 2019. "How threatening are transformations of reported happiness to subjective wellbeing research?," SocArXiv gzt7a, Center for Open Science.
    10. García-Mainar, Inmaculada & Montuenga, Víctor M. & Navarro-Paniagua, María, 2015. "Workplace environmental conditions and life satisfaction in Spain," Ecological Economics, Elsevier, vol. 119(C), pages 136-146.
    11. Alpaslan Akay & Olivier Bargain & H. Xavier Jara, 2020. "‘Fair’ welfare comparisons with heterogeneous tastes: subjective versus revealed preferences," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 55(1), pages 51-84, June.
    12. Shuo Liu & Nick Netzer, 2023. "Happy Times: Measuring Happiness Using Response Times," American Economic Review, American Economic Association, vol. 113(12), pages 3289-3322, December.
    13. Jeffrey R. Bloem & Andrew J. Oswald, 2022. "The Analysis of Human Feelings: A Practical Suggestion for a Robustness Test," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 68(3), pages 689-710, September.
    14. Kaiser, Caspar, 2020. "People do not adapt. New analyses of the dynamic effects of own and reference income on life satisfaction," Journal of Economic Behavior & Organization, Elsevier, vol. 177(C), pages 494-513.
    15. Dolan, Paul & Kavetsos, Georgios & Krekel, Christian & Mavridis, Dimitris & Metcalfe, Robert & Senik, Claudia & Szymanski, Stefan & Ziebarth, Nicolas R., 2019. "Quantifying the intangible impact of the Olympics using subjective well-being data," Journal of Public Economics, Elsevier, vol. 177(C), pages 1-1.
    16. Kristen Cooper & Mark Fabian & Christian Krekel, 2023. "New approaches to measuring welfare," Fiscal Studies, John Wiley & Sons, vol. 44(2), pages 123-135, June.
    17. Georgios Kavetsos & Ichiro Kawachi & Ilias Kyriopoulos & Sotiris Vandoros, 2021. "The effect of the Brexit referendum result on subjective well‐being," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(2), pages 707-731, April.
    18. Krekel, Christian & Shreedhar, Ganga & Lee, Helen & Marshall, Claire & Boler, Alison & Smith, Allison & Dolan, Paul, 2024. "Happy to help: welfare effects of a nationwide volunteering programme," LSE Research Online Documents on Economics 126209, London School of Economics and Political Science, LSE Library.
    19. Carol Graham, 2005. "The Economics of Happiness," World Economics, World Economics, 1 Ivory Square, Plantation Wharf, London, United Kingdom, SW11 3UE, vol. 6(3), pages 41-55, July.
    20. Perez-Truglia, Ricardo, 2015. "A Samuelsonian validation test for happiness data," Journal of Economic Psychology, Elsevier, vol. 49(C), pages 74-83.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:gzt7a_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.