IDEAS home Printed from https://ideas.repec.org/p/diw/diwwpp/dp546.html
   My bibliography  Save this paper

An Experimental Evaluation of Popular Well-Being Measures

Author

Listed:
  • Martin Kroh

Abstract

Drawing on data from two multitrait multimethod experiments carried out in the context of the German Socio-Economic Panel Study (SOEP), this paper identifies questionnaire designs that minimize measurement error in reports of subjective well-being. Among the survey instruments most often used to measure well-being, the analysis focuses on three response formats (11-point, 7-point and magnitude satisfaction scales) and three modes of data collection (self-administered paperand-pencil questionnaires (SAQ), personal paper-and-pencil interviews (PAPI) and computer-assisted personal interviews (CAPI)). Results show that both the choice of a response format and the choice of a mode of data collection make a difference in terms of measurement error: The 11-point satisfaction scale and both CAPI and PAPI improve the quality of subjective well-being data. The paper also reports differences between response formats in terms of their ease of administration and illustrates that the choice of a survey instrument affects conclusions drawn from applied well-being research.

Suggested Citation

  • Martin Kroh, 2006. "An Experimental Evaluation of Popular Well-Being Measures," Discussion Papers of DIW Berlin 546, DIW Berlin, German Institute for Economic Research.
    • Handle: RePEc:diw:diwwpp:dp546
    as

    Download full text from publisher

    File URL: https://www.diw.de/documents/publikationen/73/diw_01.c.43968.de/dp546.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. M. Stones & A. Kozma, 1985. "Structural relationships among happiness scales: A second order factorial study," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 17(1), pages 19-28, July.
    2. Bruno S. Frey & Alois Stutzer, 2002. "What Can Economists Learn from Happiness Research?," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 402-435, June.
    3. Easterlin, Richard A, 2001. "Income and Happiness: Towards an Unified Theory," Economic Journal, Royal Economic Society, vol. 111(473), pages 465-484, July.
    4. Frey, Bruno S & Stutzer, Alois, 2000. "Happiness, Economy and Institutions," Economic Journal, Royal Economic Society, vol. 110(466), pages 918-938, October.
    5. Robert J. MacCulloch & Rafael Di Tella & Andrew J. Oswald, 2001. "Preferences over Inflation and Unemployment: Evidence from Surveys of Happiness," American Economic Review, American Economic Association, vol. 91(1), pages 335-341, March.
    6. Randy Larsen & Ed Diener & Robert Emmons, 1985. "An evaluation of subjective well-being measures," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 17(1), pages 1-17, July.
    7. Clark, Andrew E & Oswald, Andrew J, 1994. "Unhappiness and Unemployment," Economic Journal, Royal Economic Society, vol. 104(424), pages 648-659, May.
    8. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, April.
    9. Duane F. Alwin, 1997. "Feeling Thermometers Versus 7-Point Scales," Sociological Methods & Research, , vol. 25(3), pages 318-340, February.
    10. Ulf Olsson, 1979. "Maximum likelihood estimation of the polychoric correlation coefficient," Psychometrika, Springer;The Psychometric Society, vol. 44(4), pages 443-460, December.
    11. Willem E. Saris, 2001. "The Strength of the Causal Relationship between Living Conditions and Satisfaction," Sociological Methods & Research, , vol. 30(1), pages 11-34, August.
    12. Martin Kroh, 2005. "Surveying the Left-Right Dimension: The Choice of a Response Format," Discussion Papers of DIW Berlin 491, DIW Berlin, German Institute for Economic Research.
    13. Annette C. Scherpenzeel & Willem E. Saris, 1997. "The Validity and Reliability of Survey Questions," Sociological Methods & Research, , vol. 25(3), pages 341-383, February.
    14. James Steiger & Alexander Shapiro & Michael Browne, 1985. "On the multivariate asymptotic distribution of sequential Chi-square statistics," Psychometrika, Springer;The Psychometric Society, vol. 50(3), pages 253-263, September.
    15. Willem Saris, 1988. "A measurement model for psychophysical scaling," Quality & Quantity: International Journal of Methodology, Springer, vol. 22(4), pages 417-433, December.
    16. Liliana Winkelmann & Rainer Winkelmann, 1998. "Why Are the Unemployed So Unhappy?Evidence from Panel Data," Economica, London School of Economics and Political Science, vol. 65(257), pages 1-15, February.
    17. Richard A. Easterlin (ed.), 2002. "Happiness in Economics," Books, Edward Elgar Publishing, number 2479.
    18. Charles Kenny, 1999. "Does Growth Cause Happiness, or Does Happiness Cause Growth?," Kyklos, Wiley Blackwell, vol. 52(1), pages 3-25, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Christian Scheve & Frederike Esche & Jürgen Schupp, 2017. "The Emotional Timeline of Unemployment: Anticipation, Reaction, and Adaptation," Journal of Happiness Studies, Springer, vol. 18(4), pages 1231-1254, August.
    2. Romina Boarini & Margherita Comola & Femke Keulenaer & Robert Manchin & Conal Smith, 2013. "Can Governments Boost People’s Sense of Well-Being? The Impact of Selected Labour Market and Health Policies on Life Satisfaction," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 114(1), pages 105-120, October.
    3. Dolan, Paul & Kavetsos, Georgios & Krekel, Christian & Mavridis, Dimitris & Metcalfe, Robert & Senik, Claudia & Szymanski, Stefan & Ziebarth, Nicolas R., 2019. "Quantifying the intangible impact of the Olympics using subjective well-being data," Journal of Public Economics, Elsevier, vol. 177(C), pages 1-1.
    4. Barrington-Leigh, C.P., 2024. "The econometrics of happiness: Are we underestimating the returns to education and income?," Journal of Public Economics, Elsevier, vol. 230(C).
    5. Laura Schräpler & Jörg-Peter Schräpler & Gert G. Wagner, 2019. "Wie (in)stabil ist die Lebenszufriedenheit? Eine Sequenzanalyse mit Daten des Sozio-oekonomischen Panels (SOEP)," SOEPpapers on Multidisciplinary Panel Data Research 1045, DIW Berlin, The German Socio-Economic Panel (SOEP).
    6. Matthias Siembab & Nico Stawarz, 2019. "How Does Life Satisfaction Change During the Transition from School to Work? A Study of Ninth and Tenth-Grade School-Leavers in Germany," Journal of Happiness Studies, Springer, vol. 20(1), pages 165-183, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rehdanz, Katrin & Maddison, David, 2005. "Climate and happiness," Ecological Economics, Elsevier, vol. 52(1), pages 111-125, January.
      • Katrin Rehdanz & David J. Maddison, 2003. "Climate and Happiness," Working Papers FNU-20, Research unit Sustainability and Global Change, Hamburg University, revised Apr 2003.
    2. Bruno S. Frey & Matthias Benz, 2004. "From Imperialism to Inspiration: A Survey of Economics and Psychology," Chapters, in: John B. Davis & Alain Marciano & Jochen Runde (ed.), The Elgar Companion To Economics and Philosophy, chapter 4, Edward Elgar Publishing.
    3. Di Tella, Rafael & MacCulloch, Robert, 2008. "Gross national happiness as an answer to the Easterlin Paradox?," Journal of Development Economics, Elsevier, vol. 86(1), pages 22-42, April.
    4. D. Mahadea & T. Rawat, 2008. "Economic Growth, Income And Happiness: An Exploratory Study," South African Journal of Economics, Economic Society of South Africa, vol. 76(2), pages 276-290, June.
    5. David G. Blanchflower & Andrew J. Oswald, 2004. "Money, Sex and Happiness: An Empirical Study," Scandinavian Journal of Economics, Wiley Blackwell, vol. 106(3), pages 393-415, October.
    6. Bruno S. Frey & Alois Stutzer, 2002. "What Can Economists Learn from Happiness Research?," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 402-435, June.
    7. Litchfield, Julie & Reilly, Barry & Veneziani, Mario, 2012. "An analysis of life satisfaction in Albania: An heteroscedastic ordered probit model approach," Journal of Economic Behavior & Organization, Elsevier, vol. 81(3), pages 731-741.
    8. Alois Stutzer & Bruno S. Frey, 2008. "Stress that Doesn't Pay: The Commuting Paradox," Scandinavian Journal of Economics, Wiley Blackwell, vol. 110(2), pages 339-366, June.
    9. Roberta Distante, 2013. "Subjective Well-Being, Income and Relative Concerns in the UK," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 113(1), pages 81-105, August.
    10. Easterlin, Richard A., 2003. "Building a Better Theory of Well-Being," IZA Discussion Papers 742, Institute of Labor Economics (IZA).
    11. Popova, Olga, 2014. "Can religion insure against aggregate shocks to happiness? The case of transition countries," Journal of Comparative Economics, Elsevier, vol. 42(3), pages 804-818.
    12. Oswald, Andrew J. & Powdthavee, Nattavudh, 2008. "Does happiness adapt? A longitudinal study of disability with implications for economists and judges," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1061-1077, June.
    13. Krause, Annabelle, 2013. "Don’t worry, be happy? Happiness and reemployment," Journal of Economic Behavior & Organization, Elsevier, vol. 96(C), pages 1-20.
    14. Molnár, György & Kapitány, Zsuzsa, 2006. "Mobilitás, bizonytalanság és szubjektív jóllét Magyarországon [Mobility, uncertainty and subjective welfare in Hungary]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(10), pages 845-872.
    15. T. Tavor & L. D. Gonen & M. Weber & U. Spiegel, 2018. "The Effects of Income Levels and Income Inequalities on Happiness," Journal of Happiness Studies, Springer, vol. 19(7), pages 2115-2137, October.
    16. Kuegler, Alice, 2009. "A Curse of Comparison? Evidence on Reference Groups for Relative Income Concerns," Policy Research Working Paper Series 4820, The World Bank.
    17. Bruno S. Frey und Matthias Benz, "undated". "�konomie und Psychologie: eine �bersicht," IEW - Working Papers 092, Institute for Empirical Research in Economics - University of Zurich.
    18. Malcolm Dowling & Yap Chin-Fang, 2006. "Homeostasis and Well Being," Development Economics Working Papers 22077, East Asian Bureau of Economic Research.
    19. Andrew E. Clark, 2018. "Four Decades of the Economics of Happiness: Where Next?," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 64(2), pages 245-269, June.
    20. John Cullis & John Hudson & Philip Jones, 2011. "A Different Rationale for Redistribution: Pursuit of Happiness in the European Union," Journal of Happiness Studies, Springer, vol. 12(2), pages 323-341, April.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:diw:diwwpp:dp546. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Bibliothek (email available below). General contact details of provider: https://edirc.repec.org/data/diwbede.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.