IDEAS home Printed from https://ideas.repec.org/p/diw/diwsop/diw_sp390.html
   My bibliography  Save this paper

Measuring Time Use in Surveys: How Valid Are Time Use Questions in Surveys? Concordance of Survey and Experience Sampling Measures

Author

Listed:
  • Bettina Sonnenberg
  • Michaela Riediger
  • Cornelia Wrzus
  • Gert G. Wagner

Abstract

Since it is still unclear to what extent time allocation retrospectively reported in questionnaires, reflects people's actual behavior, examining the accuracy of responses to time use survey questions is of crucial importance. We analyze the congruence of time use information assessed through retrospective questionnaires and through experience sampling methodology. The sample comprised 433 individuals ranging in age from 14 to 86 years. Participants completed standard survey questions on time allocation. In addition, a mobile-phone based experience sampling technology was used over a period of three weeks to obtain snapshots of, on average, 54 momentary activities in which participants participated while pursuing their normal daily routines. Experience sampling assessments were scheduled six times a day over at least nine days, including workdays, Saturdays, andSundays. Results indicate that the congruence between time allocation assessed with survey questions (i.e. in SOEP) and time allocation assessed with experience sampling methodology depends on the characteristics of the respective activities. Associations between standard survey questions and experience sampling methods are quite substantial for long-lasting and externally structured activities, such as paid work on workdays. Incontrast, associations between survey and experience sampling methods are somewhat weaker, though highly statistically significant, for less externally structured, short-term and infrequent activities, such as errands, housework, and leisure. These moderate and relatively small correlations may indicate either an error-prone estimation of the prevalence of shortterm and infrequent activities by experience sampling or respondents' overrating of sporadic and short activities in survey questions. We conclude that activities with a long duration, such as paid work, can be measured in a satisfactory manner using short survey questions. Futureresearch is necessary to elucidate which method (experience sampling method or survey questions) delivers more reliable and valid measures for shortterm and sporadic activities.Day Reconstruction Methods (DRM) should be included in this future methodological research.

Suggested Citation

  • Bettina Sonnenberg & Michaela Riediger & Cornelia Wrzus & Gert G. Wagner, 2011. "Measuring Time Use in Surveys: How Valid Are Time Use Questions in Surveys? Concordance of Survey and Experience Sampling Measures," SOEPpapers on Multidisciplinary Panel Data Research 390, DIW Berlin, The German Socio-Economic Panel (SOEP).
    • Handle: RePEc:diw:diwsop:diw_sp390
    as

    Download full text from publisher

    File URL: https://www.diw.de/documents/publikationen/73/diw_01.c.376621.de/diw_sp0390.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Iiris Niemi, 1993. "Systematic error in behavioural measurement: Comparing results from interview and time budget studies," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 30(2), pages 229-244, November.
    2. Blair, Edward & Burton, Scot, 1987. "Cognitive Processes Used by Survey Respondents to Answer Behavioral Frequency Questions," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 14(2), pages 280-288, September.
    3. Pudney, Stephen & Yee Kan, Â Man, 2007. "Measurement error in stylised and diary data on time use," ISER Working Paper Series 2007-03, Institute for Social and Economic Research.
    4. Mihaly Csikszentmihalyi & Jeremy Hunter, 2003. "Happiness in Everyday Life: The Uses of Experience Sampling," Journal of Happiness Studies, Springer, vol. 4(2), pages 185-199, June.
    5. Riediger, Michaela & Schmiedek, Florian & Wagner, Gert G. & Lindenberger, Ulman, 2009. "Seeking Pleasure and Seeking Pain: Differences in Prohedonic and Contra-Hedonic Motivation From Adolescence to Old Age," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 20(12), pages 1529-1535.
    6. Joachim Merz & Klaus G. Wolff, 1993. "The Shadow Economy: Illicit Work And Household Production: A Microanalysis Of West Germany," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 39(2), pages 177-194, June.
    7. Steffen Otterbach & Alfonso Sousa-Poza, 2010. "How Accurate are German Work-time Data? A Comparison of Time-diary Reports and Stylized Estimates," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 97(3), pages 325-339, July.
    8. Thomas Siedler & Jürgen Schupp & C. Katharina Spieß & Gert G. Wagner, 2008. "The German Socio-Economic Panel as a Reference Data Set," SOEPpapers on Multidisciplinary Panel Data Research 150, DIW Berlin, The German Socio-Economic Panel (SOEP).
    9. Ragni Kitterød, 2001. "Does the recording of parallel activities in Time Use Diaries affect the way people report their main activities?," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 56(2), pages 145-178, November.
    10. Jens Bonke, 2005. "Paid Work and Unpaid Work: Diary Information Versus Questionnaire Information," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 70(3), pages 349-368, February.
    11. Frances McGinnity & Helen Russell, 2007. "Work Rich, Time Poor? Time-Use of Women and Men in Ireland," The Economic and Social Review, Economic and Social Studies, vol. 38(3), pages 323-354.
    12. Andrew Harvey, 1993. "Guidelines for time use data collection," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 30(2), pages 197-228, November.
    13. Gershuny, Jonathan, 2000. "Changing Times: Work and Leisure in Postindustrial Society," OUP Catalogue, Oxford University Press, number 9780198287872.
    14. Kimberly Fisher & Muriel Egerton & Jonathan Gershuny & John Robinson, 2007. "Gender Convergence in the American Heritage Time use Study (AHTUS)," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 1-33, May.
    15. Gert G. Wagner & Joachim R. Frick & Jürgen Schupp, 2007. "The German Socio-Economic Panel Study (SOEP) – Scope, Evolution and Enhancements," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 127(1), pages 139-169.
    16. repec:bla:revinw:v:39:y:1993:i:2:p:177-94 is not listed on IDEAS
    17. Namkee Ahn, & Juan F. Jimeno & Arantza Ugidos, "undated". "“Mondays at the sun”: Unemployment, Time Use, and Consumption Patterns in Spain," Working Papers 2003-18, FEDEA.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Costa-Font, Joan & Fleche, Sarah & Pagan, Ricardo, 2024. "The labour market returns to sleep," Journal of Health Economics, Elsevier, vol. 93(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Man Kan, 2008. "Measuring Housework Participation: The Gap between “Stylised” Questionnaire Estimates and Diary-based Estimates," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 86(3), pages 381-400, May.
    2. Yuta Masuda & Lea Fortmann & Mary Gugerty & Marla Smith-Nilson & Joseph Cook, 2014. "Pictorial Approaches for Measuring Time Use in Rural Ethiopia," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 115(1), pages 467-482, January.
    3. Gimenez-Nadal, J. Ignacio & Molina, Jose Alberto, 2015. "Health status and the allocation of time: Cross-country evidence from Europe," Economic Modelling, Elsevier, vol. 46(C), pages 188-203.
    4. Yee Kan, Â Man, 2006. "Measuring housework participation: the gap between ‘stylised’ questionnaire estimates and diary-based estimates," ISER Working Paper Series 2006-11, Institute for Social and Economic Research.
    5. Ettore Scappini, 2010. "Daily diaries in time use surveys. A solution to overcome measurement problems in single-activity events with long characteristic rhythms," Quality & Quantity: International Journal of Methodology, Springer, vol. 44(5), pages 915-939, August.
    6. Pudney, Stephen & Yee Kan, Â Man, 2007. "Measurement error in stylised and diary data on time use," ISER Working Paper Series 2007-03, Institute for Social and Economic Research.
    7. Billari, Francesco C. & Giuntella, Osea & Stella, Luca, 2018. "Broadband internet, digital temptations, and sleep," Journal of Economic Behavior & Organization, Elsevier, vol. 153(C), pages 58-76.
    8. John Robinson & Steven Martin, 2009. "Changes in American Daily Life: 1965–2005," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 93(1), pages 47-56, August.
    9. Merz, Joachim, 2009. "Time Use and Time Budgets – Improvements, Future Challenges and Recommendations," MPRA Paper 16304, University Library of Munich, Germany.
    10. J. Ignacio Gimenez-Nadal & José Alberto Molina, 2016. "Commuting Time And Household Responsibilities: Evidence Using Propensity Score Matching," Journal of Regional Science, Wiley Blackwell, vol. 56(2), pages 332-359, March.
    11. Jens Bonke & Mette Deding & Mette Lausten & Leslie S. Stratton, 2008. "Intra‐Household Specialization in Housework in the United States and Denmark," Social Science Quarterly, Southwestern Social Science Association, vol. 89(4), pages 1023-1043, December.
    12. Michael C. Knaus & Steffen Otterbach, 2019. "Work Hour Mismatch And Job Mobility: Adjustment Channels And Resolution Rates," Economic Inquiry, Western Economic Association International, vol. 57(1), pages 227-242, January.
    13. J. Gimenez-Nadal & Jose Molina, 2013. "Parents’ education as a determinant of educational childcare time," Journal of Population Economics, Springer;European Society for Population Economics, vol. 26(2), pages 719-749, April.
    14. Steffen Otterbach & Alfonso Sousa-Poza, 2010. "How Accurate are German Work-time Data? A Comparison of Time-diary Reports and Stylized Estimates," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 97(3), pages 325-339, July.
    15. Costa-Font, Joan & Fleche, Sarah & Pagan, Ricardo, 2024. "The labour market returns to sleep," Journal of Health Economics, Elsevier, vol. 93(C).
    16. Ziqi Zhang & Zhi Qiu, 2020. "Exploring Daily Activity Patterns on the Typical Day of Older Adults for Supporting Aging-in-Place in China’s Rural Environment," IJERPH, MDPI, vol. 17(22), pages 1-20, November.
    17. Pierre Walthery & Jonathan Gershuny, 2019. "Improving Stylised Working Time Estimates with Time Diary Data: A Multi Study Assessment for the UK," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(3), pages 1303-1321, August.
    18. J. Gimenez-Nadal & Jose Molina, 2014. "Regional unemployment, gender, and time allocation of the unemployed," Review of Economics of the Household, Springer, vol. 12(1), pages 105-127, March.
    19. Monika Engler & Stefan Staubli, 2008. "The Distribution of Leisure Time Across Countries and Over Time," University of St. Gallen Department of Economics working paper series 2008 2008-14, Department of Economics, University of St. Gallen.
    20. Ragni Kitterød, 2001. "Does the recording of parallel activities in Time Use Diaries affect the way people report their main activities?," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 56(2), pages 145-178, November.

    More about this item

    Keywords

    Survey methods; experience sampling method; validity; time use; market work; housework; leisure; German Socio-Economic Panel Study; MMAA; SOEP;
    All these keywords.

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • D10 - Microeconomics - - Household Behavior - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. SOEP based publications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:diw:diwsop:diw_sp390. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Bibliothek (email available below). General contact details of provider: https://edirc.repec.org/data/sodiwde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.