IDEAS home Printed from https://ideas.repec.org/p/ifs/ifsewp/09-09.html
   My bibliography  Save this paper

An analysis of consumer panel data

Author

Listed:
  • Andrew Leicester

    (Institute for Fiscal Studies)

  • Zoe Oldfield

    (Institute for Fiscal Studies and Institute for Fiscal Studies)

Abstract

In terms of collecting comprehensive panel expenditure data, there are trade-offs to be made in terms of the demands imposed on respondents and the level of detail and spending coverage collected. Existing comprehensive spending data tends to be cross-sectional whilst panel studies include only limited expenditure questions that record spending only as broad aggregates. More recently, economists have begun to use spending information collected by market research companies that records very detailed spending down to the barcode level from a panel of households, usually recorded by in-home barcode scanners, which may provide considerable advantages over existing data more commonly used in social sciences. However, there has not been a comprehensive assessment of the strengths and weaknesses of this kind of data collection method and the potential implications of survey mode on the recorded data. This paper seeks to address this, by an in-depth examination of scanner data from one company, Taylor Nelson Sofres (TNS), on grocery purchases over a five-year period. We assess how far the ongoing demands of participation inherent in this kind of survey lead to 'fatigue' in respondents' recording of their spending and compare the demographic representativeness of the data to the well-established Expenditure and Food Survey (EFS), constructing weights for the TNS that account for observed demographic differences. We also look at demographic transitions, comparing the panel aspect of the TNS to the British Household Panel Study (BHPS). We examine in detail the expenditure data in the TNS and EFS surveys and discuss the implications of this method of data collection for survey attrition. Broadly, we suggest that problems of fatigue and attrition may not be so severe as may be expected, though there are some differences in expenditure levels (and to some extent patterns of spending) that cannot be attributed to demographic or time differences in the two surveys alone and may be suggestive of survey mode effects. Demographic transitions appear to occur less frequently than we might expect which may limit the usefulness of the panel aspect of the data for some applications.

Suggested Citation

  • Andrew Leicester & Zoe Oldfield, 2009. "An analysis of consumer panel data," IFS Working Papers W09/09, Institute for Fiscal Studies.
  • Handle: RePEc:ifs:ifsewp:09/09
    as

    Download full text from publisher

    File URL: http://www.ifs.org.uk/wps/wp0909.pdf
    Download Restriction: no
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. O’Connell, Martin & Smith, Kate & Stroud, Rebekah, 2022. "The dietary impact of the COVID-19 pandemic," Journal of Health Economics, Elsevier, vol. 84(C).
    2. Crawford, Gregory S. & Griffith, Rachel & Iaria, Alessandro, 2021. "A survey of preference estimation with unobserved choice set heterogeneity," Journal of Econometrics, Elsevier, vol. 222(1), pages 4-43.
    3. Griffith, Rachel & Smith, Kate & Krol, Michal, 2015. "Store Brands and the Role of Advertising," CEPR Discussion Papers 10877, C.E.P.R. Discussion Papers.
    4. Rachel Griffith & Martin O'Connell & Kate Smith, 2016. "Shopping Around: How Households Adjusted Food Spending Over the Great Recession," Economica, London School of Economics and Political Science, vol. 83(330), pages 247-280, April.
    5. Saeed Heravi & Peter Morgan, 2014. "Sampling schemes for price index construction: a performance comparison across the classification of individual consumption by purpose food groups," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(7), pages 1453-1470, July.
    6. Griffith, Rachel & Crawford, Gregory & Iaria, Alessandro, 2016. "Preference Estimation with Unobserved Choice Set Heterogeneity using Sufficient Sets," CEPR Discussion Papers 11675, C.E.P.R. Discussion Papers.
    7. Rachel Griffith & Martin O'Connell & Kate Smith, 2017. "The Importance of Product Reformulation Versus Consumer Choice in Improving Diet Quality," Economica, London School of Economics and Political Science, vol. 84(333), pages 34-53, January.

    More about this item

    Keywords

    Household panel data; scanner data; expenditure; food; duration models; attrition;
    All these keywords.

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C33 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Models with Panel Data; Spatio-temporal Models
    • C41 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Duration Analysis; Optimal Timing Strategies

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:ifsewp:09/09. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/ifsssuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.