IDEAS home Printed from https://ideas.repec.org/p/ecm/nawm04/123.html
   My bibliography  Save this paper

Estimating Measurement Error in SIPP Annual Job Earnings: A Comparison of Census Survey and SSA Administrative Data

Author

Listed:
  • Martha Stinson

Abstract

This paper seeks to quantify sources of variation in annual job earnings data collected by the 1996 Survey of Income and Program Participation (SIPP) and to determine how much of the variation is the result of measurement error. To this end, jobs reported in the SIPP are linked to jobs reported in a new administrative database, the Detailed Earnings Records (DER) drawn from the Social Security Administration's Master Earnings File, a universe file of all earnings reported on W-2 tax forms. As a result, each job has two earnings observations per year: survey and administrative. Unlike previous validation studies, both of these earnings measures are viewed as noisy measures of some underlying true amount of annual earnings. While the existence of survey error resulting from respondent mistakes or misinterpretation is widely accepted, the idea that administrative data is also error-prone is new. However we feel that the possibility of employer reporting error, employee under-reporting of compensation such as tips, and general differences between how earnings may be reported on tax forms and in surveys, necessitates the discarding of the assumption that administrative data is a ?true? measure of the quantity collected by the survey. Exploiting the presence of individuals with multiple jobs and shared employers over time, we stack all earnings measures for each individual and estimate an econometric model that includes random person and firm effects as well as a common error component shared by SIPP and SSA earnings. In addition, the estimation equation includes two independent error components that represent the variation unique to each earnings measure. The random person and firm effects and the shared residual are interpreted as components of "true" variation that represent differences in earnings across people, firms and time periods due to underlying economic reasons. The independent error terms are interpreted as measurement error. The ratio of true variation to total variation for the SIPP earnings measure is .82, indicating that 18 percent of the variation in SIPP annual job earnings can be attributed to measurement error. In contrast the ratio of true to total variation for the DER earnings measure is .79. We also estimate a model that allows for independent AR(1) processes in all three error terms and find auto-correlation parameters of .59 for the common component, .14 for the SIPP measurement error, and .73 for the DER measurement error. These relative magnitudes imply that for first-differenced earnings, in contrast to earnings levels, the reliability ratio will be lower for the SIPP than the DER.

Suggested Citation

  • Martha Stinson, 2004. "Estimating Measurement Error in SIPP Annual Job Earnings: A Comparison of Census Survey and SSA Administrative Data," Econometric Society 2004 North American Winter Meetings 123, Econometric Society.
  • Handle: RePEc:ecm:nawm04:123
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Akee, Randall, 2011. "Errors in self-reported earnings: The role of previous earnings volatility and individual characteristics," Journal of Development Economics, Elsevier, vol. 96(2), pages 409-421, November.

    More about this item

    Keywords

    measurement error; SIPP; earnings histories;
    All these keywords.

    JEL classification:

    • J31 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Wage Level and Structure; Wage Differentials
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecm:nawm04:123. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum (email available below). General contact details of provider: https://edirc.repec.org/data/essssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.