IDEAS home Printed from https://ideas.repec.org/p/diw/diwsop/diw_sp49.html
   My bibliography  Save this paper

Item Non-response and Imputation of Annual Labor Income in Panel Surveys from a Cross-National Perspective

Author

Listed:
  • Joachim R. Frick
  • Markus M. Grabka

Abstract

Using data on annual individual labor income from three representative panel datasets (German SOEP, British BHPS, Australian HILDA) we investigate a) the selectivity of item non-response (INR) and b) the impact of imputation as a prominent post-survey means to cope with this type of measurement error on prototypical analyses (earnings inequality, mobility and wage regressions) in a cross-national setting. Given the considerable variation of INR across surveys as well as the varying degree of selectivity build into the missing process, there is substantive and methodological interest in an improved harmonization of (income) data production as well as of imputation strategies across surveys. All three panels make use of longitudinal information in their respective imputation procedures, however, there are marked differences in the implementation. Firstly, although the probability of INR is quantitatively similar across countries, our empirical investigation identifies cross-country differences with respect to the factors driving INR: survey-related aspects as well as indicators accounting for variability and complexity of labor income composition appear to be relevant. Secondly, longitudinal analyses yield a positive correlation of INR on labor income data over time and provide evidence of INR being a predictor of subsequent unit-non-response, thus supporting the “cooperation continuum” hypothesis in all three panels. Thirdly, applying various mobility indicators there is a robust picture about earnings mobility being significantly understated using information from completely observed cases only. Finally, regression results for wage equations based on observed (“complete case analysis”) vs. all cases and controlling for imputation status, indicate that individuals with imputed incomes, ceteris paribus, earn significantly above average in SOEP and HILDA, while this relationship is negative using BHPS data. However, once applying the very same imputation procedure used for HILDA and SOEP, namely the “row-and-columnimputation” approach suggested by Little & Su (1989), also to BHPS-data, this result is reversed, i.e., individuals in the BHPS whose income has been imputed earn above average as well. In our view, the reduction in crossnational variation resulting from sensitivity to the choice of imputation approaches underscores the importance of investing more in the improved cross-national harmonization of imputation techniques.

Suggested Citation

  • Joachim R. Frick & Markus M. Grabka, 2007. "Item Non-response and Imputation of Annual Labor Income in Panel Surveys from a Cross-National Perspective," SOEPpapers on Multidisciplinary Panel Data Research 49, DIW Berlin, The German Socio-Economic Panel (SOEP).
  • Handle: RePEc:diw:diwsop:diw_sp49
    as

    Download full text from publisher

    File URL: https://www.diw.de/documents/publikationen/73/diw_01.c.65965.de/diw_sp0049.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Oliver Serfling, 2005. "The Interaction between Item, Questionnaire and Unit Nonresponse in the German SOEP," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 125(1), pages 195-205.
    2. Regina Riphahn & Oliver Serfling, 2005. "Item non-response on income and wealth questions," Empirical Economics, Springer, vol. 30(2), pages 521-538, September.
    3. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    4. Cheti Nicoletti & Franco Peracchi, 2006. "The effects of income imputation on microanalyses: evidence from the European Community Household Panel," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(3), pages 625-646, July.
    5. Little, Roderick J A, 1988. "Missing-Data Adjustments in Large Surveys," Journal of Business & Economic Statistics, American Statistical Association, vol. 6(3), pages 287-296, July.
    6. Daniel H. Hill & Robert J. Willis, 2001. "Reducing Panel Attrition: A Search for Effective Policy Instruments," Journal of Human Resources, University of Wisconsin Press, vol. 36(3), pages 416-438.
    7. Susanne Rässler & Regina Riphahn, 2006. "Survey item nonresponse and its treatment," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 90(1), pages 217-232, March.
    8. Gert G. Wagner & Joachim R. Frick & Jürgen Schupp, 2007. "The German Socio-Economic Panel Study (SOEP) – Scope, Evolution and Enhancements," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 127(1), pages 139-169.
    9. Denise Hawkes & Ian Plewis, 2006. "Modelling non‐response in the National Child Development Study," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(3), pages 479-491, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Christian Aßmann & Ariane Würbach & Solange Goßmann & Ferdinand Geissler & Anika Bela, 2017. "Nonparametric Multiple Imputation for Questionnaires with Individual Skip Patterns and Constraints: The Case of Income Imputation in the National Educational Panel Study," Sociological Methods & Research, , vol. 46(4), pages 864-897, November.
    2. Michael Ziegelmeyer, 2013. "Illuminate the unknown: evaluation of imputation procedures based on the SAVE survey," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 97(1), pages 49-76, January.
    3. Katja Landau & Stephan Klasen & Walter Zucchini, 2012. "Measuring Vulnerability to Poverty Using Long-Term Panel Data," Courant Research Centre: Poverty, Equity and Growth - Discussion Papers 118, Courant Research Centre PEG.
    4. Frick, Joachim R. & Grabka, Markus M. & Groh-Samberg, Olaf, 2012. "Dealing With Incomplete Household Panel Data in Inequality Research," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 41(1), pages 89-123.
    5. Ute Hanefeld & Jürgen Schupp, 2008. "The First Six Waves of SOEP: The Panel Project in the Years 1983 to 1989," SOEPpapers on Multidisciplinary Panel Data Research 146, DIW Berlin, The German Socio-Economic Panel (SOEP).
    6. Carsten Kuchler & Martin Spiess, 2009. "The data quality concept of accuracy in the context of publicly shared data sets," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 3(1), pages 67-80, June.
    7. Joachim R. Frick & Markus M. Grabka & Eva M. Sierminska, 2007. "Representative Wealth Data for Germany from the German SOEP: The Impact of Methodological Decisions around Imputation and the Choice of the Aggregation Unit," Discussion Papers of DIW Berlin 672, DIW Berlin, German Institute for Economic Research.
    8. Ziegelmeyer, Michael, 2009. "Documentation of the logical imputation using the panel structure of the 2003-2008 German SAVE Survey," Papers 08-41, Sonderforschungsbreich 504.
    9. Robert Breunig & Joseph Mercante, 2010. "The Accuracy of Predicted Wages of the Non‐Employed and Implications for Policy Simulations from Structural Labour Supply Models," The Economic Record, The Economic Society of Australia, vol. 86(272), pages 49-70, March.
    10. Joachim R. Frick & Kristina Krell, 2010. "Measuring Income in Household Panel Surveys for Germany: A Comparison of EU-SILC and SOEP," SOEPpapers on Multidisciplinary Panel Data Research 265, DIW Berlin, The German Socio-Economic Panel (SOEP).
    11. Frick, Joachim R. & Jenkings, Stephen P. & Lillard, Dean R. & Lipps, Oliver & Wooden, Mark, 2007. "The Cross-National Equivalent File (CNEF) and Its Member Country Household Panel Studies," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 127(4), pages 627-654.
    12. Ute Hanefeld & Jürgen Schupp, 2008. "Die ersten sechs Wellen des SOEP: das Panelprojekt in den ersten Jahren 1983-1989," Vierteljahrshefte zur Wirtschaftsforschung / Quarterly Journal of Economic Research, DIW Berlin, German Institute for Economic Research, vol. 77(3), pages 27-42.
    13. Brian Nolan & Ive Marx & Wiemer Salverda, 2011. "GINI DP 9: Comparable Indicators of Inequality Across Countries," GINI Discussion Papers 9, AIAS, Amsterdam Institute for Advanced Labour Studies.
    14. Mark Brooks & Rattiya S. Lippe & Hermann Waibel, 2020. "Comprehensive data quality studies as a component of poverty assessments," TVSEP Working Papers wp-019, Leibniz Universitaet Hannover, Institute for Environmental Economics and World Trade, Project TVSEP.
    15. Stefaan Walgrave & Jeroen K. Joly, 2018. "Surveying individual political elites: a comparative three-country study," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(5), pages 2221-2237, September.
    16. S. Anger & F. Frick & J. Goebel & M. Grabka & O. Groh-Samberg & H. Haas & E. Holst & P. Krause & M. Kroh & H. Lohmann & J. Schupp & I. Sieber & T. Siedler & C. Schmitt & C. K. Spieß & I. Tucci & G. G., 2009. "Developing SOEPsurvey and SOEPservice: The (Near) Future of the German Socio-Economic Panel Study (SOEP)," SOEPpapers on Multidisciplinary Panel Data Research 155, DIW Berlin, The German Socio-Economic Panel (SOEP).
    17. S. Anger & J. R. Frick & J. Goebel & M. M. Grabka & O. Groh-Samberg & H. Haas & E. Holst & P. Krause & M. Kroh & H. Lohmann & R. Pischner & J. Schupp & I. Sieber & T. Siedler & C. Schmitt & C. K. Spie, 2008. "Zur Weiterentwicklung von SOEPsurvey und SOEPservice," Vierteljahrshefte zur Wirtschaftsforschung / Quarterly Journal of Economic Research, DIW Berlin, German Institute for Economic Research, vol. 77(3), pages 157-177.
    18. Bernd Hayo & Edith Neuenkirch, 2018. "Survey on Germans’ Attitudes Towards and Knowledge of Monetary Policy Issues: Documentation of Survey Methodology and Descriptive Results," MAGKS Papers on Economics 201821, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Westermeier, Christian & Grabka, Markus M., 2016. "Longitudinal Wealth Data and Multiple Imputation: An Evaluation Study," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 10(3), pages 237-252.
    2. Joachim Frick & Kristina Krell, 2011. "Einkommensmessungen in Haushaltspanelstudien für Deutschland: Ein Vergleich von EU-SILC und SOEP," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 5(3), pages 221-248, December.
    3. Adel Bosch & Steven F. Koch, 2021. "Individual and Household Debt: Does Imputation Choice Matter?," Working Papers 202141, University of Pretoria, Department of Economics.
    4. Frick, Joachim R. & Grabka, Markus M. & Groh-Samberg, Olaf, 2012. "Dealing With Incomplete Household Panel Data in Inequality Research," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 41(1), pages 89-123.
    5. Joachim R. Frick & Kristina Krell, 2010. "Measuring Income in Household Panel Surveys for Germany: A Comparison of EU-SILC and SOEP," SOEPpapers on Multidisciplinary Panel Data Research 265, DIW Berlin, The German Socio-Economic Panel (SOEP).
    6. Raymundo M. Campos-Vázquez, 2013. "Efectos de los ingresos no reportados en el nivel y tendencia de la pobreza laboral en México," Ensayos Revista de Economia, Universidad Autonoma de Nuevo Leon, Facultad de Economia, vol. 0(2), pages 23-54, November.
    7. Fossen, Frank M. & König, Johannes, 2015. "Public health insurance and entry into self-employment," VfS Annual Conference 2015 (Muenster): Economic Development - Theory and Policy 112934, Verein für Socialpolitik / German Economic Association.
    8. Michael Fertig & Katja Görlitz, 2012. "Item Nonresponse in Wages: Testing for Biased Estimates in Wage Equations," Ruhr Economic Papers 0333, Rheinisch-Westfälisches Institut für Wirtschaftsforschung, Ruhr-Universität Bochum, Universität Dortmund, Universität Duisburg-Essen.
    9. Verbeek, M.J.C.M. & Nijman, T.E., 1992. "Incomplete panels and selection bias : A survey," Discussion Paper 1992-7, Tilburg University, Center for Economic Research.
    10. Hai Zhong, 2010. "The impact of missing data in the estimation of concentration index: a potential source of bias," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 11(3), pages 255-266, June.
    11. Fischer, Benjamin & Jessen, Robin & Steiner, Viktor, 2019. "Work incentives and the cost of redistribution via tax-transfer reforms under constrained labor supply," Discussion Papers 2019/10, Free University Berlin, School of Business & Economics.
    12. McGovern, Mark E. & Canning, David & Bärnighausen, Till, 2018. "Accounting for non-response bias using participation incentives and survey design: An application using gift vouchers," Economics Letters, Elsevier, vol. 171(C), pages 239-244.
    13. Adrian Chadi, 2019. "Dissatisfied with life or with being interviewed? Happiness and the motivation to participate in a survey," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 53(3), pages 519-553, October.
    14. Michael Fertig & Stefanie Schurer, 2007. "Earnings Assimilation of Immigrants in Germany: The Importance of Heterogeneity and Attrition Bias," SOEPpapers on Multidisciplinary Panel Data Research 30, DIW Berlin, The German Socio-Economic Panel (SOEP).
    15. Johannes Geyer & Thorben Korfhage, 2015. "Long‐term Care Insurance and Carers' Labor Supply – A Structural Model," Health Economics, John Wiley & Sons, Ltd., vol. 24(9), pages 1178-1191, September.
    16. Ekaterina Selezneva & Philippe Van Kerm, 2016. "A distribution-sensitive examination of the gender wage gap in Germany," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 14(1), pages 21-40, March.
    17. Daniel Schunk, 2007. "A Markov Chain Monte Carlo Multiple Imputation Procedure for Dealing with Item Nonresponse in the German SAVE Survey," MEA discussion paper series 07121, Munich Center for the Economics of Aging (MEA) at the Max Planck Institute for Social Law and Social Policy.
    18. Koumenta, Maria & Pagliero, Mario & Rostam-Afschar, Davud, 2020. "Occupational licensing and the gender wage gap," Hohenheim Discussion Papers in Business, Economics and Social Sciences 13-2020, University of Hohenheim, Faculty of Business, Economics and Social Sciences.
    19. Christina Boll & Andreas Lagemann, 2018. "Does Culture Trump Money? Employment and Childcare Use of Migrant and Non-Migrant Mothers of Pre-School Children in Germany," SOEPpapers on Multidisciplinary Panel Data Research 1015, DIW Berlin, The German Socio-Economic Panel (SOEP).
    20. Marco Caliendo & Frank Fossen & Alexander Kritikos, 2014. "Personality characteristics and the decisions to become and stay self-employed," Small Business Economics, Springer, vol. 42(4), pages 787-814, April.

    More about this item

    Keywords

    Item non-response; imputation; income inequality; income mobility; panel data; SOEP; BHPS; HILDA;
    All these keywords.

    JEL classification:

    • J31 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Wage Level and Structure; Wage Differentials
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • D33 - Microeconomics - - Distribution - - - Factor Income Distribution

    NEP fields

    This paper has been announced in the following NEP Reports:

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. SOEP based publications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:diw:diwsop:diw_sp49. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Bibliothek (email available below). General contact details of provider: https://edirc.repec.org/data/sodiwde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.