IDEAS home Printed from https://ideas.repec.org/p/diw/diwsop/diw_sp290.html
   My bibliography  Save this paper

Dealing with Incomplete Household Panel Data in Inequality Research

Author

Listed:
  • Joachim R. Frick
  • Markus M. Grabka
  • Olaf Groh-Samberg

Abstract

Population surveys around the world face the problem of declining cooperation and participation rates of respondents. Not only can item nonresponse and unit nonresponse impair important outcome measures for inequality research such as total household disposable income; there is also a further case of missingness confronting household panel surveys that potentially biases results. The approach commonly used in such surveys of interviewing all adult household members and aggregating their individual incomes to yield a final outcome measure for welfare analyses often suffers from partial unit non-response (PUNR), i.e., the non-response of at least one unit, or member, of an otherwise participating household. In these cases, the aggregate income of all household members lacks at least one individual's income. These processes are typically not random and require appropriate correction. Using data from more than twenty waves of the German Socio-Economic Panel (SOEP) we evaluate four different strategies to deal with this phenomenon: (a) Ignorance, i.e., assuming the missing individual's income to be zero. (b) Adjustment of the equivalence scale to account for differences in household size and composition. (c) Elimination of all households observed to suffer PUNR, and re-weighting of households observed to be at risk of but not affected by PUNR. (d) Longitudinal imputation of the missing income components. The aim of this paper is to show how the choice of technique affects substantive results in the inequality research. We find indications of substantial bias on income inequality and poverty as well as on income mobility. These findings are obviously even more important in cross-national comparative analyses if the data providers in the individual countries deal differently with PUNR in the underlying data.

Suggested Citation

  • Joachim R. Frick & Markus M. Grabka & Olaf Groh-Samberg, 2010. "Dealing with Incomplete Household Panel Data in Inequality Research," SOEPpapers on Multidisciplinary Panel Data Research 290, DIW Berlin, The German Socio-Economic Panel (SOEP).
  • Handle: RePEc:diw:diwsop:diw_sp290
    as

    Download full text from publisher

    File URL: https://www.diw.de/documents/publikationen/73/diw_01.c.354683.de/diw_sp0290.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. A.B. Atkinson & F. Bourguignon (ed.), 2000. "Handbook of Income Distribution," Handbook of Income Distribution, Elsevier, edition 1, volume 1, number 1.
    2. Timothy Smeeding & Gunther Schmaus & Brigitte Buhmann & Lee Rainwater, 1988. "Equivalence Scales, Well-Being, Inequality and Poverty: Sensitivity Estimates Across Ten Countries Using the LIS Database," LIS Working papers 17, LIS Cross-National Data Center in Luxembourg.
    3. Foster, James & Greer, Joel & Thorbecke, Erik, 1984. "A Class of Decomposable Poverty Measures," Econometrica, Econometric Society, vol. 52(3), pages 761-766, May.
    4. Markus M. Grabka & Joachim R. Frick, 2008. "The Shrinking German Middle Class: Signs of Long-Term Polarization in Disposable Income?," Weekly Report, DIW Berlin, German Institute for Economic Research, vol. 4(4), pages 21-27.
    5. Cheti Nicoletti & Franco Peracchi, 2006. "The effects of income imputation on microanalyses: evidence from the European Community Household Panel," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(3), pages 625-646, July.
    6. Frick, Joachim R. & Grabka, Markus M., 2007. "Item Non-Response and Imputation of Annual Labor Income in Panel Surveys from a Cross-National Perspective," IZA Discussion Papers 3043, Institute of Labor Economics (IZA).
    7. Jens Bonke & Hans Uldall-Poulsen, 2007. "Why do families actually pool their income? Evidence from Denmark," Review of Economics of the Household, Springer, vol. 5(2), pages 113-128, June.
    8. Timothy M. Smeeding & Daniel H. Weinberg, 2001. "Toward a Uniform Definition of Household Income," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 47(1), pages 1-24, March.
    9. Joachim R. Frick & Markus M. Grabka, 2003. "Imputed Rent and Income Inequality: A Decomposition Analysis for Great Britain, West Germany and the U.S," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 49(4), pages 513-537, December.
    10. Daniel H. Hill & Robert J. Willis, 2001. "Reducing Panel Attrition: A Search for Effective Policy Instruments," Journal of Human Resources, University of Wisconsin Press, vol. 36(3), pages 416-438.
    11. Brigitte Buhmann & Lee Rainwater & Guenther Schmaus & Timothy M. Smeeding, 1988. "Equivalence Scales, Well‐Being, Inequality, And Poverty: Sensitivity Estimates Across Ten Countries Using The Luxembourg Income Study (Lis) Database," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 34(2), pages 115-142, June.
    12. P. Jenkins, Stephen, 2010. "The British Household Panel Survey and its income data," ISER Working Paper Series 2010-33, Institute for Social and Economic Research.
    13. Lynn, Peter & Laurie, Heather, 2008. "The use of respondent incentives on longitudinal surveys," ISER Working Paper Series 2008-42, Institute for Social and Economic Research.
    14. Gert G. Wagner & Joachim R. Frick & Jürgen Schupp, 2007. "The German Socio-Economic Panel Study (SOEP) – Scope, Evolution and Enhancements," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 127(1), pages 139-169.
    15. repec:bla:econom:v:66:y:1999:i:264:p:455-71 is not listed on IDEAS
    16. Arie Kapteyn & Pierre-Carl Michaud & James P. Smith & Arthur Van Soest, 2006. "Effects of Attrition and Non-Response in the Health and Retirement Study," Working Papers WR-407, RAND Corporation.
    17. repec:bla:revinw:v:34:y:1988:i:2:p:115-42 is not listed on IDEAS
    18. Cristina Barceló, 2008. "The impact of alternative imputation methods on the measurement of income and wealth: Evidence from the Spanish survey of household finances," Working Papers 0829, Banco de España.
    19. Shorrocks, Anthony, 1978. "Income inequality and income mobility," Journal of Economic Theory, Elsevier, vol. 19(2), pages 376-393, December.
    20. Kapteyn, Arie & Michaud, Pierre-Carl & Smith, James P. & van Soest, Arthur, 2006. "Effects of Attrition and Non-Response in the Health and Retirement Study," IZA Discussion Papers 2246, Institute for the Study of Labor (IZA).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jonas Beste & Markus M. Grabka & Jan Goebel, 2018. "Armut in Deutschland [Poverty in Germany]," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 12(1), pages 27-62, April.
    2. Anthony Barnes Atkinson, 2010. "Macerata Lectures on European Economic Policy. Poverty and the EU: the New Decade," Working Papers 24-2010, Macerata University, Department of Studies on Economic Development (DiSSE), revised May 2010.
    3. Hornykewycz, Anna & Kapeller, Jakob & Weber, Jan David & Schütz, Bernhard & Cserjan, Lukas, 2024. "Carbon neutrality in the residential sector: A general toolbox and the case of Germany," ifso working paper series 41, University of Duisburg-Essen, Institute for Socioeconomics (ifso).
    4. Jaenichen, Ursula & Sakshaug, Joseph, 2012. "Multiple imputation of household income in the first wave of PASS," FDZ Methodenreport 201202_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    5. Beatriz Larraz, 2015. "Decomposing the Gini Inequality Index," Sociological Methods & Research, , vol. 44(3), pages 508-533, August.
    6. Jan Goebel & Peter Krause & Joachim R. Frick & Markus M. Grabka & Gert G. Wagner, 2010. "Eine exemplarische Anwendung der regionalisierten Preisniveau-Daten des BBSR auf die Einkommensverteilung für die Jahre 2005 bis 2008," SOEPpapers on Multidisciplinary Panel Data Research 284, DIW Berlin, The German Socio-Economic Panel (SOEP).
    7. J. F. Muñoz & E. à lvarez-Verdejo & R. M. García-Fernández, 2018. "On Estimating the Poverty Gap and the Poverty Severity Indices With Auxiliary Information," Sociological Methods & Research, , vol. 47(3), pages 598-625, August.
    8. Coban, Mustafa & Sauerhammer, Sarah, 2017. "Transmission channels of intergenerational income mobility: Empirical evidence from Germany and the Unites States," Discussion Paper Series 138, Julius Maximilian University of Würzburg, Chair of Economic Order and Social Policy.
    9. Theresa Köhler, 2016. "Income and Wealth Poverty in Germany," SOEPpapers on Multidisciplinary Panel Data Research 857, DIW Berlin, The German Socio-Economic Panel (SOEP).
    10. repec:iab:iabfme:201202(en is not listed on IDEAS
    11. Markus M. Grabka, 2013. "Codebook for the $PEQUIV File 1984-2012: CNEF Variables with Extended Income Information for the SOEP," Data Documentation 69, DIW Berlin, German Institute for Economic Research.
    12. Markus M. Grabka, 2014. "Codebook for the $PEQUIV File 1984-2013: CNEF Variables with Extended Income Information for the SOEP," Data Documentation 74, DIW Berlin, German Institute for Economic Research.
    13. Markus M. Grabka, 2011. "Codebook for the $PEQUIV File 1984-2010: CNEF Variables with Extended Income Information for the SOEP," Data Documentation 57, DIW Berlin, German Institute for Economic Research.
    14. Markus M. Grabka, 2012. "Codebook for the $PEQUIV File 1984-2011: CNEF Variables with Extended Income Information for the SOEP," Data Documentation 65, DIW Berlin, German Institute for Economic Research.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Salvatore Morelli & Timothy Smeeding & Jeffrey Thompson, 2014. "Post-1970 Trends in Within-Country Inequality and Poverty: Rich and Middle Income Countries," CSEF Working Papers 356, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
    2. Joachim R. Frick & Kristina Krell, 2010. "Measuring Income in Household Panel Surveys for Germany: A Comparison of EU-SILC and SOEP," SOEPpapers on Multidisciplinary Panel Data Research 265, DIW Berlin, The German Socio-Economic Panel (SOEP).
    3. Frick, Joachim R. & Grabka, Markus M. & Smeeding, Timothy M. & Tsakloglou, Panos, 2010. "Distributional Effects of Imputed Rents in Five European Countries," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 19(3), pages 167-179.
    4. Frick, Joachim R. & Grabka, Markus M., 2009. "Accounting for Imputed and Capital Income Flows in Income Inequality Analyses," IZA Discussion Papers 4634, Institute of Labor Economics (IZA).
    5. Cem Baslevent & Meltem Dayoglu, 2005. "The Effect of Squatter Housing on Income Distribution in Urban Turkey," Urban Studies, Urban Studies Journal Limited, vol. 42(1), pages 31-45, January.
    6. Disney, Richard & Whitehouse, Edward, 2002. "The economic well-being of older people in international perspective: a critical review," MPRA Paper 10398, University Library of Munich, Germany.
    7. Maitra, Pushkar & Ray, Ranjan, 2003. "The effect of transfers on household expenditure patterns and poverty in South Africa," Journal of Development Economics, Elsevier, vol. 71(1), pages 23-49, June.
    8. Riccardo Massari, 2005. "A Measure of Welfare Based on Permanent Income Hypothesis: An Application on Italian Households Budgets," Giornale degli Economisti, GDE (Giornale degli Economisti e Annali di Economia), Bocconi University, vol. 64(1), pages 55-92, September.
    9. John Creedy & Cath Sleeman, 2005. "Adult equivalence scales, inequality and poverty," New Zealand Economic Papers, Taylor & Francis Journals, vol. 39(1), pages 51-81.
    10. Joachim R. Frick & Markus M. Grabka, 2007. "Item Non-response and Imputation of Annual Labor Income in Panel Surveys from a Cross-National Perspective," Discussion Papers of DIW Berlin 736, DIW Berlin, German Institute for Economic Research.
    11. William Horrace & Joseph Marchand & Timothy Smeeding, 2008. "Ranking inequality: Applications of multivariate subset selection," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 6(1), pages 5-32, March.
    12. John Creedy & Catherine Sleeman, 2004. "Adult Equivalence Scales, Inequality and Poverty in New Zealand," Treasury Working Paper Series 04/21, New Zealand Treasury.
    13. Núñez Velázquez, José Javier, 2009. "Estado actual y nuevas aproximaciones a la medición de la pobreza/Current Status and New Approaches to the Measurement of Poverty," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 27, pages 325-346, Agosto.
    14. Vecchi, Giovanni & Coppola, Michela, 2006. "Nutrition and growth in Italy, 1861-1911: What macroeconomic data hide," Explorations in Economic History, Elsevier, vol. 43(3), pages 438-464, July.
    15. Gordon Anderson, 2003. "Poverty in America 1970-1990: who did gain ground? An application of stochastic dominance criteria employing simultaneous inequality tests in a partial panel," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(6), pages 621-640.
    16. Joachim Frick & Markus Grabka & Olaf Groh-Samberg, 2012. "The impact of home production on economic inequality in Germany," Empirical Economics, Springer, vol. 43(3), pages 1143-1169, December.
    17. Tess Penne & Irene Cussó Parcerisas & Lauri Mäkinen & Bérénice Storms & Tim Goedemé, 2016. "Can reference budgets be used as a poverty line?," ImPRovE Working Papers 16/05, Herman Deleeck Centre for Social Policy, University of Antwerp.
    18. Whitehouse, Edward, 2000. "How Poor are the Old? A Survey of Evidence from 44 Countries," MPRA Paper 14177, University Library of Munich, Germany.
    19. Yi Chen & Frank A. Cowell, 2017. "Mobility in China," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 63(2), pages 203-218, June.
    20. Elena Bárcena Martín & Frank A. Cowell, 2006. "Static and Dynamic Poverty in Spain, 1993-2000," Hacienda Pública Española / Review of Public Economics, IEF, vol. 179(4), pages 51-77, September.

    More about this item

    Keywords

    Household Panel Surveys; Partial Unit Non-Response; Inequality; Mobility; Imputation; SOEP;
    All these keywords.

    JEL classification:

    • D33 - Microeconomics - - Distribution - - - Factor Income Distribution
    • I32 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Measurement and Analysis of Poverty
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. SOEP based publications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:diw:diwsop:diw_sp290. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Bibliothek (email available below). General contact details of provider: https://edirc.repec.org/data/sodiwde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.