IDEAS home Printed from https://ideas.repec.org/p/ldr/wpaper/54.html
   My bibliography  Save this paper

Re-weighting South African National Household Survey Data to create a consistent series over time: A cross entropy estimation approach

Author

Listed:
  • Nicola Branson

    (SALDRU, School of Economics, University of Cape Town)

  • Martin Wittenberg

    (SALDRU, School of Economics, University of Cape Town)

Abstract

In the absence of established longitudinal panel surveys in South African, national cross-sectional household survey data are frequently used to analyse change. When these data are stacked side-byside, however, inconsistencies both in time trends and between household and person level data are found. This study uses a new set of weights calibrated to the ASSA 2003 model totals using a cross entropy estimation approach. This approach is favoured because the calculated weights are similar to the initial sample weights (and hence retain the survey design benefits) but match to a series of age-sex-race and province marginal totals that are consistent over time. The weights are publicly available for a fourteen year period between 1994 and 2007. This is a SALDRU/DataFirst Working Paper

Suggested Citation

  • Nicola Branson & Martin Wittenberg, 2011. "Re-weighting South African National Household Survey Data to create a consistent series over time: A cross entropy estimation approach," SALDRU Working Papers 54, Southern Africa Labour and Development Research Unit, University of Cape Town.
    • Handle: RePEc:ldr:wpaper:54
    as

    Download full text from publisher

    File URL: https://opensaldru.uct.ac.za/bitstream/handle/11090/63/2011_54.pdf?sequence=1
    File Function: Full text
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Martin Wittenberg, 2009. "Sample Survey Calibration: An Informationtheoretic perspective," SALDRU Working Papers 41, Southern Africa Labour and Development Research Unit, University of Cape Town.
    2. Daniela Casale & Colette Muller & Dorrit Posel, 2004. "‘Two Million Net New Jobs': A Reconsideration Of The Rise In Employment In South Africa, 1995–2003," South African Journal of Economics, Economic Society of South Africa, vol. 72(5), pages 978-1002, December.
    3. Colette Muller, 2003. "Measuring South Africa’s Informal Sector: An Analysis of National Household Surveys," Working Papers 03071, University of Cape Town, Development Policy Research Unit.
    4. Rulof Burger & Derek Yu, 2006. "Wage trends in post-apartheid South Africa: Constructing an earnings series from household survey data," Working Papers 10/2006, Stellenbosch University, Department of Economics.
    5. Dorrit Posel & Daniela Casale, 2003. "What Has Been Happening To Internal Labour Migration In South Africa, 1993–1999?," South African Journal of Economics, Economic Society of South Africa, vol. 71(3), pages 455-479, September.
    6. Golan, Amos & Judge, George G. & Miller, Douglas, 1996. "Maximum Entropy Econometrics," Staff General Research Papers Archive 1488, Iowa State University, Department of Economics.
    7. Nicola Branson & Martin Wittenberg, 2007. "The Measurement Of Employment Status In South Africa Using Cohort Analysis, 1994‐20041," South African Journal of Economics, Economic Society of South Africa, vol. 75(2), pages 313-326, June.
    8. Haroon Bhorat & Ravi Kanbur, 2005. "Poverty and Well-being in Post-Apartheid South Africa: An Overview of Data, Outcomes and Policy," Working Papers 05101, University of Cape Town, Development Policy Research Unit.
    9. Ernest Aryeetey & Ravi Kanbur & John Page, 2006. "Introduction," African Development Review, African Development Bank, vol. 18(3), pages 279-282.
    10. Martin Wittenberg, 2010. "An introduction to maximum entropy and minimum cross-entropy estimation using Stata," Stata Journal, StataCorp LP, vol. 10(3), pages 315-330, September.
    11. Cally Ardington & David Lam & Murray Leibbrandt & Matthew Welch, 2005. "The Sensitivity of Estimates of Post-Apartheid Changes in South African Poverty and Inequality to key Data Imputations," SALDRU/CSSR Working Papers 106, Southern Africa Labour and Development Research Unit, University of Cape Town.
    12. Malcolm Keswell & Laura Poswell, 2004. "Returns To Education In South Africa: A Retrospective Sensitivity Analysis Of The Available Evidence," South African Journal of Economics, Economic Society of South Africa, vol. 72(4), pages 834-860, September.
    13. Dorrit Posel, 2003. "The collection of national household survey data in South Africa (1993-2001): Rendering labour migration invisible," Development Southern Africa, Taylor & Francis Journals, vol. 20(3), pages 361-368.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Neil Rankin & Rulof Burger & Friedrich Kreuser, 2015. "The elasticity of substitution and labour-displacing technical change in post-apartheid South Africa," WIDER Working Paper Series 101, World Institute for Development Economic Research (UNU-WIDER).
    2. Magejo, Prudence & Benhura, Miracle, 2015. "A Detailed Decomposition Analysis of the Public-Private Sector Wage Gap in South Africa," IZA Discussion Papers 9271, Institute of Labor Economics (IZA).
    3. Rulof Burger & Rachel Jafta & Dieter von Fintel, 2016. "Affirmative action policies and the evolution of post-apartheid South Africa's racial wage gap," WIDER Working Paper Series 066, World Institute for Development Economic Research (UNU-WIDER).
    4. Amy Thornton & Martin Wittenberg, 2022. "Reweighting the OHS and GHS to improve data quality: Representativeness, household counts, and small households," South African Journal of Economics, Economic Society of South Africa, vol. 90(4), pages 513-534, December.
    5. Serena Merrino, 2020. "Measuring labour earnings inequality in post-apartheid South Africa," WIDER Working Paper Series wp-2020-32, World Institute for Development Economic Research (UNU-WIDER).
    6. Friedrich Kreuser & Rulof Burger & Neil Rankin, 2015. "The elasticity of substitution and labour-displacing technical change in post-apartheid South Africa," WIDER Working Paper Series wp-2015-101, World Institute for Development Economic Research (UNU-WIDER).
    7. Neryvia Pillay Bell, 2020. "The impacts of unconditional cash transfers on schooling in adolescence and young adulthood: Evidence from South Africa," Working Papers 821, Economic Research Southern Africa.
    8. Jacqueline Mosomi, 2019. "Distributional changes in the gender wage gap in the post-apartheid South African labour market," WIDER Working Paper Series wp-2019-17, World Institute for Development Economic Research (UNU-WIDER).
    9. Rulof Burger & Rachel Jafta & Dieter von Fintel, 2016. "Affirmative action policies and the evolution of post-apartheid South Africa's racial wage gap," WIDER Working Paper Series wp-2016-66, World Institute for Development Economic Research (UNU-WIDER).
    10. Andrew Kerr & Martin Wittenberg, 2019. "Earnings and employment microdata in South Africa," WIDER Working Paper Series wp-2019-47, World Institute for Development Economic Research (UNU-WIDER).
    11. Sharp, Matthew, 2021. "The labour market impacts of female internal migration: Evidence from the end of Apartheid," Regional Science and Urban Economics, Elsevier, vol. 91(C).
    12. Oyenubi, Adeola & Mosomi, Jacqueline, 2024. "Utility of inequality sensitive measures of the gender wage gap: Evidence from South Africa," Economic Analysis and Policy, Elsevier, vol. 81(C), pages 576-590.
    13. Reza C. Daniels, 2012. "A Framework for Investigating Micro Data Quality, with Application to South African Labour Market Household Surveys," SALDRU Working Papers 90, Southern Africa Labour and Development Research Unit, University of Cape Town.
    14. Martin Wittenberg, 2017. "Wages and Wage Inequality in South Africa 1994–2011: Part 1 – Wage Measurement and Trends," South African Journal of Economics, Economic Society of South Africa, vol. 85(2), pages 279-297, June.
    15. Wittenberg, Martin., 2014. "Analysis of employment, real wage, and productivity trends in South Africa since 1994," ILO Working Papers 994847703402676, International Labour Organization.
    16. repec:ilo:ilowps:484770 is not listed on IDEAS
    17. Wittenberg, Martin & Pirouz, Farah, 2013. "The measurement of earnings in the post-Apartheid period: An overview," SALDRU Working Papers 108, Southern Africa Labour and Development Research Unit, University of Cape Town.
    18. Takwanisa Machemedze & Andrew Kerr & Rob Dorrington, 2020. "South African population projection and household survey sample weight recalibration," WIDER Working Paper Series wp-2020-67, World Institute for Development Economic Research (UNU-WIDER).
    19. Anne Konrad & Jan Pablo Burgard & Ralf Münnich, 2021. "A Two‐level GREG Estimator for Consistent Estimation in Household Surveys," International Statistical Review, International Statistical Institute, vol. 89(3), pages 635-656, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicola Branson, 2009. "Re-weighting the OHS and LFS National household Survey Data to create a consistent series over time: A Cross Entropy Estimation Approach," SALDRU Working Papers 38, Southern Africa Labour and Development Research Unit, University of Cape Town.
    2. Serena Merrino, 2020. "Measuring labour earnings inequality in post-apartheid South Africa," WIDER Working Paper Series wp-2020-32, World Institute for Development Economic Research (UNU-WIDER).
    3. Frederick C.v.N. Fourie, 2011. "The South African unemployment debate: three worlds, three discourses?," SALDRU Working Papers 63, Southern Africa Labour and Development Research Unit, University of Cape Town.
    4. Rulof P. Burger & Francis J. Teal, 2015. "The Effect of Schooling on Worker Productivity: Evidence from a South African Industry Panel," Journal of African Economies, Centre for the Study of African Economies, vol. 24(5), pages 629-644.
    5. Andrew Kerr & Martin Wittenberg, 2019. "Earnings and employment microdata in South Africa," WIDER Working Paper Series wp-2019-47, World Institute for Development Economic Research (UNU-WIDER).
    6. Hassan Essop & Derek Yu, 2008. "The South African informal sector (1997 – 2006)," Working Papers 03/2008, Stellenbosch University, Department of Economics.
    7. Rashid Hassan & James Thurlow, 2011. "Macro–micro feedback links of water management in South Africa: CGE analyses of selected policy regimes," Agricultural Economics, International Association of Agricultural Economists, vol. 42(2), pages 235-247, March.
    8. Rulof Burger & Rachel Jafta & Dieter von Fintel, 2016. "Affirmative action policies and the evolution of post-apartheid South Africa's racial wage gap," WIDER Working Paper Series 066, World Institute for Development Economic Research (UNU-WIDER).
    9. Mats Lundahl & Lennart Petersson, 2009. "Post-Apartheid South Africa: An Economic Success Story?," WIDER Working Paper Series RP2009-56, World Institute for Development Economic Research (UNU-WIDER).
    10. Holly Reed, 2013. "Moving Across Boundaries: Migration in South Africa, 1950–2000," Demography, Springer;Population Association of America (PAA), vol. 50(1), pages 71-95, February.
    11. Neil Rankin & Rulof Burger & Friedrich Kreuser, 2015. "The elasticity of substitution and labour-displacing technical change in post-apartheid South Africa," WIDER Working Paper Series 101, World Institute for Development Economic Research (UNU-WIDER).
    12. Rulof Burger & Rachel Jafta & Dieter von Fintel, 2016. "Affirmative action policies and the evolution of post-apartheid South Africa's racial wage gap," WIDER Working Paper Series wp-2016-66, World Institute for Development Economic Research (UNU-WIDER).
    13. Leibbrandt Murray & Levinsohn James A & McCrary Justin, 2010. "Incomes in South Africa after the Fall of Apartheid," Journal of Globalization and Development, De Gruyter, vol. 1(1), pages 1-62, January.
    14. Jacqueline Mosomi, 2019. "Distributional changes in the gender wage gap in the post-apartheid South African labour market," WIDER Working Paper Series wp-2019-17, World Institute for Development Economic Research (UNU-WIDER).
    15. Friedrich Kreuser & Rulof Burger & Neil Rankin, 2015. "The elasticity of substitution and labour-displacing technical change in post-apartheid South Africa," WIDER Working Paper Series wp-2015-101, World Institute for Development Economic Research (UNU-WIDER).
    16. Maria S. Floro & Hitomi Komatsu, 2011. "Labor Force Participation, Gender and Work in South Africa: What Can Time Use Data Reveal?," Working Papers 2011-02, American University, Department of Economics.
    17. Posel, Dorrit & Fairburn, James A. & Lund, Frances, 2006. "Labour migration and households: A reconsideration of the effects of the social pension on labour supply in South Africa," Economic Modelling, Elsevier, vol. 23(5), pages 836-853, September.
    18. Haroon Bhorat & Sumayya Goga, 2012. "The Gender Wage Gap in the Post-apartheid South African Labour Market," Working Papers 12148, University of Cape Town, Development Policy Research Unit.
    19. Amina Ebrahim & Kezia Lilenstein, 2019. "Gender and the South African labour market: Policy relevant research possibilities using South African tax data," WIDER Working Paper Series wp-2019-31, World Institute for Development Economic Research (UNU-WIDER).
    20. repec:lrk:lrkwkp:fiirs016 is not listed on IDEAS
    21. Darma Mahadea, 2012. "Prospects Of Entrepreneurship To The Challenge Of Job Creation In South Africa," Journal of Developmental Entrepreneurship (JDE), World Scientific Publishing Co. Pte. Ltd., vol. 17(04), pages 1-17.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ldr:wpaper:54. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alison Siljeur (email available below). General contact details of provider: https://edirc.repec.org/data/sauctza.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.