IDEAS home Printed from https://ideas.repec.org/p/ldr/wpaper/38.html
   My bibliography  Save this paper

Re-weighting the OHS and LFS National household Survey Data to create a consistent series over time: A Cross Entropy Estimation Approach

Author

Listed:
  • Nicola Branson

    (SALDRU, School of Economics, University of Cape Town)

Abstract

In the absence of South African longitudinal data for the ten years post apartheid, national cross-sectional household survey data is frequently used to analyse change over time. When these data are stacked side-by-side however, they reveal inconsistencies both in trends across time and between the household and person level data. These inconsistencies can introduce biases into research which analyse change. This study calculates a new set of person and household weights for the October Household Surveys between 1995 and 1999 and the Labour Force Surveys between 2000 and 2004. A cross entropy estimation approach is used. This approach is favoured because the calculated weights are similar to the initial sample weights (and hence retain the survey design benefits) while simultaneously being consistent with aggregate auxiliary data. A consistent series of aggregates from the Actuarial Society of South Africa (ASSA) model and the 1996 and 2001 South African Census data are used as benchmarks. The new weights result in consistent demographic and geographic trends over time and greater consistency between person and household level data.

Suggested Citation

  • Nicola Branson, 2009. "Re-weighting the OHS and LFS National household Survey Data to create a consistent series over time: A Cross Entropy Estimation Approach," SALDRU Working Papers 38, Southern Africa Labour and Development Research Unit, University of Cape Town.
    • Handle: RePEc:ldr:wpaper:38
    as

    Download full text from publisher

    File URL: https://opensaldru.uct.ac.za/bitstream/handle/11090/17/2009_38.pdf?sequence=1
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Geeta Kingdon & John Knight, 2007. "Unemployment in South Africa, 1995--2003: Causes, Problems and Policies," Journal of African Economies, Centre for the Study of African Economies, vol. 16(5), pages 813-848, November.
    2. Colette Muller, 2003. "Measuring South Africa’s Informal Sector: An Analysis of National Household Surveys," Working Papers 03071, University of Cape Town, Development Policy Research Unit.
    3. Rulof Burger & Derek Yu, 2006. "Wage trends in post-apartheid South Africa: Constructing an earnings series from household survey data," Working Papers 10/2006, Stellenbosch University, Department of Economics.
    4. Dorrit Posel & Daniela Casale, 2003. "What Has Been Happening To Internal Labour Migration In South Africa, 1993–1999?," South African Journal of Economics, Economic Society of South Africa, vol. 71(3), pages 455-479, September.
    5. Golan, Amos & Judge, George G. & Miller, Douglas, 1996. "Maximum Entropy Econometrics," Staff General Research Papers Archive 1488, Iowa State University, Department of Economics.
    6. Nicola Branson & Martin Wittenberg, 2007. "The Measurement Of Employment Status In South Africa Using Cohort Analysis, 1994‐20041," South African Journal of Economics, Economic Society of South Africa, vol. 75(2), pages 313-326, June.
    7. Joachim Merz, 1994. "Microdata Adjustment by the Minimum Information Loss Principle," FFB-Discussionpaper 10, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    8. Özler, Berk, 2007. "Not Separate, Not Equal: Poverty and Inequality in Post-apartheid South Africa," Economic Development and Cultural Change, University of Chicago Press, vol. 55(3), pages 487-529, April.
    9. Joachim Merz & Henning Stolze, 2005. "Representative Time Use Data and Calibration of the American Time Use Studies 1965-1999," FFB-Discussionpaper 54, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg, revised Jan 2006.
    10. Daniela Casale & Colette Muller & Dorrit Posel, 2004. "‘Two Million Net New Jobs': A Reconsideration Of The Rise In Employment In South Africa, 1995–2003," South African Journal of Economics, Economic Society of South Africa, vol. 72(5), pages 978-1002, December.
    11. Ernest Aryeetey & Ravi Kanbur & John Page, 2006. "Introduction," African Development Review, African Development Bank, vol. 18(3), pages 279-282.
    12. Iain Fraser, 2000. "An application of maximum entropy estimation: the demand for meat in the United Kingdom," Applied Economics, Taylor & Francis Journals, vol. 32(1), pages 45-59.
    13. Anne‐Sophie Robilliard & Sherman Robinson, 2003. "Reconciling Household Surveys and National Accounts Data Using a Cross Entropy Estimation Method," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 49(3), pages 395-406, September.
    14. Cally Ardington & David Lam & Murray Leibbrandt & Matthew Welch, 2005. "The Sensitivity of Estimates of Post-Apartheid Changes in South African Poverty and Inequality to key Data Imputations," SALDRU/CSSR Working Papers 106, Southern Africa Labour and Development Research Unit, University of Cape Town.
    15. Malcolm Keswell & Laura Poswell, 2004. "Returns To Education In South Africa: A Retrospective Sensitivity Analysis Of The Available Evidence," South African Journal of Economics, Economic Society of South Africa, vol. 72(4), pages 834-860, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Haroon Bhorat & Ravi Kanbur & Natasha Mayet, 2013. "The impact of sectoral minimum wage laws on employment, wages, and hours of work in South Africa," IZA Journal of Labor & Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 2(1), pages 1-27, December.
    2. Dinkelman, Taryn & Ranchhod, Vimal, 2012. "Evidence on the impact of minimum wage laws in an informal sector: Domestic workers in South Africa," Journal of Development Economics, Elsevier, vol. 99(1), pages 27-45.
    3. Reza C. Daniels, 2012. "A Framework for Investigating Micro Data Quality, with Application to South African Labour Market Household Surveys," SALDRU Working Papers 90, Southern Africa Labour and Development Research Unit, University of Cape Town.
    4. Haroon Bhorat & Ravi Kanbur & Benjamin Stanwix, 2014. "Estimating the Impact of Minimum Wages on Employment, Wages, and Non-Wage Benefits: The Case of Agriculture in South Africa," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 96(5), pages 1402-1419.
    5. Neil Rankin & Rulof Burger & Friedrich Kreuser, 2015. "The elasticity of substitution and labour-displacing technical change in post-apartheid South Africa," WIDER Working Paper Series 101, World Institute for Development Economic Research (UNU-WIDER).
    6. Magejo, Prudence & Benhura, Miracle, 2015. "A Detailed Decomposition Analysis of the Public-Private Sector Wage Gap in South Africa," IZA Discussion Papers 9271, Institute of Labor Economics (IZA).
    7. Rulof Burger & Rachel Jafta & Dieter von Fintel, 2016. "Affirmative action policies and the evolution of post-apartheid South Africa's racial wage gap," WIDER Working Paper Series 066, World Institute for Development Economic Research (UNU-WIDER).
    8. Derek Yu, 2013. "Some factors influencing the comparability and reliability of poverty estimates across household surveys," Working Papers 03/2013, Stellenbosch University, Department of Economics.
    9. repec:pri:rpdevs:dinkelman_ranchhod_minwages_0710 is not listed on IDEAS

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicola Branson & Martin Wittenberg, 2014. "Reweighting South African National Household Survey Data to Create a Consistent Series Over Time: A Cross-Entropy Estimation Approach," South African Journal of Economics, Economic Society of South Africa, vol. 82(1), pages 19-38, March.
    2. Frederick C.v.N. Fourie, 2011. "The South African unemployment debate: three worlds, three discourses?," SALDRU Working Papers 63, Southern Africa Labour and Development Research Unit, University of Cape Town.
    3. Rulof P. Burger & Francis J. Teal, 2015. "The Effect of Schooling on Worker Productivity: Evidence from a South African Industry Panel," Journal of African Economies, Centre for the Study of African Economies, vol. 24(5), pages 629-644.
    4. Serena Merrino, 2020. "Measuring labour earnings inequality in post-apartheid South Africa," WIDER Working Paper Series wp-2020-32, World Institute for Development Economic Research (UNU-WIDER).
    5. Maria S. Floro & Hitomi Komatsu, 2011. "Labor Force Participation, Gender and Work in South Africa: What Can Time Use Data Reveal?," Working Papers 2011-02, American University, Department of Economics.
    6. repec:lrk:lrkwkp:fiirs016 is not listed on IDEAS
    7. Andrew Kerr & Martin Wittenberg, 2019. "Earnings and employment microdata in South Africa," WIDER Working Paper Series wp-2019-47, World Institute for Development Economic Research (UNU-WIDER).
    8. Hassan Essop & Derek Yu, 2008. "The South African informal sector (1997 – 2006)," Working Papers 03/2008, Stellenbosch University, Department of Economics.
    9. Rashid Hassan & James Thurlow, 2011. "Macro–micro feedback links of water management in South Africa: CGE analyses of selected policy regimes," Agricultural Economics, International Association of Agricultural Economists, vol. 42(2), pages 235-247, March.
    10. Fernández, Esteban & Fernández, Paula, 2008. "An extension to Sun's decomposition methodology: The Path Based approach," Energy Economics, Elsevier, vol. 30(3), pages 1020-1036, May.
    11. Erten, Bilge & Leight, Jessica & Tregenna, Fiona, 2019. "Trade liberalization and local labor market adjustment in South Africa," Journal of International Economics, Elsevier, vol. 118(C), pages 448-467.
    12. Rulof Burger & Rachel Jafta & Dieter von Fintel, 2016. "Affirmative action policies and the evolution of post-apartheid South Africa's racial wage gap," WIDER Working Paper Series 066, World Institute for Development Economic Research (UNU-WIDER).
    13. Agenor, Pierre-Richard & Chen, Derek H.C. & Grimm, Michael, 2004. "Linking representative household models with household surveys for poverty analysis : a comparison of alternative methodologies," Policy Research Working Paper Series 3343, The World Bank.
    14. Nicola Branson & Martin Wittenberg, 2007. "The Measurement Of Employment Status In South Africa Using Cohort Analysis, 1994‐20041," South African Journal of Economics, Economic Society of South Africa, vol. 75(2), pages 313-326, June.
    15. Mats Lundahl & Lennart Petersson, 2009. "Post-Apartheid South Africa: An Economic Success Story?," WIDER Working Paper Series RP2009-56, World Institute for Development Economic Research (UNU-WIDER).
    16. Fiona Tregenna, 2012. "What are the distributional implications of halving poverty in South Africa when growth alone is not enough?," Applied Economics, Taylor & Francis Journals, vol. 44(20), pages 2577-2596, July.
    17. Holly Reed, 2013. "Moving Across Boundaries: Migration in South Africa, 1950–2000," Demography, Springer;Population Association of America (PAA), vol. 50(1), pages 71-95, February.
    18. Rui Fragoso & Maria Leonor da Silva Carvalho, 2013. "Estimation of cost allocation coefficients at the farm level using an entropy approach," Journal of Applied Statistics, Taylor & Francis Journals, vol. 40(9), pages 1893-1906, September.
    19. Merz, Joachim, 2002. "Zur Kumulation von Haushaltsstichproben," MPRA Paper 5991, University Library of Munich, Germany.
    20. Pauw, Karl & Leibbrandt, Murray, 2012. "Minimum Wages and Household Poverty: General Equilibrium Macro–Micro Simulations for South Africa," World Development, Elsevier, vol. 40(4), pages 771-783.
    21. Duncan Hodge, 2009. "Growth, Employment And Unemployment In South Africa," South African Journal of Economics, Economic Society of South Africa, vol. 77(4), pages 488-504, December.

    More about this item

    Keywords

    South African national household survey data; Post-stratification; Reweighting; Cross entropy estimation.;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ldr:wpaper:38. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alison Siljeur (email available below). General contact details of provider: https://edirc.repec.org/data/sauctza.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.