IDEAS home Printed from https://ideas.repec.org/p/nbp/nbpmis/372.html
   My bibliography  Save this paper

Measuring labour force participation during pandemics and methodological changes

Author

Listed:
  • Katarzyna Saczuk

    (SGH Warsaw School of Economics
    University of Warsaw
    Narodowy Bank Polski)

  • Olga Zajkowska

    (University of Warsaw
    Narodowy Bank Polski)

Abstract

In 2020-2021, several methodological changes were introduced in the Labour Force Survey (LFS), which caused disruptions in data analysis and inference: the Covid-19 pandemic forced a change in the data collection method, and from the beginning of 2021, planned changes related to the harmonisation of social surveys in the EU were introduced (changes in the subject and object coverage of the survey). The aim of this paper is to examine the impact of the methodological changes on the measurement of labour force participation in Poland. Based on the analysis of quarterly LFS data over the period Q1 2019 - Q4 2021, it is shown that the change in the recruitment and interviewing method to CATI and the change in the rotation scheme had a significant impact on survey selection, attrition, propensity to participate in person and thus also on the sample structure, and that the problems of survey selection are not fully compensated for in the process of generalising the results from the sample to the general population. By treating the change in survey method as a natural experiment, it has been shown that the method of recruitment affects the underlying results of the survey. Over the period Q3 2020 - Q3 2021, the changes introduced to the LFS together increased the estimates of the participation rate by around 0.6 percentage points, the employment rate by around 0.1 percentage points and the unemployment rate by around 0.9 percentage points relative to the pre-pandemic measures. If the effect of the inconsistent classification of some people as working in subsistence agriculture is also taken into account, the overestimation of the participation rate under the new methodology would be around 0.9 percentage points.

Suggested Citation

  • Katarzyna Saczuk & Olga Zajkowska, 2024. "Measuring labour force participation during pandemics and methodological changes," NBP Working Papers 372, Narodowy Bank Polski.
    • Handle: RePEc:nbp:nbpmis:372
    Note: The views expressed herein are those of the authors and not necessarily those of Narodowy Bank Polski. Autors would like to thank: Agnieszka Zgierska, Małgorzata Długołęcka, Aleksandra Majchrowska, Sonia Buchholtz, Adrian Domitrz and Robert Wyszyński for insightful comments.
    as

    Download full text from publisher

    File URL: https://nbp.pl/wp-content/uploads/2024/07/nbp-wp_372-www.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bruce D. Meyer & Wallace K. C. Mok & James X. Sullivan, 2015. "Household Surveys in Crisis," Journal of Economic Perspectives, American Economic Association, vol. 29(4), pages 199-226, Fall.
    2. Bound, John & Krueger, Alan B, 1991. "The Extent of Measurement Error in Longitudinal Earnings Data: Do Two Wrongs Make a Right?," Journal of Labor Economics, University of Chicago Press, vol. 9(1), pages 1-24, January.
    3. Hie Joo Ahn & James Hamilton, 2022. "Measuring Labor-Force Participation and the Incidence and Duration of Unemployment," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 44, pages 1-32, April.
    4. Meyer, Bruce D. & Mittag, Nikolas, 2021. "An empirical total survey error decomposition using data combination," Journal of Econometrics, Elsevier, vol. 224(2), pages 286-305.
    5. Jungmin Lee & Sokbae Lee, 2012. "Does it Matter WHO Responded to the Survey? Trends in the U.S. Gender Earnings Gap Revisited," ILR Review, Cornell University, ILR School, vol. 65(1), pages 148-160, January.
    6. Mellow, Wesley & Sider, Hal, 1983. "Accuracy of Response in Labor Market Surveys: Evidence and Implications," Journal of Labor Economics, University of Chicago Press, vol. 1(4), pages 331-344, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christopher R. Bollinger & Barry T. Hirsch, 2010. "GDP & Beyond – die europäische Perspektive," RatSWD Working Papers 165, German Data Forum (RatSWD).
    2. Christopher R. Bollinger & Barry T. Hirsch, 2013. "Is Earnings Nonresponse Ignorable?," The Review of Economics and Statistics, MIT Press, vol. 95(2), pages 407-416, May.
    3. Bollinger, Christopher R. & Hirsch, Barry & Hokayem, Charles M. & Ziliak, James P., 2018. "Trouble in the Tails? What We Know about Earnings Nonresponse Thirty Years after Lillard, Smith, and Welch," IZA Discussion Papers 11710, Institute of Labor Economics (IZA).
    4. Laisney, François & Pohlmeier, Winfried & Staat, Matthias, 1991. "Estimation of labour supply functions using panel data: a survey," ZEW Discussion Papers 91-05, ZEW - Leibniz Centre for European Economic Research.
    5. John Abowd & Martha Stinson, 2011. "Estimating Measurement Error in SIPP Annual Job Earnings: A Comparison of Census Bureau Survey and SSA Administrative Data," Working Papers 11-20, Center for Economic Studies, U.S. Census Bureau.
    6. Christopher R. Bollinger, 2001. "Response Error and the Union Wage Differential," Southern Economic Journal, John Wiley & Sons, vol. 68(1), pages 60-76, July.
    7. Fisher, Jonathan D. & Houseworth, Christina A., 2013. "Occupation inflation in the Current Population Survey," Journal of Economic and Social Measurement, IOS Press, issue 3, pages 243-261.
    8. Nicolas Frémeaux, 2023. "The More, the Better? Individual and Joint Interviewing in Surveys," Annals of Economics and Statistics, GENES, issue 149, pages 63-96.
    9. Michele Lalla & Patrizio Frederic & Daniela Mantovani, 2022. "The inextricable association of measurement errors and tax evasion as examined through a microanalysis of survey data matched with fiscal data: a case study," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(5), pages 1375-1401, December.
    10. Celhay, Pablo & Meyer, Bruce D. & Mittag, Nikolas, 2022. "What Leads to Measurement Errors? Evidence from Reports of Program Participation in Three Surveys," IZA Discussion Papers 14995, Institute of Labor Economics (IZA).
    11. Barry T. Hirsch & David A. Macpherson, 2004. "Wages, Sorting on Skill, and the Racial Composition of Jobs," Journal of Labor Economics, University of Chicago Press, vol. 22(1), pages 189-210, January.
    12. Thomas J. Kane & Cecilia E. Rouse & Douglas Staiger, 1999. "Estimating Returns to Schooling When Schooling is Misreported," Working Papers 798, Princeton University, Department of Economics, Industrial Relations Section..
    13. Cyrille Hagneré & Arnaud Lefranc, 2006. "Étendue et conséquences des erreurs de mesure dans les données individuelles d'enquête : une évaluation à partir des données appariées des enquêtes emploi et revenus fiscaux," Economie & Prévision, La Documentation Française, vol. 0(3), pages 131-154.
    14. Bruce D. Meyer & Nikolas Mittag, 2015. "Using Linked Survey and Administrative Data to Better Measure Income: Implications for Poverty, Program Effectiveness and Holes in the Safety Net," NBER Working Papers 21676, National Bureau of Economic Research, Inc.
    15. Jungmin Lee & Sokbae Lee, 2012. "Does it Matter WHO Responded to the Survey? Trends in the U.S. Gender Earnings Gap Revisited," ILR Review, Cornell University, ILR School, vol. 65(1), pages 148-160, January.
    16. Meyer, Bruce D. & Mittag, Nikolas, 2017. "Using Linked Survey and Administrative Data to Better Measure Income: Implications for Poverty, Program Effectiveness and Holes in the Safety Net," IZA Discussion Papers 10943, Institute of Labor Economics (IZA).
    17. Katharine G. Abraham & John Haltiwanger & Kristin Sandusky & James R. Spletzer, 2013. "Exploring Differences in Employment between Household and Establishment Data," Journal of Labor Economics, University of Chicago Press, vol. 31(S1), pages 129-172.
    18. Nayoung Lee, 2022. "Measurement error and its impact on estimates of income dynamics," Empirical Economics, Springer, vol. 63(5), pages 2539-2550, November.
    19. Burt S. Barnow & David Greenberg, 2015. "Do Estimated Impacts on Earnings Depend on the Source of the Data Used to Measure Them? Evidence From Previous Social Experiments," Evaluation Review, , vol. 39(2), pages 179-228, April.
    20. Adam Bee & Joshua Mitchell & Nikolas Mittag & Jonathan Rothbaum & Carl Sanders & Lawrence Schmidt & Matthew Unrath, 2023. "National Experimental Wellbeing Statistics - Version 1," Working Papers 23-04, Center for Economic Studies, U.S. Census Bureau.

    More about this item

    Keywords

    labour force participation; BAEL; surveys; methodological changes; panel attrition; non-response; rotational panels; measurement errors; LFS;
    All these keywords.

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • J21 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Labor Force and Employment, Size, and Structure

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbp:nbpmis:372. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jakub Growiec (email available below). General contact details of provider: https://edirc.repec.org/data/nbpgvpl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.