IDEAS home Printed from https://ideas.repec.org/a/eee/labeco/v72y2021ics0927537121000956.html
   My bibliography  Save this article

CPS Nonresponse During the COVID-19 Pandemic: Explanations, Extent, and Effects

Author

Listed:
  • Ward, Jason M.
  • Anne Edwards, Kathryn

Abstract

The COVID-19 pandemic significantly affected data collection for the nation's primary source of household-level labor force data, the Current Population Survey (CPS). In the first four months of the pandemic period (March-June 2020) the average month-over-month nonresponse rate increased by 58 percent, while the size of newly entering cohorts declined by 37 percent relative to the prior 15 months. Together, these factors reduced the overall sample size of the CPS by around 16 percent. We hypothesize that these changes, and significant associated shifts in the demographic composition of the sample, were caused by the cessation of in-person interviewing. Geographic variation in nonresponse over this period does not appear related to variation in COVID case rates across metro areas or states. Using this change in interview method as a natural experiment, we compare labor market outcomes of those who entered the survey before and after the start of the COVID pandemic and find that the change in how individuals were recruited into the survey affected estimates of unemployment and labor force participation. In an exercise generating a counterfactual group of “missing” respondents, we estimate that, between April and August of 2020, the average unemployment rate was 0.5 to 0.7 percentage points higher, and the labor force participation rate was 0.4 to 0.8 percentage points lower than estimates using the actual sample of respondents. One implication of these results is that web-based surveys, which are increasingly relied on in empirical labor market studies, may fail to reach important subpopulations of the labor market and that reweighting is unlikely to address the selection on outcomes we document.

Suggested Citation

  • Ward, Jason M. & Anne Edwards, Kathryn, 2021. "CPS Nonresponse During the COVID-19 Pandemic: Explanations, Extent, and Effects," Labour Economics, Elsevier, vol. 72(C).
    • Handle: RePEc:eee:labeco:v:72:y:2021:i:c:s0927537121000956
    DOI: 10.1016/j.labeco.2021.102060
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0927537121000956
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.labeco.2021.102060?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Alan B. Krueger & Alexandre Mas & Xiaotong Niu, 2017. "The Evolution of Rotation Group Bias: Will the Real Unemployment Rate Please Stand Up?," The Review of Economics and Statistics, MIT Press, vol. 99(2), pages 258-264, May.
    2. Reuben, Ernesto & Sapienza, Paola & Zingales, Luigi, 2015. "Procrastination and impatience," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 58(C), pages 63-76.
    3. Gabriel D. Carroll & James J. Choi & David Laibson & Brigitte C. Madrian & Andrew Metrick, 2009. "Optimal Defaults and Active Decisions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(4), pages 1639-1674.
    4. Coibion, Olivier & Gorodnichenko, Yuriy & Weber, Michael, 2020. "Labor Markets During the Covid-19 Crisis: A Preliminary View," Department of Economics, Working Paper Series qt7rx7t91p, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    5. Stefano DellaVigna & M. Daniele Paserman, 2005. "Job Search and Impatience," Journal of Labor Economics, University of Chicago Press, vol. 23(3), pages 527-588, July.
    6. Laura Montenovo & Xuan Jiang & Felipe Lozano Rojas & Ian M. Schmutte & Kosali I. Simon & Bruce A. Weinberg & Coady Wing, 2020. "Determinants of Disparities in Covid-19 Job Losses," NBER Working Papers 27132, National Bureau of Economic Research, Inc.
    7. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    8. Shlomo Benartzi & Richard Thaler, 2007. "Heuristics and Biases in Retirement Savings Behavior," Journal of Economic Perspectives, American Economic Association, vol. 21(3), pages 81-104, Summer.
    9. Andrew Halpern-Manners & John Warren, 2012. "Panel Conditioning in Longitudinal Studies: Evidence From Labor Force Items in the Current Population Survey," Demography, Springer;Population Association of America (PAA), vol. 49(4), pages 1499-1519, November.
    10. Hie Joo Ahn & James Hamilton, 2022. "Measuring Labor-Force Participation and the Incidence and Duration of Unemployment," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 44, pages 1-32, April.
    11. Christopher Foote & William D. Nordhaus & Douglas Rivers, 2020. "The US Employment Situation Using the Yale Labor Survey," Cowles Foundation Discussion Papers 2243, Cowles Foundation for Research in Economics, Yale University.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Giovanni Gallo & Alessia sconti, 2023. "Could financial education be a universal social policy? A simulation of potential influences on inequality levels," Center for the Analysis of Public Policies (CAPP) 0182, Universita di Modena e Reggio Emilia, Dipartimento di Economia "Marco Biagi".
    2. Crossley, Thomas F. & Fisher, Paul & Hussein, Omar, 2023. "Assessing data from summary questions about earnings and income," Labour Economics, Elsevier, vol. 81(C).
    3. Goda, Gopi Shah & Jackson, Emilie & Nicholas, Lauren Hersch & Stith, Sarah See, 2023. "Older workers’ employment and Social Security spillovers through the second year of the COVID-19 pandemic," Journal of Pension Economics and Finance, Cambridge University Press, vol. 22(4), pages 524-549, October.
    4. Rahi Abouk & John S. Earle & Johanna Catherine Maclean & Sungbin Park, 2024. "Promoting Public Health with Blunt Instruments: Evidence from Vaccine Mandates," NBER Working Papers 32286, National Bureau of Economic Research, Inc.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bernhardt, Robert & Munro, David & Wolcott, Erin, 2021. "How Does the Dramatic Rise of CPS Non-Response Impact Labor Market Indicators?," GLO Discussion Paper Series 781, Global Labor Organization (GLO).
    2. Alexander Bick & Adam Blandin, 2020. "The Labor Market Impact of a Pandemic: Validation and Application of a Do-It-Yourself CPS," Working Papers 2031, Federal Reserve Bank of Dallas.
    3. Li, Teng & Barwick, Panle Jia & Deng, Yongheng & Huang, Xinfei & Li, Shanjun, 2023. "The COVID-19 pandemic and unemployment: Evidence from mobile phone data from China," Journal of Urban Economics, Elsevier, vol. 135(C).
    4. Gopi Shah Goda & Emilie Jackson & Lauren Hersch Nicholas & Sarah See Stith, 2023. "The impact of Covid-19 on older workers’ employment and Social Security spillovers," Journal of Population Economics, Springer;European Society for Population Economics, vol. 36(2), pages 813-846, April.
    5. Couch, Kenneth A. & Fairlie, Robert W. & Xu, Huanan, 2020. "Early evidence of the impacts of COVID-19 on minority unemployment," Journal of Public Economics, Elsevier, vol. 192(C).
    6. Mitchell, O.S. & Piggott, J., 2016. "Workplace-Linked Pensions for an Aging Demographic," Handbook of the Economics of Population Aging, in: Piggott, John & Woodland, Alan (ed.), Handbook of the Economics of Population Aging, edition 1, volume 1, chapter 0, pages 865-904, Elsevier.
    7. Beshears, John & Choi, James J. & Laibson, David & Madrian, Brigitte C., 2011. "Behavioral economics perspectives on public sector pension plans," Journal of Pension Economics and Finance, Cambridge University Press, vol. 10(2), pages 315-336, April.
    8. Truc Thi Mai Bui & Patrick Button & Elyce G. Picciotti, 2020. "Early Evidence on the Impact of COVID-19 and the Recession on Older Workers," NBER Working Papers 27448, National Bureau of Economic Research, Inc.
    9. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    10. Chodorow-Reich, Gabriel & Coglianese, John, 2021. "Projecting unemployment durations: A factor-flows simulation approach with application to the COVID-19 recession," Journal of Public Economics, Elsevier, vol. 197(C).
    11. Hamish Low & Michaela Benzeval & Jon Burton & Thomas F. Crossley & Paul Fisher & Annette Jäckle & Brendan Read, 2020. "The Idiosyncratic Impact of an Aggregate Shock The Distributional Consequences of COVID-19," Economics Series Working Papers 911, University of Oxford, Department of Economics.
    12. Christopher L. Foote & Tyler Hounshell & William D. Nordhaus & Douglas Rivers & Pamela Torola, 2021. "Measuring the US Employment Situation Using Online Panels: The Yale Labor Survey," Current Policy Perspectives 93422, Federal Reserve Bank of Boston.
    13. Blanas, Sotiris & Oikonomou, Rigas, 2023. "COVID-induced economic uncertainty, tasks and occupational demand," Labour Economics, Elsevier, vol. 81(C).
    14. Choi, James J. & Haisley, Emily & Kurkoski, Jennifer & Massey, Cade, 2017. "Small cues change savings choices," Journal of Economic Behavior & Organization, Elsevier, vol. 142(C), pages 378-395.
    15. Lars Behlen & Oliver Himmler & Robert Jäckle, 2023. "Defaults and effortful tasks," Experimental Economics, Springer;Economic Science Association, vol. 26(5), pages 1022-1059, November.
    16. Francisco Gomes & Michael Haliassos & Tarun Ramadorai, 2021. "Household Finance," Journal of Economic Literature, American Economic Association, vol. 59(3), pages 919-1000, September.
    17. Sumedha Gupta & Kosali I. Simon & Coady Wing, 2020. "Mandated and Voluntary Social Distancing During The COVID-19 Epidemic: A Review," NBER Working Papers 28139, National Bureau of Economic Research, Inc.
    18. Magnus Dahlquist & Ofer Setty & Roine Vestman, 2018. "On the Asset Allocation of a Default Pension Fund," Journal of Finance, American Finance Association, vol. 73(4), pages 1893-1936, August.
    19. Hie Joo Ahn & James Hamilton, 2022. "Measuring Labor-Force Participation and the Incidence and Duration of Unemployment," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 44, pages 1-32, April.
    20. Robert French & Philip Oreopoulos, 2017. "Applying behavioural economics to public policy in Canada," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 50(3), pages 599-635, August.

    More about this item

    Keywords

    Current Population Survey; Survey nonresponse; Covid-19;
    All these keywords.

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • J21 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Labor Force and Employment, Size, and Structure

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:labeco:v:72:y:2021:i:c:s0927537121000956. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/labeco .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.