IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v185y2022i3p798-821.html
   My bibliography  Save this article

Transitioning a panel survey from in‐person to predominantly web data collection: Results and lessons learned

Author

Listed:
  • Paul P. Biemer
  • Kathleen Mullan Harris
  • Brian J. Burke
  • Dan Liao
  • Carolyn Tucker Halpern

Abstract

Over the last two decades, in‐person interviewing costs continued to increase while the data quality advantages traditionally identified with this data collection mode have faded. Consequently, some longitudinal surveys have begun transitioning from in‐person to web data collection despite risks to data quality and longitudinal comparability. This paper addresses the major issues involved in the transition process and proposes a multi‐sample, multi‐phase responsive design that attempts to minimize the data quality risks while preserving the considerable cost savings promised by the transition. The paper describes the design as it was applied to the National Longitudinal Study of Adolescent to Adult Health (Add Health)—a nationally representative panel survey of around 20,000 adolescents selected from grades 7 to 12 (typically 13 to 18 years of age) in the 1994–95 school year. Also described are key results from several experiments embedded within the design and the analysis of mode effects. Also presented are some lessons learned and recommendations for other in‐person panel surveys that may be contemplating a similar transition to web or mixed‐mode data collection.

Suggested Citation

  • Paul P. Biemer & Kathleen Mullan Harris & Brian J. Burke & Dan Liao & Carolyn Tucker Halpern, 2022. "Transitioning a panel survey from in‐person to predominantly web data collection: Results and lessons learned," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 798-821, July.
    • Handle: RePEc:bla:jorssa:v:185:y:2022:i:3:p:798-821
    DOI: 10.1111/rssa.12750
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssa.12750
    Download Restriction: no
    File URL: https://libkey.io/10.1111/rssa.12750?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Robert M. Groves & Steven G. Heeringa, 2006. "Responsive design for household surveys: tools for actively controlling survey errors and costs," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(3), pages 439-457, July.
    2. Abowd, John M & Zellner, Arnold, 1985. "Estimating Gross Labor-Force Flows," Journal of Business & Economic Statistics, American Statistical Association, vol. 3(3), pages 254-283, June.
    3. Lynn, Peter, 2009. "Sample design for Understanding Society," Understanding Society Working Paper Series 2009-01, Understanding Society at the Institute for Social and Economic Research.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lagorio, Carlos, 2016. "Call and response: modelling longitudinal contact and cooperation using Wave 1 call records data," Understanding Society Working Paper Series 2016-01, Understanding Society at the Institute for Social and Economic Research.
    2. Annamaria Bianchi & Silvia Biffignandi, 2019. "Social Indicators to Explain Response in Longitudinal Studies," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(3), pages 931-957, February.
    3. Lynn, Peter, 2014. "Targeted initial letters to longitudinal survey sample members: effects on response rates, response speed, and sample composition," Understanding Society Working Paper Series 2014-08, Understanding Society at the Institute for Social and Economic Research.
    4. Elsby, Michael W.L. & Hobijn, Bart & Şahin, Ayşegül, 2015. "On the importance of the participation margin for labor market fluctuations," Journal of Monetary Economics, Elsevier, vol. 72(C), pages 64-82.
    5. Isabel Cairó & Shigeru Fujita & Camilo Morales-Jimenez, 2020. "The Cyclicality of Labor Force Participation Flows: The Role of Labor Supply Elasticities and Wage Rigidity," Working Papers 20-23, Federal Reserve Bank of Philadelphia.
    6. Shigeru Fujita, 2011. "Dynamics of worker flows and vacancies: evidence from the sign restriction approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(1), pages 89-121, January/F.
    7. Early Kirstin & Mankoff Jennifer & Fienberg Stephen E., 2017. "Dynamic Question Ordering in Online Surveys," Journal of Official Statistics, Sciendo, vol. 33(3), pages 625-657, September.
    8. Borowczyk-Martins, Daniel & Lalé, Etienne, 2020. "The ins and outs of involuntary part-time employment," Labour Economics, Elsevier, vol. 67(C).
    9. Robert Dixon & G. C. Lim & Jan C. van Ours, 2015. "The effect of shocks to labour market flows on unemployment and participation rates," Applied Economics, Taylor & Francis Journals, vol. 47(24), pages 2523-2539, May.
    10. Altorjai, Szilvia, 2013. "Over-qualification of immigrants in the UK," ISER Working Paper Series 2013-11, Institute for Social and Economic Research.
    11. Chun Asaph Young & Schouten Barry & Wagner James, 2017. "JOS Special Issue on Responsive and Adaptive Survey Design: Looking Back to See Forward – Editorial: In Memory of Professor Stephen E. Fienberg, 1942–2016," Journal of Official Statistics, Sciendo, vol. 33(3), pages 571-577, September.
    12. Reza C. Daniels, 2012. "A Framework for Investigating Micro Data Quality, with Application to South African Labour Market Household Surveys," SALDRU Working Papers 90, Southern Africa Labour and Development Research Unit, University of Cape Town.
    13. Robert E. Hall & Sam Schulhofer-Wohl, 2018. "Measuring Job-Finding Rates and Matching Efficiency with Heterogeneous Job-Seekers," American Economic Journal: Macroeconomics, American Economic Association, vol. 10(1), pages 1-32, January.
    14. Reist, Benjamin M. & Rodhouse, Joseph B. & Ball, Shane T. & Young, Linda J., 2019. "Subsampling of Nonrespondents in the 2017 Census of Agriculture," NASS Research Reports 322826, United States Department of Agriculture, National Agricultural Statistics Service.
    15. Steven J. Davis & John Haltiwanger, 1998. "Measuring Gross Worker and Job Flows," NBER Chapters, in: Labor Statistics Measurement Issues, pages 77-122, National Bureau of Economic Research, Inc.
    16. Stefania Albanesi & Aysegul Sahin, 2018. "The Gender Unemployment Gap," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 30, pages 47-67, October.
    17. Yashiv, Eran, 2007. "Labor search and matching in macroeconomics," European Economic Review, Elsevier, vol. 51(8), pages 1859-1895, November.
    18. Karen Mumford & Peter N. Smith, 2000. "Men, Women and the Hiring Function," The Economic Record, The Economic Society of Australia, vol. 76(235), pages 374-385, December.
    19. Lewis Taylor, 2017. "Univariate Tests for Phase Capacity: Tools for Identifying When to Modify a Survey’s Data Collection Protocol," Journal of Official Statistics, Sciendo, vol. 33(3), pages 601-624, September.
    20. Jiayun Jin & Caroline Vandenplas & Geert Loosveldt, 2019. "The Evaluation of Statistical Process Control Methods to Monitor Interview Duration During Survey Data Collection," SAGE Open, , vol. 9(2), pages 21582440198, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:185:y:2022:i:3:p:798-821. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.