IDEAS home Printed from https://ideas.repec.org/a/vrs/offsta/v30y2014i4p19n7.html
   My bibliography  Save this article

Modeling Nonresponse in Establishment Surveys: Using an Ensemble Tree Model to Create Nonresponse Propensity Scores and Detect Potential Bias in an Agricultural Survey

Author

Listed:
  • Earp Morgan

    (Bureau of Labor Statistics – Office of Survey Methods Research, PSB Suite 1950, 2 Massachusetts Avenue, NE Washington District of Columbia 20212, U.S.A.)

  • Mitchell Melissa

    (USDA – National Agricultural Statistics Service, Fairfax, Virginia, U.S.A.)

  • McCarthy Jaki

    (USDA – National Agricultural Statistics Service, Fairfax, Virginia, U.S.A.)

  • Kreuter Frauke

    (University of Maryland – JPSM, 1218 Lefrak Hall, College Park, MD 20742, Maryland 20742, U.S.A.)

Abstract

Increasing nonresponse rates in federal surveys and potentially biased survey estimates are a growing concern, especially with regard to establishment surveys. Unlike household surveys, not all establishments contribute equally to survey estimates. With regard to agricultural surveys, if an extremely large farm fails to complete a survey, the United States Department of Agriculture (USDA) could potentially underestimate average acres operated among other things. In order to identify likely nonrespondents prior to data collection, the USDA’s National Agricultural Statistics Service (NASS) began modeling nonresponse using Census of Agriculture data and prior Agricultural Resource Management Survey (ARMS) response history. Using an ensemble of classification trees, NASS has estimated nonresponse propensities for ARMS that can be used to predict nonresponse and are correlated with key ARMS estimates.

Suggested Citation

  • Earp Morgan & Mitchell Melissa & McCarthy Jaki & Kreuter Frauke, 2014. "Modeling Nonresponse in Establishment Surveys: Using an Ensemble Tree Model to Create Nonresponse Propensity Scores and Detect Potential Bias in an Agricultural Survey," Journal of Official Statistics, Sciendo, vol. 30(4), pages 701-719, December.
    • Handle: RePEc:vrs:offsta:v:30:y:2014:i:4:p:19:n:7
    DOI: 10.2478/jos-2014-0044
    as

    Download full text from publisher

    File URL: https://doi.org/10.2478/jos-2014-0044
    Download Restriction: no
    File URL: https://libkey.io/10.2478/jos-2014-0044?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Katharine G. Abraham & Aaron Maitland & Suzanne M. Bianchi, 2006. "Non-response in the American Time Use Survey: Who Is Missing from the Data and How Much Does It Matter?," NBER Technical Working Papers 0328, National Bureau of Economic Research, Inc.
    2. William Axinn & Cynthia Link & Robert Groves, 2011. "Responsive Survey Design, Demographic Data Collection, and Models of Demographic Behavior," Demography, Springer;Population Association of America (PAA), vol. 48(3), pages 1127-1149, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Osei Mireku & Alina Rodriguez, 2021. "Sleep Duration and Waking Activities in Relation to the National Sleep Foundation’s Recommendations: An Analysis of US Population Sleep Patterns from 2015 to 2017," IJERPH, MDPI, vol. 18(11), pages 1-15, June.
    2. Joshua Graff Zivin & Matthew Neidell, 2014. "Temperature and the Allocation of Time: Implications for Climate Change," Journal of Labor Economics, University of Chicago Press, vol. 32(1), pages 1-26.
    3. Roger Tourangeau & J. Michael Brick & Sharon Lohr & Jane Li, 2017. "Adaptive and responsive survey designs: a review and assessment," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(1), pages 203-223, January.
    4. Daniel S. Hamermesh & Katie R. Genadek & Michael C. Burda, 2022. "Reply to “Racial Differences in Time at Work Not Working†by William A. Darity Jr. et al," ILR Review, Cornell University, ILR School, vol. 75(3), pages 573-577, May.
    5. Jens Bonke & Mette Deding & Mette Lausten & Leslie S. Stratton, 2008. "Intra‐Household Specialization in Housework in the United States and Denmark," Social Science Quarterly, Southwestern Social Science Association, vol. 89(4), pages 1023-1043, December.
    6. Arenas-Arroyo, Esther & Schmidpeter, Bernhard, 2022. "Spillover effects of immigration policies on children's human capital," Ruhr Economic Papers 974, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    7. Borgschulte, Mark & Cho, Heepyung & Lubotsky, Darren, 2022. "Partisanship and survey refusal," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 332-357.
    8. Holly Matulewicz & Eric Grau & Arif Mamun & Gina Livermore, "undated". "Promoting Readiness of Minors in Supplemental Security Income (PROMISE): PROMISE 60-Month Sampling and Survey Plan," Mathematica Policy Research Reports be402161c12e402392af9182e, Mathematica Policy Research.
    9. Charlene Kalenkoski & Karen Hamrick & Margaret Andrews, 2011. "Time Poverty Thresholds and Rates for the US Population," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 104(1), pages 129-155, October.
    10. Han, Jeehoon & Meyer, Bruce D. & Sullivan, James X., 2020. "Inequality in the joint distribution of consumption and time use," Journal of Public Economics, Elsevier, vol. 191(C).
    11. te Braak Petrus & Minnen Joeri & Glorieux Ignace, 2020. "The Representativeness of Online Time Use Surveys. Effects of Individual Time Use Patterns and Survey Design on the Timing of Survey Dropout," Journal of Official Statistics, Sciendo, vol. 36(4), pages 887-906, December.
    12. McCarthy, Jaki S. & Jacob, Thomas & McCraken, Amanda, 2010. "Modeling Non-response in National Agricultural Statistics Service (NASS) Surveys Using Classification Trees," NASS Research Reports 235029, United States Department of Agriculture, National Agricultural Statistics Service.
    13. Stella Chatzitheochari & Sara Arber, 2011. "Identifying the Third Agers: An Analysis of British Retirees' Leisure Pursuits," Sociological Research Online, , vol. 16(4), pages 44-55, December.
    14. Laura Fumagalli & Heather Laurie & Peter Lynn, 2013. "Experiments with methods to reduce attrition in longitudinal surveys," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(2), pages 499-519, February.
    15. Jay Stewart & Harley Frazis, 2019. "The importance and challenges of measuring work hours," IZA World of Labor, Institute of Labor Economics (IZA), pages 1-95, July.
    16. Switek, Maggie, 2012. "Internal Migration and Life Satisfaction: Well-Being Effects of Moving as a Young Adult," IZA Discussion Papers 7016, Institute of Labor Economics (IZA).
    17. Beaumont Jean-Francois & Bocci Cynthia & Haziza David, 2014. "An Adaptive Data Collection Procedure for Call Prioritization," Journal of Official Statistics, Sciendo, vol. 30(4), pages 607-621, December.
    18. Burns, Christopher & Prager, Daniel & Ghosh, Sujit & Goodwin, Barry, 2015. "Imputing for Missing Data in the ARMS Household Section: A Multivariate Imputation Approach," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205291, Agricultural and Applied Economics Association.
    19. Wagner James & West Brady T. & Elliott Michael R. & Coffey Stephanie, 2020. "Comparing the Ability of Regression Modeling and Bayesian Additive Regression Trees to Predict Costs in a Responsive Survey Design Context," Journal of Official Statistics, Sciendo, vol. 36(4), pages 907-931, December.
    20. Malgorzata Switek, 2016. "Internal Migration and Life Satisfaction: Well-Being Paths of Young Adult Migrants," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 125(1), pages 191-241, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vrs:offsta:v:30:y:2014:i:4:p:19:n:7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.sciendo.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.