IDEAS home Printed from https://ideas.repec.org/a/vrs/offsta/v38y2022i2p637-662n4.html
   My bibliography  Save this article

Data Collection Expert Prior Elicitation in Survey Design: Two Case Studies

Author

Listed:
  • Wu Shiya

    (Department of Methodology and Statistics, Utrecht University, Padualaan 14, 3584 CH Utrecht, The Netherlands.)

  • Schouten Barry

    (Department of Process Development and Methodology, Statistics Netherlands, P.O. Box 24500, 2490 HA Den Haag, The Netherlands.)

  • Meijers Ralph

    (Department of Traffic and Transport of Division Social Statistics, Statistics Netherlands, P.O. Box 4481, 6401 CZ Heerlen, The Netherlands.)

  • Moerbeek Mirjam

    (Department of Methodology and Statistics, Utrecht University, Padualaan 14, 3584 CH Utrecht, The Netherlands.)

Abstract

Data collection staff involved in sampling designs, monitoring and analysis of surveys often have a good sense of the response rate that can be expected in a survey, even when this survey is new or done at a relatively low frequency. They make expectations of response rates, and, subsequently, costs on an almost continuous basis. Rarely, however, are these expectations formally structured. Furthermore, the expectations usually are point estimates without any assessment of precision or uncertainty. In recent years, the interest in adaptive survey designs has increased. These designs lean heavily on accurate estimates of response rates and costs. In order to account for inaccurate estimates, a Bayesian analysis of survey design parameters is very sensible. The combination of strong intrinsic knowledge of data collection staff and a Bayesian analysis is a natural next step. In this article, prior elicitation is developed for design parameters with the help of data collection staff. The elicitation is applied to two case studies in which surveys underwent a major redesign and direct historic survey data was unavailable.

Suggested Citation

  • Wu Shiya & Schouten Barry & Meijers Ralph & Moerbeek Mirjam, 2022. "Data Collection Expert Prior Elicitation in Survey Design: Two Case Studies," Journal of Official Statistics, Sciendo, vol. 38(2), pages 637-662, June.
    • Handle: RePEc:vrs:offsta:v:38:y:2022:i:2:p:637-662:n:4
    DOI: 10.2478/jos-2022-0028
    as

    Download full text from publisher

    File URL: https://doi.org/10.2478/jos-2022-0028
    Download Restriction: no
    File URL: https://libkey.io/10.2478/jos-2022-0028?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jamie C. Moore & Gabriele B. Durrant & Peter W. F. Smith, 2018. "Data set representativeness during data collection in three UK social surveys: generalizability and the effects of auxiliary covariate choice," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(1), pages 229-248, January.
    2. Barry Schouten & Natalie Shlomo, 2017. "Selecting Adaptive Survey Design Strata with Partial R-indicators," International Statistical Review, International Statistical Institute, vol. 85(1), pages 143-163, April.
    3. Naomi C. Brownstein & Thomas A. Louis & Anthony O’Hagan & Jane Pendergast, 2019. "The Role of Expert Judgment in Statistical Inference and Evidence-Based Decision-Making," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 56-68, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roberts Caroline & Vandenplas Caroline & Herzing Jessica M.E., 2020. "A Validation of R-Indicators as a Measure of the Risk of Bias using Data from a Nonresponse Follow-Up Survey," Journal of Official Statistics, Sciendo, vol. 36(3), pages 675-701, September.
    2. Jamie C. Moore & Gabriele B. Durrant & Peter W. F. Smith, 2021. "Do coefficients of variation of response propensities approximate non‐response biases during survey data collection?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(1), pages 301-323, January.
    3. Chun Asaph Young & Schouten Barry & Wagner James, 2017. "JOS Special Issue on Responsive and Adaptive Survey Design: Looking Back to See Forward – Editorial: In Memory of Professor Stephen E. Fienberg, 1942–2016," Journal of Official Statistics, Sciendo, vol. 33(3), pages 571-577, September.
    4. Irina Vinogradova-Zinkevič, 2021. "Application of Bayesian Approach to Reduce the Uncertainty in Expert Judgments by Using a Posteriori Mean Function," Mathematics, MDPI, vol. 9(19), pages 1-23, October.
    5. Patrick Gleiser & Joseph W. Sakshaug & Marieke Volkert & Peter Ellguth & Susanne Kohaut & Iris Möller, 2022. "Introducing Web in a mixed‐mode establishment survey: Effects on nonresponse," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 891-915, July.
    6. Tobias Gummer & Bella Struminskaya, 2023. "Early and Late Participation during the Field Period: Response Timing in a Mixed-Mode Probability-Based Panel Survey," Sociological Methods & Research, , vol. 52(2), pages 909-932, May.
    7. Plewis Ian & Shlomo Natalie, 2017. "Using Response Propensity Models to Improve the Quality of Response Data in Longitudinal Studies," Journal of Official Statistics, Sciendo, vol. 33(3), pages 753-779, September.
    8. van Berkel Kees & van der Doef Suzanne & Schouten Barry, 2020. "Implementing Adaptive Survey Design with an Application to the Dutch Health Survey," Journal of Official Statistics, Sciendo, vol. 36(3), pages 609-629, September.
    9. Adán Acosta-Banda & Verónica Aguilar-Esteva & Miguel Patiño Ortiz & Julián Patiño Ortiz, 2021. "Construction and Validity of an Instrument to Evaluate Renewable Energies and Energy Sustainability Perceptions for Social Consciousness," Sustainability, MDPI, vol. 13(4), pages 1-14, February.
    10. Dan Hedlin, 2020. "Is there a 'safe area' where the nonresponse rate has only a modest effect on bias despite non‐ignorable nonresponse?," International Statistical Review, International Statistical Institute, vol. 88(3), pages 642-657, December.
    11. Olga Maslovskaya & Peter Lugtig, 2022. "Representativeness in six waves of CROss‐National Online Survey (CRONOS) panel," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 851-871, July.
    12. Chethika Gunasiri Wadumestrige Dona & Geetha Mohan & Kensuke Fukushi, 2021. "Promoting Urban Agriculture and Its Opportunities and Challenges—A Global Review," Sustainability, MDPI, vol. 13(17), pages 1-22, August.
    13. la Cecilia, Daniele & Maggi, Federico, 2020. "Influential sources of uncertainty in glyphosate biochemical degradation in soil," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 175(C), pages 121-139.
    14. Amir Mukeri & Habibullah Shaikh & D. P. Gaikwad, 2020. "Financial Data Analysis Using Expert Bayesian Framework For Bankruptcy Prediction," Papers 2010.13892, arXiv.org, revised Oct 2020.
    15. Katarina Buganova & Maria Luskova & Jozef Kubas & Michal Brutovsky & Jaroslav Slepecky, 2021. "Sustainability of Business through Project Risk Identification with Use of Expert Estimates," Sustainability, MDPI, vol. 13(11), pages 1-17, June.
    16. Jamie C. Moore & Peter W. F. Smith & Gabriele B. Durrant, 2018. "Correlates of record linkage and estimating risks of non‐linkage biases in business data sets," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(4), pages 1211-1230, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vrs:offsta:v:38:y:2022:i:2:p:637-662:n:4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.sciendo.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.