IDEAS home Printed from https://ideas.repec.org/a/vrs/offsta/v34y2018i3p721-752n7.html
   My bibliography  Save this article

Accounting for Complex Sampling in Survey Estimation: A Review of Current Software Tools

Author

Listed:
  • West Brady T.

    (Survey Research Center, University of Michigan-Ann Arbor, 4118 Institute for Social Research, 426 Thompson Street, Ann Arbor, MI, 48106, U.S.A.)

  • Sakshaug Joseph W.

    (Institute for Employment Research, Regensburger Strasse 104, Nuremberg, 90478, Germany.)

  • Aurelien Guy Alain S.

    (Walter R. McDonald & Associates, 12300 Twinbrook Pkwy, Suite 310, Rockville, MD 20852, U.S.A.)

Abstract

In this article, we review current state-of-the art software enabling statisticians to apply design-based, model-based, and so-called “hybrid” approaches to the analysis of complex sample survey data. We present brief overviews of the similarities and differences between these alternative approaches, and then focus on software tools that are presently available for implementing each approach. We conclude with a summary of directions for future software development in this area.

Suggested Citation

  • West Brady T. & Sakshaug Joseph W. & Aurelien Guy Alain S., 2018. "Accounting for Complex Sampling in Survey Estimation: A Review of Current Software Tools," Journal of Official Statistics, Sciendo, vol. 34(3), pages 721-752, September.
    • Handle: RePEc:vrs:offsta:v:34:y:2018:i:3:p:721-752:n:7
    DOI: 10.2478/jos-2018-0034
    as

    Download full text from publisher

    File URL: https://doi.org/10.2478/jos-2018-0034
    Download Restriction: no
    File URL: https://libkey.io/10.2478/jos-2018-0034?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. F. Kreuter & K. Olson & J. Wagner & T. Yan & T. M. Ezzati‐Rice & C. Casas‐Cordero & M. Lemay & A. Peytchev & R. M. Groves & T. E. Raghunathan, 2010. "Using proxy measures and other correlates of survey outcomes to adjust for non‐response: examples from multiple surveys," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(2), pages 389-407, April.
    2. repec:mpr:mprres:4937 is not listed on IDEAS
    3. West, B.T. & Beer, L. & Gremel, G.W. & Weiser, J. & Johnson, C.H. & Garg, S. & Skarbinski, J., 2015. "Weighted multilevel models: A case study," American Journal of Public Health, American Public Health Association, vol. 105(11), pages 2214-2215.
    4. D. Pfeffermann & C. J. Skinner & D. J. Holmes & H. Goldstein & J. Rasbash, 1998. "Weighting for unequal selection probabilities in multilevel models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(1), pages 23-40.
    5. Archer, Kellie J. & Lemeshow, Stanley & Hosmer, David W., 2007. "Goodness-of-fit tests for logistic regression models when data are collected using a complex sampling design," Computational Statistics & Data Analysis, Elsevier, vol. 51(9), pages 4450-4464, May.
    6. Little, Roderick J., 2006. "Calibrated Bayes: A Bayes/Frequentist Roadmap," The American Statistician, American Statistical Association, vol. 60, pages 213-223, August.
    7. Brady T West & Joseph W Sakshaug & Guy Alain S Aurelien, 2016. "How Big of a Problem is Analytic Error in Secondary Analyses of Survey Data?," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-29, June.
    8. Hanzhi Zhou & Michael R. Elliott & Trviellore E. Raghunathan, 2016. "A two-step semiparametric method to accommodate sampling weights in multiple imputation," Biometrics, The International Biometric Society, vol. 72(1), pages 242-252, March.
    9. Daniele Pacifico, 2014. "sreweight: A Stata command to reweight survey data to external totals," Stata Journal, StataCorp LP, vol. 14(1), pages 4-21, March.
    10. Oberski, Daniel, 2014. "lavaan.survey: An R Package for Complex Survey Analysis of Structural Equation Models," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 57(i01).
    11. David Haziza & Jean‐François Beaumont, 2007. "On the Construction of Imputation Classes in Surveys," International Statistical Review, International Statistical Institute, vol. 75(1), pages 25-43, April.
    12. Raymond L. Chambers & Alan H. Dorfman & Suojin Wang, 1998. "Limited information likelihood analysis of survey data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(2), pages 397-411.
    13. Stanislav Kolenikov, 2010. "Resampling variance estimation for complex survey data," Stata Journal, StataCorp LP, vol. 10(2), pages 165-199, June.
    14. Little R.J., 2004. "To Model or Not To Model? Competing Modes of Inference for Finite Population Sampling," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 546-556, January.
    15. Jae Kwang Kim & Mingue Park, 2010. "Calibration Estimation in Survey Sampling," International Statistical Review, International Statistical Institute, vol. 78(1), pages 21-39, April.
    16. repec:mpr:mprres:4780 is not listed on IDEAS
    17. Peress, Michael, 2010. "Correcting for Survey Nonresponse Using Variable Response Propensity," Journal of the American Statistical Association, American Statistical Association, vol. 105(492), pages 1418-1430.
    18. Stanislav Kolenikov, 2014. "Calibrating survey data using iterative proportional fitting (raking)," Stata Journal, StataCorp LP, vol. 14(1), pages 22-59, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sonja Spitzer, 2020. "Biases in health expectancies due to educational differences in survey participation of older Europeans: It’s worth weighting for," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 21(4), pages 573-605, June.
    2. David Kaplan & Chansoon Lee, 2018. "Optimizing Prediction Using Bayesian Model Averaging: Examples Using Large-Scale Educational Assessments," Evaluation Review, , vol. 42(4), pages 423-457, August.
    3. Heng Chen & Marie-Hélène Felt & Christopher Henry, 2018. "2017 Methods-of-Payment Survey: Sample Calibration and Variance Estimation," Technical Reports 114, Bank of Canada.
    4. Shixiao Zhang & Peisong Han & Changbao Wu, 2023. "Calibration Techniques Encompassing Survey Sampling, Missing Data Analysis and Causal Inference," International Statistical Review, International Statistical Institute, vol. 91(2), pages 165-192, August.
    5. Yves G. Berger, 2020. "An empirical likelihood approach under cluster sampling with missing observations," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(1), pages 91-121, February.
    6. Brady T West & Joseph W Sakshaug & Guy Alain S Aurelien, 2016. "How Big of a Problem is Analytic Error in Secondary Analyses of Survey Data?," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-29, June.
    7. Yasmin S. Cypel & Shira Maguen & Paul A. Bernhard & William J. Culpepper & Aaron I. Schneiderman, 2024. "Prevalence and Correlates of Food and/or Housing Instability among Men and Women Post-9/11 US Veterans," IJERPH, MDPI, vol. 21(3), pages 1-16, March.
    8. Rodrigo M. Leifert & Claudio R. Lucinda, 2015. "Linear Symmetric "Fat Taxes": Evidence from Brazil," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 37(4), pages 634-666.
    9. Gabriele B. Durrant & Sylke V. Schnepf, 2018. "Which schools and pupils respond to educational achievement surveys?: a focus on the English Programme for International Student Assessment sample," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(4), pages 1057-1075, October.
    10. David Cutler & Kaushik Ghosh & Irina Bondarenko & Kassandra Messer & Trivellore Raghunathan & Susan Stewart & Allison B. Rosen, 2018. "Attributing Medical Spending to Conditions: A Comparison of Methods," NBER Working Papers 25233, National Bureau of Economic Research, Inc.
    11. Matthew Robson & Miqdad Asaria & Richard Cookson & Aki Tsuchiya & Shehzad Ali, 2017. "Eliciting the Level of Health Inequality Aversion in England," Health Economics, John Wiley & Sons, Ltd., vol. 26(10), pages 1328-1334, October.
    12. Chun Asaph Young & Schouten Barry & Wagner James, 2017. "JOS Special Issue on Responsive and Adaptive Survey Design: Looking Back to See Forward – Editorial: In Memory of Professor Stephen E. Fienberg, 1942–2016," Journal of Official Statistics, Sciendo, vol. 33(3), pages 571-577, September.
    13. Anthony Evans & Willem Sleegers & Žan Mlakar, 2020. "Individual differences in receptivity to scientific bullshit," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 15(3), pages 401-412, May.
    14. Robert E. Hall & Sam Schulhofer-Wohl, 2018. "Measuring Job-Finding Rates and Matching Efficiency with Heterogeneous Job-Seekers," American Economic Journal: Macroeconomics, American Economic Association, vol. 10(1), pages 1-32, January.
    15. Little Roderick J., 2013. "Discussion," Journal of Official Statistics, Sciendo, vol. 29(3), pages 363-366, June.
    16. Giovanna Messina & Marco Savegnago, 2015. "Le imposte sulla prima casa in Italia, un equilibrio difficile fra decentramento e redistribuzione," ECONOMIA PUBBLICA, FrancoAngeli Editore, vol. 2015(3), pages 5-29.
    17. Robert J. Bennett & Harry Smith & Piero Montebruno & Carry van Lieshout, 2022. "Changes in Victorian entrepreneurship in England and Wales 1851-1911: Methodology and business population estimates," Business History, Taylor & Francis Journals, vol. 64(7), pages 1211-1243, September.
    18. Vanda Almeida & Salvador Barrios & Michael Christl & Silvia Poli & Alberto Tumino & Wouter Wielen, 2021. "The impact of COVID-19 on households´ income in the EU," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 19(3), pages 413-431, September.
    19. Pezzuti, Lina & Tommasi, Marco & Saggino, Aristide & Dawe, James & Lauriola, Marco, 2020. "Gender differences and measurement bias in the assessment of adult intelligence: Evidence from the Italian WAIS-IV and WAIS-R standardizations," Intelligence, Elsevier, vol. 79(C).
    20. Keith Davis & Timothy Bell & Jacqueline Miller & Derek Misurski & Bela Bapat, 2011. "Hospital costs, length of stay and mortality associated with childhood, adolescent and young Adult meningococcal disease in the US," Applied Health Economics and Health Policy, Springer, vol. 9(3), pages 197-207, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vrs:offsta:v:34:y:2018:i:3:p:721-752:n:7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.sciendo.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.