IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v48y2023i3p271-295.html
   My bibliography  Save this article

A Case Study of Nonresponse Bias Analysis in Educational Assessment Surveys

Author

Listed:
  • Yajuan Si
  • Roderick J. A. Little

    (University of Michigan)

  • Ya Mo

    (Boise State University)

  • Nell Sedransk

    (National Institute of Statistical Sciences)

Abstract

Nonresponse bias is a widely prevalent problem for data on education. We develop a ten-step exemplar to guide nonresponse bias analysis (NRBA) in cross-sectional studies and apply these steps to the Early Childhood Longitudinal Study, Kindergarten Class of 2010–2011. A key step is the construction of indices of nonresponse bias based on proxy pattern-mixture models for survey variables of interest. A novel feature is to characterize the strength of evidence about nonresponse bias contained in these indices, based on the strength of the relationship between the characteristics in the nonresponse adjustment and the key survey variables. Our NRBA improves the existing methods by incorporating both missing at random and missing not at random mechanisms, and all analyses can be done straightforwardly with standard statistical software.

Suggested Citation

  • Yajuan Si & Roderick J. A. Little & Ya Mo & Nell Sedransk, 2023. "A Case Study of Nonresponse Bias Analysis in Educational Assessment Surveys," Journal of Educational and Behavioral Statistics, , vol. 48(3), pages 271-295, June.
    • Handle: RePEc:sae:jedbes:v:48:y:2023:i:3:p:271-295
    DOI: 10.3102/10769986221141074
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/10769986221141074
    Download Restriction: no
    File URL: https://libkey.io/10.3102/10769986221141074?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Yucel, Recai M., 2011. "State of the Multiple Imputation Software," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 45(i01).
    2. Si, Yajuan & Reiter, Jerome P. & Hillygus, D. Sunshine, 2015. "Semi-parametric Selection Models for Potentially Non-ignorable Attrition in Panel Studies with Refreshment Samples," Political Analysis, Cambridge University Press, vol. 23(1), pages 92-112, January.
    3. repec:mpr:mprres:4780 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Florian M. Hollenbach & Iavor Bojinov & Shahryar Minhas & Nils W. Metternich & Michael D. Ward & Alexander Volfovsky, 2021. "Multiple Imputation Using Gaussian Copulas," Sociological Methods & Research, , vol. 50(3), pages 1259-1283, August.
    2. Josse, Julie & Husson, François, 2016. "missMDA: A Package for Handling Missing Values in Multivariate Data Analysis," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 70(i01).
    3. Shakir Hussain & Mohamed A Mohammed & Ghazi Shukur, 2013. "Congenial Multiple Imputation and Matched Pairs Models for Square Tables: An Example of patients¡¯ self-management," Journal of Business Administration Research, Journal of Business Administration Research, Sciedu Press, vol. 2(1), pages 1-8, April.
    4. Schalk Burger & Searle Silverman & Gary van Vuuren, 2018. "Deriving Correlation Matrices for Missing Financial Time-Series Data," International Journal of Economics and Finance, Canadian Center of Science and Education, vol. 10(10), pages 105-105, October.
    5. Takahiro Hoshino & Keisuke Takahata, 2018. "Identification of heterogeneous treatment effects as a function of potential untreated outcome under the nonignorable assignment condition," Keio-IES Discussion Paper Series 2018-005, Institute for Economics Studies, Keio University.
    6. Celeste Combrinck & Vanessa Scherman & David Maree & Sarah Howie, 2018. "Multiple Imputation for Dichotomous MNAR Items Using Recursive Structural Equation Modeling With Rasch Measures as Predictors," SAGE Open, , vol. 8(1), pages 21582440187, February.
    7. Rüdiger Mutz & Lutz Bornmann & Hans-Dieter Daniel, 2015. "Testing for the fairness and predictive validity of research funding decisions: A multilevel multiple imputation for missing data approach using ex-ante and ex-post peer evaluation data from the Austr," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(11), pages 2321-2339, November.
    8. Martin, Eisele & Zhu, Junyi, 2013. "Multiple imputation in a complex household survey - the German Panel on Household Finances (PHF): challenges and solutions," MPRA Paper 57666, University Library of Munich, Germany.
    9. Grigory Franguridi & Lidia Kosenkova, 2024. "Closed-form estimation and inference for panels with attrition and refreshment samples," Papers 2410.11263, arXiv.org.
    10. Heng Chen & Marie-Hélène Felt & Kim P. Huynh, 2017. "Retail payment innovations and cash usage: accounting for attrition by using refreshment samples," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(2), pages 503-530, February.
    11. Olanrewaju Akande & Gabriel Madson & D. Sunshine Hillygus & Jerome P. Reiter, 2021. "Leveraging auxiliary information on marginal distributions in nonignorable models for item and unit nonresponse," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(2), pages 643-662, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:48:y:2023:i:3:p:271-295. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.