Bootstrapping clustered data

Summary. Various bootstraps have been proposed for bootstrapping clustered data from one‐way arrays. The simulation results in the literature suggest that some of these methods work quite well in practice; the theoretical results are limited and more mixed in their conclusions. For example, McCullagh reached negative conclusions about the use of non‐parametric bootstraps for one‐way arrays. The purpose of this paper is to extend our understanding of the issues by discussing the effect of different ways of modelling clustered data, the criteria for successful bootstraps used in the literature and extending the theory from functions of the sample mean to include functions of the between and within sums of squares and non‐parametric bootstraps to include model‐based bootstraps. We determine that the consistency of variance estimates for a bootstrap method depends on the choice of model with the residual bootstrap giving consistency under the transformation model whereas the cluster bootstrap gives consistent estimates under both the transformation and the random‐effect model. In addition we note that the criteria based on the distribution of the bootstrap observations are not really useful in assessing consistency.