Therapist effects in randomised controlled trials: what to do about them

Aims and objectives. The aim of this study is to describe and compare three statistical methods to allow for therapist effects in individually randomised controlled trials. Background. In an individually randomised controlled trial where the intervention is delivered by a health professional it seems likely that the effectiveness of the intervention, independent of any treatment effect, could depend on the skill of the health professional delivering it. This leads to a potential clustering of the outcomes for the patients being treated by the same health professional. Design. Retrospective statistical analysis of outcomes from four example randomised controlled trial datasets with potential clustering by health professional. Methods. Three methods to allow for clustering are described: cluster level analysis; random effects models and marginal models. These models were fitted to continuous outcome data from four example randomised controlled trial datasets with potential clustering by health professional. Results. The cluster level models produced the widest confidence intervals. Little difference was found between the estimates of the regression coefficients for the treatment effect and confidence intervals between the individual patient level models for the datasets. The conclusions reached for each dataset match those published in the original papers. The intracluster correlation coefficient ranged from