Evaluating systemic changes to support clinical and translational health research

In evaluation research, “programs” are often conceptualized as clearly bounded, narrow in scope, focused on specific outcomes, using a well-defined linear causal model, and hence, suitable for standard evaluation methods. The evaluation work reported here was carried out in a more challenging context, where large, complex, interwoven systems were targets for change as a means to influence a diffuse array of outcomes. Our evaluation of an NIH-funded program to improve statewide infrastructure for clinical and translational health research (“Advance-CTR”) used qualitative data provided by investigators who used the program’s services, were funded awardees, or were members of an internal advisory committee (leadership representatives from partnering institutions). We examined perceived barriers to systemic changes to enhance research, as well as how systems have changed due to the Rhode Island Advance-CTR program’s efforts, to what degree, and with what effects. Using the causal logic of our program to connect these more distal systemic outcomes to the services and components of Advance-CTR, we discuss the effects this program has had on researchers and their environments, contributing to the development of sustainable programs of research that ultimately improve the health and well-being of our state’s residents.