Coherent chaos in a recurrent neural network with structured connectivity

We present a simple model for coherent, spatially correlated chaos in a recurrent neural network. Networks of randomly connected neurons exhibit chaotic fluctuations and have been studied as a model for capturing the temporal variability of cortical activity. The dynamics generated by such networks, however, are spatially uncorrelated and do not generate coherent fluctuations, which are commonly observed across spatial scales of the neocortex. In our model we introduce a structured component of connectivity, in addition to random connections, which effectively embeds a feedforward structure via unidirectional coupling between a pair of orthogonal modes. Local fluctuations driven by the random connectivity are summed by an output mode and drive coherent activity along an input mode. The orthogonality between input and output mode preserves chaotic fluctuations by preventing feedback loops. In the regime of weak structured connectivity we apply a perturbative approach to solve the dynamic mean-field equations, showing that in this regime coherent fluctuations are driven passively by the chaos of local residual fluctuations. When we introduce a row balance constraint on the random connectivity, stronger structured connectivity puts the network in a distinct dynamical regime of self-tuned coherent chaos. In this regime the coherent component of the dynamics self-adjusts intermittently to yield periods of slow, highly coherent chaos. The dynamics display longer time-scales and switching-like activity. We show how in this regime the dynamics depend qualitatively on the particular realization of the connectivity matrix: a complex leading eigenvalue can yield coherent oscillatory chaos while a real leading eigenvalue can yield chaos with broken symmetry. The level of coherence grows with increasing strength of structured connectivity until the dynamics are almost entirely constrained to a single spatial mode. We examine the effects of network-size scaling and show that these results are not finite-size effects. Finally, we show that in the regime of weak structured connectivity, coherent chaos emerges also for a generalized structured connectivity with multiple input-output modes.Author summary: Neural activity observed in the neocortex is temporally variable, displaying irregular temporal fluctuations at every accessible level of measurement. Furthermore, these temporal fluctuations are often found to be spatially correlated whether at the scale of local measurements such as membrane potentials and spikes, or global measurements such as EEG and fMRI. A thriving field of study has developed models of recurrent networks which intrinsically generate irregular temporal variability, the paradigmatic example being networks of randomly connected rate neurons which exhibit chaotic dynamics. These models have been examined analytically and numerically in great detail, yet until now the intrinsic variability generated by these networks have been spatially uncorrelated, yielding no large-scale coherent fluctuations. Here we present a simple model of a recurrent network of firing-rate neurons that intrinsically generates spatially correlated activity yielding coherent fluctuations across the entire network. The model incorporates random connections and introduces a structured component of connectivity that sums network activity over a spatial “output” mode and projects it back to the network along an orthogonal “input” mode. We show that this form of structured connectivity is a general mechanism for producing coherent chaos.