Eigenmode orthogonality breaking and anomalous dynamics in multimode nano-optomechanical systems under non-reciprocal coupling

Thermal motion of nanomechanical probes directly impacts their sensitivities to external forces. Its proper understanding is therefore critical for ultimate force sensing. Here, we investigate a vectorial force field sensor: a singly-clamped nanowire oscillating along two quasi-frequency-degenerate transverse directions. Its insertion in a rotational optical force field couples its eigenmodes non-symmetrically, causing dramatic modifications of its mechanical properties. In particular, the eigenmodes lose their intrinsic orthogonality. We show that this circumstance is at the origin of an anomalous excess of noise and of a violation of the fluctuation dissipation relation. Our model, which quantitatively accounts for all observations, provides a novel modified version of the fluctuation dissipation theorem that remains valid in non-conservative rotational force fields, and that reveals the prominent role of non-axial mechanical susceptibilities. These findings help understand the intriguing properties of thermal fluctuations in non-reciprocally-coupled multimode systems.