We show that high-dimensional neural activity can arise from low-dimensional latent dynamics, both in RNNs and in the brain.