We regularize the Hankel singular value distribution when training state space models for high compressibility.