GeoClip makes DP-SGD geometry-aware by adapting clipping to the structure of the gradients. It reduces noise and improves convergence and utility without additional privacy cost.

We consider the privacy guarantees of a new sampling method, which combines aspects of Poisson subsamplig and shuffling, and prove it can be approximated as Poisson subsampling.