Achieving High Accuracy in Distributed Training Even with Aggressive Gradient Compression

A new framework for efficient gradient estimation using the Lie algebraic structures and the Hadamard test.