We approximate ReLU networks for hidden-state DP analysis; the results on practical noisy cyclic GD are on par with DP-SGD