Yair Carmon

Introducing a learned algorithm for curating datasets for CLIP pretraining that achieves state-of-the-art ImageNet accuracy on the DataComp benchmark.

We show that clipped SGD converges with high probability on convex $(L_0,L_1)$-smooth functions.