Vincent Sitzmann

Locality is an important factor in generalization of diffusion models, but it is unclear where it comes from; we show that it comes from pixel correlation patterns in the dataset.

We distill large datasets to just one image per class and use them to train linear probes on top of self-supervised vision models.