We propose a novel architecture and training objective specifically designed to upsample features from foundation vision encoders at any resolution.

ACCO is a new and principled optimization techniques with provable guarantees for Sharded Distributed LLM Training