today local_bar

Lucio M. Dery

Researcher, Google

1 paper at NeurIPS 2025

Homepage· OpenReview· Semantic Scholar· Google Scholar

Poster Session 3

Thursday, December 4, 2025 · 11:00 AM → 2:00 PM

Exhibit Hall C,D,E

Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo

#811 Spotlight · Zachary Charles, Gabriel Teston, Lucio M. Dery, J Keith Rush, Nova Fallen, Zachary Garrett, Arthur Szlam, Arthur Douillard

We show that DiLoCo, a method for communication-efficient language model training, exhibits reliable scaling law behavior.