logo
today local_bar
distributed training; communication overlapping; sharded optimizers

1 paper across 1 session

Poster Session 2

1 paper
Wednesday, December 3, 2025 · 4:30 PM → 7:30 PM
Exhibit Hall C,D,E
ACCO: Accumulate While You Communicate for Communication-Overlapped Sharded LLM Training
#909 · Adel Nabli, Louis Fournier, Pierre ERBACHER, Louis Serrano, Eugene Belilovsky, Edouard Oyallon

ACCO is a new and principled optimization techniques with provable guarantees for Sharded Distributed LLM Training