logo
today local_bar
context parallelism

2 papers across 2 sessions

Poster Session 3

1 paper
Thursday, December 4, 2025 · 11:00 AM → 2:00 PM
Exhibit Hall C,D,E
ZeCO: Zero-Communication Overhead Sequence Parallelism for Linear Attention
#3507 · Yuhong CHOU, Zehao Liu, Rui-Jie Zhu, Xinyi Wan, Tianjian Li, Congying Chu, Qian Liu, Jibin Wu, Zejun MA

A SoTA sequence parallelism for linear attention with a brand new collective communication.

Poster Session 4

1 paper
Thursday, December 4, 2025 · 4:30 PM → 7:30 PM
Exhibit Hall C,D,E
Skrull: Towards Efficient Long Context Fine-tuning through Dynamic Data Scheduling
#2002 · Hongtao Xu, Wenting Shen, Yuanxin Wei, Ang Wang, Guo Runfan, Tianxing Wang, Yong Li, Mingzhen Li, Weile Jia

Efficient Long Context Fine-tuning through Dynamic Data Scheduling