queueing theory

1 paper across 1 session

Poster Session 2

Wednesday, December 3, 2025 · 4:30 PM → 7:30 PM

LLM Query Scheduling with Prefix Reuse and Latency Constraints

#3304 · Gregory Dexter, Shao Tang, Ata Fatahi, Qingquan Song, Tejas Dharamsi, Aman Gupta

Theoretical analysis of scheduling algorithms for LLM queries with latency constraints when using RadixAttention along with a novel scheduling algorithm.