3 papers across 2 sessions
A framework for tensor and pipeline parallelism to reduce TP bubbles.
Concentric Ring Parallelism that reduces P2P communication volume and avoid inter-node communication.
