Kun Yuan

MISA: Memory-Efficient LLMs Optimization with Module-wise Importance Sampling

MeCeFO: Enhancing LLM Training Robustness via Fault-Tolerant Optimization

Improving Model Representation and Reducing KV Cache via Skip Connections with First Value Heads