today local_bar

Haochen Zhang

PhD student, Rice University

1 paper at NeurIPS 2025

OpenReview· Semantic Scholar· Google Scholar

Poster Session 5

Friday, December 5, 2025 · 11:00 AM → 2:00 PM

Exhibit Hall C,D,E

Breaking the Frozen Subspace: Importance Sampling for Low-Rank Optimization in LLM Pretraining

#902 · Haochen Zhang, Junze Yin, Guanchu Wang, Zirui Liu, Lin Yang, Tianyi Zhang, Anshumali Shrivastava, Vladimir Braverman

We introduce a new method for selecting subspaces in low-rank optimization for memory-efficient pretraining of large language models (LLMs).