lei chen

Associate Professor, Chinese Academy of Sciences

1 paper at NeurIPS 2025

Homepage· OpenReview· Semantic Scholar· Google Scholar

Poster Session 3

1 paper

Thursday, December 4, 2025 · 11:00 AM → 2:00 PM

Exhibit Hall C,D,E

GoRA: Gradient-driven Adaptive Low Rank Adaptation

#3408 · haonan he, Peng Ye, Yuchen Ren, yuan yuan, LuyangZhou, ShucunJu, lei chen

GoRA improves LoRA by adaptively assigning ranks and initializing weights using gradient info, achieving better performance while staying efficient. It outperforms LoRA and full fine-tuning on GLUE (+5.88) and GSM8k (+5.13) benchmarks.