GoRA improves LoRA by adaptively assigning ranks and initializing weights using gradient info, achieving better performance while staying efficient. It outperforms LoRA and full fine-tuning on GLUE (+5.88) and GSM8k (+5.13) benchmarks.