An efficient fine-tuning framework that adapts a pre-trained weight matrix by decomposing its update into two components: (1) a projection onto the complement of a low-rank subspace spanned by a low-rank matrix, and (2) a low-rank update.