We propose a novel model ``MoE-ization'' strategy using SVD, which leads to a conflict- and oblivion-resistant multi-task adaptation method.