Mitigating Intra- and Inter-modal Forgetting in Continual Learning of Unified Multimodal Models