We propose Approximate Domain Unlearning (ADU), a new task for selectively removing domain-specific knowledge from pre-trained vision-language models, and introduce two key techniques, domain disentangling and instance-wise prompting, to solve it.