The paper introduces a novel latent diffusion model that uses local vicinity structures to achieve state-of-the-art domain adaptation, preserving privacy without needing source data during adaptation.