We propose IPSI, a general structural inference framework that improves performance by injecting pretrained structural priors into variational inference module.