We investigate catastrophic forgetting in LLM medical knowledge injection and propose an internal knowledge augmentation learning method to mitigate it.