IPFormer introduces context-adaptive instance proposals for vision-based 3D Panoptic Scene Completion, outperforming the state-of-the-art and reducing runtime by over 14x.