We implement a framework for learning constraints in vision models and algorithms to support this. We showcase it in Autonomous Driving.