For given query points, track their direction relative to the camera through a video, even if they leave the field of view. A dataset, benchmark and baseline method.