NOVA is an extreme OOD stress-test dataset of ∼900 multi-modal brain MRI scans (with 281 rare pathologies) for benchmarking VLMs on three clinical tasks: anomaly localization, captioning, and diagnostic reasoning.