We introduce a policy-grounded guardrail dataset and benchmark SOTA guardrail models, offering novel insights into their capabilities and limitations.