XSTest

XSTest measures the opposite problem: over refusal. It has 250 safe prompts that sound risky (homonyms like "how do I kill a Python process," historical questions, fiction) alongside 200 genuinely unsafe ones. A well calibrated model should answer the first set and refuse the second.

Small and sharp. Run it whenever you tighten a guardrail to make sure you didn't break ordinary use.