PyRIT

PyRIT (Python Risk Identification Toolkit) is the framework Microsoft's AI Red Team uses. It gives you the building blocks of an automated attack: targets (any model or app endpoint), attack strategies (single turn, multi turn, crescendo, jailbreak templates), converters that mutate prompts (encoding, translation, obfuscation), scorers that judge outputs, and memory to track it all. You compose them into campaigns.

It's mature and well documented. Expect to write Python.