Red-teaming agents with the GOAT attack strategy

GOAT (Generative Offensive Agent Tester, arXiv:2410.01606): an attacker LLM holds an in-context toolbox of 7 jailbreak techniques and reasons in an Observation/Thought/Strategy/Reply structure each turn, sending only the Reply to the target. Now available in an evals SDK for any agent harness SDK.

[dead]