Jailbreak
Definition pending
We've cataloged "Jailbreak" but haven't written a full definition yet. Definitions are hand-curated rather than auto-generated, so it takes time to cover every term.
Want this one prioritized? Email us and we'll bump it.
Practical example
A jailbreak is a prompt that tricks the model into bypassing its safety training. The most famous: "DAN" (Do Anything Now) roleplay prompts. Operationally, jailbreaks are a cat-and-mouse game: every model update patches known jailbreaks, and attackers find new ones within hours. Your defense is layered: input guardrails, output guardrails, and canary prompts that detect when your model is being probed.
Workflow example
Jailbreak monitoring: (1) inject canary prompts into your traffic (invisible to users, triggered by guardrail middleware), (2) if a canary triggers (model complies with a known-dangerous request), log the full request + response, (3) alert on-call, (4) block the IP/user-agent pattern, (5) rotate to a backup model version. Run known jailbreak strings against staging models before any production deploy.