IN THIS BREAKDOWN · 10 SECTIONS
You can read 16% of this breakdown.
The paper in one minute
Constitutional Classifiers are Anthropic's defense against universal jailbreaks: prompting strategies that get a model to answer most questions in a dangerous domain, here chemical, biological, radiological and nuclear (CBRN) weapons. The previous version used an input classifier plus a separate output classifier, cost 23% extra compute and refused 0.38% of production traffic.
Further red teaming found two ways around it. Reconstruction attacks scatter a request across a long, harmless-looking context and have the model reassemble it. Output obfuscation has the model answer in substitutions or metaphors that look harmless unless you also read the prompt. Both degrade the model's capability, but by varying amounts, so better versions are likely.
The paper makes three changes. An exchange classifier judges the output in the context of its input, token batch by token batch as the reply streams. A two-stage cascade runs a cheap classifier on everything and escalates only suspicious exchanges to an expensive one, which can therefore flag freely. And linear probes on the protected model's own activations serve as an almost free first stage, ensembled with an external classifier fine-tuned from Claude Haiku 4.5.
The production system uses 3.5% of the old system's compute, refused 0.05% of production traffic during a month of shadow deployment on Claude Sonnet 4.5, and had the lowest rate of high-risk vulnerabilities in about 1,736 hours of red teaming. No red teamer found a universal jailbreak that answered all eight target questions at half the detail of an unguarded model.
Research notes: the problem, approach and results
less compute than the single exchange classifier (3.5% vs 150% of the last generation)
refusal rate on production traffic, shadow deployment on Claude Sonnet 4.5, Dec 2025
high-risk vulnerabilities per thousand red-team queries, lowest of the four systems (last generation: 0.019)
Last-generation Constitutional Classifiers read inputs and outputs separately, which attackers beat by splitting requests across long contexts or disguising replies, and they cost 23% extra compute with a 0.38% refusal rate on production traffic.
Replace the pair with an exchange classifier that judges each output in the context of its input; run a cheap first stage on all traffic and escalate only suspicious exchanges; make the first stage a linear probe on the protected model's activations and blend it with the external classifier.
The production system uses 3.5% of the last generation's compute, refused 0.05% of production traffic in a month of shadow deployment, and had the lowest vulnerability rate across about 1,736 hours of red teaming, with no universal jailbreak found.
Why it matters to an FDE
Guardrail projects usually die on cost and false positives, not on the security idea. This paper is a rare public account of a large provider designing a classifier system against both constraints at once, with numbers for each.
Judge the exchange, not the message. Checking outputs without their inputs misses anything that's only harmful in context. The same holds for a customer's data-leak or policy classifier.
Cascades let the first stage over-flag. Because a first-stage flag means "look closer", not "refuse", a weak, cheap model is good enough there. It's the same economics as model routing, applied to safety.
Know what you can and can't build. Activation probes need access to the protected model's internals, so a team calling a hosted API can't copy that part. The cascade, the exchange framing and the streaming evaluation all transfer to any stack.
Understand the mechanism. Try it on a real problem.
Unlock this breakdown and 157 more papers.
Premium opens every paper in full, plus every answer, concept, course and guide on the site. One payment for six months of access.
6 months · One payment · No auto-renewal
- ◇1 architecture diagram
- </>1 runnable code experiment
- ▦2 results tables
- ?5 interview questions with answers
- 03Key takeaways
Two attack classes, three design changes, what red teaming measured, three misreadings
Free account - 04How it works
Exchange classification, the cascade, probe training, the ensemble and the red-teaming protocol
Premium - 05The numbers that matter
Red-teaming results per system, cost ratios, probe ablations and the deployment month
Premium - 06Try it yourself
Check Table 1 and the cost claims, then simulate a probe-then-classifier cascade
Premium - 07Where it breaks
Internals access, CBRN-only scope, shifting red-team rules, comparability and slips
Premium - 08Using it on a deployment
Exchange-level checks, a cascade with a compute budget, streaming evaluation and the probe question
Premium - 09Interview angles
Five questions this paper prepares you for, with answer hints
Premium - 10Read next
Where to go from here on this site
Premium
