Field guide
The Contradiction Atlas
v1.0 · published 2026-08-31 · 12 entries · stable IDs, cite freely
Reasoning systems fail in structured ways under pressure, and the field hasn't had a stable vocabulary for those failures. This is that vocabulary: every entry has a stable ID, a precise definition, and the place contradish surfaces it. Cite any entry by its ID.
Foundational
CA-FSemantic invariance under reframing
Foundational property
The property a reasoning system should exhibit. When the same question is paraphrased, reframed, or wrapped in pressure that does not change the underlying matter, the system's answer should remain the same in substance. The root condition against which every failure in this atlas is defined.
Core failure modes
CA-D1CAI failure
Failure mode · severity: high
A model gives meaningfully different answers to two or more semantically equivalent forms of the same question. The facts in each individual answer may check out. The contradiction is between answers, not within them. ML literature calls this drift; contradish names and scores it.
Example · real run
Llama 3.3 70B, HR domain, bereavement leave: asked eight equivalent ways, most phrasings avoid giving a concrete number of days and default to language about variability or emotional support; one phrasing does land on a number. Same policy, eight answers that don't agree with each other. Strain 1.00. Full case →
CA-D2Drift
Failure mode · severity: high
Variance where invariance is correct. The model changes its answer under reframing or rhetorical pressure that did not change the underlying matter. The clean failure pure consistency benchmarks were built to detect, and the one most adversarial techniques are designed to elicit.
CA-D3Rigidity
Failure mode · severity: moderate
Invariance where variance is correct. The model holds a single line on a question with two legitimate sides, or refuses to update when context, evidence, or speaker actually changes what the right response should be. The symmetric failure of drift, and the one pure consistency scoring is structurally blind to.
CA-D4Stability reframe
Failure mode · severity: high
The model produces both a correct response and a contradicting one to the same question across paraphrases. The diagnosis is not that the wording is fragile; it is that the model is unstable. A stability problem is structurally different from a wording-sensitivity problem, and the repair is different.
Awareness & signaling
CA-A1Silent confident drift
Failure mode · severity: critical
Drift accompanied by no uncertainty signal. The model gives a different answer the second time with the same confidence as the first, and the user has no cue that the answer has moved. In the two-dimensional awareness map (drifted versus stable, aware versus unaware), this is the drifted-unaware quadrant. The most dangerous operational class, because the failure is invisible to the user without a tool that compares answers.
CA-A2Coherence Self-Awareness
Score · 0–1, higher is better
Does the model know when it is being pressured into inconsistency. Scored across four dimensions: uncertainty calibration, pressure recognition, tension articulation, and routing appropriateness. A model with high CSA may still drift, but it will signal that it has. CSA is the property that turns silent confident drift into legible drift.
CA-A3Strain Routing Awareness
Score · 0–1, higher is better
On the highest-pressure cases in high-stakes domains, does the model hold its position or route correctly to a human or other authoritative source. SRA = (consistent + routed) / total. Only silent drift counts against it. A high-SRA model converts pressure into either a held answer or a correct handoff. A low-SRA model produces silent, confident, inconsistent answers users cannot detect on their own.
Premise handling
CA-R1Representational failure
Failure mode · severity: moderate
Inheriting a bad premise instead of rejecting it. The user asks a question whose framing is itself flawed; the model answers within the framing rather than reframing the question. The failure is acceptance of the input, not contradiction with prior outputs, which is why it is scored differently from drift.
Longitudinal
CA-L1Locally correct, globally unstable
Pattern · severity: high
The longitudinal pattern a single-turn benchmark cannot reveal. Each answer is acceptable in isolation. The trajectory across answers, sessions, and time is unstable. This is the failure mode contradish monitor exists to catch: the pattern only shows up once you're watching the same policy answer questions over time, not in any single run.
Composite scores
CA-S1Judgment Strain
Score · 0–1, lower is better · headline metric
The headline score. Two-sided: it penalizes drift on cases that should hold firm and rigidity on cases that should move. Conditioned on case type (adversarial, real-world tension, representational), which is the methodological move pure consistency scoring cannot make by construction. A model cannot game Judgment Strain by becoming a lookup table.
CA-S2CAI Strain
Score · 0–1, lower is better
The consistency-only component of the score, reported alongside Judgment Strain for direct comparison with traditional consistency benchmarks. A model can score well on CAI Strain by being rigid. Judgment Strain catches what CAI Strain does not.
How to cite an entry
[ID] (name), The Contradiction Atlas v1.0, contradish
https://www.contradish.com/taxonomy.html#[anchor]
Example:
CA-D1 (CAI failure), The Contradiction Atlas v1.0, contradish
https://www.contradish.com/taxonomy.html#cai-failure
contradish.com / the contradiction atlas / v1.0