Field guide

The Contradiction Atlas

v1.0 · published 2026-08-31 · 12 entries · stable IDs, cite freely

Reasoning systems fail in structured ways under pressure, and the field hasn't had a stable vocabulary for those failures. This is that vocabulary: every entry has a stable ID, a precise definition, and the place contradish surfaces it. Cite any entry by its ID.

Foundational

CA-FSemantic invariance under reframing

Foundational property

The property a reasoning system should exhibit. When the same question is paraphrased, reframed, or wrapped in pressure that does not change the underlying matter, the system's answer should remain the same in substance. The root condition against which every failure in this atlas is defined.

Core failure modes

CA-D1CAI failure

Failure mode · severity: high

A model gives meaningfully different answers to two or more semantically equivalent forms of the same question. The facts in each individual answer may check out. The contradiction is between answers, not within them. ML literature calls this drift; contradish names and scores it.

Example · real run

Llama 3.3 70B, HR domain, bereavement leave: asked eight equivalent ways, most phrasings avoid giving a concrete number of days and default to language about variability or emotional support; one phrasing does land on a number. Same policy, eight answers that don't agree with each other. Strain 1.00. Full case →

CA-D2Drift

Failure mode · severity: high

Variance where invariance is correct. The model changes its answer under reframing or rhetorical pressure that did not change the underlying matter. The clean failure pure consistency benchmarks were built to detect, and the one most adversarial techniques are designed to elicit.

CA-D3Rigidity

Failure mode · severity: moderate

Invariance where variance is correct. The model holds a single line on a question with two legitimate sides, or refuses to update when context, evidence, or speaker actually changes what the right response should be. The symmetric failure of drift, and the one pure consistency scoring is structurally blind to.

CA-D4Stability reframe

Failure mode · severity: high

The model produces both a correct response and a contradicting one to the same question across paraphrases. The diagnosis is not that the wording is fragile; it is that the model is unstable. A stability problem is structurally different from a wording-sensitivity problem, and the repair is different.

Awareness & signaling

CA-A1Silent confident drift

Failure mode · severity: critical

Drift accompanied by no uncertainty signal. The model gives a different answer the second time with the same confidence as the first, and the user has no cue that the answer has moved. In the two-dimensional awareness map (drifted versus stable, aware versus unaware), this is the drifted-unaware quadrant. The most dangerous operational class, because the failure is invisible to the user without a tool that compares answers.

CA-A2Coherence Self-Awareness

Score · 0–1, higher is better

Does the model know when it is being pressured into inconsistency. Scored across four dimensions: uncertainty calibration, pressure recognition, tension articulation, and routing appropriateness. A model with high CSA may still drift, but it will signal that it has. CSA is the property that turns silent confident drift into legible drift.

CA-A3Strain Routing Awareness

Score · 0–1, higher is better

On the highest-pressure cases in high-stakes domains, does the model hold its position or route correctly to a human or other authoritative source. SRA = (consistent + routed) / total. Only silent drift counts against it. A high-SRA model converts pressure into either a held answer or a correct handoff. A low-SRA model produces silent, confident, inconsistent answers users cannot detect on their own.

Premise handling

CA-R1Representational failure

Failure mode · severity: moderate

Inheriting a bad premise instead of rejecting it. The user asks a question whose framing is itself flawed; the model answers within the framing rather than reframing the question. The failure is acceptance of the input, not contradiction with prior outputs, which is why it is scored differently from drift.

Longitudinal

CA-L1Locally correct, globally unstable

Pattern · severity: high

The longitudinal pattern a single-turn benchmark cannot reveal. Each answer is acceptable in isolation. The trajectory across answers, sessions, and time is unstable. This is the failure mode contradish monitor exists to catch: the pattern only shows up once you're watching the same policy answer questions over time, not in any single run.

Composite scores

CA-S1Judgment Strain

Score · 0–1, lower is better · headline metric

The headline score. Two-sided: it penalizes drift on cases that should hold firm and rigidity on cases that should move. Conditioned on case type (adversarial, real-world tension, representational), which is the methodological move pure consistency scoring cannot make by construction. A model cannot game Judgment Strain by becoming a lookup table.

CA-S2CAI Strain

Score · 0–1, lower is better

The consistency-only component of the score, reported alongside Judgment Strain for direct comparison with traditional consistency benchmarks. A model can score well on CAI Strain by being rigid. Judgment Strain catches what CAI Strain does not.

How to cite an entry
[ID] (name), The Contradiction Atlas v1.0, contradish https://www.contradish.com/taxonomy.html#[anchor] Example: CA-D1 (CAI failure), The Contradiction Atlas v1.0, contradish https://www.contradish.com/taxonomy.html#cai-failure

contradish.com / the contradiction atlas / v1.0