mlsanityData to 7 Oct 2026

Semantic Gravity Wells: Why Negative Constraints Backfire

arXiv 2601.08070 ↗First posted 12 Jan 2026cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Negative constraints (instructions of the form "do not use word X") represent a fundamental test of instruction-following capability in large language models. Despite their apparent simplicity, these constraints fail with striking regularity, and the conditions governing failure have remained poorly understood. This paper presents the first comprehensive mechanistic investigation of negative instruction failure. We introduce semantic pressure, a quantitative measure of the model's intrinsic probability of generating the forbidden token, and demonstrate that violation probability follows a tight logistic relationship with pressure (p=σ(-2.40+2.27· P0); n=40,000 samples; bootstrap 95% CI for slope: [2.21,,2.33]). Through layer-wise analysis using the logit lens technique, we establish that the suppression signal induced by negative instructions is present but systematically weaker in failures: the instruction reduces target probability by only 5.2 percentage points in failures versus 22.8 points in successes -- a 4.4× asymmetry. We trace this asymmetry to two mechanistically distinct failure modes. In priming failure (87.5% of violations), the instruction's explicit mention of the forbidden word paradoxically activates rather than suppresses the target representation. In override failure (12.5%), late-layer feed-forward networks generate contributions of +0.39 toward the target probability -- nearly 4× larger than in successes -- overwhelming earlier suppression signals. Activation patching confirms that layers 23--27 are causally responsible: replacing these layers' activations flips the sign of constraint effects. These findings reveal a fundamental tension in negative constraint design: the very act of naming a forbidden word primes the model to produce it.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 15 references that are in the map. First posted on arXiv 12 Jan 2026.

Builds on

8 of 15 references.

References · 8

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  3. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  4. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
  5. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,130
  6. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
  7. 2022Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Spacecited by 522
  8. 2019Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Flycited by 240

Built on by

Not cited yet.