mlsanityData to 7 Oct 2026

Mood Matters: How Syntactic Sensitivity Undermines Safety Alignment

arXiv 2608.05409 ↗First posted 5 Aug 2026cs.CLcited by 0

On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks

also in 1 more
Abstract (arXiv)

Large language models typically undergo post-training to align them with safety policies but there exist many sophisticated jailbreaks that sidestep established safeguards. For instance, prior work by Andriushchenko et al. (2025) has found that changing the grammatical tense from present to past can be enough to elicit harmful responses. In this work, we uncover a more general failure of non-imperative syntactic forms. We demonstrate that this syntactic vulnerability exists in 16 models up to 70B parameters, using behavioral evaluation. To investigate the root cause, we apply causal mediation analysis, finding that refusal is partially conditioned on upstream syntactic features. By steering these purely syntactic features we are able to trigger and suppress refusal. Finally, we trace this ill-conditioning to linguistically biased post-training data of open-source models and show that increasing syntactic diversity can mitigate the issue. Our findings suggest that current alignment approaches introduce confounders that prevent a pure semantic grounding of the refusal decision.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 27 of its 47 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

27 of 47 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Why LLM Safety Guardrails Collapse After Fine-tuning: A Similarity Analysis Between Alignment and Fine-tuning Datasets5 Jun
  2. 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deep10 Jun
  3. 2024Don't Say No: Jailbreaking LLM by Suppressing Refusal25 Apr
  4. 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul

Other references · 23

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  2. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
  3. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
  4. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
  5. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
  6. 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 847
  7. 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 598
  8. 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 488
  9. 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 460
  10. 2024Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Modelscited by 412
  11. 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2cited by 381
  12. 2023Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructionscited by 377
11 more
  1. 2024Improving Alignment and Robustness with Circuit Breakerscited by 302
  2. 2024What is in Your Safe Data? Identifying Benign Data that Breaks Safetycited by 114
  3. 2024Efficient Adversarial Training in LLMs with Continuous Attackscited by 104
  4. 2024Steering Language Model Refusal with Sparse Autoencoderscited by 89
  5. 2025LLMs Encode Harmfulness and Refusal Separatelycited by 75
  6. 2024Does Refusal Training in LLMs Generalize to the Past Tense?cited by 74
  7. 2023Fake Alignment: Are LLMs Really Aligned Well?cited by 39
  8. 2025Improving Large Language Model Safety with Contrastive Representation Learningcited by 7
  9. 2025When Style Breaks Safety: Defending LLMs Against Superficial Style Alignmentcited by 6
  10. 2025Learning the Wrong Lessons: Syntactic-Domain Spurious Correlations in Language Modelscited by 6
  11. 2025Steering Language Models in Multi-Token Generation: A Case Study on Tense and Aspectcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Deactivating Refusal Triggers: Understanding and Mitigating Overrefusal in Safety Alignment
  2. 2025Refusal Direction is Universal Across Safety-Aligned Languages
  3. 2026LLMs Can Unlearn Refusal with Only 1,000 Benign Samples
  4. 2026Discern Truth from Falsehood: Reducing Over-Refusal via Contrastive Refinement
  5. 2026Refuse without Refusal: A Structural Analysis of Safety-Tuning Responses for Reducing False Refusals in Language Models
  6. 2025Syntactic Framing Fragility: An Audit of Robustness in LLM Ethical Decisions
  7. 2026When Safety Routing Breaks: Understanding Alignment Fragility under Benign Fine-Tuning
  8. 2025How Semantically Stable Are LLM Refusals? Measuring Confusion in Local Safety Boundaries