mlsanityData to 7 Oct 2026

How Narrative Wrapping Affects LLM Refusal: A Cross-Language Benchmark and Defense

arXiv 2610.11005 ↗First posted 7 Oct 2026cs.AIcited by 0

On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks

also in 1 more
Abstract (arXiv)

Safety-aligned language models often refuse a harmful request stated directly but answer the same request inside a role-play or narrative wrapper. We measure this vulnerability across languages and registers: attack success on Qwen3-1.7B is already 89.4% in English and 93.0% in modern Chinese, and reaches 95.7% in Classical Chinese. We build GUISE, a benchmark for systematically studying this vulnerability. It includes parallel requests in English, modern Chinese, and Classical Chinese, matched harmful and benign pairs, wrapper types held out for evaluation, and a stricter criterion that counts warn-then-answer responses as attack successes. Representation analysis shows that language and register move harmful-request representations only slightly away from the model's refusal direction, whereas narrative wrappers move them much farther away. We propose AXIS, which combines preference optimisation with a rotation objective that aligns harmful-request representations with the refusal direction and a commitment objective that trains the model to refuse completely rather than produce a warn-then-answer response. Across Qwen3-1.7B, Qwen3-4B and GLM-4-9B, AXIS achieves the highest combined safety and usability score among the compared methods.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 27 of its 47 references that are in the map. First posted on arXiv 7 Oct 2026.

Builds on

27 of 47 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026Low-Resource Safety Failures Are Action Failures, Not Representation Failures31 May
  2. 2025Improving LLM Safety Alignment with Dual-Objective Optimization5 Mar
  3. 2024SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal20 Jun
  4. 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deep10 Jun
  5. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!5 Oct
  6. 2023GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher12 Aug
  7. 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul

Other references · 20

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
  3. 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Promptscited by 520
  4. 2023XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Modelscited by 477
  5. 2023DeepInception: Hypnotize Large Language Model to Be Jailbreakercited by 337
  6. 2023Multilingual Jailbreak Challenges in Large Language Modelscited by 222
  7. 2023Scalable and Transferable Black-Box Jailbreaks for Language Models via Persona Modulationcited by 202
  8. 2024ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMscited by 197
  9. 2024Booster: Tackling Harmful Fine-tuning for Large Language Models via Attenuating Harmful Perturbationcited by 92
  10. 2024Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Trainingcited by 67
  11. 2025From Hard Refusals to Safe-Completions: Toward Output-Centric Safety Trainingcited by 49
  12. 2024JailbreakEval: An Integrated Toolkit for Evaluating Jailbreak Attempts Against Large Language Modelscited by 28
8 more
  1. 2025Representation Bending for Large Language Model Safetycited by 28
  2. 2024AlphaDPO: Adaptive Reward Margin for Direct Preference Optimizationcited by 27
  3. 2025SimPER: A Minimalist Approach to Preference Alignment without Hyperparameterscited by 25
  4. 2025Adversarial Poetry as a Universal Single-Turn Jailbreak Mechanism in Large Language Modelscited by 14
  5. 2026Obscure but Effective: Classical Chinese Jailbreak Prompt Optimization via Bio-Inspired Searchcited by 10
  6. 2025When Style Breaks Safety: Defending LLMs Against Superficial Style Alignmentcited by 6
  7. 2025Anchoring Refusal Direction: Mitigating Safety Risks in Tuning via Projection Constraintcited by 6
  8. 2026Voices Across Registers: Corpus-Conditioned Vernacular Jailbreaks against Aligned LLMs via Fanfiction Subgenrescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Refusal Direction is Universal Across Safety-Aligned Languages
  2. 2024OR-Bench: An Over-Refusal Benchmark for Large Language Models
  3. 2026Minionese: Comprehensive Benchmark and Mechanistic Study of Multilingual LLM Safety
  4. 2026Breaking Refusal in the First Half: A Mechanistic Study of the Prefill Jailbreak
  5. 2026LLMs Can Unlearn Refusal with Only 1,000 Benign Samples
  6. 2026Hard Negatives Reveal What Easy Negatives Hide: Cross-Lingual Harmfulness Representations Degrade with Resource Tier Under Hard Negatives
  7. 2025FalseReject: A Resource for Improving Contextual Safety and Mitigating Over-Refusals in LLMs via Structured Reasoning
  8. 2026Beyond English and Evasion: A Human-Annotated Multi-Domain Benchmark for High-Stakes LLM Safety Evaluation in Chinese