How Narrative Wrapping Affects LLM Refusal: A Cross-Language Benchmark and Defense
On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks
also in 1 more
Abstract (arXiv)
Safety-aligned language models often refuse a harmful request stated directly but answer the same request inside a role-play or narrative wrapper. We measure this vulnerability across languages and registers: attack success on Qwen3-1.7B is already 89.4% in English and 93.0% in modern Chinese, and reaches 95.7% in Classical Chinese. We build GUISE, a benchmark for systematically studying this vulnerability. It includes parallel requests in English, modern Chinese, and Classical Chinese, matched harmful and benign pairs, wrapper types held out for evaluation, and a stricter criterion that counts warn-then-answer responses as attack successes. Representation analysis shows that language and register move harmful-request representations only slightly away from the model's refusal direction, whereas narrative wrappers move them much farther away. We propose AXIS, which combines preference optimisation with a rotation objective that aligns harmful-request representations with the refusal direction and a commitment objective that trains the model to refuse completely rather than produce a warn-then-answer response. Across Qwen3-1.7B, Qwen3-4B and GLM-4-9B, AXIS achieves the highest combined safety and usability score among the compared methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 27 of its 47 references that are in the map. First posted on arXiv 7 Oct 2026.
Builds on
27 of 47 references.
Closest ancestors · 7
Same direction, newest first
- 2026Low-Resource Safety Failures Are Action Failures, Not Representation Failures31 May
- 2025Improving LLM Safety Alignment with Dual-Objective Optimization5 Mar
- 2024SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal20 Jun
- 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deep10 Jun
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!5 Oct
- 2023GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher12 Aug
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
Other references · 20
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
- 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Promptscited by 520
- 2023XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Modelscited by 477
- 2023DeepInception: Hypnotize Large Language Model to Be Jailbreakercited by 337
- 2023Multilingual Jailbreak Challenges in Large Language Modelscited by 222
- 2023Scalable and Transferable Black-Box Jailbreaks for Language Models via Persona Modulationcited by 202
- 2024ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMscited by 197
- 2024Booster: Tackling Harmful Fine-tuning for Large Language Models via Attenuating Harmful Perturbationcited by 92
- 2024Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Trainingcited by 67
- 2025From Hard Refusals to Safe-Completions: Toward Output-Centric Safety Trainingcited by 49
- 2024JailbreakEval: An Integrated Toolkit for Evaluating Jailbreak Attempts Against Large Language Modelscited by 28
8 more
- 2025Representation Bending for Large Language Model Safetycited by 28
- 2024AlphaDPO: Adaptive Reward Margin for Direct Preference Optimizationcited by 27
- 2025SimPER: A Minimalist Approach to Preference Alignment without Hyperparameterscited by 25
- 2025Adversarial Poetry as a Universal Single-Turn Jailbreak Mechanism in Large Language Modelscited by 14
- 2026Obscure but Effective: Classical Chinese Jailbreak Prompt Optimization via Bio-Inspired Searchcited by 10
- 2025When Style Breaks Safety: Defending LLMs Against Superficial Style Alignmentcited by 6
- 2025Anchoring Refusal Direction: Mitigating Safety Risks in Tuning via Projection Constraintcited by 6
- 2026Voices Across Registers: Corpus-Conditioned Vernacular Jailbreaks against Aligned LLMs via Fanfiction Subgenrescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Refusal Direction is Universal Across Safety-Aligned Languages
- 2024OR-Bench: An Over-Refusal Benchmark for Large Language Models
- 2026Minionese: Comprehensive Benchmark and Mechanistic Study of Multilingual LLM Safety
- 2026Breaking Refusal in the First Half: A Mechanistic Study of the Prefill Jailbreak
- 2026LLMs Can Unlearn Refusal with Only 1,000 Benign Samples
- 2026Hard Negatives Reveal What Easy Negatives Hide: Cross-Lingual Harmfulness Representations Degrade with Resource Tier Under Hard Negatives
- 2025FalseReject: A Resource for Improving Contextual Safety and Mitigating Over-Refusals in LLMs via Structured Reasoning
- 2026Beyond English and Evasion: A Human-Annotated Multi-Domain Benchmark for High-Stakes LLM Safety Evaluation in Chinese