Scaling Patterns in Adversarial Alignment: Evidence from Multi-LLM Jailbreak Experiments
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
Large language models (LLMs) increasingly operate in multi-agent and safety-critical settings, raising open questions about how their vulnerabilities scale when models interact adversarially. This study examines whether larger models can systematically jailbreak smaller ones - eliciting harmful or restricted behavior despite alignment safeguards. Using standardized adversarial tasks from JailbreakBench, we simulate over 6,000 multi-turn attacker-target exchanges across major LLM families and scales (0.6B-120B parameters), measuring both harm score and refusal behavior as indicators of adversarial potency and alignment integrity. Each interaction is evaluated through aggregated harm and refusal scores assigned by three independent LLM judges, providing a consistent, model-based measure of adversarial outcomes. Aggregating results across prompts, we find a strong and statistically significant correlation between mean harm and the logarithm of the attacker-to-target size ratio (Pearson r = 0.51, p < 0.001; Spearman rho = 0.52, p < 0.001), indicating that relative model size correlates with the likelihood and severity of harmful completions. Mean harm score variance is higher across attackers (0.18) than across targets (0.10), suggesting that attacker-side behavioral diversity contributes more to adversarial outcomes than target susceptibility. Attacker refusal frequency is strongly and negatively correlated with harm (rho = -0.93, p < 0.001), showing that attacker-side alignment mitigates harmful responses. These findings reveal that size asymmetry influences robustness and provide exploratory evidence for adversarial scaling patterns, motivating more controlled investigations into inter-model alignment and safety.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 17 of its 30 references that are in the map. First posted on arXiv 16 Nov 2025.
Builds on
17 of 30 references.
Closest ancestors · 9
Same direction, newest first
- 2025JADES: A Universal Framework for Jailbreak Assessment via Decompositional Scoring28 Aug
- 2025Confusion is the Final Barrier: Rethinking Jailbreak Evaluation and Investigating the Real Misuse Threat of LLMs22 Aug
- 2025Multi-Turn Jailbreaks Are Simpler Than They Seem11 Aug
- 2025Large Reasoning Models Are Autonomous Jailbreak Agents4 Aug
- 2025Logic Jailbreak: Efficiently Unlocking LLM Safety Restrictions Through Formal Logical Expression18 May
- 2025xJailbreak: Representation Space Guided Reinforcement Learning for Interpretable LLM Jailbreaking28 Jan
- 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models28 Mar
- 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs12 Jan
- 2023Jailbreaking Black Box Large Language Models in Twenty Queries12 Oct
Other references · 8
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,154
- 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
- 2023An Overview of Catastrophic AI Riskscited by 222
- 2023The Capacity for Moral Self-Correction in Large Language Modelscited by 173
- 2025Agentic Misalignment: How LLMs Could Be Insider Threatscited by 158
- 2023The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversationcited by 109
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Adversarial Alignment for LLMs Requires Simpler, Reproducible, and More Measurable Objectives
- 2026Understanding the Effects of Safety Unalignment on Large Language Models
- 2025AdversariaLLM: A Unified and Modular Toolbox for LLM Robustness Research
- 2025Short-length Adversarial Training Helps LLMs Defend Long-length Jailbreak Attacks: Theoretical and Empirical Evidence
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attacks
- 2026SoK: Robustness in Large Language Models against Jailbreak Attacks
- 2026Mechanistic Interpretability of LLM Jailbreaks via Internal Attribution Graphs
- 2024Jailbreaking and Mitigation of Vulnerabilities in Large Language Models