A Single Suffix to Break Them All: Basin-Aware Jailbreaks for Merged Model Families
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
Model merging enables combining multiple fine-tuned models without additional training, but its safety implications remain poorly understood. Prior work primarily attributes merging risks to unsafe constituent models, implicitly assuming that merging individually aligned models preserves safety. In contrast, we show that model merging reveals a previously overlooked jailbreak risk rooted in the pretrained foundation model, even when all constituent models are individually safety-aligned. Motivated by this observation, we study a new threat setting where an attacker constructs jailbreak prompts that generalize across merged models sharing the same pretrained backbone, without access to the exact merging coefficients or constituent checkpoints. To exploit this phenomenon, we propose Basin-Aware Jailbreak (BAJ), which formulates jailbreak generation as a min--max optimization over the merging space to produce transferable adversarial suffixes across merged model families. Experiments across diverse backbones and merging settings show that BAJ achieves consistently high transfer success rates and remains effective under existing defenses.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 33 of its 54 references that are in the map. First posted on arXiv 27 Aug 2026.
Builds on
33 of 54 references.
Closest ancestors · 11
Same direction, newest first
- 2025One Leak Away: How Pretrained Model Exposure Amplifies Jailbreak Risks in Finetuned LLMs14 Dec
- 2025Mitigating Jailbreaks with Intent-Aware LLMs16 Aug
- 2025Guiding not Forcing: Enhancing the Transferability of Jailbreaking Attacks on LLMs via Removing Superfluous Constraints25 Feb
- 2024AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to Jailbreak LLMs3 Oct
- 2024Towards Understanding Jailbreak Attacks in LLMs: A Representation Space Analysis16 Jun
- 2024How Alignment and Jailbreak Work: Explain LLM Safety through Intermediate Hidden States9 Jun
- 2024Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses3 Jun
- 2024Improved Generation of Adversarial Examples Against Safety-aligned LLMs28 May
- 2024AmpleGCG: Learning a Universal and Transferable Generative Model of Adversarial Suffixes for Jailbreaking Both Open and Closed LLMs11 Apr
- 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automatically4 Dec
- 2023Jailbreaking Black Box Large Language Models in Twenty Queries12 Oct
Other references · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
- 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 728
- 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 679
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 608
10 more
- 2019SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarizationcited by 530
- 2023Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructionscited by 377
- 2024ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMscited by 197
- 2024Model Stock: All we need is just a few fine-tuned modelscited by 87
- 2024DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Samplingcited by 77
- 2024Uncovering Safety Risks of Large Language Models through Concept Activation Vectorcited by 63
- 2024Model Merging and Safety Alignment: One Bad Model Spoils the Bunchcited by 41
- 2024BadMerging: Backdoor Attacks Against Model Mergingcited by 32
- 2025Disrupting Model Merging: A Parameter-Level Defense Without Sacrificing Accuracycited by 11
- 2025BADTV: Unveiling Backdoor Threats in Third-Party Task Vectorscited by 3
Built on by
Not cited yet.