Cross-Session Decomposition Attacks: Scaling Risk and Intent-Aligned Retrieval Defense
Not on the map. Why?
Abstract (arXiv)
Scaling laws are usually read as a capability story: lower language-modeling loss yields more useful models. We study a safety consequence of this mechanism in cross-session decomposition attacks, where benign-looking subqueries are asked across independent interactions and later recomposed toward a forbidden objective. We formalize this setting as compositional safety risk and prove a conditional risk-transfer bound: when the reference environment already contains dispersed evidence for a risky reconstruction, the gap between deployed composed risk and reference composed risk is controlled by the model's excess loss on allowed subqueries. Synthetic withholding experiments show that wider transformers assign lower loss to held-out instructions that never appear verbatim in training but are recoverable from injected supporting facts. A 600-intent pretrained-LLM evaluation shows that larger Qwen3 and Gemma3 family members can yield greater harmful-capability uplift under a fixed decomposition-composition pipeline. As a defense, IntentAlign-MiniLM, our 22M-parameter intent-aligned retriever, outperforms much larger embedding models on held-out intent retrieval and yields the best learned-retriever harmful recall across tested guardrails. Code is available in hrefhttps://github.com/liaodisen/Cross-Session-Decomposition-Attacksour GitHub repository.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 41 references that are in the map. First posted on arXiv 28 Aug 2026.
Builds on
22 of 41 references.
References · 22
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
- 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 723
10 more
- 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 629
- 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 390
- 2023Multi-step Jailbreaking Privacy Attacks on ChatGPTcited by 333
- 2024Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Modelscited by 326
- 2018WikiHow: A Large Scale Text Summarization Datasetcited by 204
- 2024DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakerscited by 101
- 2025Monitoring Decomposition Attacks in LLMs with Lightweight Sequential Monitorscited by 25
- 2024You Know What I'm Saying: Jailbreak Attack via Implicit Referencecited by 14
- 2024Can LLMs Deeply Detect Complex Malicious Queries? A Framework for Jailbreaking via Obfuscating Intentcited by 8
- 2025Benchmarking Misuse Mitigation Against Covert Adversariescited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Intent-Hiding Jailbreaks: An Information-Theoretic Framework for Compositional Attacks
- 2025SAID: Safety-Aware Intent Defense via Prefix Probing for Large Language Models
- 2024Jailbreak Antidote: Runtime Safety-Utility Balance via Sparse Representation Adjustment in Large Language Models
- 2026Closing the Activation-Cone Blind Spot: Response-Time Probing and Unified Defense
- 2026LTBD: Learnable Trust-Boundary Delimiters for Prompt Injection Defense
- 2026Safety Anchor: Defending Harmful Fine-tuning via Geometric Bottlenecks
- 2025CTRAP: Embedding Collapse Trap to Safeguard Large Language Models from Harmful Fine-Tuning
- 2026The Defense Trilemma: Why Prompt Injection Defense Wrappers Fail?