TraceRouter: Robust Safety for Large Foundation Models via Path-Level Intervention
On the map: Mechanistic interpretability → Steering and probing for LLM safety
Abstract (arXiv)
Despite their capabilities, large foundation models (LFMs) remain susceptible to adversarial manipulation. Current defenses predominantly rely on the "locality hypothesis", suppressing isolated neurons or features. However, harmful semantics act as distributed, cross-layer circuits, rendering such localized interventions brittle and detrimental to utility. To bridge this gap, we propose TraceRouter, a path-level framework that traces and disconnects the causal propagation circuits of illicit semantics. TraceRouter operates in three stages: (1) it pinpoints a sensitive onset layer by analyzing attention divergence; (2) it leverages sparse autoencoders (SAEs) and differential activation analysis to disentangle and isolate malicious features; and (3) it maps these features to downstream causal pathways via feature influence scores (FIS) derived from zero-out interventions. By selectively suppressing these causal chains, TraceRouter physically severs the flow of harmful information while leaving orthogonal computation routes intact. Extensive experiments demonstrate that TraceRouter significantly outperforms state-of-the-art baselines, achieving a superior trade-off between adversarial robustness and general utility. Our code will be publicly released. WARNING: This paper contains unsafe model responses.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Steering and probing for LLM safety, one of 13 directions in Mechanistic interpretability. Builds on 44 of its 49 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
44 of 49 references.
References · 44
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
32 more
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2023Progress measures for grokking via mechanistic interpretabilitycited by 839
- 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2023Erasing Concepts from Diffusion Modelscited by 539
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 513
- 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deepcited by 472
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 398
- 2023Unified Concept Editing in Diffusion Modelscited by 388
- 2024Improving Alignment and Robustness with Circuit Breakerscited by 322
- 2023Ablating Concepts in Text-to-Image Diffusion Modelscited by 317
- 2023Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Modelscited by 301
- 2023MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Modelscited by 274
- 2023Ring-A-Bell! How Reliable are Concept Removal Methods for Diffusion Models?cited by 250
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
- 2024Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluationcited by 191
- 2023Prompting4Debugging: Red-Teaming Text-to-Image Diffusion Models by Finding Problematic Promptscited by 171
- 2023One-Dimensional Adapter to Rule Them All: Concepts, Diffusion Models and Erasing Applicationscited by 169
- 2024Reliable and Efficient Concept Erasure of Text-to-Image Diffusion Modelscited by 133
- 2024Eyes Closed, Safety On: Protecting Multimodal LLMs via Image-to-Text Transformationcited by 124
- 2023Circumventing Concept Erasure Methods For Text-to-Image Generative Modelscited by 85
- 2024Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Trainingcited by 69
- 2023AltDiffusion: A Multilingual Text-to-Image Diffusion Modelcited by 30
- 2026Mass Concept Erasure in Diffusion Models with Concept Hierarchycited by 14
- 2025Side Effects of Erasing Concepts from Diffusion Modelscited by 13
- 2025DuMo: Dual Encoder Modulation Network for Precise Concept Erasurecited by 11
- 2025SafePTR: Token-Level Jailbreak Defense in Multimodal LLMs via Prune-then-Restore Mechanismcited by 10
- 2025A Single Neuron Works: Precise Concept Erasure in Text-to-Image Diffusion Modelscited by 8
- 2025Discovering Influential Neuron Path in Vision Transformerscited by 7
- 2025HumorReject: Decoupling LLM Safety from Refusal Prefix via A Little Humorcited by 6
- 2025SGM: Safety Glasses for Multimodal Large Language Models via Neuron-Level Detoxificationcited by 1
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026Latent Anomaly Knowledge Excavation: Unveiling Sparse Sensitive Neurons in Vision-Language Modelscited by 3
- 2026McCast: Memory-Guided Latent Drift Correction for Long-Horizon Precipitation Nowcastingcited by 2
- 2026A Multi-Scale Graph Learning Framework with Temporal Consistency Constraints for Financial Fraud Detection in Transaction Networks under Non-Stationary Conditionscited by 1
- 2026A Heuristic Perspective on Debiasing Language Modelscited by 1
- 2026From Knowledge to Inference: Formalizing Specialized Public Health Reasoning on GlobalHealthAtlascited by 0
- 2026Moving the Safety Barrier: Dynamic Routing Adaptive Alignment Against White-Box Attackscited by 0
- 2026AnyTrack: Unifying Visual Object Tracking with Any Modalitiescited by 0
- 2026Tripwire: Triggering Aligned Refusal via Statistically Certified Safety Neuronscited by 0
- 2026BARQ: Balanced Codebook Refinement for Low-Bit LLM Quantizationcited by 0
- 2026Do correct answers have stable latent knowledge support?cited by 0
- 2026SuperAI: Merging Capabilities Across Heterogeneous Foundation Modelscited by 0
- 2026SuperAI: Merging Capabilities Across Heterogeneous Foundation Models11 Oct 2026
- 2026Do correct answers have stable latent knowledge support?11 Oct 2026
- 2026BARQ: Balanced Codebook Refinement for Low-Bit LLM Quantization3 Oct 2026
- 2026Tripwire: Triggering Aligned Refusal via Statistically Certified Safety Neurons14 Aug 2026
- 2026AnyTrack: Unifying Visual Object Tracking with Any Modalities7 Aug 2026
- 2026Moving the Safety Barrier: Dynamic Routing Adaptive Alignment Against White-Box Attacks2 Aug 2026
- 2026A Heuristic Perspective on Debiasing Language Models1 Aug 2026
- 2026McCast: Memory-Guided Latent Drift Correction for Long-Horizon Precipitation Nowcasting13 May 2026
- 2026Latent Anomaly Knowledge Excavation: Unveiling Sparse Sensitive Neurons in Vision-Language Models9 Apr 2026
- 2026A Multi-Scale Graph Learning Framework with Temporal Consistency Constraints for Financial Fraud Detection in Transaction Networks under Non-Stationary Conditions15 Mar 2026
- 2026From Knowledge to Inference: Formalizing Specialized Public Health Reasoning on GlobalHealthAtlas31 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026TRACER: Trace-Regularized Training Against Indirect Prompt Injection
- 2026Harmfulness Propagation Dynamics: Layer-wise Trajectories of Adversarial Intent in Large Language Models
- 2025SoK: a Comprehensive Causality Analysis Framework for Large Language Model Security
- 2026PermaFrost-Attack: Stealth Pretraining Seeding(SPS) for planting Logic Landmines During LLM Training
- 2026Making MLLMs Blind: Adversarial Smuggling Attacks in MLLM Content Moderation
- 2026TRACE: Trajectory Aware Reasoning for Multi-Turn Adversarial Conversation Evaluation
- 2024Steering Away from Harm: An Adaptive Approach to Defending Vision Language Model Against Jailbreaks
- 2026Mechanistic Interpretability of LLM Jailbreaks via Internal Attribution Graphs