mlsanityData to 14 Oct 2026

TraceRouter: Robust Safety for Large Foundation Models via Path-Level Intervention

arXiv 2601.21900 ↗First posted 29 Jan 2026cs.CV cs.AI cs.CYcited by 11

On the map: Mechanistic interpretability → Steering and probing for LLM safety

Abstract (arXiv)

Despite their capabilities, large foundation models (LFMs) remain susceptible to adversarial manipulation. Current defenses predominantly rely on the "locality hypothesis", suppressing isolated neurons or features. However, harmful semantics act as distributed, cross-layer circuits, rendering such localized interventions brittle and detrimental to utility. To bridge this gap, we propose TraceRouter, a path-level framework that traces and disconnects the causal propagation circuits of illicit semantics. TraceRouter operates in three stages: (1) it pinpoints a sensitive onset layer by analyzing attention divergence; (2) it leverages sparse autoencoders (SAEs) and differential activation analysis to disentangle and isolate malicious features; and (3) it maps these features to downstream causal pathways via feature influence scores (FIS) derived from zero-out interventions. By selectively suppressing these causal chains, TraceRouter physically severs the flow of harmful information while leaving orthogonal computation routes intact. Extensive experiments demonstrate that TraceRouter significantly outperforms state-of-the-art baselines, achieving a superior trade-off between adversarial robustness and general utility. Our code will be publicly released. WARNING: This paper contains unsafe model responses.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Steering and probing for LLM safety, one of 13 directions in Mechanistic interpretability. Builds on 44 of its 49 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

44 of 49 references.

References · 44

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2024The Llama 3 Herd of Modelscited by 14,715
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  6. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  7. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  8. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  9. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  10. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  11. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  12. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
32 more
  1. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  2. 2023Progress measures for grokking via mechanistic interpretabilitycited by 839
  3. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
  4. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  5. 2023Erasing Concepts from Diffusion Modelscited by 539
  6. 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 513
  7. 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deepcited by 472
  8. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  9. 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 398
  10. 2023Unified Concept Editing in Diffusion Modelscited by 388
  11. 2024Improving Alignment and Robustness with Circuit Breakerscited by 322
  12. 2023Ablating Concepts in Text-to-Image Diffusion Modelscited by 317
  13. 2023Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Modelscited by 301
  14. 2023MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Modelscited by 274
  15. 2023Ring-A-Bell! How Reliable are Concept Removal Methods for Diffusion Models?cited by 250
  16. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
  17. 2024Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluationcited by 191
  18. 2023Prompting4Debugging: Red-Teaming Text-to-Image Diffusion Models by Finding Problematic Promptscited by 171
  19. 2023One-Dimensional Adapter to Rule Them All: Concepts, Diffusion Models and Erasing Applicationscited by 169
  20. 2024Reliable and Efficient Concept Erasure of Text-to-Image Diffusion Modelscited by 133
  21. 2024Eyes Closed, Safety On: Protecting Multimodal LLMs via Image-to-Text Transformationcited by 124
  22. 2023Circumventing Concept Erasure Methods For Text-to-Image Generative Modelscited by 85
  23. 2024Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Trainingcited by 69
  24. 2023AltDiffusion: A Multilingual Text-to-Image Diffusion Modelcited by 30
  25. 2026Mass Concept Erasure in Diffusion Models with Concept Hierarchycited by 14
  26. 2025Side Effects of Erasing Concepts from Diffusion Modelscited by 13
  27. 2025DuMo: Dual Encoder Modulation Network for Precise Concept Erasurecited by 11
  28. 2025SafePTR: Token-Level Jailbreak Defense in Multimodal LLMs via Prune-then-Restore Mechanismcited by 10
  29. 2025A Single Neuron Works: Precise Concept Erasure in Text-to-Image Diffusion Modelscited by 8
  30. 2025Discovering Influential Neuron Path in Vision Transformerscited by 7
  31. 2025HumorReject: Decoupling LLM Safety from Refusal Prefix via A Little Humorcited by 6
  32. 2025SGM: Safety Glasses for Multimodal Large Language Models via Neuron-Level Detoxificationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 11.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026TRACER: Trace-Regularized Training Against Indirect Prompt Injection
  2. 2026Harmfulness Propagation Dynamics: Layer-wise Trajectories of Adversarial Intent in Large Language Models
  3. 2025SoK: a Comprehensive Causality Analysis Framework for Large Language Model Security
  4. 2026PermaFrost-Attack: Stealth Pretraining Seeding(SPS) for planting Logic Landmines During LLM Training
  5. 2026Making MLLMs Blind: Adversarial Smuggling Attacks in MLLM Content Moderation
  6. 2026TRACE: Trajectory Aware Reasoning for Multi-Turn Adversarial Conversation Evaluation
  7. 2024Steering Away from Harm: An Adaptive Approach to Defending Vision Language Model Against Jailbreaks
  8. 2026Mechanistic Interpretability of LLM Jailbreaks via Internal Attribution Graphs