mlsanityData to 7 Oct 2026

When Routing Reveals Membership: Privacy Leakage from MoE Router Telemetry

arXiv 2610.10616 ↗First posted 7 Oct 2026cs.LG cs.CRcited by 0

On the map: Mixture-of-experts → Expert routing strategies

also in 1 more
Abstract (arXiv)

Mixture-of-Experts (MoE) language models produce routing information during inference that may be logged or exposed for monitoring, debugging, load analysis, and safety auditing. Unlike ordinary model outputs, this telemetry reveals a view of the model's internal computation, raising a privacy question: can it reveal whether an example was used to fine-tune the deployed model? We introduce a router-augmented membership inference attack that combines conventional output-side signals with aggregated routing features and applies a membership classifier learned from independently fine-tuned shadow models to the target model. Across three MoE architectures and three data domains, router telemetry consistently improves membership inference over a strong output-signal ensemble, increasing TPR at 1% FPR by 2.7--9.4 percentage points across all nine settings. The leakage persists across full fine-tuning, frozen-router training, LoRA, and instruction tuning, and remains observable with only discrete expert selections, restricted telemetry, or a single shadow model. Mechanistic analysis further shows that the leakage does not require router-specific memorization: fine-tuning introduces membership information into hidden representations, while the router exposes a projection of this signal even when its parameters are frozen. Perturbing the telemetry reduces this additional leakage only as its fidelity degrades. Our results show that router telemetry can turn an operational signal into an additional privacy surface for fine-tuned MoE models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Expert routing strategies, one of 12 directions in Mixture-of-experts. Builds on 11 of its 35 references that are in the map. First posted on arXiv 7 Oct 2026.

Builds on

11 of 35 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026RouteScan: A Non-Intrusive Approach to Auditing MoE LLMs Safety via Expert Routing Telemetry24 May
  2. 2026Task-Conditioned Routing Signatures in Sparse Mixture-of-Experts Transformers11 Mar
  3. 2026Expert Selections In MoE Models Reveal (Almost) As Much As Text4 Feb
  4. 2024Stealing User Prompts from Mixture of Experts30 Oct

Other references · 7

  1. 2024Mixtral of Expertscited by 1,785
  2. 2024Do Membership Inference Attacks Work on Large Language Models?cited by 188
  3. 2024LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Trainingcited by 25
  4. 2024Adaptive Pre-training Data Detection for Large Language Models via Surprising Tokenscited by 10
  5. 2026Window-based Membership Inference Attacks Against Fine-tuned Large Language Modelscited by 5
  6. 2026AttenMIA: LLM Membership Inference Attack through Attention Signalscited by 4
  7. 2026Learning the Signature of Memorization in Autoregressive Language Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Safety-Oriented Routing Analysis of Mixtral MoE Under Benign and Harmful Prompts
  2. 2025RepetitionCurse: Measuring and Understanding Router Imbalance in Mixture-of-Experts LLMs under DoS Stress
  3. 2025Coupling Experts and Routers in Mixture-of-Experts via an Auxiliary Loss
  4. 2026Router Prior Bias: Preserving Base Routing Structure in MoE Post-Training
  5. 2026Router Sensitivity Under Lightweight Fine-Tuning Identifies Prunable Experts in Mixture-of-Experts Models
  6. 2026Misrouter: Exploiting Routing Mechanisms for Input-Only Attacks on Mixture-of-Experts LLMs
  7. 2026A Persistent State for Auditable Mixture-of-Experts Routing
  8. 2026RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMs