mlsanityData to 14 Oct 2026

RouteMark: A Fingerprint for Intellectual Property Attribution in Routing-based Model Merging

arXiv 2508.01784 ↗First posted 3 Aug 2025cs.CR cs.AI cs.ETcited by 4

On the map: Mixture-of-experts → Expert routing strategies

Abstract (arXiv)

Model merging via Mixture-of-Experts (MoE) has emerged as a scalable solution for consolidating multiple task-specific models into a unified sparse architecture, where each expert is derived from a model fine-tuned on a distinct task. While effective for multi-task integration, this paradigm introduces a critical yet underexplored challenge: how to attribute and protect the intellectual property (IP) of individual experts after merging. We propose RouteMark, a framework for IP protection in merged MoE models through the design of expert routing fingerprints. Our key insight is that task-specific experts exhibit stable and distinctive routing behaviors under probing inputs. To capture these patterns, we construct expert-level fingerprints using two complementary statistics: the Routing Score Fingerprint (RSF), quantifying the intensity of expert activation, and the Routing Preference Fingerprint (RPF), characterizing the input distribution that preferentially activates each expert. These fingerprints are reproducible, task-discriminative, and lightweight to construct. For attribution and tampering detection, we introduce a similarity-based matching algorithm that compares expert fingerprints between a suspect and a reference (victim) model. Extensive experiments across diverse tasks and CLIP-based MoE architectures show that RouteMark consistently yields high similarity for reused experts and clear separation from unrelated ones. Moreover, it remains robust against both structural tampering (expert replacement, addition, deletion) and parametric tampering (fine-tuning, pruning, permutation), outperforming weight- and activation-based baseliness. Our work lays the foundation for RouteMark as a practical and broadly applicable framework for IP verification in MoE-based model merging.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Expert routing strategies, one of 12 directions in Mixture-of-experts. Builds on 21 of its 36 references that are in the map. First posted on arXiv 3 Aug 2025.

Builds on

21 of 36 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy2 Oct
  2. 2023Soft Merging of Experts with Adaptive Routing6 Jun

Other references · 19

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  5. 2013Describing Textures in the Wildcited by 2,125
  6. 2019Similarity of Neural Network Representations Revisitedcited by 1,755
  7. 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
  8. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
  9. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
  10. 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
  11. 2022DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scalecited by 404
  12. 2024OpenMoE: An Early Effort on Open Mixture-of-Experts Language Modelscited by 187
7 more
  1. 2023ZipIt! Merging Models from Different Tasks without Trainingcited by 179
  2. 2024Twin-Merging: Dynamic Integration of Modular Expertise in Model Mergingcited by 116
  3. 2024Merging Multi-Task Models via Weight-Ensembling Mixture of Expertscited by 85
  4. 2024A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learningcited by 52
  5. 2024Self-MoE: Towards Compositional Large Language Models with Self-Specialized Expertscited by 23
  6. 2024Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Mergingcited by 23
  7. 2024Have You Merged My Model? On The Robustness of Large Language Model IP Protection Methods Against Model Mergingcited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026PathMark: Protecting Intellectual Property of Mixture-of-Expert LLMs via Path Watermarks
  2. 2026A Persistent State for Auditable Mixture-of-Experts Routing
  3. 2026RASA: Routing-Aware Safety Alignment for Mixture-of-Experts Models
  4. 2026RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMs
  5. 2026Share First, Route What Remains: A Unified Framework for Token-Adaptive MoE Computation
  6. 2024Buffer Overflow in Mixture of Experts
  7. 2026When Routing Reveals Membership: Privacy Leakage from MoE Router Telemetry
  8. 2026Safety-Oriented Routing Analysis of Mixtral MoE Under Benign and Harmful Prompts