mlsanityData to 14 Oct 2026

Defending Unauthorized Model Merging via Dual-Stage Weight Protection

arXiv 2511.11851 ↗First posted 14 Nov 2025cs.CV cs.CRcited by 2

Not on the map. Why?

Abstract (arXiv)

The rapid proliferation of pretrained models and open repositories has made model merging a convenient yet risky practice, allowing free-riders to combine fine-tuned models into a new multi-capability model without authorization. Such unauthorized model merging not only violates intellectual property rights but also undermines model ownership and accountability. To address this issue, we present MergeGuard, a proactive dual-stage weight protection framework that disrupts merging compatibility while maintaining task fidelity. In the first stage, we redistribute task-relevant information across layers via L2-regularized optimization, ensuring that important gradients are evenly dispersed. In the second stage, we inject structured perturbations to misalign task subspaces, breaking curvature compatibility in the loss landscape. Together, these stages reshape the model's parameter geometry such that merged models collapse into destructive interference while the protected model remains fully functional. Extensive experiments on both vision (ViT-L-14) and language (Llama2, Gemma2, Mistral) models demonstrate that MergeGuard reduces merged model accuracy by up to 90% with less than 1.5% performance loss on the protected model.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 39 of its 50 references that are in the map. First posted on arXiv 14 Nov 2025.

Builds on

39 of 50 references.

References · 39

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  7. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  8. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  9. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
  10. 2013Describing Textures in the Wildcited by 2,125
  11. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  12. 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
27 more
  1. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
  2. 2017Visualizing the Loss Landscape of Neural Netscited by 1,130
  3. 2022Editing Models with Task Arithmeticcited by 1,120
  4. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
  5. 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
  6. 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 694
  7. 2023Zephyr: Direct Distillation of LM Alignmentcited by 506
  8. 2024Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunitiescited by 254
  9. 2023AdaMerging: Adaptive Model Merging for Multi-Task Learningcited by 252
  10. 2024Model merging with SVD to tie the Knotscited by 122
  11. 2024Twin-Merging: Dynamic Integration of Modular Expertise in Model Mergingcited by 116
  12. 2024Representation Surgery for Multi-Task Model Mergingcited by 96
  13. 2024DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Samplingcited by 81
  14. 2024Parameter Competition Balancing for Model Mergingcited by 72
  15. 2023A Survey of Large Language Models Attributioncited by 71
  16. 2021Non-Transferable Learning: A New Approach for Model Ownership Verification and Applicability Authorizationcited by 52
  17. 2025Modeling Multi-Task Model Merging as Adaptive Projective Gradient Descentcited by 39
  18. 2023Merging by Matching Models in Task Parameter Subspacescited by 36
  19. 2024Revisiting Weight Averaging for Model Mergingcited by 25
  20. 2024Have You Merged My Model? On The Robustness of Large Language Model IP Protection Methods Against Model Mergingcited by 19
  21. 2025Unveiling the Basin-Like Loss Landscape in Large Language Modelscited by 13
  22. 2025Disrupting Model Merging: A Parameter-Level Defense Without Sacrificing Accuracycited by 11
  23. 2025CABS: Conflict-Aware and Balanced Sparsification for Enhancing Model Mergingcited by 8
  24. 2024MergePrint: Merge-Resistant Fingerprints for Robust Black-box Ownership Verification of Large Language Modelscited by 7
  25. 2025On Task Vectors and Gradientscited by 7
  26. 2025ImPart: Importance-Aware Delta-Sparsification for Improved Model Compression and Merging in LLMscited by 5
  27. 2025Do Not Merge My Model! Safeguarding Open-Source LLMs Against Unauthorized Model Mergingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.