mlsanityData to 14 Oct 2026

ModalImmune: Immunity Driven Unlearning via Self Destructive Training

arXiv 2602.16197 ↗First posted 18 Feb 2026cs.LG cs.CL cs.MMcited by 1

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

Multimodal systems are vulnerable to partial or complete loss of input channels at deployment, which undermines reliability in real-world settings. This paper presents ModalImmune, a training framework that enforces modality immunity by intentionally and controllably collapsing selected modality information during training so the model learns joint representations that are robust to destructive modality influence. The framework combines a spectrum-adaptive collapse regularizer, an information-gain guided controller for targeted interventions, curvature-aware gradient masking to stabilize destructive updates, and a certified Neumann-truncated hyper-gradient procedure for automatic meta-parameter adaptation. Empirical evaluation on standard multimodal benchmarks demonstrates that ModalImmune improves resilience to modality removal and corruption while retaining convergence stability and reconstruction capacity.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 29 of its 56 references that are in the map. First posted on arXiv 18 Feb 2026.

Builds on

29 of 56 references.

References · 29

  1. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  2. 2018Memory Fusion Network for Multi-view Sequential Learningcited by 168
  3. 2020On Information Gain and Regret Bounds in Gaussian Process Banditscited by 158
  4. 2024Deep Multimodal Learning with Missing Modality: A Surveycited by 92
  5. 2022GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversationcited by 87
  6. 2022M3Care: Learning with Missing Modalities in Multimodal Healthcare Datacited by 72
  7. 2022UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognitioncited by 61
  8. 2024Multimodal Fusion on Low-quality Data: A Comprehensive Surveycited by 49
  9. 2022Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representationscited by 48
  10. 2021Hybrid Contrastive Learning of Tri-Modal Representation for Multimodal Sentiment Analysiscited by 41
  11. 2023Unified Multi-Modal Image Synthesis for Missing Modality Imputationcited by 40
  12. 2024Gradient Routing: Masking Gradients to Localize Computation in Neural Networkscited by 34
17 more
  1. 2021BiAdam: Fast Adaptive Bilevel Optimization Methodscited by 33
  2. 2024Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalitiescited by 32
  3. 2024MaxInfoRL: Boosting exploration in reinforcement learning through information gain maximizationcited by 30
  4. 2023Robust Multimodal Learning with Missing Modalities via Parameter-Efficient Adaptationcited by 29
  5. 2025A Closer Look at Multimodal Representation Collapsecited by 28
  6. 2024Towards Robust Multimodal Sentiment Analysis with Incomplete Datacited by 27
  7. 2024DLF: Disentangled-Language-Focused Multimodal Sentiment Analysiscited by 27
  8. 2024Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognitioncited by 26
  9. 2025SimMLM: A Simple Framework for Multi-modal Learning with Missing Modalitycited by 23
  10. 2025Benchmarking Multi-modal Semantic Segmentation under Sensor Failures: Missing and Noisy Modality Robustnesscited by 18
  11. 2024Toward Robust Incomplete Multimodal Sentiment Analysis via Hierarchical Representation Learningcited by 16
  12. 2023Enhancing Multimodal Entity and Relation Extraction with Variational Information Bottleneckcited by 9
  13. 2024Causal Bandits with General Causal Models and Interventionscited by 7
  14. 2023Learning Robust Self-attention Features for Speech Emotion Recognition with Label-adaptive Mixupcited by 5
  15. 2024HyDiscGAN: A Hybrid Distributed cGAN for Audio-Visual Privacy Preservation in Multimodal Sentiment Analysiscited by 4
  16. 2022Improving Speech Emotion Recognition with Unsupervised Speaking Style Transfercited by 3
  17. 2025RoHyDR: Robust Hybrid Diffusion Recovery for Incomplete Multimodal Emotion Recognitioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026Dual Distribution Estimation for Zero-shot Noisy Test-Time Adaptation with VLMscited by 2

Similar, not cited

Close in wording, no citation either way

  1. 2026Do More Modalities Always Help? A Geometric Perspective on Missing-Modality Robustness
  2. 2026MAPLE: Modality-Aware Post-training and Learning Ecosystem
  3. 2026DeLo: Dual Decomposed Low-Rank Experts Collaboration for Continual Missing Modality Learning
  4. 2025Rebalanced Multimodal Learning with Data-aware Unimodal Sampling
  5. 2025Preserving Cross-Modal Stability for Visual Unlearning in Multimodal Scenarios
  6. 2026Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks
  7. 2025Mitigating Intra- and Inter-modal Forgetting in Continual Learning of Unified Multimodal Models
  8. 2026Mitigating Strong-Modality Collapse in Multimodal Learning via Inverted Asymmetric Fusion