mlsanityData to 7 Oct 2026

Robust-U1: Can MLLMs Self-Recover Corrupted Visual Content for Robust Understanding?

arXiv 2606.08063 ↗First posted 6 Jun 2026cs.CV cs.AI cs.CLcited by 1

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning

Abstract (arXiv)

Multimodal Large Language Models (MLLMs) have demonstrated remarkable success in visual understanding, yet their performance degrades significantly under real-world visual corruptions. While existing robustness enhancement approaches exist, they are limited: black-box feature alignment lacks interpretability, and white-box text-based reasoning cannot restore lost pixel-level details. This work investigates a fundamental research question: Can MLLMs recover corrupted visual content by themselves? To address this, we propose Robust-U1, a novel framework that equips MLLMs with explicit visual self-recovery capability for robust understanding. The approach comprises three core stages: supervised fine-tuning for initial reconstruction, reinforcement learning with dual rewards (pixel-level SSIM and semantic-level CLIP similarity) for aligning high visual quality, and multimodal reasoning that jointly considers both the corrupted input and the recovered image. Extensive experiments demonstrate that Robust-U1 achieves state-of-the-art robustness on the real-world corruption benchmark and maintains superior performance under adversarial corruptions on general VQA benchmarks. Analysis confirms that high-quality visual recovery directly enhances reasoning performance, establishing self-recovery as a critical mechanism for robust visual understanding. The source code is available at https://github.com/jqtangust/Robust-U1.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 35 of its 42 references that are in the map. First posted on arXiv 6 Jun 2026.

Builds on

35 of 42 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Robust-R1: Degradation-Aware Reasoning for Robust Visual Understanding19 Dec
  2. 2025Thinking with Generated Images28 May
  3. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?29 Mar

Other references · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2025Qwen2.5-VL Technical Reportcited by 5,418
  6. 2024GPT-4o System Cardcited by 4,467
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  8. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  9. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  10. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  11. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
  12. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
20 more
  1. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  2. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
  3. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
  4. 2022Understanding Zero-Shot Adversarial Robustness for Large-Scale Modelscited by 117
  5. 2023TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritancecited by 90
  6. 2024MambaIRv2: Attentive State Space Restorationcited by 90
  7. 2024Hawk: Learning to Understand Open-World Video Anomaliescited by 47
  8. 2025Degradation-Aware Feature Perturbation for All-in-One Image Restorationcited by 39
  9. 2024Parrot: Multilingual Visual Instruction Tuningcited by 30
  10. 2024R-Bench: Are your Large Multimodal Model Robust to Real-world Corruptions?cited by 29
  11. 2024Efficient Visual State Space Model for Image Deblurringcited by 27
  12. 2023An Incremental Unified Framework for Small Defect Inspectioncited by 25
  13. 2025LongVideoAgent: Multi-Agent Reasoning with Long Videoscited by 23
  14. 2025LPO: Towards Accurate GUI Agent Interaction via Location Preference Optimizationcited by 16
  15. 2025Robust-LLaVA: On the Effectiveness of Large-Scale Robust Image Encoders for Multi-modal Large Language Modelscited by 9
  16. 2026Bilevel Layer-Positioning LoRA for Real Image Dehazingcited by 5
  17. 2025Robust SAM: On the Adversarial Robustness of Vision Foundation Modelscited by 4
  18. 2024Learning to Remove Wrinkled Transparent Film with Polarized Priorcited by 3
  19. 2025When MLLMs Meet Compression Distortion: A Coding Paradigm Tailored to MLLMscited by 3
  20. 2026A Semantic Decoupling-Based Two-Stage Rainy-Day Attack for Revealing Weather Robustness Deficiencies in Vision-Language Modelscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Investigating Adversarial Robustness of Multi-modal Large Language Models
  2. 2026BRUCE: Benchmarking Robustness Under Corruption Escalation for Scientific Vision-Language Reasoning
  3. 2026Predictive Regularization Against Visual Representation Degradation in Multimodal Large Language Models
  4. 2025Analysing the Robustness of Vision-Language-Models to Common Corruptions
  5. 2026Reinforcing Multimodal Reasoning Against Visual Degradation
  6. 2025MVI-Bench: A Comprehensive Benchmark for Evaluating Robustness to Misleading Visual Inputs in LVLMs
  7. 2025Evaluating Robustness of Vision-Language Models Under Noisy Conditions
  8. 2026Are Reasoning Vision-Language Models Robust to Semantic Visual Distractions?