Robust-U1: Can MLLMs Self-Recover Corrupted Visual Content for Robust Understanding?
On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) have demonstrated remarkable success in visual understanding, yet their performance degrades significantly under real-world visual corruptions. While existing robustness enhancement approaches exist, they are limited: black-box feature alignment lacks interpretability, and white-box text-based reasoning cannot restore lost pixel-level details. This work investigates a fundamental research question: Can MLLMs recover corrupted visual content by themselves? To address this, we propose Robust-U1, a novel framework that equips MLLMs with explicit visual self-recovery capability for robust understanding. The approach comprises three core stages: supervised fine-tuning for initial reconstruction, reinforcement learning with dual rewards (pixel-level SSIM and semantic-level CLIP similarity) for aligning high visual quality, and multimodal reasoning that jointly considers both the corrupted input and the recovered image. Extensive experiments demonstrate that Robust-U1 achieves state-of-the-art robustness on the real-world corruption benchmark and maintains superior performance under adversarial corruptions on general VQA benchmarks. Analysis confirms that high-quality visual recovery directly enhances reasoning performance, establishing self-recovery as a critical mechanism for robust visual understanding. The source code is available at https://github.com/jqtangust/Robust-U1.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 35 of its 42 references that are in the map. First posted on arXiv 6 Jun 2026.
Builds on
35 of 42 references.
Closest ancestors · 3
Same direction, newest first
- 2025Robust-R1: Degradation-Aware Reasoning for Robust Visual Understanding19 Dec
- 2025Thinking with Generated Images28 May
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?29 Mar
Other references · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
20 more
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
- 2022Understanding Zero-Shot Adversarial Robustness for Large-Scale Modelscited by 117
- 2023TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritancecited by 90
- 2024MambaIRv2: Attentive State Space Restorationcited by 90
- 2024Hawk: Learning to Understand Open-World Video Anomaliescited by 47
- 2025Degradation-Aware Feature Perturbation for All-in-One Image Restorationcited by 39
- 2024Parrot: Multilingual Visual Instruction Tuningcited by 30
- 2024R-Bench: Are your Large Multimodal Model Robust to Real-world Corruptions?cited by 29
- 2024Efficient Visual State Space Model for Image Deblurringcited by 27
- 2023An Incremental Unified Framework for Small Defect Inspectioncited by 25
- 2025LongVideoAgent: Multi-Agent Reasoning with Long Videoscited by 23
- 2025LPO: Towards Accurate GUI Agent Interaction via Location Preference Optimizationcited by 16
- 2025Robust-LLaVA: On the Effectiveness of Large-Scale Robust Image Encoders for Multi-modal Large Language Modelscited by 9
- 2026Bilevel Layer-Positioning LoRA for Real Image Dehazingcited by 5
- 2025Robust SAM: On the Adversarial Robustness of Vision Foundation Modelscited by 4
- 2024Learning to Remove Wrinkled Transparent Film with Polarized Priorcited by 3
- 2025When MLLMs Meet Compression Distortion: A Coding Paradigm Tailored to MLLMscited by 3
- 2026A Semantic Decoupling-Based Two-Stage Rainy-Day Attack for Revealing Weather Robustness Deficiencies in Vision-Language Modelscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Investigating Adversarial Robustness of Multi-modal Large Language Models
- 2026BRUCE: Benchmarking Robustness Under Corruption Escalation for Scientific Vision-Language Reasoning
- 2026Predictive Regularization Against Visual Representation Degradation in Multimodal Large Language Models
- 2025Analysing the Robustness of Vision-Language-Models to Common Corruptions
- 2026Reinforcing Multimodal Reasoning Against Visual Degradation
- 2025MVI-Bench: A Comprehensive Benchmark for Evaluating Robustness to Misleading Visual Inputs in LVLMs
- 2025Evaluating Robustness of Vision-Language Models Under Noisy Conditions
- 2026Are Reasoning Vision-Language Models Robust to Semantic Visual Distractions?