mlsanityData to 7 Oct 2026

CLEAR: Unlocking Generative Potential for Degraded Image Understanding in Unified Multimodal Models

arXiv 2604.04780 ↗First posted 6 Apr 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Image degradation from blur, noise, compression, and poor illumination severely undermines multimodal understanding in real-world settings. Unified multimodal models that combine understanding and generation within a single architecture are a natural fit for this challenge, as their generative pathway can model the fine-grained visual structure that degradation destroys. Yet these models fail to leverage their own generative capacity on degraded inputs. We trace this disconnect to two compounding factors: existing training regimes never ask the model to invoke generation during reasoning, and the standard decode-reencode pathway does not support effective joint optimization. We present CLEAR, a framework that connects the two capabilities through three progressive steps: (1) supervised fine-tuning on a degradation-aware dataset to establish the generate-then-answer reasoning pattern; (2) a Latent Representation Bridge that replaces the decode-reencode detour with a direct, optimizable connection between generation and reasoning; (3) Interleaved GRPO, a reinforcement learning method that jointly optimizes text reasoning and visual generation under answer-correctness rewards. We construct MMD-Bench, covering three degradation severity levels across six standard multimodal benchmarks. Experiments show that CLEAR substantially improves robustness on degraded inputs while preserving clean-image performance. Our analysis further reveals that removing pixel-level reconstruction supervision leads to intermediate visual states with higher perceptual quality, suggesting that task-driven optimization and visual quality are naturally aligned.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 43 of its 49 references that are in the map. First posted on arXiv 6 Apr 2026.

Builds on

43 of 49 references.

References · 43

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  5. 2023Visual Instruction Tuningcited by 7,792
  6. 2022Flow Matching for Generative Modelingcited by 5,426
  7. 2024GPT-4o System Cardcited by 4,467
  8. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  9. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  10. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  11. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  12. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
31 more
  1. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  2. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  3. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
  4. 2024Qwen2 Technical Reportcited by 2,076
  5. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  6. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  7. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
  8. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  9. 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,221
  10. 2023Training Diffusion Models with Reinforcement Learningcited by 939
  11. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  12. 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 897
  13. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
  14. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  15. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
  16. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
  17. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  18. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  19. 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
  20. 2022Simple Baselines for Image Restorationcited by 701
  21. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
  22. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 515
  23. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
  24. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
  25. 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 301
  26. 2015Deep multi-scale video prediction beyond mean square errorcited by 297
  27. 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
  28. 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
  29. 2021On Interaction Between Augmentations and Corruptions in Natural Corruption Robustnesscited by 98
  30. 2024R-Bench: Are your Large Multimodal Model Robust to Real-world Corruptions?cited by 29
  31. 2025COOPER: A Unified Model for Cooperative Perception and Reasoning in Spatial Intelligencecited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reversing the Flow: Generation-to-Understanding Synergy in Large Multimodal Models
  2. 2026Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewards
  3. 2026Can Unified Generation and Understanding Models Maintain Semantic Equivalence Across Different Output Modalities?
  4. 2026UniG2U-Bench: Do Unified Models Advance Multimodal Understanding?
  5. 2026Omni-R1: Towards the Unified Generative Paradigm for Multimodal Reasoning
  6. 2025Mitigating Visual Context Degradation in Large Multimodal Models: A Training-Free Decoupled Agentic Framework
  7. 2026Reinforcing Multimodal Reasoning Against Visual Degradation
  8. 2025Query-Kontext: An Unified Multimodal Model for Image Generation and Editing