mlsanityData to 7 Oct 2026

VQ-Jarvis: Retrieval-Augmented Video Restoration Agent with Sharp Vision and Fast Thought

arXiv 2603.22998 ↗First posted 24 Mar 2026cs.CVcited by 0

On the map: Retrieval-augmented generation → Multimodal RAG

Abstract (arXiv)

Video restoration in real-world scenarios is challenged by heterogeneous degradations, where static architectures and fixed inference pipelines often fail to generalize. Recent agent-based approaches offer dynamic decision making, yet existing video restoration agents remain limited by insufficient quality perception and inefficient search strategies. We propose VQ-Jarvis, a retrieval-augmented, all-in-one intelligent video restoration agent with sharper vision and faster thought. VQ-Jarvis is designed to accurately perceive degradations and subtle differences among paired restoration results, while efficiently discovering optimal restoration trajectories. To enable sharp vision, we construct VSR-Compare, the first large-scale video paired enhancement dataset with 20K comparison pairs covering 7 degradation types, 11 enhancement operators, and diverse content domains. Based on this dataset, we train a multiple operator judge model and a degradation perception model to guide agent decisions. To achieve fast thought, we introduce a hierarchical operator scheduling strategy that adapts to video difficulty: for easy cases, optimal restoration trajectories are retrieved in a one-step manner from a retrieval-augmented generation (RAG) library; for harder cases, a step-by-step greedy search is performed to balance efficiency and accuracy. Extensive experiments demonstrate that VQ-Jarvis consistently outperforms existing methods on complex degraded videos.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 59 of its 69 references that are in the map. First posted on arXiv 24 Mar 2026.

Builds on

59 of 69 references.

References · 59

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  3. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  4. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  5. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
  6. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  7. 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 492
  8. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
  9. 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 340
  10. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
  11. 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 303
  12. 2022VRT: A Video Restoration Transformercited by 219
38 more
  1. 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 211
  2. 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
  3. 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 168
  4. 2019Quality Assessment of In-the-Wild Videoscited by 164
  5. 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
  6. 2017Detail-revealing Deep Video Super-resolutioncited by 147
  7. 2020Patch-VQ: 'Patching Up' the Video Quality Problemcited by 147
  8. 2020UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Contentcited by 140
  9. 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
  10. 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 131
  11. 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 128
  12. 2018Large-Scale Study of Perceptual Video Qualitycited by 127
  13. 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 93
  14. 2022Rethinking Alignment in Video Super-Resolution Transformerscited by 71
  15. 2024VEnhancer: Generative Space-Time Enhancement for Video Generationcited by 64
  16. 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restorationcited by 62
  17. 2023Motion-Guided Latent Diffusion for Temporally Consistent Real-world Video Super-resolutioncited by 59
  18. 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
  19. 2024RainMamba: Enhanced Locality Learning with State Space Models for Video Derainingcited by 56
  20. 2025STAR: Spatial-Temporal Augmentation with Text-to-Video Models for Real-World Video Super-Resolutioncited by 56
  21. 2020Learning Generalized Spatial-Temporal Deep Feature Representation for No-Reference Video Quality Assessmentcited by 50
  22. 2025SeedVR2: One-Step Video Restoration via Diffusion Adversarial Post-Trainingcited by 45
  23. 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Modelscited by 41
  24. 2024An Intelligent Agentic System for Complex Image Restoration Problemscited by 41
  25. 2025FlashVSR: Towards Real-Time Diffusion-Based Streaming Video Super-Resolutioncited by 40
  26. 2023Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Modelscited by 38
  27. 2025Toward Generalized Image Quality Assessment: Relaxing the Perfect Reference Quality Assumptioncited by 34
  28. 20254KAgent: Agentic Any Image to 4K Super-Resolutioncited by 34
  29. 2024CodeTree: Agent-guided Tree Search for Code Generation with Large Language Modelscited by 32
  30. 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 32
  31. 2025DOVE: Efficient One-Step Diffusion Model for Real-World Video Super-Resolutioncited by 30
  32. 2024FineVQ: Fine-Grained User Generated Content Video Quality Assessmentcited by 28
  33. 2025VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learningcited by 26
  34. 2024Modular Blind Video Quality Assessmentcited by 23
  35. 2022Benchmark Dataset and Effective Inter-Frame Alignment for Real-World Video Super-Resolutioncited by 20
  36. 2025Multi-Agent Image Restorationcited by 19
  37. 2025Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessmentcited by 18
  38. 2024Generalizable Implicit Motion Modeling for Video Frame Interpolationcited by 16

50 most cited of 59 All 59 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026TIR-Agent: Training an Explorative and Efficient Agent for Image Restoration
  2. 2026DiTTo: Scalable Order-aware All-in-One Image Restoration Agent
  3. 2025Restore-R1: Efficient Image Restoration Agents via Reinforcement Learning with Multimodal LLM Perceptual Feedback
  4. 2026PaAgent: Portrait-Aware Image Restoration Agent via Subjective-Objective Reinforcement Learning
  5. 2026EvoIR-Agent: Self-Evolving Image Restoration Agentic System via Experience-Driven Learning
  6. 2026Causal-AgentIR: Self-Evolving Causal Memory for Adaptive Image Restoration Agents
  7. 2026SkillIR: Evolving Scene-Aware Skills for Agentic Image Restoration
  8. 2025UniFlowRestore: A General Video Restoration Framework via Flow Matching and Prompt Guidance