VQ-Jarvis: Retrieval-Augmented Video Restoration Agent with Sharp Vision and Fast Thought
On the map: Retrieval-augmented generation → Multimodal RAG
Abstract (arXiv)
Video restoration in real-world scenarios is challenged by heterogeneous degradations, where static architectures and fixed inference pipelines often fail to generalize. Recent agent-based approaches offer dynamic decision making, yet existing video restoration agents remain limited by insufficient quality perception and inefficient search strategies. We propose VQ-Jarvis, a retrieval-augmented, all-in-one intelligent video restoration agent with sharper vision and faster thought. VQ-Jarvis is designed to accurately perceive degradations and subtle differences among paired restoration results, while efficiently discovering optimal restoration trajectories. To enable sharp vision, we construct VSR-Compare, the first large-scale video paired enhancement dataset with 20K comparison pairs covering 7 degradation types, 11 enhancement operators, and diverse content domains. Based on this dataset, we train a multiple operator judge model and a degradation perception model to guide agent decisions. To achieve fast thought, we introduce a hierarchical operator scheduling strategy that adapts to video difficulty: for easy cases, optimal restoration trajectories are retrieved in a one-step manner from a retrieval-augmented generation (RAG) library; for harder cases, a step-by-step greedy search is performed to balance efficiency and accuracy. Extensive experiments demonstrate that VQ-Jarvis consistently outperforms existing methods on complex degraded videos.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 59 of its 69 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
59 of 69 references.
References · 59
- 2025Qwen3 Technical Reportcited by 8,195
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 492
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 340
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
- 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 303
- 2022VRT: A Video Restoration Transformercited by 219
38 more
- 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 211
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 168
- 2019Quality Assessment of In-the-Wild Videoscited by 164
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2017Detail-revealing Deep Video Super-resolutioncited by 147
- 2020Patch-VQ: 'Patching Up' the Video Quality Problemcited by 147
- 2020UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Contentcited by 140
- 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
- 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 131
- 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 128
- 2018Large-Scale Study of Perceptual Video Qualitycited by 127
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 93
- 2022Rethinking Alignment in Video Super-Resolution Transformerscited by 71
- 2024VEnhancer: Generative Space-Time Enhancement for Video Generationcited by 64
- 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restorationcited by 62
- 2023Motion-Guided Latent Diffusion for Temporally Consistent Real-world Video Super-resolutioncited by 59
- 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
- 2024RainMamba: Enhanced Locality Learning with State Space Models for Video Derainingcited by 56
- 2025STAR: Spatial-Temporal Augmentation with Text-to-Video Models for Real-World Video Super-Resolutioncited by 56
- 2020Learning Generalized Spatial-Temporal Deep Feature Representation for No-Reference Video Quality Assessmentcited by 50
- 2025SeedVR2: One-Step Video Restoration via Diffusion Adversarial Post-Trainingcited by 45
- 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Modelscited by 41
- 2024An Intelligent Agentic System for Complex Image Restoration Problemscited by 41
- 2025FlashVSR: Towards Real-Time Diffusion-Based Streaming Video Super-Resolutioncited by 40
- 2023Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Modelscited by 38
- 2025Toward Generalized Image Quality Assessment: Relaxing the Perfect Reference Quality Assumptioncited by 34
- 20254KAgent: Agentic Any Image to 4K Super-Resolutioncited by 34
- 2024CodeTree: Agent-guided Tree Search for Code Generation with Large Language Modelscited by 32
- 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 32
- 2025DOVE: Efficient One-Step Diffusion Model for Real-World Video Super-Resolutioncited by 30
- 2024FineVQ: Fine-Grained User Generated Content Video Quality Assessmentcited by 28
- 2025VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learningcited by 26
- 2024Modular Blind Video Quality Assessmentcited by 23
- 2022Benchmark Dataset and Effective Inter-Frame Alignment for Real-World Video Super-Resolutioncited by 20
- 2025Multi-Agent Image Restorationcited by 19
- 2025Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessmentcited by 18
- 2024Generalizable Implicit Motion Modeling for Video Frame Interpolationcited by 16
50 most cited of 59 All 59 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026TIR-Agent: Training an Explorative and Efficient Agent for Image Restoration
- 2026DiTTo: Scalable Order-aware All-in-One Image Restoration Agent
- 2025Restore-R1: Efficient Image Restoration Agents via Reinforcement Learning with Multimodal LLM Perceptual Feedback
- 2026PaAgent: Portrait-Aware Image Restoration Agent via Subjective-Objective Reinforcement Learning
- 2026EvoIR-Agent: Self-Evolving Image Restoration Agentic System via Experience-Driven Learning
- 2026Causal-AgentIR: Self-Evolving Causal Memory for Adaptive Image Restoration Agents
- 2026SkillIR: Evolving Scene-Aware Skills for Agentic Image Restoration
- 2025UniFlowRestore: A General Video Restoration Framework via Flow Matching and Prompt Guidance