VQQA: An Agentic Approach for Video Evaluation and Quality Improvement
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Despite rapid advancements in video generation models, aligning their outputs with complex user intent remains challenging. Existing test-time optimization methods are typically either computationally expensive or require white-box access to model internals. To address this, we present VQQA (Video Quality Question Answering), a unified, multi-agent framework generalizable across diverse input modalities and video generation tasks. By dynamically generating visual questions and using the resulting Vision-Language Model (VLM) critiques as semantic gradients, VQQA replaces traditional, passive evaluation metrics with human-interpretable, actionable feedback. This enables a highly efficient, closed-loop prompt optimization process via a black-box natural language interface. Extensive experiments demonstrate that VQQA effectively isolates and resolves visual artifacts, substantially improving generation quality in just a few refinement steps. Applicable to both text-to-video (T2V) and image-to-video (I2V) tasks, our method achieves absolute improvements of +11.57% on T2V-CompBench and +8.43% on VBench2 over vanilla generation, significantly outperforming state-of-the-art stochastic search and prompt optimization techniques.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 49 of its 77 references that are in the map. First posted on arXiv 12 Mar 2026.
Builds on
49 of 77 references.
Closest ancestors · 3
Same direction, newest first
- 2025MCCD: Multi-Agent Collaboration-based Compositional Diffusion for Complex Text-to-Image Generation5 May
- 2025Automated Movie Generation via Multi-Agent CoT Planning10 Mar
- 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editing8 Jul
Other references · 46
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2024GPT-4o System Cardcited by 4,467
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2016Improved Techniques for Training GANscited by 2,938
- 2020Learning to summarize from human feedbackcited by 2,562
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
34 more
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
- 2025OpenAI GPT-5 System Cardcited by 910
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
- 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 317
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2024TextGrad: Automatic "Differentiation" via Textcited by 250
- 2022Optimizing Prompts for Text-to-Image Generationcited by 204
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
- 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 119
- 2025One-Minute Video Generation with Test-Time Trainingcited by 100
- 2025Controllable Video Generation: A Surveycited by 93
- 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 66
- 2024Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videoscited by 54
- 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generationcited by 48
- 2025Feedback Descent: Open-Ended Text Optimization via Pairwise Comparisoncited by 42
- 2024Evaluation Agent: Efficient and Promptable Evaluation Framework for Visual Generative Modelscited by 41
- 2024Subjective-Aligned Dataset and Metric for Text-to-Video Quality Assessmentcited by 39
- 2025Video-T1: Test-Time Scaling for Video Generationcited by 39
- 2025Scaling Image and Video Generation via Test-Time Evolutionary Searchcited by 38
- 2025VideoScore2: Think before You Score in Generative Video Evaluationcited by 37
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
- 2025VPO: Aligning Text-to-Video Generation Models with Prompt Optimizationcited by 27
- 2025VISTA: A Test-Time Self-Improving Video Generation Agentcited by 26
- 2024VideoAgent: Self-Improving Video Generationcited by 24
- 2024Prompt-A-Video: Prompt Your Video Diffusion Model via Preference-Aligned LLMcited by 22
- 2024Self-Correcting Text-to-Video Generation with Misalignment Detection and Localized Refinementcited by 13
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026A2RD: Agentic Autoregressive Diffusion for Long Video Consistencycited by 6
- 2026VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generationcited by 5
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worldscited by 3
- 2026Open Evaluation Agent: Efficient and Promptable Evaluation of Visual Generative Modelscited by 2
- 2026Test-Time Scaling for Video Diffusion Models via Diagnosis-Guided Candidate Recyclingcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
- 2026AgenticGen: Reward-Guided Agentic Video Generation for Advertisingcited by 0
- 2026SkillPE: Creativity-Oriented Cinematic Skill Evolution for Text-to-Video Prompt Engineeringcited by 0
- 2026SkillPE: Creativity-Oriented Cinematic Skill Evolution for Text-to-Video Prompt Engineering28 Sep 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026AgenticGen: Reward-Guided Agentic Video Generation for Advertising31 Aug 2026
- 2026Test-Time Scaling for Video Diffusion Models via Diagnosis-Guided Candidate Recycling29 Aug 2026
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worlds17 Aug 2026
- 2026Open Evaluation Agent: Efficient and Promptable Evaluation of Visual Generative Models10 Aug 2026
- 2026VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generation6 Jun 2026
- 2026A2RD: Agentic Autoregressive Diffusion for Long Video Consistency7 May 2026
Similar, not cited
Close in wording, no citation either way
- 2024VQA2: Visual Question Answering for Video Quality Assessment
- 2025VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learning
- 2026VTAgent: Agentic Keyframe Anchoring for Evidence-Aware Video TextVQA
- 2025VideoMultiAgents: A Multi-Agent Framework for Video Question Answering
- 2025VideoGen-Eval: Agent-based System for Video Generation Evaluation
- 2026Beyond Trial-and-Error: Agentic Optimization for Image-to-Video Adherence
- 2025Multilevel Semantic-Aware Model for AI-Generated Video Quality Assessment
- 2025ViQAgent: Zero-Shot Video Question Answering via Agent with Open-Vocabulary Grounding Validation