mlsanityData to 7 Oct 2026

VQQA: An Agentic Approach for Video Evaluation and Quality Improvement

arXiv 2603.12310 ↗First posted 12 Mar 2026cs.CV cs.AI cs.LGcited by 8

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Despite rapid advancements in video generation models, aligning their outputs with complex user intent remains challenging. Existing test-time optimization methods are typically either computationally expensive or require white-box access to model internals. To address this, we present VQQA (Video Quality Question Answering), a unified, multi-agent framework generalizable across diverse input modalities and video generation tasks. By dynamically generating visual questions and using the resulting Vision-Language Model (VLM) critiques as semantic gradients, VQQA replaces traditional, passive evaluation metrics with human-interpretable, actionable feedback. This enables a highly efficient, closed-loop prompt optimization process via a black-box natural language interface. Extensive experiments demonstrate that VQQA effectively isolates and resolves visual artifacts, substantially improving generation quality in just a few refinement steps. Applicable to both text-to-video (T2V) and image-to-video (I2V) tasks, our method achieves absolute improvements of +11.57% on T2V-CompBench and +8.43% on VBench2 over vanilla generation, significantly outperforming state-of-the-art stochastic search and prompt optimization techniques.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 49 of its 77 references that are in the map. First posted on arXiv 12 Mar 2026.

Builds on

49 of 77 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025MCCD: Multi-Agent Collaboration-based Compositional Diffusion for Complex Text-to-Image Generation5 May
  2. 2025Automated Movie Generation via Multi-Agent CoT Planning10 Mar
  3. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editing8 Jul

Other references · 46

  1. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  2. 2022Scalable Diffusion Models with Transformerscited by 5,931
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  7. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  8. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  9. 2016Improved Techniques for Training GANscited by 2,938
  10. 2020Learning to summarize from human feedbackcited by 2,562
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  12. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
34 more
  1. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  3. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  4. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
  5. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  6. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  7. 2025OpenAI GPT-5 System Cardcited by 910
  8. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  9. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
  10. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
  11. 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 317
  12. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
  13. 2024TextGrad: Automatic "Differentiation" via Textcited by 250
  14. 2022Optimizing Prompts for Text-to-Image Generationcited by 204
  15. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
  16. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
  17. 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 119
  18. 2025One-Minute Video Generation with Test-Time Trainingcited by 100
  19. 2025Controllable Video Generation: A Surveycited by 93
  20. 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 66
  21. 2024Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videoscited by 54
  22. 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generationcited by 48
  23. 2025Feedback Descent: Open-Ended Text Optimization via Pairwise Comparisoncited by 42
  24. 2024Evaluation Agent: Efficient and Promptable Evaluation Framework for Visual Generative Modelscited by 41
  25. 2024Subjective-Aligned Dataset and Metric for Text-to-Video Quality Assessmentcited by 39
  26. 2025Video-T1: Test-Time Scaling for Video Generationcited by 39
  27. 2025Scaling Image and Video Generation via Test-Time Evolutionary Searchcited by 38
  28. 2025VideoScore2: Think before You Score in Generative Video Evaluationcited by 37
  29. 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
  30. 2025VPO: Aligning Text-to-Video Generation Models with Prompt Optimizationcited by 27
  31. 2025VISTA: A Test-Time Self-Improving Video Generation Agentcited by 26
  32. 2024VideoAgent: Self-Improving Video Generationcited by 24
  33. 2024Prompt-A-Video: Prompt Your Video Diffusion Model via Preference-Aligned LLMcited by 22
  34. 2024Self-Correcting Text-to-Video Generation with Misalignment Detection and Localized Refinementcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024VQA2: Visual Question Answering for Video Quality Assessment
  2. 2025VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learning
  3. 2026VTAgent: Agentic Keyframe Anchoring for Evidence-Aware Video TextVQA
  4. 2025VideoMultiAgents: A Multi-Agent Framework for Video Question Answering
  5. 2025VideoGen-Eval: Agent-based System for Video Generation Evaluation
  6. 2026Beyond Trial-and-Error: Agentic Optimization for Image-to-Video Adherence
  7. 2025Multilevel Semantic-Aware Model for AI-Generated Video Quality Assessment
  8. 2025ViQAgent: Zero-Shot Video Question Answering via Agent with Open-Vocabulary Grounding Validation