Plan-and-Verify Video Reward Reasoning with Spatio-Temporal Scene Graph Grounding
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Reward models for text-to-video (T2V) generation guide post-training but often fail at fine-grained semantic alignment. We trace this to two structural weaknesses in existing reasoning-based reward models: they do not systematically verify every condition described in the prompt, and the visual evidence supporting each judgment remains implicit in their free-form reasoning. We propose SG-PVR, a video reward model that addresses these limitations through plan-and-verify reasoning grounded in spatio-temporal scene graphs. The verification plan decomposes the prompt into atomic claims, making the set of requirements to be checked explicit. The spatio-temporal scene graph, encoding entities, attributes, and temporally grounded relations, is extracted from the video and maintained as a persistent structured visual reference throughout reasoning. Each claim is verified against both the video and the scene graph, anchoring judgments in explicit visual evidence. SG-PVR achieves strong performance on semantic alignment, including fine-grained temporal semantics. As a test-time reranker, it further enhances compositional alignment in T2V generation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 30 of its 48 references that are in the map. First posted on arXiv 10 Jun 2026.
Builds on
30 of 48 references.
Closest ancestors · 7
Same direction, newest first
- 2026Unified Personalized Reward Model for Vision Generation2 Feb
- 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuning6 May
- 2025ETVA: Evaluation of Text-to-Video Alignment via Fine-grained Question Generation and Answering21 Mar
- 2025Improving Video Generation with Human Feedback23 Jan
- 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generation30 Dec
- 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generation18 Dec
- 2024LiFT: Leveraging Human Feedback for Text-to-Video Model Alignment6 Dec
Other references · 23
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognitioncited by 153
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
11 more
- 2024Tarsier: Recipes for Training and Evaluating Large Video Description Modelscited by 141
- 2025VideoScore2: Think before You Score in Generative Video Evaluationcited by 40
- 2024Vinoground: Scrutinizing LMMs over Dense Temporal Reasoning with Short Videoscited by 38
- 2025Q-Eval-100K: Evaluating Visual Quality and Alignment Level for Text-to-Vision Contentcited by 32
- 2025VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learningcited by 26
- 2025MJ-VIDEO: Fine-Grained Benchmarking and Rewarding Video Preferences in Video Generationcited by 16
- 2024Benchmarking Multi-dimensional AIGC Video Quality Assessment: A Dataset and Unified Modelcited by 13
- 2026TimeBlind: A Spatio-Temporal Compositionality Benchmark for Video LLMscited by 11
- 2024Neuro-Symbolic Evaluation of Text-to-Video Models using Formal Verificationcited by 9
- 2026GraphThinker: Reinforcing Temporally Grounded Video Reasoning with Event Graph Thinkingcited by 5
- 2026Synthetic Visual Genome 2: Extracting Large-scale Spatio-Temporal Scene Graphs from Videoscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SER: Learning to Ground Video Reasoning with Semantic Evidence Rewards
- 2025Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models
- 2026Video Understanding Reward Modeling: A Robust Benchmark and Performant Reward Models
- 2026Reasoning as Intersection: Consensus-Frame Alignment for Visual Focus in Video-MLLMs
- 2026Think, then Score: Decoupled Reasoning and Scoring for Video Reward Modeling
- 2026Reinforcing Consistency in Video MLLMs with Structured Rewards
- 2025Know-Show: Benchmarking Video-Language Models on Spatio-Temporal Grounded Reasoning
- 2026Video-ToC: Video Tree-of-Cue Reasoning