VARI: Robust Text-to-Video Generation via Group-Structured Intent Alignment
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Modern text-to-video (T2V) models generate visually compelling videos, yet meaning-preserving changes in prompt wording can substantially alter semantic realization and overall quality. Existing prompt rewriting modifies the inference input, whereas conventional post-training constructs supervision from one prompt formulation at a time; neither explicitly optimizes reliability across equivalent forms. We introduce VARI (Verified Alignment over Representations of Intent), a group-structured framework that treats automatically verified formulations of the same visual intent as a shared supervision unit. VARI builds matched form-seed rollout pools, cross-scores each video against all forms, and applies a wording-independent structured intent audit to identify valid realizations and hard semantic failures. Group-Consistent Distillation (GCD) aligns every verified form with interchangeable valid realizations, while Form-Contrastive Flow-DPO (FC-DPO) learns group-level preferences from audited positive-negative pairs, prioritizing same-seed, different-form contrasts. On HunyuanVideo-1.5, VARI attains the highest T2V-CompBench, VBench, and StoryEval scores among the evaluated methods. On prompt-form extensions of T2V-CompBench and VBench, it improves weakest-form alignment over the strongest prompt-level baselines by 2.45 and 3.55 points and reduces cross-form drop by 30.5% and 32.2%, respectively, while preserving visual quality. Human evaluation, natural-caption controls, prompt-enhancement experiments, diversity analyses, and transfer to LTX-2.3 further support the robustness and transferability of these gains, while VARI requires no additional inference-time module.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 32 of its 44 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
32 of 44 references.
Closest ancestors · 8
Same direction, newest first
- 2026Diffusion-APO: Trajectory-Aware Direct Preference Alignment for Video Diffusion Transformers8 May
- 2025DanceGRPO: Unleashing GRPO on Visual Generation12 May
- 2025Dual-IPO: Dual-Iterative Preference Optimization for Text-to-Video Generation4 Feb
- 2025Improving Video Generation with Human Feedback23 Jan
- 2024OnlineVPO: Align Video Diffusion Model with Online Video-Centric Preference Optimization19 Dec
- 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generation18 Dec
- 2024Video Diffusion Alignment via Reward Gradients11 Jul
- 2023Using Human Feedback to Fine-tune Diffusion Models without Any Reward Model22 Nov
Other references · 24
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2023Training Diffusion Models with Reinforcement Learningcited by 982
- 2023ModelScope Text-to-Video Technical Reportcited by 658
12 more
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 602
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2019VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Researchcited by 414
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
- 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 302
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
- 2024Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generationcited by 30
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025RAPO++: Cross-Stage Prompt Optimization for Text-to-Video Generation via Data Alignment and Test-Time Scaling
- 2025VPO: Aligning Text-to-Video Generation Models with Prompt Optimization
- 2024Self-Correcting Text-to-Video Generation with Misalignment Detection and Localized Refinement
- 2025ETVA: Evaluation of Text-to-Video Alignment via Fine-grained Question Generation and Answering
- 2025InfLVG: Reinforce Inference-Time Consistent Long Video Generation with GRPO
- 2025Rethinking Prompt Design for Inference-time Scaling in Text-to-Visual Generation
- 2026CAPE-T2V: Captioner-Anchored Prompt Enhancement toward Two-Sided Conditioning Alignment in Text-to-Video Generation
- 2025RISE-T2V: Rephrasing and Injecting Semantics with LLM for Expansive Text-to-Video Generation