mlsanityData to 14 Oct 2026

VARI: Robust Text-to-Video Generation via Group-Structured Intent Alignment

arXiv 2610.18189 ↗First posted 13 Oct 2026cs.CVcited by 0

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Modern text-to-video (T2V) models generate visually compelling videos, yet meaning-preserving changes in prompt wording can substantially alter semantic realization and overall quality. Existing prompt rewriting modifies the inference input, whereas conventional post-training constructs supervision from one prompt formulation at a time; neither explicitly optimizes reliability across equivalent forms. We introduce VARI (Verified Alignment over Representations of Intent), a group-structured framework that treats automatically verified formulations of the same visual intent as a shared supervision unit. VARI builds matched form-seed rollout pools, cross-scores each video against all forms, and applies a wording-independent structured intent audit to identify valid realizations and hard semantic failures. Group-Consistent Distillation (GCD) aligns every verified form with interchangeable valid realizations, while Form-Contrastive Flow-DPO (FC-DPO) learns group-level preferences from audited positive-negative pairs, prioritizing same-seed, different-form contrasts. On HunyuanVideo-1.5, VARI attains the highest T2V-CompBench, VBench, and StoryEval scores among the evaluated methods. On prompt-form extensions of T2V-CompBench and VBench, it improves weakest-form alignment over the strongest prompt-level baselines by 2.45 and 3.55 points and reduces cross-form drop by 30.5% and 32.2%, respectively, while preserving visual quality. Human evaluation, natural-caption controls, prompt-enhancement experiments, diversity analyses, and transfer to LTX-2.3 further support the robustness and transferability of these gains, while VARI requires no additional inference-time module.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 32 of its 44 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

32 of 44 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026Diffusion-APO: Trajectory-Aware Direct Preference Alignment for Video Diffusion Transformers8 May
  2. 2025DanceGRPO: Unleashing GRPO on Visual Generation12 May
  3. 2025Dual-IPO: Dual-Iterative Preference Optimization for Text-to-Video Generation4 Feb
  4. 2025Improving Video Generation with Human Feedback23 Jan
  5. 2024OnlineVPO: Align Video Diffusion Model with Online Video-Centric Preference Optimization19 Dec
  6. 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generation18 Dec
  7. 2024Video Diffusion Alignment via Reward Gradients11 Jul
  8. 2023Using Human Feedback to Fine-tune Diffusion Models without Any Reward Model22 Nov

Other references · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  6. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  7. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  8. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  9. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  10. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  11. 2023Training Diffusion Models with Reinforcement Learningcited by 982
  12. 2023ModelScope Text-to-Video Technical Reportcited by 658
12 more
  1. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  2. 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 602
  3. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  4. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
  5. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
  6. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  7. 2019VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Researchcited by 414
  8. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
  9. 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 302
  10. 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
  11. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
  12. 2024Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generationcited by 30

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025RAPO++: Cross-Stage Prompt Optimization for Text-to-Video Generation via Data Alignment and Test-Time Scaling
  2. 2025VPO: Aligning Text-to-Video Generation Models with Prompt Optimization
  3. 2024Self-Correcting Text-to-Video Generation with Misalignment Detection and Localized Refinement
  4. 2025ETVA: Evaluation of Text-to-Video Alignment via Fine-grained Question Generation and Answering
  5. 2025InfLVG: Reinforce Inference-Time Consistent Long Video Generation with GRPO
  6. 2025Rethinking Prompt Design for Inference-time Scaling in Text-to-Visual Generation
  7. 2026CAPE-T2V: Captioner-Anchored Prompt Enhancement toward Two-Sided Conditioning Alignment in Text-to-Video Generation
  8. 2025RISE-T2V: Rephrasing and Injecting Semantics with LLM for Expansive Text-to-Video Generation