SARA: Semantically Adaptive Relational Alignment for Video Diffusion Models
On the map: Diffusion models → Video generation
Abstract (arXiv)
Recent video diffusion models (VDMs) synthesize visually convincing clips, yet still drop entities, mis-bind attributes, and weaken the interactions specified in the prompt. Representation-alignment objectives such as VideoREPA and MoAlign improve fine-grained text following by distilling spatio-temporal token relations from a frozen visual foundation model, but their pairwise supervision budget is allocated by visual or motion cues rather than by how relevant each pair is to the prompt. We present SARA, Semantically Adaptive Relational Alignment, which keeps token-relation distillation (TRD) on a frozen VFM target and adds a text-conditioned saliency that decides which token pairs carry supervision. A lightweight Stage~1 aligner is trained with per-entity SAM~3.1 mask supervision and an InfoNCE regulariser, and its continuous saliency is fused into TRD through a pair-routing operator that assigns each token pair a weight whenever either of its two endpoints is salient, thereby routing supervision toward subject-subject and subject-background pairs and away from background-background ones. In the Wan2.2 continual-training setting, SARA improves both text alignment and motion quality over SFT, VideoREPA, and MoAlign on a 13-dimension VLM rubric, on the public VBench benchmarks, and in a blind user study. Project page: https://saradit.github.io/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 28 of its 31 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
28 of 31 references.
Closest ancestors · 6
Same direction, newest first
- 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Models21 Oct
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Models29 May
- 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generation18 Dec
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generation31 Jul
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
Other references · 22
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 413
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
10 more
- 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 230
- 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformerscited by 225
- 2025HunyuanVideo 1.5 Technical Reportcited by 160
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
- 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningcited by 117
- 2025VL-JEPA: Joint Embedding Predictive Architecture for Vision-languagecited by 68
- 2026Vision Transformers Need More Than Registerscited by 15
- 2026RefAlign: Representation Alignment for Reference-to-Video Generationcited by 10
- 2026Script-a-Video: Deep Structured Audio-visual Captions via Factorized Streams and Relational Groundingcited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024StarVid: Enhancing Semantic Alignment in Video Diffusion Models via Spatial and SynTactic Guided Attention Refocusing
- 2026MiMaAlign: Hierarchical Micro-Macro Alignment for Physically Plausible Video Generation
- 2025Inference-Time Text-to-Video Alignment with Diffusion Latent Beam Search
- 2025Dynamic Reflections: Probing Video Representations with Text Alignment
- 2024Self-Correcting Text-to-Video Generation with Misalignment Detection and Localized Refinement
- 2026CAPE-T2V: Captioner-Anchored Prompt Enhancement toward Two-Sided Conditioning Alignment in Text-to-Video Generation
- 2025AlignTok: Aligning Visual Foundation Encoders to Tokenizers for Diffusion Models
- 2024Free2Guide: Training-Free Text-to-Video Alignment using Image LVLM