mlsanityData to 7 Oct 2026

Towards Subject Consistency over Dynamic Subject Sets in Video Generation

arXiv 2610.01052 ↗First posted 1 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We argue that as video generation extends to longer durations, subject consistency should be evaluated over textitdynamic subject sets. We therefore introduce DynSC-Eval, an evaluation framework that dynamically tracks eligible subjects throughout their visible lifespans and measures local continuity and global identity preservation using six complementary object-level metrics, with explicit detection of inconsistency events. To validate its effectiveness, we design synthetic experiments that actively inject inconsistency events, demonstrating both the sensitivity of DynSC-Eval and the limitations of existing metrics. Evaluations of diverse models on 5s, 15s, and 60s video generation further reveal substantial subject consistency differences that are obscured by conventional metrics. Beyond evaluation, we construct rewards from DynSC-Eval and apply DiffusionNFT post-training in an autonomous-driving testbed. On 5s generation, our approach reduces the six inconsistency metrics by an average of 13.82% for Wan-2.1-1.3B and 5.66% for SANA-2B, with improvements also observed on the I2V model ReSim. Qualitative comparisons further demonstrate the effectiveness of our method. We then extend generation to 10s and 30s through curriculum learning and show that consistency optimization remains effective while largely preserving other capabilities.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 39 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

33 of 39 references.

References · 33

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  5. 2025Qwen3-VL Technical Reportcited by 2,534
  6. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  7. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  8. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  9. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
  10. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  11. 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
  12. 2025Video models are zero-shot learners and reasonerscited by 208
21 more
  1. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
  2. 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 190
  3. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
  4. 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 116
  5. 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformercited by 91
  6. 2023InstructVideo: Instructing Video Diffusion Models with Human Feedbackcited by 85
  7. 2025Kling-Omni Technical Reportcited by 60
  8. 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
  9. 2025Video-Bench: Human-Aligned Video Generation Benchmarkcited by 53
  10. 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 50
  11. 2023Control-A-Video: Controllable Text-to-Video Diffusion Models with Motion Prior and Reward Feedback Learningcited by 46
  12. 2025ReSim: Reliable World Simulation for Autonomous Drivingcited by 42
  13. 2026Infinite Worlds with Versatile Interactionscited by 37
  14. 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluationcited by 34
  15. 2026DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous Drivingcited by 20
  16. 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Modelscited by 15
  17. 2026LongAV-Compass: Towards Unified Evaluation of Minute-Scale Audio-Visual Generation Across T2AV, I2AV, and V2AVcited by 9
  18. 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimizationcited by 7
  19. 2026WorldJen: An End-to-End Multi-Dimensional Benchmark for Generative Video Modelscited by 3
  20. 2026SHIFT: Motion Alignment in Video Diffusion Models with Adversarial Hybrid Fine-Tuningcited by 2
  21. 2025Video Consistency Distance: Enhancing Temporal Consistency for Image-to-Video Generation via Reward-Based Fine-Tuningcited by 1

Built on by

Not cited yet.