mlsanityData to 7 Oct 2026

VR-JEPA: Learning Contrastive-State Latent Guidance for Generation-based Video Reasoning

arXiv 2609.40129 ↗First posted 30 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Reasoning through video generation offers a promising path toward visual intelligence by modeling latent visual states and their dynamics. However, current video generation models often lack explicit guidance on how these states should evolve, leaving generated trajectories prone to physical and structural inconsistencies that undermine reasoning reliability. While the Video Joint-Embedding Predictive Architecture (V-JEPA) provides rich spatiotemporal priors learned through latent prediction, these general priors do not naturally adapt to the logical reasoning capabilities required for complex visual tasks. To bridge this gap, we propose VR-JEPA, a framework that aligns the V-JEPA predictor with task-specific reasoning logic through localized contrastive-state learning and uses its predicted latent trajectories to guide video generation for visual reasoning. Specifically, (i) we pair successful trajectories with generated alternatives under the same input conditions and use discrepancies in their V-JEPA representations to identify informative states and tokens for localized contrastive supervision. (ii) We further equip the V-JEPA predictor with skill-specific experts trained on anchor-task data, allowing the model to adaptively specialize its shared spatiotemporal priors across diverse cognitive domains. Together with skill-specific experts, this contrastive supervision enables VR-JEPA to predict latent trajectories that provide task-specific logical guidance for video generation. Comprehensive experiments on the large-scale VBVR-Pro-Bench dataset demonstrate that VR-JEPA achieves an 11.33% relative improvement over the cutting-edge generation-based reasoning baseline, significantly mitigating physical artifacts and enhancing logical consistency.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 36 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

31 of 36 references.

References · 31

  1. 2022Scalable Diffusion Models with Transformerscited by 5,931
  2. 2022Flow Matching for Generative Modelingcited by 5,426
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  4. 2022Video Diffusion Modelscited by 2,280
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  6. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  7. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  8. 2018World Modelscited by 1,444
  9. 2025DINOv3cited by 1,297
  10. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  11. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  12. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
19 more
  1. 2022Transformers are Sample-Efficient World Modelscited by 317
  2. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 213
  3. 2025Video models are zero-shot learners and reasonerscited by 208
  4. 2019Sparse Sequence-to-Sequence Modelscited by 167
  5. 2023Video Language Planningcited by 160
  6. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 142
  7. 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningcited by 104
  8. 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigmcited by 41
  9. 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 32
  10. 2026A Very Big Video Reasoning Suitecited by 29
  11. 2026VISReg: Variance-Invariance-Sketching Regularization for JEPA trainingcited by 14
  12. 2026ThinkJEPA: Empowering Latent World Models with Large Vision-Language Reasoning Modelcited by 12
  13. 2026PhysVideoGenerator: Towards Physically Aware Video Generation via Latent Physics Guidancecited by 5
  14. 2025JEPA-Reasoner: Decoupling Latent Reasoning from Token Generationcited by 4
  15. 2026VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimizationcited by 4
  16. 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoningcited by 4
  17. 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AIcited by 3
  18. 2026Wan-R1: Verifiable-Reinforcement Learning for Video Reasoningcited by 3
  19. 2026Off-Manifold Refinement: Guiding Video Generators with a Frozen World Modelcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026V-JEPA Policy: Building Effective World-Action Models on Predictive Visual Latents
  2. 2026From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Models
  3. 2026VGI-Bench: Probing Visual Intelligence in Video Generation Models
  4. 2026JEPA-VLA: Video Predictive Embedding is Needed for VLA Models
  5. 2025TiViBench: Benchmarking Think-in-Video Reasoning for Video Generative Models
  6. 2026Thinking in Frames: How Visual Context and Test-Time Scaling Empower Video Reasoning
  7. 2025VChain: Chain-of-Visual-Thought for Reasoning in Video Generation
  8. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model