mlsanityData to 14 Oct 2026

Latent Clarity: Bridging World-Model Kinematics to Semantic Manifolds for Video Anomaly Anticipation

arXiv 2607.03558 ↗First posted 3 Jul 2026cs.CV cs.AI cs.LGcited by 1

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Continuous video anomaly detection is dominated by reactive Multiple Instance Learning (MIL) that collapses spatiotemporal features into scalar scores. We introduce PULS (Predictive Unified Latent Space), a continuous semantic world-model pipeline comprising two modules: a 490M-parameter KSD Bridge (Kinematic-to-Semantic Distillation) and a 16.8M-parameter Anticipatory State Predictor (ASP). The KSD Bridge maps V-JEPA 2 physical tensors into the 2048-d Qwen3-VL-Embedding-2B text-aligned hypersphere, trained on a subset of UCF-Crime. This translation alone yields a chunk-level AUROC of 0.8994 for UCF-Crime and 0.8162 for out-of-distribution XD-Violence without MIL or hierarchical fusion. We introduce and validate the Latent Clarity Hypothesis: because JEPA's temporal predictor discards aleatoric pixel noise while preserving kinematics, anticipated future representations are more semantically separable than observed presents. The ASP sharpens these anticipated future latents, achieving 44.5% mean 14-way zero-shot VQA accuracy (exceeding observation baseline by +9.6 pp). Applying the ASP to Observation Tensors collapses accuracy to 7.3% (random chance), proving Anticipation and Observation occupy distinct sub-manifolds. A Triple-Track Lead-Time protocol with an L1-surprise gate yields a peak +8.9 pp anticipatory advantage at T-0.5s (p < 0.001, N = 1,000 permutation), separating physical anticipation from static scene priors. Zero-shot transfer to XD-Violence confirms that Newtonian-invariant kinematic representations generalize out-of-distribution.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 12 of its 28 references that are in the map. First posted on arXiv 3 Jul 2026.

Builds on

12 of 28 references.

References · 12

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  4. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  5. 2025Qwen3-VL Technical Reportcited by 2,793
  6. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  7. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  8. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
  9. 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 230
  10. 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningcited by 117
  11. 2025VL-JEPA: Joint Embedding Predictive Architecture for Vision-languagecited by 68
  12. 2025Rethinking JEPA: Compute-Efficient Video SSL with Frozen Teacherscited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Anomaly-Guided Observation and Two-Level Semantic Feedback for Training-Free Video Anomaly Analysis
  2. 2026Is Video Anomaly Detection Misframed? Evidence from LLM-Based and Multi-Scene Models
  3. 2026Glance, Scrutinize, and Think: Advancing Video Anomaly Detection from Training-Free to Agentic Reasoning
  4. 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understanding
  5. 2026SphereVAD: Training-Free Video Anomaly Detection via Geodesic Inference on the Unit Hypersphere
  6. 2026LATERN: Test-Time Context-Aware Explainable Video Anomaly Detection
  7. 2026Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understanding
  8. 2025CueBench: Advancing Unified Understanding of Context-Aware Video Anomalies in Real-World