mlsanityData to 14 Oct 2026

SLAP: The Semantic Least Action Principle for Variational Video-Language Modeling

arXiv 2605.30750 ↗First posted 29 May 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

In the era of Large Video-Language Models (LVLMs), the computational necessity of sparse frame sampling creates a fundamental ``temporal gap'', rendering models blind to critical causal transitions. Existing solutions relying on generative hallucination (e.g., latent diffusion) or autoregressive extrapolation often fail to maintain semantic consistency over long horizons, suffering from object vanishing and energetic instability. We propose a paradigm shift from probabilistic generation to variational mechanics with the Semantic Least Action Principle (SLAP). Drawing a rigorous isomorphism between classical mechanics and semantic dynamics, we model the latent video trajectory as a path on a Riemannian manifold governed by a Semantic Lagrangian. By formulating the interpolation task as a Boundary Value Problem (BVP) solved via the discrete Euler-Lagrange equations, SLAP naturally enforces object persistence without pixel-level rendering. Extensive experiments show the effectiveness of our proposed SLAP.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 47 of its 86 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

47 of 86 references.

References · 47

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2023Visual Instruction Tuningcited by 7,869
  7. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  8. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  9. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  10. 2018Neural Ordinary Differential Equationscited by 3,779
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  12. 2020GLU Variants Improve Transformercited by 1,804
35 more
  1. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
  2. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
  3. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
  4. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
  5. 2016Geometric deep learning: going beyond Euclidean datacited by 1,048
  6. 2019Hamiltonian Neural Networkscited by 712
  7. 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 672
  8. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
  9. 2020Lagrangian Neural Networkscited by 398
  10. 2023Instant3D: Instant Text-to-3D Generationcited by 45
  11. 2022Multi-Modal Cross-Domain Alignment Network for Video Moment Retrievalcited by 43
  12. 2023You Can Ground Earlier than See: An Effective and Efficient Pipeline for Temporal Sentence Grounding in Compressed Videoscited by 41
  13. 2022Hierarchical Local-Global Transformer for Temporal Sentence Groundingcited by 38
  14. 2022Exploring Optical-Flow-Guided Motion and Detection-Based Appearance for Temporal Sentence Groundingcited by 35
  15. 2020Unbalanced Incomplete Multi-view Clustering via the Scheme of View Evolution: Weak Views are Meat; Strong Views do Eatcited by 30
  16. 2020ANIMC: A Soft Framework for Auto-weighted Noisy and Incomplete Multi-view Clusteringcited by 30
  17. 2023STPrivacy: Spatio-Temporal Privacy-Preserving Action Recognitioncited by 29
  18. 2020Self-supervised Geometric Features Discovery via Interpretable Attention for Vehicle Re-Identification and Beyondcited by 25
  19. 2023Hypotheses Tree Building for One-Shot Temporal Sentence Localizationcited by 25
  20. 2020Double Self-weighted Multi-view Clustering via Adaptive View Fusioncited by 23
  21. 2024Your Data Is Not Perfect: Towards Cross-Domain Out-of-Distribution Detection in Class-Imbalanced Datacited by 21
  22. 2024Multi-Pair Temporal Sentence Grounding via Multi-Thread Knowledge Transfer Networkcited by 15
  23. 2025Taylor Series-Inspired Local Structure Fitting Network for Few-shot Point Cloud Semantic Segmentationcited by 14
  24. 2025To Align or Not to Align: Strategic Multimodal Representation Alignment for Optimal Performancecited by 14
  25. 2025Prototype-Driven Structure Synergy Network for Remote Sensing Images Segmentationcited by 11
  26. 2026Unveiling the Fragility of Vision-Language Models: Multi-Modal Adversarial Synergy via Texture-Constrained Perturbations and Cross-Modal Optimizationcited by 9
  27. 2024Adaptive Hierarchical Graph Cut for Multi-granularity Out-of-distribution Detectioncited by 8
  28. 2025Adaptive Multi-prompt Contrastive Network for Few-shot Out-of-distribution Detectioncited by 8
  29. 2026Rethinking Weakly-supervised Video Temporal Grounding From a Game Perspectivecited by 8
  30. 2026Disentangling Adversarial Prompts: A Semantic-Graph Defense for Robust LLM Securitycited by 8
  31. 2026Rethinking Video-Language Model from the Language Input Perspectivecited by 6
  32. 2026Not All Inputs Are Valid: Towards Open-Set Video Moment Retrieval Using Languagecited by 6
  33. 2026Towards Unified Vision-Language Models with Incomplete Multi-Modal Inputscited by 5
  34. 2026Fewer Steps, Better Performance: Efficient Cross-Modal Clip Trimming for Video Moment Retrieval Using Languagecited by 5
  35. 2026CogniVerse: Revolutionizing Multi-Modal Retrieval-Augmented Generation with Cognitive Reflection and Geometric Reasoningcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Grounded Forcing: Bridging Time-Independent Semantics and Proximal Dynamics in Autoregressive Video Synthesis
  2. 2024A Survey on Future Frame Synthesis: Bridging Deterministic and Generative Approaches
  3. 2026TeDiO: Temporal Diagonal Optimization for Training-Free Coherent Video Diffusion
  4. 2024Animate Your Motion: Turning Still Images into Dynamic Videos
  5. 2026Inference-time Physics Alignment of Video Generative Models with Latent World Models
  6. 2024Towards Multi-Task Multi-Modal Models: A Video Generative Perspective
  7. 2025CycliST: A Video Language Model Benchmark for Reasoning on Cyclical State Transitions
  8. 2026Generation Models Know Space: Unleashing Implicit 3D Priors for Scene Understanding