Temporal Forcing: 4D Representation Alignment for Vision-Language-Action Models
On the map: Vision-language-action models → 3D and spatial-aware VLA
Abstract (arXiv)
Long-horizon robotic manipulation requires vision-language-action (VLA) models to track scene states and their evolution beyond the current observation. However, simply conditioning policies on observation history does not guarantee that the history is effectively utilized: action supervision constrains what the policy should do, but only indirectly constrains what its history representations should retain. To resolve this, we present Temporal Forcing, a 4D representation alignment framework that explicitly supervises latent temporal states and their transitions. Specifically, we first introduce a history pathway that compresses past observations into compact latent tokens. We then align these tokens and current-frame features with geometric targets from a pretrained 4D foundation model, providing direct supervision at both the state and transition levels. The 4D foundation model and alignment heads are used only for training-time supervision. Temporal Forcing improves average success from 96.6% to 98.8% on LIBERO, with the largest gain on LIBERO-Long (93.8% to 97.2%), and from 53.5% to 62.8% across twelve RoboTwin 2.0 tasks. Furthermore, Temporal Forcing increases full-task success from 20.0% to 43.3% on a physical multi-stage hidden-placement task. Controlled experiments show that 4D representation alignment is crucial for making observation history beneficial to the model. Code will be publicly available.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 39 of its 41 references that are in the map. First posted on arXiv 31 Aug 2026.
Builds on
39 of 41 references.
Closest ancestors · 12
Same direction, newest first
- 2026StemVLA:An Open-Source Vision-Language-Action Model with Future 3D Spatial Geometry Knowledge and 4D Historical Representation27 Feb
- 2026ROCKET: Residual-Oriented Multi-Layer Alignment for Spatially-Aware Vision-Language-Action Models20 Feb
- 2025GLaD: Geometric Latent Distillation for Vision-Language-Action Models10 Dec
- 2025VLA-4D: Embedding 4D Awareness into Vision-Language-Action Models for SpatioTemporally Coherent Robotic Manipulation21 Nov
- 2025QDepth-VLA: Quantized Depth Prediction as Auxiliary Supervision for Vision-Language-Action Models16 Oct
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Model14 Oct
- 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Models12 Aug
- 20254D-VLA: Spatiotemporal Vision-Language-Action Pretraining with Cross-Scene Calibration27 Jun
- 2025OG-VLA: Orthographic Image Generation for 3D-Aware Vision-Language Action Model1 Jun
- 2025PointVLA: Injecting the 3D World into Vision-Language-Action Models10 Mar
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Model27 Jan
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policies13 Dec
Other references · 27
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 699
15 more
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 278
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 183
- 2025Streaming 4D Visual Geometry Transformercited by 147
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
- 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modelingcited by 86
- 2025HAMLET: Switch your Vision-Language-Action Model into a History-Aware Policycited by 42
- 2026ReMem-VLA: Empowering Vision-Language-Action Model with Memory via Dual-Level Recurrent Queriescited by 28
- 2026WAM4D: Fast 4D World Action Model via Spatial Register Tokenscited by 12
- 2026MemoryVLA++: Temporal Modeling via Memory and Imagination in Vision-Language-Action Modelscited by 9
- 2026VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignmentcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MotionVLA: Injecting Geometric Motion into Vision-Language-Action Model
- 2026FOCAL-VLA: Subtask-Guided Geometry Distillation and Implicit World Modeling for Vision-Language-Action Models
- 2026BridgeVLA++: A Data-Efficient, Generalizable, and Memory-Augmented Vision-Language-Action Framework for 3D Manipulation
- 2026Mind-VLA: Instruction-Aware Spatial Representation Alignment for Vision-Language-Action Models
- 2026TEMPO: Learning Temporal Context for Dynamic Robot Manipulation
- 2026PointACT: Vision-Language-Action Models with Multi-Scale Point-Action Interaction
- 2026AWM-VLA: AlignedWorld Modeling for Efficient and Explainable Vision-Language-Action Policies
- 2026ST-VLA: Enabling 4D-Aware Spatiotemporal Understanding for General Robot Manipulation