ConsisVLA-4D: Advancing Spatiotemporal Consistency in Efficient 3D-Perception and 4D-Reasoning for Robotic Manipulation
On the map: LLM reasoning → Spatial and embodied reasoning
also in 1 more
Abstract (arXiv)
Current Vision-Language-Action (VLA) models primarily focus on mapping 2D observations to actions, but exhibit notable limitations in spatiotemporal perception and reasoning: 1) spatial representations often rely on additional sensors, introducing substantial computational overhead; 2) visual reasoning is typically limited to future-frame prediction, lacking alignment with the instruction-grounded scene and thus compromising spatiotemporal consistency. To address these challenges, we propose ConsisVLA-4D, a unified and efficient framework that enhances spatiotemporal consistency in 3D perception and 4D reasoning. Specifically, we design: 1) CV-Aligner, which ensures cross-view object semantic consistency by filtering instruction-relevant regions and aligning object identities across multiple viewpoints; 2) CO-Fuser, which guarantees cross-object spatial geometric consistency by eliminating spatial relation ambiguities between objects across views using compact latent representations. Building upon these, we introduce 3) CS-Thinker to achieve cross-scene spatiotemporal consistency as actions unfold. It learns implicit knowledge of local dynamics from object-semantic tokens of CV-Aligner and global depth from geometric tokens of CO-Fuser, thereby enhancing efficient visual reasoning under scene variations. Extensive experiments demonstrate that, benefiting from its efficient spatiotemporal consistency design, ConsisVLA-4D achieves 21.6% and 41.5% performance improvements, along with 2.3-fold and 2.4-fold inference speedups compared to OpenVLA on the LIBERO benchmark and real-world platforms, respectively.ConsisVLA-4D is open-sourced and publicly available at
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 81 of its 93 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
81 of 93 references.
Closest ancestors · 5
Same direction, newest first
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
- 2025PointVLA: Injecting the 3D World into Vision-Language-Action Models10 Mar
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution4 Nov
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation24 Dec
Other references · 76
- 2017Attention Is All You Needcited by 60,361
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025Qwen3 Technical Reportcited by 8,820
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
38 more
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2024Depth Anything V2cited by 1,422
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 642
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 391
- 2023An Embodied Generalist Agent in 3D Worldcited by 365
- 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 328
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 327
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 304
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 240
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 181
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 161
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 146
- 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 128
- 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 99
- 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decodingcited by 88
- 2025BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Modelscited by 80
- 2024Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Modelscited by 76
- 2025Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policycited by 74
- 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsificationcited by 74
- 2025MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulationcited by 70
- 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Modelscited by 70
50 most cited of 76 All 76 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Modelcited by 6
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modelingcited by 1
- 2026Learning to Use Imagination: Progress-Conditioned Future Utilization for World Action Modelscited by 0
- 2026GeomVLA: Unifying Scene, Motion, and Action in 3Dcited by 0
- 2026Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoningcited by 0
- 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injectioncited by 0
- 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injection1 Oct 2026
- 2026Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoning17 Sep 2026
- 2026GeomVLA: Unifying Scene, Motion, and Action in 3D12 Sep 2026
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modeling10 Sep 2026
- 2026Learning to Use Imagination: Progress-Conditioned Future Utilization for World Action Models6 Sep 2026
- 2026From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Model21 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025VLA-4D: Embedding 4D Awareness into Vision-Language-Action Models for SpatioTemporally Coherent Robotic Manipulation
- 2025VLM4D: Towards Spatiotemporal Awareness in Vision Language Models
- 2026ST-VLA: Enabling 4D-Aware Spatiotemporal Understanding for General Robot Manipulation
- 2026RoboStream: Weaving Spatio-Temporal Reasoning with Memory in Vision-Language Models for Robotics
- 20263DVLA: Enhancing Vision-Language-Action Models via 3D Spatial and Instance Understanding
- 20263DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-training
- 2026RoTA-Bench: Evaluating 3D Spatial Reasoning through Interactive Projection Alignment
- 2026StemVLA:An Open-Source Vision-Language-Action Model with Future 3D Spatial Geometry Knowledge and 4D Historical Representation