mlsanityData to 14 Oct 2026

ConsisVLA-4D: Advancing Spatiotemporal Consistency in Efficient 3D-Perception and 4D-Reasoning for Robotic Manipulation

arXiv 2605.05126 ↗First posted 6 May 2026cs.ROcited by 6

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Current Vision-Language-Action (VLA) models primarily focus on mapping 2D observations to actions, but exhibit notable limitations in spatiotemporal perception and reasoning: 1) spatial representations often rely on additional sensors, introducing substantial computational overhead; 2) visual reasoning is typically limited to future-frame prediction, lacking alignment with the instruction-grounded scene and thus compromising spatiotemporal consistency. To address these challenges, we propose ConsisVLA-4D, a unified and efficient framework that enhances spatiotemporal consistency in 3D perception and 4D reasoning. Specifically, we design: 1) CV-Aligner, which ensures cross-view object semantic consistency by filtering instruction-relevant regions and aligning object identities across multiple viewpoints; 2) CO-Fuser, which guarantees cross-object spatial geometric consistency by eliminating spatial relation ambiguities between objects across views using compact latent representations. Building upon these, we introduce 3) CS-Thinker to achieve cross-scene spatiotemporal consistency as actions unfold. It learns implicit knowledge of local dynamics from object-semantic tokens of CV-Aligner and global depth from geometric tokens of CO-Fuser, thereby enhancing efficient visual reasoning under scene variations. Extensive experiments demonstrate that, benefiting from its efficient spatiotemporal consistency design, ConsisVLA-4D achieves 21.6% and 41.5% performance improvements, along with 2.3-fold and 2.4-fold inference speedups compared to OpenVLA on the LIBERO benchmark and real-world platforms, respectively.ConsisVLA-4D is open-sourced and publicly available at

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 81 of its 93 references that are in the map. First posted on arXiv 6 May 2026.

Builds on

81 of 93 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
  2. 2025PointVLA: Injecting the 3D World into Vision-Language-Action Models10 Mar
  3. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
  4. 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution4 Nov
  5. 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation24 Dec

Other references · 76

  1. 2017Attention Is All You Needcited by 60,361
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  8. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  9. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  10. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  11. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  12. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
38 more
  1. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  2. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  3. 2021Vision Transformers for Dense Predictioncited by 1,803
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  5. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  6. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  7. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  8. 2024Depth Anything V2cited by 1,422
  9. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  10. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  11. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  12. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  13. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  14. 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 642
  15. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
  16. 2023CoTracker: It is Better to Track Togethercited by 522
  17. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  18. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  19. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  20. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 391
  21. 2023An Embodied Generalist Agent in 3D Worldcited by 365
  22. 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 328
  23. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 327
  24. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 304
  25. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
  26. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 240
  27. 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 181
  28. 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 161
  29. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 146
  30. 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 128
  31. 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 99
  32. 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decodingcited by 88
  33. 2025BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Modelscited by 80
  34. 2024Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Modelscited by 76
  35. 2025Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policycited by 74
  36. 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsificationcited by 74
  37. 2025MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulationcited by 70
  38. 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Modelscited by 70

50 most cited of 76 All 76 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025VLA-4D: Embedding 4D Awareness into Vision-Language-Action Models for SpatioTemporally Coherent Robotic Manipulation
  2. 2025VLM4D: Towards Spatiotemporal Awareness in Vision Language Models
  3. 2026ST-VLA: Enabling 4D-Aware Spatiotemporal Understanding for General Robot Manipulation
  4. 2026RoboStream: Weaving Spatio-Temporal Reasoning with Memory in Vision-Language Models for Robotics
  5. 20263DVLA: Enhancing Vision-Language-Action Models via 3D Spatial and Instance Understanding
  6. 20263DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-training
  7. 2026RoTA-Bench: Evaluating 3D Spatial Reasoning through Interactive Projection Alignment
  8. 2026StemVLA:An Open-Source Vision-Language-Action Model with Future 3D Spatial Geometry Knowledge and 4D Historical Representation