GeoPredict: Leveraging Predictive Kinematics and 3D Gaussian Geometry for Precise VLA Manipulation
On the map: Vision-language-action models → 3D and spatial-aware VLA
Abstract (arXiv)
Vision-Language-Action (VLA) models achieve strong generalization in robotic manipulation but remain largely reactive and 2D-centric, making them unreliable in tasks that require precise 3D reasoning. We propose GeoPredict, a geometry-aware VLA framework that augments a continuous-action policy with predictive kinematic and geometric priors. GeoPredict introduces a trajectory-level module that encodes motion history and predicts multi-step 3D keypoint trajectories of robot arms, and a predictive 3D Gaussian geometry module that forecasts workspace geometry with track-guided refinement along future keypoint trajectories. These predictive modules serve exclusively as training-time supervision through depth-based rendering, while inference requires only lightweight additional query tokens without invoking any 3D decoding. Experiments on RoboCasa Human-50, LIBERO, and real-world manipulation tasks show that GeoPredict consistently outperforms strong VLA baselines, especially in geometry-intensive and spatially demanding scenarios.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 50 of its 55 references that are in the map. First posted on arXiv 18 Dec 2025.
Builds on
50 of 55 references.
Closest ancestors · 4
Same direction, newest first
- 20254D-VLA: Spatiotemporal Vision-Language-Action Pretraining with Cross-Scene Calibration27 Jun
- 2025BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Models9 Jun
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Model27 Jan
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policies13 Dec
Other references · 46
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
34 more
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2020Mastering Atari with Discrete World Modelscited by 990
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
- 2022Transformers are Sample-Efficient World Modelscited by 317
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
- 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 264
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 218
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
- 2025Unified Video Action Modelcited by 195
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 159
- 2022EfficientNeRF: Efficient Neural Radiance Fieldscited by 110
- 2022Deep Hierarchical Planning from Pixelscited by 96
- 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
- 2023STORM: Efficient Stochastic Transformer based World Models for Reinforcement Learningcited by 88
- 2025Universal Actions for Enhanced Embodied Foundation Modelscited by 80
- 2024Moto: Latent Motion Token as the Bridging Language for Learning Robot Manipulation from Videoscited by 65
- 2025villa-X: Enhancing Latent Action Modeling in Vision-Language-Action Modelscited by 58
- 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplatscited by 56
- 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulationcited by 37
- 2025Geometry-aware 4D Video Generation for Robot Manipulationcited by 23
- 2025AVA-VLA: Improving Vision-Language-Action models with Active Visual Attentioncited by 22
- 2025WristWorld: Generating Wrist-Views via 4D World Models for Robotic Manipulationcited by 21
- 2024Pre-trained Text-to-Image Diffusion Models Are Versatile Representation Learners for Controlcited by 11
Built on by
Citing papers per year: 2026: 15.
15 papers.
Sort:
By area:
- 2026STARRY: Spatial-Temporal Action-Centric World Modeling for Robotic Manipulationcited by 10
- 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specializationcited by 7
- 2026Track4Action: Distilling World-Centric 3D Tracker into Vision-Language-Action Policiescited by 5
- 2026GaussianDream: A Feed-Forward 3D Gaussian World Model for Robotic Manipulationcited by 3
- 2026FoMoVLA: Bridging Visual Foresight and Motion Guidance for Vision-Language-Action Modelscited by 2
- 2026ELAN4D: Embodiment-Centric 4D Supervision for Vision-Language-Action Models via Plug-and-Play Adaptationcited by 1
- 20263DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-trainingcited by 1
- 2026GeoProp: Grounding Robot State in Vision for Generalist Manipulationcited by 1
- 2026Breaking Structural Isolation: Scalable Graph Clustering via Community-Aware Sampling and Structural Entropycited by 0
- 2026GaussianDream++: Efficient 3D Gaussian World Modeling for Robotic Manipulationcited by 0
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunitiescited by 0
- 2026StrataVLA: Hierarchical and Efficient 3D Geometric Grounding for Vision-Language-Action Modelscited by 0
- 2026VersaCamVLA: Camera-Configurable VLA Policies for Robotic Manipulation8 Oct 2026
- 2026Spatial Grafting: Grounding 3D Features for Flow-Matching Robot Policies28 Sep 2026
- 2026SLIP-VLA: Single-Step Latent Imagination for Policy Learning in Vision-Language-Action Models27 Sep 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026GaussianDream++: Efficient 3D Gaussian World Modeling for Robotic Manipulation26 Aug 2026
- 2026Track4Action: Distilling World-Centric 3D Tracker into Vision-Language-Action Policies4 Aug 2026
- 2026StrataVLA: Hierarchical and Efficient 3D Geometric Grounding for Vision-Language-Action Models3 Aug 2026
- 2026FoMoVLA: Bridging Visual Foresight and Motion Guidance for Vision-Language-Action Models16 Jul 2026
- 2026GeoProp: Grounding Robot State in Vision for Generalist Manipulation8 Jul 2026
- 2026Breaking Structural Isolation: Scalable Graph Clustering via Community-Aware Sampling and Structural Entropy6 Jul 2026
- 20263DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-training3 Jun 2026
- 2026ELAN4D: Embodiment-Centric 4D Supervision for Vision-Language-Action Models via Plug-and-Play Adaptation28 May 2026
3 more
- 2026Track4Action: Distilling World-Centric 3D Tracker into Vision-Language-Action Policiescited by 5
- 2026FoMoVLA: Bridging Visual Foresight and Motion Guidance for Vision-Language-Action Modelscited by 2
- 2026ELAN4D: Embodiment-Centric 4D Supervision for Vision-Language-Action Models via Plug-and-Play Adaptationcited by 1
- 2026SLIP-VLA: Single-Step Latent Imagination for Policy Learning in Vision-Language-Action Modelscited by 0
- 2026SLIP-VLA: Single-Step Latent Imagination for Policy Learning in Vision-Language-Action Models27 Sep 2026
- 2026Track4Action: Distilling World-Centric 3D Tracker into Vision-Language-Action Policies4 Aug 2026
- 2026FoMoVLA: Bridging Visual Foresight and Motion Guidance for Vision-Language-Action Models16 Jul 2026
- 2026ELAN4D: Embodiment-Centric 4D Supervision for Vision-Language-Action Models via Plug-and-Play Adaptation28 May 2026
- 2026STARRY: Spatial-Temporal Action-Centric World Modeling for Robotic Manipulationcited by 10
- 2026GaussianDream: A Feed-Forward 3D Gaussian World Model for Robotic Manipulationcited by 3
- 2026GaussianDream++: Efficient 3D Gaussian World Modeling for Robotic Manipulationcited by 0
- 2026Spatial Grafting: Grounding 3D Features for Flow-Matching Robot Policiescited by 0
- 2026Spatial Grafting: Grounding 3D Features for Flow-Matching Robot Policies28 Sep 2026
- 2026GaussianDream++: Efficient 3D Gaussian World Modeling for Robotic Manipulation26 Aug 2026
- 2026GaussianDream: A Feed-Forward 3D Gaussian World Model for Robotic Manipulation20 May 2026
- 2026STARRY: Spatial-Temporal Action-Centric World Modeling for Robotic Manipulation29 Apr 2026
- 2026GeoProp: Grounding Robot State in Vision for Generalist Manipulationcited by 1
- 2026Breaking Structural Isolation: Scalable Graph Clustering via Community-Aware Sampling and Structural Entropycited by 0
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunitiescited by 0
- 2026VersaCamVLA: Camera-Configurable VLA Policies for Robotic Manipulationcited by 0
- 2026VersaCamVLA: Camera-Configurable VLA Policies for Robotic Manipulation8 Oct 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026GeoProp: Grounding Robot State in Vision for Generalist Manipulation8 Jul 2026
- 2026Breaking Structural Isolation: Scalable Graph Clustering via Community-Aware Sampling and Structural Entropy6 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026GEAR-VLA: Learning Geometry-Aware Action Representations for Generalizable Robotic Manipulation
- 2026FOCAL-VLA: Subtask-Guided Geometry Distillation and Implicit World Modeling for Vision-Language-Action Models
- 2026BridgeVLA++: A Data-Efficient, Generalizable, and Memory-Augmented Vision-Language-Action Framework for 3D Manipulation
- 2026GeomVLA: Unifying Scene, Motion, and Action in 3D
- 2026Geometry-Aware Motion Latents for Learning Robust Manipulation Policies
- 2026VistaVLA: Geometry- and Semantic-Aware 3D Gaussian-Grounded VLA for Robotic Manipulation
- 2026Robotic Manipulation is Vision-to-Geometry Mapping: Vision-Geometry Backbones over Language and Video Models
- 2026GWM-VLA: Geometry-Aware Latent World Modeling for Vision-Language-Action Learning