GeoProp: Grounding Robot State in Vision for Generalist Manipulation
Not on the map. Why?
Abstract (arXiv)
Proprioception is fundamental to robotic manipulation, yet standard fusion methods often treat it as an isolated vector lacking explicit alignment with visual tokens. Without a direct correspondence between 3D kinematics and 2D feature maps, manipulation policies struggle to ground the robot's state within the scene, frequently underperforming even vision-only baselines. To address this, we introduce GeoProp, a lightweight, plug-and-play adapter that aligns proprioception with vision through explicit geometric grounding and spatial feature sampling. GeoProp projects the robot state onto the image plane to sample localized visual features, constructing a grounded state token. It then injects state-derived spatial priors into the corresponding visual features via FiLM modulation. To capture motion intent, GeoProp further samples features at a short-horizon predicted coordinate derived from recent kinematics, providing look-ahead visual context. Across 67 tasks, GeoProp improves Diffusion Policy by 8.7% on 63 simulation tasks and pi_0 by 4.0% on the RoboTwin subset, and yields a 10.6% average gain across both policy families in the real world, while adding only 2-3% to the parameter count. These results demonstrate that GeoProp is a simple yet high-impact inductive bias for generalist embodied policies. Project page: https://alibaba-damo-academy.github.io/GeoProp/.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 42 of its 44 references that are in the map. First posted on arXiv 8 Jul 2026.
Builds on
42 of 44 references.
References · 42
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2015Continuous control with deep reinforcement learningcited by 3,279
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
30 more
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 517
- 2023Where are we in the search for an Artificial Visual Cortex for Embodied Intelligence?cited by 215
- 2023Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulationcited by 135
- 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 135
- 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulationcited by 125
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
- 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 117
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 111
- 2024FlowPolicy: Enabling Fast and Robust 3D Flow-based Policy via Consistency Flow Matching for Robot Manipulationcited by 99
- 2024LLARVA: Vision-Action Instruction Tuning Enhances Robot Learningcited by 87
- 2024The Ingredients for Robotic Diffusion Transformerscited by 72
- 2024Theia: Distilling Diverse Vision Foundation Models for Robot Learningcited by 56
- 2025Do You Need Proprioceptive States in Visuomotor Policies?cited by 16
- 2025Contrastive Representation Regularization for Vision-Language-Action Modelscited by 16
- 2025XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representationscited by 15
- 2025GeoPredict: Leveraging Predictive Kinematics and 3D Gaussian Geometry for Precise VLA Manipulationcited by 15
- 2025GP3: A 3D Geometry-Aware Policy with Multi-View Images for Robotic Manipulationcited by 11
- 2025PEEK: Guiding and Minimal Image Representations for Zero-Shot Generalization of Robot Manipulation Policiescited by 11
- 2025AimBot: A Simple Auxiliary Visual Cue to Enhance Spatial Awareness of Visuomotor Policiescited by 10
- 2025Towards Scalable Spatial Intelligence via 2D-to-3D Data Liftingcited by 8
- 2026When would Vision-Proprioception Policies Fail in Robotic Manipulation?cited by 8
- 2025Robotic VLA Benefits from Joint Learning with Motion Image Diffusioncited by 7
- 2026On the Generalization Capacities of MLLMs for Spatial Intelligencecited by 7
- 2025Towards Proprioception-Aware Embodied Planning for Dual-Arm Humanoid Robotscited by 3
- 2025Proprioception Enhances Vision Language Model in Generating Captions and Subtask Segmentations for Robot Taskcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025VGGT-DP: Generalizable Robot Control via Vision Foundation Models
- 2026VolumeDP: Modeling Volumetric Representation for Manipulation Policy Learning
- 2026Spatial Grafting: Grounding 3D Features for Flow-Matching Robot Policies
- 2025Spatial RoboGrasp: Generalized Robotic Grasping Control Policy
- 2025MOVE: A Simple Motion-Based Data Collection Paradigm for Spatial Generalization in Robotic Manipulation
- 2025GeoManip: Geometric Constraints as General Interfaces for Robot Manipulation
- 2026SpatialVAM:Spatial-Aware Multi-View Video Diffusion as a Data-Efficient Robot Policy
- 2026Spatially Grounded Long-Horizon Task Planning in the Wild