BIND: Binding 3D Robot Actions to 2D Image Features
Not on the map. Why?
Abstract (arXiv)
We introduce BIND, a new action representation for visuomotor robot policies that binds 3D robot actions to their corresponding 2D image features, yielding strong data efficiency gains and robustness to out-of-distribution object positions and camera viewpoints. The action heads of current robot policies are typically formulated as an MLP regression from a single global feature vector produced by a pre-trained vision encoder. This global formulation requires the policy network to discover, from demonstrations alone, the relationship between target robot actions and the image features they project onto. The consequence is that although modern image features are semantically descriptive, spatially robust, and even multiview-consistent, the policies built on them are brittle to subtle changes in camera viewpoint and object placement--and surprisingly data-inefficient. BIND closes this gap by supplying the action-feature relationship through camera geometry rather than learning: it discretizes a volume of candidate end effector positions, attaches each candidate to the pre-trained features at its projection in each camera view, and selects actions by scoring each candidate's position and image-bound feature combination. On a real robot, we study data efficiency and out-of-distribution robustness to unseen object positions and camera viewpoints, as well as general long-horizon task execution and dexterity. We find BIND to be highly data-efficient and robust: it achieves near-perfect success on tasks with as few as 5 demonstrations, and degrades gracefully under steep camera-viewpoint shifts and held-out object positions where coordinate-regression baselines completely fail.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 36 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
33 of 36 references.
References · 33
- 2017Attention Is All You Needcited by 59,932
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025DINOv3cited by 1,297
- 2015End-to-End Training of Deep Visuomotor Policiescited by 847
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
21 more
- 2018Behavioral Cloning from Observationcited by 482
- 2026World Action Models are Zero-shot Policiescited by 411
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 373
- 2020Transporter Networks: Rearranging the Visual World for Robotic Manipulationcited by 342
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
- 2017One-Shot Imitation Learningcited by 232
- 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 224
- 2025Unified Video Action Modelcited by 195
- 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulatorscited by 180
- 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 135
- 2021Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisationcited by 120
- 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 117
- 2023GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fieldscited by 99
- 2025Motion Tracks: A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learningcited by 57
- 2024RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulationcited by 55
- 2026MolmoAct2: Action Reasoning Models for Real-world Deploymentcited by 45
- 2025ManiFlow: A General Robot Manipulation Policy via Consistency Flow Trainingcited by 43
- 2024RT-Affordance: Affordances are Versatile Intermediate Representations for Robot Manipulationcited by 40
- 2025UAD: Unsupervised Affordance Distillation for Generalization in Robotic Manipulationcited by 23
- 2026DynaFLIP: Rethinking Robotics Perception via Tri-Modal-Dynamics Guided Representationcited by 4
- 2026Fiducial Exoskeletons: Image-Centric Robot State Estimationcited by 1
Built on by
Not cited yet.