StereoPolicy: Improving Robotic Manipulation Policies via Stereo Perception
On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning
Abstract (arXiv)
Recent advances in robot imitation learning have produced powerful visuomotor policies that manipulate diverse objects from visual inputs. However, monocular observations lack depth information, which is critical for precise manipulation in cluttered or geometrically complex scenes. Explicit depth maps and point clouds are often noisy and fragile in real-world manipulation. We introduce StereoPolicy, a visuomotor policy learning framework that directly leverages synchronized stereo image pairs to improve spatial perception without constructing explicit 3D representations. StereoPolicy processes each image with pretrained 2D vision encoders and fuses left-right features through a cross-attention-based Stereo Transformer, learning task-conditioned binocular representations. The framework integrates with diffusion-based and pretrained vision-language-action (VLA) policies, delivering consistent improvements over RGB, RGB-D, point cloud, and multi-view baselines across three simulation benchmarks and seven real-robot tabletop and bimanual mobile manipulation tasks. Our results support task-trained binocular fusion as an effective way to adapt 2D visual representations for manipulation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 85 of its 100 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
85 of 100 references.
Closest ancestors · 5
Same direction, newest first
- 2025HoMeR: Learning In-the-Wild Mobile Manipulation via Hybrid Imitation and Whole-Body Control1 Jun
- 2024EquiBot: SIM(3)-Equivariant Diffusion Policy for Generalizable and Data Efficient Learning1 Jul
- 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulation12 Mar
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware23 Apr
- 2018Reinforcement and Imitation Learning for Diverse Visuomotor Skills26 Feb
Other references · 80
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
38 more
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2018Group Normalizationcited by 1,514
- 2020Point Transformercited by 1,462
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
- 2015End-to-End Training of Deep Visuomotor Policiescited by 847
- 2022A Generalist Agentcited by 802
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 699
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
- 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 502
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2018Pyramid Stereo Matching Networkcited by 486
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
- 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 278
- 2024Rotary Position Embedding for Vision Transformercited by 226
- 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 224
- 2020Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contextscited by 210
- 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2020Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformerscited by 190
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
- 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 165
- 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 153
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
- 2023Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulationcited by 135
- 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 135
- 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 133
- 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Modelscited by 123
50 most cited of 80 All 80 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026StereoPatch: Patch-Aligned RGB-Depth Fusion for Spatial Perception in Robot Manipulation
- 20253D Flow Diffusion Policy: Visuomotor Policy Learning via Generating Flow in 3D Space
- 2025Improving Robotic Manipulation with Efficient Geometry-Aware Vision Encoder
- 2025ISS Policy : Scalable Diffusion Policy with Implicit Scene Supervision
- 2021Seeing All the Angles: Learning Multiview Manipulation Policies for Contact-Rich Tasks from Demonstrations
- 2025VO-DP: Semantic-Geometric Adaptive Diffusion Policy for Vision-Only Robotic Manipulation
- 20243D Diffusion Policy: Generalizable Visuomotor Policy Learning via Simple 3D Representations
- 2026Spatially Conditioned Diffusion Policy: Learning Precise and Robust Manipulation with a Single RGB Camera