PEAfowl: Perception-Enhanced Multi-View Vision-Language-Action for Bimanual Manipulation
On the map: Vision-language-action models → 3D and spatial-aware VLA
Abstract (arXiv)
Bimanual manipulation in cluttered scenes requires policies that remain stable under occlusions, viewpoint changes and scene variations. Existing vision-language-action models often lack such robustness because (i) multi-view features are fused via view-agnostic token concatenation, yielding limited cross-view spatial representations, and (ii) language is injected as global conditioning, resulting in coarse instruction grounding. In this paper, we introduce PEAfowl, a perception-enhanced multi-view VLA policy for bimanual manipulation. For spatial perception, PEAfowl predicts per-token depth distributions, performs differentiable 3D lifting, and aggregates local cross-view neighbors to form geometrically grounded, cross-view aligned representations. For language utilization, we propose to replace global conditioning with a Perceiver-style text-aware readout over frozen CLIP visual features, enabling iterative evidence accumulation. To better exploit commodity RGB-D sensing despite noisy and incomplete depth, PEAfowl's depth-distribution lifting naturally supports training-only depth distillation, where a pretrained depth teacher supervises the depth-distribution head to inject refined geometric priors without adding inference overhead. On RoboTwin 2.0 under domain-randomized setting, PEAfowl improves the strongest baseline by 23.0 pp in success rate, and physical experiments further demonstrate improved performance on the evaluated real-robot tasks. Project website: https://peafowlvla.github.io/.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 32 of its 39 references that are in the map. First posted on arXiv 25 Jan 2026.
Builds on
32 of 39 references.
Closest ancestors · 2
Same direction, newest first
- 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Models12 Aug
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Model27 Jan
Other references · 30
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
18 more
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2020ReZero is All You Need: Fast Convergence at Large Depthcited by 264
- 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 225
- 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 137
- 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 121
- 2024ClearCLIP: Decomposing CLIP Representations for Dense Vision-Language Inferencecited by 113
- 2023Multi-View Masked World Models for Visual Robotic Manipulationcited by 80
- 2025OTTER: A Vision-Language-Action Model with Text-Aware Visual Feature Extractioncited by 54
- 2025FP3: A 3D Foundation Policy for Robotic Manipulationcited by 32
- 2024CLIP-RT: Learning Language-Conditioned Robotic Policies from Natural Language Supervisioncited by 16
- 2025Manipulation as in Simulation: Enabling Accurate Geometry Perception in Robotscited by 11
- 20243D-MVP: 3D Multiview Pretraining for Robotic Manipulationcited by 10
- 2025BFA: Best-Feature-Aware Fusion for Multi-View Fine-grained Manipulationcited by 10
- 2025SEM: Enhancing Spatial Understanding for Robust Robot Manipulationcited by 8
- 2025ManiVID-3D: Generalizable View-Invariant Reinforcement Learning for Robotic Manipulation via Disentangled 3D Representationscited by 5
- 2025NeuGrasp: Generalizable Neural Surface Reconstruction with Background Priors for Material-Agnostic Object Grasp Detectioncited by 3
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specializationcited by 10
- 2026Improving Robustness of Vision-Language-Action Models by Restoring Corrupted Visual Inputscited by 4
- 2026DepthCache: Depth-Guided Training-Free Visual Token Merging for Vision-Language-Action Model Inferencecited by 1
- 2026GRAFT: Grounded and Efficient Online Reinforcement Adaptation for Fine-Grained Robot Manipulationcited by 0
- 2026TAO-DA: Towards Autonomous Operation--A Dual-Arm Vision-Language-Action Model for Coordinated Manipulationcited by 0
- 2026VersaCamVLA: Camera-Configurable VLA Policies for Robotic Manipulationcited by 0
- 2026VersaCamVLA: Camera-Configurable VLA Policies for Robotic Manipulation8 Oct 2026
- 2026TAO-DA: Towards Autonomous Operation--A Dual-Arm Vision-Language-Action Model for Coordinated Manipulation27 Sep 2026
- 2026GRAFT: Grounded and Efficient Online Reinforcement Adaptation for Fine-Grained Robot Manipulation27 Aug 2026
- 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specialization12 May 2026
- 2026DepthCache: Depth-Guided Training-Free Visual Token Merging for Vision-Language-Action Model Inference11 Mar 2026
- 2026Improving Robustness of Vision-Language-Action Models by Restoring Corrupted Visual Inputs1 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026Evo-Depth: A Lightweight Depth-Enhanced Vision-Language-Action Model
- 20253D CAVLA: Leveraging Depth and 3D Context to Generalize Vision Language Action Models for Unseen Tasks
- 2026AnchorVLA4D: an Anchor-Based Spatial-Temporal Vision-Language-Action Model for Robotic Manipulation
- 2026Overcoming Visual Clutter in Vision Language Action Models via Concept-Gated Visual Distillation
- 2026LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imagination
- 2025TwinVLA: Data-Efficient Bimanual Manipulation with Twin Single-Arm Vision-Language-Action Models
- 2026Robust Bimanual Vision-Language-Action Models via Embarrassingly Simple Modality Masking
- 2026StereoPolicy: Improving Robotic Manipulation Policies via Stereo Perception