mlsanityData to 14 Oct 2026

PEAfowl: Perception-Enhanced Multi-View Vision-Language-Action for Bimanual Manipulation

arXiv 2601.17885 ↗First posted 25 Jan 2026cs.CV cs.AI cs.ROcited by 6

On the map: Vision-language-action models → 3D and spatial-aware VLA

Abstract (arXiv)

Bimanual manipulation in cluttered scenes requires policies that remain stable under occlusions, viewpoint changes and scene variations. Existing vision-language-action models often lack such robustness because (i) multi-view features are fused via view-agnostic token concatenation, yielding limited cross-view spatial representations, and (ii) language is injected as global conditioning, resulting in coarse instruction grounding. In this paper, we introduce PEAfowl, a perception-enhanced multi-view VLA policy for bimanual manipulation. For spatial perception, PEAfowl predicts per-token depth distributions, performs differentiable 3D lifting, and aggregates local cross-view neighbors to form geometrically grounded, cross-view aligned representations. For language utilization, we propose to replace global conditioning with a Perceiver-style text-aware readout over frozen CLIP visual features, enabling iterative evidence accumulation. To better exploit commodity RGB-D sensing despite noisy and incomplete depth, PEAfowl's depth-distribution lifting naturally supports training-only depth distillation, where a pretrained depth teacher supervises the depth-distribution head to inject refined geometric priors without adding inference overhead. On RoboTwin 2.0 under domain-randomized setting, PEAfowl improves the strongest baseline by 23.0 pp in success rate, and physical experiments further demonstrate improved performance on the evaluated real-robot tasks. Project website: https://peafowlvla.github.io/.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 32 of its 39 references that are in the map. First posted on arXiv 25 Jan 2026.

Builds on

32 of 39 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Models12 Aug
  2. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Model27 Jan

Other references · 30

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  6. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  8. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  9. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  10. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  11. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  12. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
18 more
  1. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  2. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
  3. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  4. 2020ReZero is All You Need: Fast Convergence at Large Depthcited by 264
  5. 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 225
  6. 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 137
  7. 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 121
  8. 2024ClearCLIP: Decomposing CLIP Representations for Dense Vision-Language Inferencecited by 113
  9. 2023Multi-View Masked World Models for Visual Robotic Manipulationcited by 80
  10. 2025OTTER: A Vision-Language-Action Model with Text-Aware Visual Feature Extractioncited by 54
  11. 2025FP3: A 3D Foundation Policy for Robotic Manipulationcited by 32
  12. 2024CLIP-RT: Learning Language-Conditioned Robotic Policies from Natural Language Supervisioncited by 16
  13. 2025Manipulation as in Simulation: Enabling Accurate Geometry Perception in Robotscited by 11
  14. 20243D-MVP: 3D Multiview Pretraining for Robotic Manipulationcited by 10
  15. 2025BFA: Best-Feature-Aware Fusion for Multi-View Fine-grained Manipulationcited by 10
  16. 2025SEM: Enhancing Spatial Understanding for Robust Robot Manipulationcited by 8
  17. 2025ManiVID-3D: Generalizable View-Invariant Reinforcement Learning for Robotic Manipulation via Disentangled 3D Representationscited by 5
  18. 2025NeuGrasp: Generalizable Neural Surface Reconstruction with Background Priors for Material-Agnostic Object Grasp Detectioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Evo-Depth: A Lightweight Depth-Enhanced Vision-Language-Action Model
  2. 20253D CAVLA: Leveraging Depth and 3D Context to Generalize Vision Language Action Models for Unseen Tasks
  3. 2026AnchorVLA4D: an Anchor-Based Spatial-Temporal Vision-Language-Action Model for Robotic Manipulation
  4. 2026Overcoming Visual Clutter in Vision Language Action Models via Concept-Gated Visual Distillation
  5. 2026LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imagination
  6. 2025TwinVLA: Data-Efficient Bimanual Manipulation with Twin Single-Arm Vision-Language-Action Models
  7. 2026Robust Bimanual Vision-Language-Action Models via Embarrassingly Simple Modality Masking
  8. 2026StereoPolicy: Improving Robotic Manipulation Policies via Stereo Perception