Pelican-VLA 0.5: Attending Before Acting Benefits Generalization
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
In this report, we present Pelican-VLA 0.5, a unified VLA model that integrates vision-language understanding, future-frame generation, and action prediction within a single architecture. Pelican-VLA 0.5 achieves attention-level generalization: without object annotations, segmentation masks, attention supervision, or task-specific fine-tuning, its action pathway already focuses on the manipulation-relevant object and contact region. This behavior persists across unseen scenes and unseen robot embodiments, and is substantially stronger than in other open-source VLA baselines. We verify that this ability originates from the learnable Bottleneck Token inserted between perception and action: by routing task-relevant visual information through a compact bottleneck, the tokens interface induces manipulation-centric attention during pre-training and remains effective across different policy structures, including a MoT-style architecture.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 16 of its 26 references that are in the map. First posted on arXiv 7 Jul 2026.
Builds on
16 of 26 references.
Closest ancestors · 6
Same direction, newest first
- 2026Hy-Embodied-0.5-VLA: From Vision-Language-Action Models to a Real-World Robot Learning Stack12 Jun
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing6 Apr
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model11 Oct
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
- 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 10
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2020Quantifying Attention Flow in Transformerscited by 775
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 175
- 2026JoyAI-RA 0.1: A Foundation Model for Robotic Autonomycited by 23
- 2025Goal-VLA: Image-Generative VLMs as Object-Centric World Models Empowering Zero-shot Robot Manipulationcited by 15
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025PosA-VLA: Enhancing Action Generation via Pose-Conditioned Anchor Attention
- 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specialization
- 2025Enhancing Generalization in Vision-Language-Action Models by Preserving Pretrained Representations
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model
- 2026Wall-OSS-0.5 Technical Report
- 2025AVA-VLA: Improving Vision-Language-Action models with Active Visual Attention
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
- 2026DTP: A Simple yet Effective Distracting Token Pruning Framework for Vision-Language Action Models