PosA-VLA: Enhancing Action Generation via Pose-Conditioned Anchor Attention
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
The Vision-Language-Action (VLA) models have demonstrated remarkable performance on embodied tasks and shown promising potential for real-world applications. However, current VLAs still struggle to produce consistent and precise target-oriented actions, as they often generate redundant or unstable motions along trajectories, limiting their applicability in time-sensitive scenarios.In this work, we attribute these redundant actions to the spatially uniform perception field of existing VLAs, which causes them to be distracted by target-irrelevant objects, especially in complex environments.To address this issue, we propose an efficient PosA-VLA framework that anchors visual attention via pose-conditioned supervision, consistently guiding the model's perception toward task-relevant regions. The pose-conditioned anchor attention mechanism enables the model to better align instruction semantics with actionable visual cues, thereby improving action generation precision and efficiency. Moreover, our framework adopts a lightweight architecture and requires no auxiliary perception modules (e.g., segmentation or grounding networks), ensuring efficient inference. Extensive experiments verify that our method executes embodied tasks with precise and time-efficient behavior across diverse robotic manipulation benchmarks and shows robust generalization in a variety of challenging environments.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 54 of its 62 references that are in the map. First posted on arXiv 3 Dec 2025.
Builds on
54 of 62 references.
Closest ancestors · 6
Same direction, newest first
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics2 Jun
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
- 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 48
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023Qwen Technical Reportcited by 3,344
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
36 more
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2020Object-Centric Learning with Slot Attentioncited by 876
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2023Learning Interactive Real-World Simulatorscited by 458
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2024InternLM2 Technical Reportcited by 397
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 346
- 2024Latent Action Pretraining from Videoscited by 321
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
- 2019RoboNet: Large-Scale Multi-Robot Learningcited by 270
- 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 255
- 2025SmolVLM: Redefining small and efficient multimodal modelscited by 237
- 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunkingcited by 169
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulationcited by 162
- 2023Open-World Object Manipulation using Pre-trained Vision-Language Modelscited by 156
- 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 123
- 2024Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detectioncited by 122
- 2024CoPa: General Robotic Manipulation through Spatial Constraints of Parts with Foundation Modelscited by 99
- 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
- 2025DexGraspVLA: A Vision-Language-Action Framework Towards General Dexterous Graspingcited by 89
- 2025ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learningcited by 66
- 2023Learning Generalizable Manipulation Policies with Object-Centric 3D Representationscited by 61
- 2017Deep Object-Centric Representations for Generalizable Robot Learningcited by 50
- 2025ControlVLA: Few-shot Object-centric Adaptation for Pre-trained Vision-Language-Action Modelscited by 43
- 2023GraspGPT: Leveraging Semantic Knowledge from a Large Language Model for Task-Oriented Graspingcited by 40
- 2021RLDS: an Ecosystem to Generate, Share and Use Datasets in Reinforcement Learningcited by 31
- 2024Ag2Manip: Learning Novel Manipulation Skills with Agent-Agnostic Visual and Action Representationscited by 24
- 2025ReSemAct: Advancing Fine-Grained Robotic Manipulation via Semantic Structuring and Affordance Refinementcited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026DyQ-VLA: Temporal-Dynamic-Aware Quantization for Embodied Vision-Language-Action Modelscited by 12
- 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specializationcited by 10
- 2026Mirage2Matter: A Physically Grounded Gaussian World Model from Videocited by 0
- 2026ROI-Driven Foveated Attention for Unified Egocentric Representations in Vision-Language-Action Systemscited by 0
- 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specialization12 May 2026
- 2026ROI-Driven Foveated Attention for Unified Egocentric Representations in Vision-Language-Action Systems21 Mar 2026
- 2026DyQ-VLA: Temporal-Dynamic-Aware Quantization for Embodied Vision-Language-Action Models9 Mar 2026
- 2026Mirage2Matter: A Physically Grounded Gaussian World Model from Video24 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
- 2026AnchorVLA4D: an Anchor-Based Spatial-Temporal Vision-Language-Action Model for Robotic Manipulation
- 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Models
- 2026VISTA: Enhancing Visual Conditioning via Track-Following Preference Optimization in Vision-Language-Action Models
- 2026Restoring Linguistic Grounding in VLA Models via Train-Free Attention Recalibration
- 2025AVA-VLA: Improving Vision-Language-Action models with Active Visual Attention
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
- 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review