AttenA+: Rectifying Action Inequality in Robotic Foundation Models
Not on the map. Why?
Abstract (arXiv)
Existing robotic foundation models, while powerful, are predicated on an implicit assumption of temporal homogeneity: treating all actions as equally informative during optimization. This "flat" training paradigm, inherited from language modeling, remains indifferent to the underlying physical hierarchy of manipulation. In reality, robot trajectories are fundamentally heterogeneous, where low-velocity segments often dictate task success through precision-demanding interactions, while high-velocity motions serve as error-tolerant transitions. Such a misalignment between uniform loss weighting and physical criticality fundamentally limits the performance of current Vision-Language-Action (VLA) models and World-Action Models (WAM) in complex, long-horizon tasks. To rectify this, we introduce AttenA+, an architecture-agnostic framework that prioritizes kinematically critical segments via velocity-driven action attention. By reweighting the training objective based on the inverse velocity field, AttenA+ naturally aligns the model's learning capacity with the physical demands of manipulation. As a plug-and-play enhancement, AttenA+ can be integrated into existing backbones without structural modifications or additional parameters. Extensive experiments demonstrate that AttenA+ significantly elevates the ceilings of current state-of-the-art models. Specifically, it improves OpenVLA-OFT to 98.6% (+1.5%) on the Libero benchmark and pushes FastWAM to 92.4% (+0.6%) on RoboTwin 2.0. Real-world validation on a Franka manipulator further showcases its robustness and cross-task generalization. Our work suggests that mining the intrinsic structural priors of action sequences offers a highly efficient, physics-aware complement to standard scaling laws, paving a new path for general-purpose robotic control.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 39 of its 43 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
39 of 43 references.
References · 39
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
27 more
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 642
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2024SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inferencecited by 391
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 349
- 2026Causal World Modeling for Robot Controlcited by 321
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
- 2025Motus: A Unified Latent Action World Modelcited by 251
- 2022Interactive Language: Talking to Robots in Real Timecited by 218
- 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 127
- 2021Coarse-to-Fine Imitation Learning: Robot Manipulation from a Single Demonstrationcited by 93
- 2019IRIS: Implicit Reinforcement without Interaction at Scale for Learning Control from Offline Robot Manipulation Datacited by 86
- 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Cachingcited by 86
- 2025SP-VLA: A Joint Model Scheduling and Token Pruning Approach for VLA Model Accelerationcited by 58
- 2025Robot Data Curation with Mutual Information Estimatorscited by 37
- 2025Action-aware Dynamic Pruning for Efficient Vision-Language-Action Manipulationcited by 34
- 2025Think Twice, Act Once: Token-Aware Compression and Action Reuse for Efficient Inference in Vision-Language-Action Modelscited by 30
- 2020Robust Imitation Learning from Noisy Demonstrationscited by 26
- 2024Mamba Policy: Towards Efficient 3D Diffusion Policy with Hybrid Selective State Modelscited by 23
- 2024Cross-Self KV Cache Pruning for Efficient Vision-Language Inferencecited by 12
- 2025LOVON: Legged Open-Vocabulary Object Navigatorcited by 11
- 2025Compose Your Policies! Improving Diffusion-based or Flow-based Robot Policies via Test-time Distribution-level Compositioncited by 9
- 2025Spatial RoboGrasp: Generalized Robotic Grasping Control Policycited by 6
- 2026Structured Observation Language for Efficient and Generalizable Vision-Language Navigationcited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization
- 2025From Grounding to Manipulation: Case Studies of Foundation Model Integration in Embodied Robotic Systems
- 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review
- 2026Vision-Language-Action Models: Experimental Insights from a Real-World UR5 Platform
- 2025Experiences from Benchmarking Vision-Language-Action Models for Robotic Manipulation
- 2024Benchmarking Vision, Language, & Action Models on Robotic Learning Tasks
- 2026Colosseum V2: Benchmarking Generalization for Vision-Language-Action Models
- 2026GIFT: Guided Intermediate Feature Training via Action-Oriented Structural Supervision for Robotic Manipulation