From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Model
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
Vision-Language-Action (VLA) models often suffer from performance degradation under distribution shifts, as they struggle to learn generalized behavior representations across varying environments. While existing approaches attempt to construct behavior representations through action-centric latent variables, they are often limited by short-horizon temporal fragmentation and static execution-alignment, leading to inconsistent behaviors in complex scenarios. To address these limitations, we propose BehaviorVLA, a framework that facilitates robust manipulation through the learning of a temporally coherent behavioral representations. Our approach features two symmetric components: (1) the Visuomotor Behavior Encoder (VBE), which utilizes a causal Mamba-based architecture to aggregate long-horizon trajectory information into a unified behavior representation; and (2) the Phase-conditioned Behavior Decoder (PBD), which decodes this representation into precise actions by dynamically aligning task-level priors with real-time execution progress. Experiments on RoboTwin 2.0, LIBERO, and CALVIN demonstrate state-of-the-art success rates of 58%, 98%, and 4.36 (Avg.Len), respectively. Notably, in real-world sim-to-real transfer, BehaviorVLA matches the performance of OpenVLA-OFT using only 50% of the demonstration data, showcasing its superior data efficiency and generalization.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 63 of its 72 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
63 of 72 references.
Closest ancestors · 12
Same direction, newest first
- 2025MLA: A Multisensory Language-Action Model for Multimodal Understanding and Forecasting in Robotic Manipulation30 Sep
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey18 Aug
- 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceiver14 Aug
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics2 Jun
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agent31 Jan
- 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
- 2024Towards Synergistic, Generalized, and Efficient Dual-System for Robotic Manipulation10 Oct
- 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulation6 Jun
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 51
- 2023Visual Instruction Tuningcited by 7,869
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
38 more
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
- 2022Behavior Transformers: Cloning k modes with one stonecited by 304
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 161
- 2024Behavior Generation with Latent Actionscited by 160
- 2025PointVLA: Injecting the 3D World into Vision-Language-Action Modelscited by 105
- 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 99
- 2024Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Taskscited by 84
- 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 84
- 2023LION : Empowering Multimodal Large Language Model with Dual-Level Visual Knowledgecited by 81
- 2024Learning Visuotactile Skills with Two Multifingered Handscited by 76
- 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsificationcited by 74
- 2024In-Context Imitation Learning via Next-Token Predictioncited by 70
- 2025VQ-VLA: Improving Vision-Language-Action Models via Scaling Vector-Quantized Action Tokenizerscited by 70
- 2024ReMEmbR: Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robot Navigationcited by 67
- 2025LION-FS: Fast & Slow Video-Language Thinker as Online Video Assistantcited by 58
- 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyondcited by 56
- 2023Robot Learning with Sensorimotor Pre-trainingcited by 51
- 2022EmoCaps: Emotion Capsule based Model for Conversational Emotion Recognitioncited by 48
- 2024Embodied-RAG: General Non-parametric Embodied Memory for Retrieval and Generationcited by 44
- 2024Retrieval-Augmented Embodied Agentscited by 31
- 2024Flow Matching Imitation Learning for Multi-Support Manipulationcited by 29
- 2025MAP-VLA: Memory-Augmented Prompting for Vision-Language-Action Model in Robotic Manipulationcited by 28
- 2025Optimus-2: Multimodal Minecraft Agent with Goal-Observation-Action Conditioned Policycited by 25
- 2025The Reality Gap in Robotics: Challenges, Solutions, and Best Practicescited by 24
- 2025Dexterous Manipulation through Imitation Learning: A Surveycited by 21
- 2025SemanticVLA: Semantic-Aligned Sparsification and Enhancement for Efficient Robotic Manipulationcited by 21
- 2025FALCON: Resolving Visual Redundancy and Fragmentation in High-resolution Multimodal Large Language Models via Visual Registerscited by 20
- 2026Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulationcited by 20
- 2025Mirage-1: Augmenting and Updating GUI Agent with Hierarchical Multimodal Skillscited by 19
- 2025H-GAR: A Hierarchical Interaction Framework via Goal-Driven Observation-Action Refinement for Robotic Manipulationcited by 17
- 2025EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulationcited by 15
- 2025STAR: Learning Diverse Robot Skill Abstractions through Rotation-Augmented Vector Quantizationcited by 13
- 2025HiconAgent: History Context-aware Policy Optimization for GUI Agentscited by 13
- 2025MTIL: Encoding Full History with Mamba for Temporal Imitation Learningcited by 10
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agentscited by 9
- 2026ConsisVLA-4D: Advancing Spatiotemporal Consistency in Efficient 3D-Perception and 4D-Reasoning for Robotic Manipulationcited by 6
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Hermite Curves as Trajectory Priors for Vision-Language-Action Modelscited by 1
- 2026BICPO-VLA: Behavior-Identified Continuation Preference Optimization for Smooth Asynchronous Vision-Language-Action Controlcited by 1
- 2026PhaseLoRA: Control-Regime-Conditioned Low-Rank Adaptation for Continuous-Action Vision-Language-Action Policiescited by 1
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modelingcited by 1
- 2026LookAgain: Closed-Loop GUI Grounding with Visually Grounded Reflectioncited by 0
- 2026World-Calibrated Proposal-to-Action Flow for Vision-Language-Action Modelscited by 0
- 2026World-Calibrated Proposal-to-Action Flow for Vision-Language-Action Models1 Oct 2026
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modeling10 Sep 2026
- 2026PhaseLoRA: Control-Regime-Conditioned Low-Rank Adaptation for Continuous-Action Vision-Language-Action Policies15 Aug 2026
- 2026BICPO-VLA: Behavior-Identified Continuation Preference Optimization for Smooth Asynchronous Vision-Language-Action Control14 Aug 2026
- 2026LookAgain: Closed-Loop GUI Grounding with Visually Grounded Reflection10 Aug 2026
- 2026Hermite Curves as Trajectory Priors for Vision-Language-Action Models2 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026DiMaS: Distribution Matching for Steering Vision-Language-Action Models
- 2025Mechanistic interpretability for steering vision-language-action models
- 2025XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representations
- 2026QuoVLA: Quotient Space for Vision-Language-Action Models
- 2026Observing and Controlling Features in Vision-Language-Action Models
- 2026CAC-VLA: Context-Gated Action Conditioning for Vision-Language-Action Models
- 2026ElegantVLA: Learning When to Think for Efficient Vision-Language-Action Models
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation