mlsanityData to 14 Oct 2026

From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Model

arXiv 2605.22671 ↗First posted 21 May 2026cs.CVcited by 6

On the map: Vision-language-action models → Generalist VLA models and benchmarks

Abstract (arXiv)

Vision-Language-Action (VLA) models often suffer from performance degradation under distribution shifts, as they struggle to learn generalized behavior representations across varying environments. While existing approaches attempt to construct behavior representations through action-centric latent variables, they are often limited by short-horizon temporal fragmentation and static execution-alignment, leading to inconsistent behaviors in complex scenarios. To address these limitations, we propose BehaviorVLA, a framework that facilitates robust manipulation through the learning of a temporally coherent behavioral representations. Our approach features two symmetric components: (1) the Visuomotor Behavior Encoder (VBE), which utilizes a causal Mamba-based architecture to aggregate long-horizon trajectory information into a unified behavior representation; and (2) the Phase-conditioned Behavior Decoder (PBD), which decodes this representation into precise actions by dynamically aligning task-level priors with real-time execution progress. Experiments on RoboTwin 2.0, LIBERO, and CALVIN demonstrate state-of-the-art success rates of 58%, 98%, and 4.36 (Avg.Len), respectively. Notably, in real-world sim-to-real transfer, BehaviorVLA matches the performance of OpenVLA-OFT using only 50% of the demonstration data, showcasing its superior data efficiency and generalization.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 63 of its 72 references that are in the map. First posted on arXiv 21 May 2026.

Builds on

63 of 72 references.

Closest ancestors · 12

Same direction, newest first

  1. 2025MLA: A Multisensory Language-Action Model for Multimodal Understanding and Forecasting in Robotic Manipulation30 Sep
  2. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey18 Aug
  3. 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceiver14 Aug
  4. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics2 Jun
  5. 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
  6. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
  7. 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agent31 Jan
  8. 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
  9. 2024Towards Synergistic, Generalized, and Efficient Dual-System for Robotic Manipulation10 Oct
  10. 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
  11. 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulation6 Jun
  12. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 51

  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  4. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  5. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  6. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  7. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  8. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  9. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
  10. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  11. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  12. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
38 more
  1. 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
  2. 2022Behavior Transformers: Cloning k modes with one stonecited by 304
  3. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
  4. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
  5. 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 161
  6. 2024Behavior Generation with Latent Actionscited by 160
  7. 2025PointVLA: Injecting the 3D World into Vision-Language-Action Modelscited by 105
  8. 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 99
  9. 2024Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Taskscited by 84
  10. 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 84
  11. 2023LION : Empowering Multimodal Large Language Model with Dual-Level Visual Knowledgecited by 81
  12. 2024Learning Visuotactile Skills with Two Multifingered Handscited by 76
  13. 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsificationcited by 74
  14. 2024In-Context Imitation Learning via Next-Token Predictioncited by 70
  15. 2025VQ-VLA: Improving Vision-Language-Action Models via Scaling Vector-Quantized Action Tokenizerscited by 70
  16. 2024ReMEmbR: Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robot Navigationcited by 67
  17. 2025LION-FS: Fast & Slow Video-Language Thinker as Online Video Assistantcited by 58
  18. 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyondcited by 56
  19. 2023Robot Learning with Sensorimotor Pre-trainingcited by 51
  20. 2022EmoCaps: Emotion Capsule based Model for Conversational Emotion Recognitioncited by 48
  21. 2024Embodied-RAG: General Non-parametric Embodied Memory for Retrieval and Generationcited by 44
  22. 2024Retrieval-Augmented Embodied Agentscited by 31
  23. 2024Flow Matching Imitation Learning for Multi-Support Manipulationcited by 29
  24. 2025MAP-VLA: Memory-Augmented Prompting for Vision-Language-Action Model in Robotic Manipulationcited by 28
  25. 2025Optimus-2: Multimodal Minecraft Agent with Goal-Observation-Action Conditioned Policycited by 25
  26. 2025The Reality Gap in Robotics: Challenges, Solutions, and Best Practicescited by 24
  27. 2025Dexterous Manipulation through Imitation Learning: A Surveycited by 21
  28. 2025SemanticVLA: Semantic-Aligned Sparsification and Enhancement for Efficient Robotic Manipulationcited by 21
  29. 2025FALCON: Resolving Visual Redundancy and Fragmentation in High-resolution Multimodal Large Language Models via Visual Registerscited by 20
  30. 2026Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulationcited by 20
  31. 2025Mirage-1: Augmenting and Updating GUI Agent with Hierarchical Multimodal Skillscited by 19
  32. 2025H-GAR: A Hierarchical Interaction Framework via Goal-Driven Observation-Action Refinement for Robotic Manipulationcited by 17
  33. 2025EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulationcited by 15
  34. 2025STAR: Learning Diverse Robot Skill Abstractions through Rotation-Augmented Vector Quantizationcited by 13
  35. 2025HiconAgent: History Context-aware Policy Optimization for GUI Agentscited by 13
  36. 2025MTIL: Encoding Full History with Mamba for Temporal Imitation Learningcited by 10
  37. 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agentscited by 9
  38. 2026ConsisVLA-4D: Advancing Spatiotemporal Consistency in Efficient 3D-Perception and 4D-Reasoning for Robotic Manipulationcited by 6

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026DiMaS: Distribution Matching for Steering Vision-Language-Action Models
  2. 2025Mechanistic interpretability for steering vision-language-action models
  3. 2025XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representations
  4. 2026QuoVLA: Quotient Space for Vision-Language-Action Models
  5. 2026Observing and Controlling Features in Vision-Language-Action Models
  6. 2026CAC-VLA: Context-Gated Action Conditioning for Vision-Language-Action Models
  7. 2026ElegantVLA: Learning When to Think for Efficient Vision-Language-Action Models
  8. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation