mlsanityData to 7 Oct 2026

AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordance-Aware Understanding

arXiv 2606.06155 ↗First posted 4 Jun 2026cs.RO cs.CV cs.MMcited by 8

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) models leverage the rich world knowledge of pretrained vision-language models (VLMs) to enable instruction-following robotic manipulation. However, the structural mismatch between VLM semantic spaces and embodied control policies often hinders the learning of precise perception--action mappings. To address this challenge, we propose AffordanceVLA, a unified framework that introduces structured affordance forecasting as a task-oriented intermediate representation to establish a more precise and robust perception--action mapping. Specifically, we progressively model manipulation priors through three complementary components: 1) Which2Act for object-centric grounding via visual latent prediction to suppress distractions; 2) Where2Act for 2D interaction localization via affordance map estimation; and 3) How2Act for 3D geometric reasoning to guide manipulation policies. These affordance cues provide spatially grounded, semantically conditioned, and action-coupled intermediate representations, thereby naturally bridging vision, language and action. We integrate these modules into a Mixture-of-Transformer (MoT) architecture with specialized experts and train the model using a three-stage training strategy with a progressive data curriculum. To overcome the scarcity of dense affordance labels in robotic datasets, we also develop a robust automated data augmentation pipeline. Extensive experiments on simulation and real-world demonstrate that AffordanceVLA achieves strong performance across diverse manipulation scenarios.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 56 of its 68 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

56 of 68 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Models9 Jun
  2. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
  3. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
  4. 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agent31 Jan

Other references · 52

  1. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  2. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  3. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  4. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  5. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  6. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
  7. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  8. 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 320
  9. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
  10. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
  11. 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 264
  12. 2023Affordances from Human Videos as a Versatile Representation for Roboticscited by 221
38 more
  1. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 218
  2. 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 216
  3. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
  4. 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 179
  5. 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 159
  6. 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
  7. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
  8. 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
  9. 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
  10. 2017Robotic Pick-and-Place of Novel Objects in Clutter with Multi-Affordance Grasping and Cross-Domain Image Matchingcited by 124
  11. 2020EGO-TOPO: Environment Affordances from Egocentric Videocited by 111
  12. 2014Reducing the Barrier to Entry of Complex Robotic Software: a MoveIt! Case Studycited by 86
  13. 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 85
  14. 2024General Flow as Foundation Affordance for Scalable Robot Learningcited by 80
  15. 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
  16. 2021VAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated Objectscited by 78
  17. 2024Robo-ABC: Affordance Generalization Beyond Categories via Semantic Correspondence for Robot Manipulationcited by 69
  18. 2025Detect Anything via Next Point Predictioncited by 66
  19. 2020Learning Affordance Landscapes for Interaction Exploration in 3D Environmentscited by 65
  20. 2024Diffusion-VLA: Generalizable and Interpretable Robot Foundation Model via Self-Generated Reasoningcited by 57
  21. 2024RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulationcited by 55
  22. 2024Closed-Loop Visuomotor Control with Generative Expectation for Robotic Manipulationcited by 51
  23. 2025FlowVLA: Visual Chain of Thought-based Motion Reasoning for Vision-Language-Action Modelscited by 50
  24. 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policycited by 46
  25. 2021Act the Part: Learning Interaction Strategies for Articulated Object Part Discoverycited by 45
  26. 2024AffordDP: Generalizable Diffusion Policy with Transferable Affordancecited by 35
  27. 2023Where2Explore: Few-shot Affordance Learning for Unseen Novel Categories of Articulated Objectscited by 33
  28. 2019Learning Task-Oriented Grasping from Human Activity Datasetscited by 32
  29. 2024CoA-VLA: Improving Vision-Language-Action Models via Visual-Textual Chain-of-Affordancecited by 29
  30. 2024ET-SEED: Efficient Trajectory-Level SE(3) Equivariant Diffusion Policycited by 24
  31. 2022Grounded Affordance from Exocentric Viewcited by 21
  32. 2022DualAfford: Learning Collaborative Visual Affordance for Dual-gripper Manipulationcited by 18
  33. 2025Gripper Keypose and Object Pointflow as Interfaces for Bimanual Robotic Manipulationcited by 16
  34. 2025DexGarmentLab: Dexterous Garment Manipulation Environment with Generalizable Policycited by 12
  35. 2025GarmentPile: Point-Level Visual Affordance Guided Retrieval and Adaptation for Cluttered Garments Manipulationcited by 9
  36. 2025GraspMolmo: Generalizable Task-Oriented Grasping via Large-Scale Synthetic Data Generationcited by 9
  37. 2024EqvAfford: SE(3) Equivariance for Point-Level Affordance Learningcited by 6
  38. 2026A3D: Adaptive Affordance Assembly with Dual-Arm Manipulationcited by 3

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AffordVLA: Injecting Affordance Representations into Vision-Language-Action Models via Implicit Feature Alignment
  2. 2025Affordance Field Intervention: Enabling VLAs to Escape Memory Traps in Robotic Manipulation
  3. 2026Afford-VLA: Action-Aligned Visual Planning via Internalized Affordance
  4. 2026PALM: Progress-Aware Policy Learning via Affordance Reasoning for Long-Horizon Robotic Manipulation
  5. 2025A0: An Affordance-Aware Hierarchical Model for General Robotic Manipulation
  6. 2024Learning Instruction-Guided Manipulation Affordance via Large Models for Embodied Robotic Tasks
  7. 2026AffordSim: A Scalable Data Generator and Benchmark for Affordance-Aware Robotic Manipulation
  8. 2024Affordance-based Robot Manipulation with Flow Matching