AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordance-Aware Understanding
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
also in 1 more
Abstract (arXiv)
Vision-Language-Action (VLA) models leverage the rich world knowledge of pretrained vision-language models (VLMs) to enable instruction-following robotic manipulation. However, the structural mismatch between VLM semantic spaces and embodied control policies often hinders the learning of precise perception--action mappings. To address this challenge, we propose AffordanceVLA, a unified framework that introduces structured affordance forecasting as a task-oriented intermediate representation to establish a more precise and robust perception--action mapping. Specifically, we progressively model manipulation priors through three complementary components: 1) Which2Act for object-centric grounding via visual latent prediction to suppress distractions; 2) Where2Act for 2D interaction localization via affordance map estimation; and 3) How2Act for 3D geometric reasoning to guide manipulation policies. These affordance cues provide spatially grounded, semantically conditioned, and action-coupled intermediate representations, thereby naturally bridging vision, language and action. We integrate these modules into a Mixture-of-Transformer (MoT) architecture with specialized experts and train the model using a three-stage training strategy with a progressive data curriculum. To overcome the scarcity of dense affordance labels in robotic datasets, we also develop a robust automated data augmentation pipeline. Extensive experiments on simulation and real-world demonstrate that AffordanceVLA achieves strong performance across diverse manipulation scenarios.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 56 of its 68 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
56 of 68 references.
Closest ancestors · 4
Same direction, newest first
- 2025BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Models9 Jun
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agent31 Jan
Other references · 52
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 320
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
- 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 264
- 2023Affordances from Human Videos as a Versatile Representation for Roboticscited by 221
38 more
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 218
- 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 216
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 179
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 159
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
- 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
- 2017Robotic Pick-and-Place of Novel Objects in Clutter with Multi-Affordance Grasping and Cross-Domain Image Matchingcited by 124
- 2020EGO-TOPO: Environment Affordances from Egocentric Videocited by 111
- 2014Reducing the Barrier to Entry of Complex Robotic Software: a MoveIt! Case Studycited by 86
- 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 85
- 2024General Flow as Foundation Affordance for Scalable Robot Learningcited by 80
- 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
- 2021VAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated Objectscited by 78
- 2024Robo-ABC: Affordance Generalization Beyond Categories via Semantic Correspondence for Robot Manipulationcited by 69
- 2025Detect Anything via Next Point Predictioncited by 66
- 2020Learning Affordance Landscapes for Interaction Exploration in 3D Environmentscited by 65
- 2024Diffusion-VLA: Generalizable and Interpretable Robot Foundation Model via Self-Generated Reasoningcited by 57
- 2024RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulationcited by 55
- 2024Closed-Loop Visuomotor Control with Generative Expectation for Robotic Manipulationcited by 51
- 2025FlowVLA: Visual Chain of Thought-based Motion Reasoning for Vision-Language-Action Modelscited by 50
- 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policycited by 46
- 2021Act the Part: Learning Interaction Strategies for Articulated Object Part Discoverycited by 45
- 2024AffordDP: Generalizable Diffusion Policy with Transferable Affordancecited by 35
- 2023Where2Explore: Few-shot Affordance Learning for Unseen Novel Categories of Articulated Objectscited by 33
- 2019Learning Task-Oriented Grasping from Human Activity Datasetscited by 32
- 2024CoA-VLA: Improving Vision-Language-Action Models via Visual-Textual Chain-of-Affordancecited by 29
- 2024ET-SEED: Efficient Trajectory-Level SE(3) Equivariant Diffusion Policycited by 24
- 2022Grounded Affordance from Exocentric Viewcited by 21
- 2022DualAfford: Learning Collaborative Visual Affordance for Dual-gripper Manipulationcited by 18
- 2025Gripper Keypose and Object Pointflow as Interfaces for Bimanual Robotic Manipulationcited by 16
- 2025DexGarmentLab: Dexterous Garment Manipulation Environment with Generalizable Policycited by 12
- 2025GarmentPile: Point-Level Visual Affordance Guided Retrieval and Adaptation for Cluttered Garments Manipulationcited by 9
- 2025GraspMolmo: Generalizable Task-Oriented Grasping via Large-Scale Synthetic Data Generationcited by 9
- 2024EqvAfford: SE(3) Equivariance for Point-Level Affordance Learningcited by 6
- 2026A3D: Adaptive Affordance Assembly with Dual-Arm Manipulationcited by 3
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026LIRA: Local Cross-Layer Information Routing for Vision-Language-Action Decodingcited by 2
- 2026GIFT: Guided Intermediate Feature Training via Action-Oriented Structural Supervision for Robotic Manipulationcited by 2
- 2026AffordanceWAM: Affordance-Aware Joint World-Action Modeling for Robot Manipulationcited by 1
- 2026MachEmbodied-U0: Unified Understanding and Generation Model for Embodied Intelligencecited by 1
- 2026SLIP-VLA: Single-Step Latent Imagination for Policy Learning in Vision-Language-Action Modelscited by 0
- 2026GroundingPI: A Grounding Foundation Model towards Physical Intelligence with Visual Primitivescited by 0
- 2026AffordDrive3D: Affordance-Aware World-Action Modeling with Spatial Understandingcited by 0
- 2026AffordDrive3D: Affordance-Aware World-Action Modeling with Spatial Understanding8 Oct 2026
- 2026GroundingPI: A Grounding Foundation Model towards Physical Intelligence with Visual Primitives30 Sep 2026
- 2026SLIP-VLA: Single-Step Latent Imagination for Policy Learning in Vision-Language-Action Models27 Sep 2026
- 2026MachEmbodied-U0: Unified Understanding and Generation Model for Embodied Intelligence22 Sep 2026
- 2026AffordanceWAM: Affordance-Aware Joint World-Action Modeling for Robot Manipulation16 Sep 2026
- 2026GIFT: Guided Intermediate Feature Training via Action-Oriented Structural Supervision for Robotic Manipulation3 Sep 2026
- 2026LIRA: Local Cross-Layer Information Routing for Vision-Language-Action Decoding6 Aug 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026AffordVLA: Injecting Affordance Representations into Vision-Language-Action Models via Implicit Feature Alignment
- 2025Affordance Field Intervention: Enabling VLAs to Escape Memory Traps in Robotic Manipulation
- 2026Afford-VLA: Action-Aligned Visual Planning via Internalized Affordance
- 2026PALM: Progress-Aware Policy Learning via Affordance Reasoning for Long-Horizon Robotic Manipulation
- 2025A0: An Affordance-Aware Hierarchical Model for General Robotic Manipulation
- 2024Learning Instruction-Guided Manipulation Affordance via Large Models for Embodied Robotic Tasks
- 2026AffordSim: A Scalable Data Generator and Benchmark for Affordance-Aware Robotic Manipulation
- 2024Affordance-based Robot Manipulation with Flow Matching