mlsanityData to 7 Oct 2026

AffordVLA: Injecting Affordance Representations into Vision-Language-Action Models via Implicit Feature Alignment

arXiv 2605.17517 ↗First posted 17 May 2026cs.ROcited by 5

On the map: Vision-language-action models → Reasoning and chain-of-thought in VLA

Abstract (arXiv)

Recent advances in Vision-Language-Action (VLA) models have shown strong potential for general-purpose robotic manipulation. However, the visual representations of most VLA models are often dominated by global object appearance and struggle to focus on task-relevant functional interaction regions, which limits their robustness in unstructured environments. Existing affordance-based methods typically rely on explicit mask injection or external perception modules, requiring additional annotations while introducing cascading perception errors and inference overhead. To address these limitations, we propose AffordVLA, an affordance-enhanced VLA framework that internalizes manipulation-centric affordance perception into VLA visual representations through implicit representation alignment. Specifically, we construct a zero-shot affordance teacher to extract task-conditioned affordance visual representations from RGB observations and language instructions. AffordVLA aligns the intermediate visual representations of the VLA with the affordance visual representations extracted by the teacher, thereby implicitly injecting manipulation-centric affordance perception into VLA visual representations and improving action accuracy. Extensive simulation and real-world experiments demonstrate that AffordVLA and its affordance teacher achieve state-of-the-art performance and outperform strong baselines. Ablation analyses show that AffordVLA effectively reshapes VLA visual representations while preserving inference efficiency, leading to improved manipulation success rates and training efficiency.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Reasoning and chain-of-thought in VLA, one of 13 directions in Vision-language-action models. Builds on 61 of its 76 references that are in the map. First posted on arXiv 17 May 2026.

Builds on

61 of 76 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Latent Reasoning VLA: Latent Thinking and Prediction for Vision-Language-Action Models1 Feb
  2. 2026PALM: Progress-Aware Policy Learning via Affordance Reasoning for Long-Horizon Robotic Manipulation11 Jan
  3. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
  4. 2024CoA-VLA: Improving Vision-Language-Action Models via Visual-Textual Chain-of-Affordance29 Dec

Other references · 57

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Flow Matching for Generative Modelingcited by 5,426
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  6. 2025Qwen3-VL Technical Reportcited by 2,534
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  8. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  9. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  10. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  11. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  12. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
38 more
  1. 2025SAM 3: Segment Anything with Conceptscited by 835
  2. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
  3. 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 678
  4. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  5. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
  6. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  7. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
  8. 2025π*0.6: a VLA That Learns From Experiencecited by 280
  9. 2016What do different evaluation metrics tell us about saliency models?cited by 184
  10. 2025VLA-RL: Towards Masterful and General Robotic Manipulation with Scalable Reinforcement Learningcited by 166
  11. 2018Grounded Human-Object Interaction Hotspots from Videocited by 128
  12. 2017AffordanceNet: An End-to-End Deep Learning Approach for Object Affordance Detectioncited by 126
  13. 2024MOKA: Open-World Robotic Manipulation through Mark-Based Visual Promptingcited by 126
  14. 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
  15. 2025FLARE: Robot Learning with Implicit World Modelingcited by 105
  16. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 104
  17. 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 85
  18. 2022Learning Affordance Grounding from Exocentric Imagescited by 82
  19. 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
  20. 2023LOCATE: Localize and Transfer Object Parts for Weakly Supervised Affordance Groundingcited by 64
  21. 20253DRS: MLLMs Need 3D-Aware Representation Supervision for Scene Understandingcited by 63
  22. 2025OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraintscited by 58
  23. 2024AffordanceLLM: Grounding Affordance from Vision Language Modelscited by 55
  24. 2024Reconstructive Visual Instruction Tuningcited by 54
  25. 2024Closed-Loop Visuomotor Control with Generative Expectation for Robotic Manipulationcited by 51
  26. 2023One-Shot Open Affordance Learning with Foundation Modelscited by 45
  27. 2025A0: An Affordance-Aware Hierarchical Model for General Robotic Manipulationcited by 44
  28. 2024RT-Affordance: Affordances are Versatile Intermediate Representations for Robot Manipulationcited by 40
  29. 2025Vision Language Action Models in Robotic Manipulation: A Systematic Reviewcited by 38
  30. 2023Understanding 3D Object Interaction from a Single Imagecited by 33
  31. 2023Uncertainty-aware State Space Transformer for Egocentric 3D Hand Trajectory Forecastingcited by 33
  32. 2022One-Shot Transfer of Affordance Regions? AffCorrs!cited by 31
  33. 2025MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentationcited by 28
  34. 2024ManipVQA: Injecting Robotic Affordance and Physically Grounded Information into Multi-Modal Large Language Modelscited by 25
  35. 2024Robots Pre-train Robots: Manipulation-Centric Robotic Representation from Large-Scale Robot Datasetscited by 23
  36. 2025UAD: Unsupervised Affordance Distillation for Generalization in Robotic Manipulationcited by 23
  37. 2023Language-Conditioned Affordance-Pose Detection in 3D Point Cloudscited by 16
  38. 2025GenHancer: Imperfect Generative Models are Secretly Strong Vision-Centric Enhancerscited by 16

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordance-Aware Understanding
  2. 2026Afford-VLA: Action-Aligned Visual Planning via Internalized Affordance
  3. 2025Affordance Field Intervention: Enabling VLAs to Escape Memory Traps in Robotic Manipulation
  4. 2026VLAff: Vision-Language-Affordance Model for Unified Actionable Affordances
  5. 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Models
  6. 2026Benchmarking Affordance Generalization with BusyBox
  7. 2025Bridging the Semantic-Action Gap in Visual Token Pruning for Efficient VLA Inference
  8. 2026V-Link: Recovering Lost Visual Representations in Action DiT for Vision-Language-Action Models