mlsanityData to 7 Oct 2026

Wiring Matters: Injection Topology and Initialization of Affordance Heads in Vision-Language-Action Policies

arXiv 2610.06318 ↗First posted 5 Oct 2026cs.CV cs.AIcited by 0

New in Vision-language-action models; no direction yet. Vision-language-action models

Abstract (arXiv)

Dense affordance supervision is an appealing auxiliary signal for vision-language-action (VLA) policies, yet naively co-training an affordance head can severely damage instruction following. We present a controlled study of how to wire such a head into a modern VLA on the LIBERO benchmark. Our recipe reads the backbone through a stop-gradient and re-injects an intermediate head feature into the action expert via a learned bridge. The stop-gradient is a precondition: letting affordance gradients reach the backbone drops the policy below the headless base (85.5% vs. 93.1%). With the backbone protected, a same-budget 2*2 ablation over injection topology (concatenation vs. residual) and bridge initialization (zero vs. random) shows initialization is the dominant lever. The best wiring, an actively initialized residual bridge, reaches 96.2%, matching the far more elaborate three-expert AffordanceVLA (95.8%) with under 1% extra parameters. Two probes explain the mechanism: ground-truth affordances fed as an input hurt, and inference-time zeroing shows a lazy bridge acts only as a training-time regularizer while an active bridge becomes load-bearing.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). First posted on arXiv 5 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AffordVLA: Injecting Affordance Representations into Vision-Language-Action Models via Implicit Feature Alignment
  2. 2026Benchmarking Affordance Generalization with BusyBox
  3. 2026Afford-VLA: Action-Aligned Visual Planning via Internalized Affordance
  4. 2026AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordance-Aware Understanding
  5. 2025Affordance Field Intervention: Enabling VLAs to Escape Memory Traps in Robotic Manipulation
  6. 2026The Layer Mystery of VLA: An Information-Theoretical Analysis of VLA Latent Interface
  7. 2024CoA-VLA: Improving Vision-Language-Action Models via Visual-Textual Chain-of-Affordance
  8. 2026Part Grounding, Not Action Knowledge: Locating the Bottleneck in VLM Affordance Prediction