Wiring Matters: Injection Topology and Initialization of Affordance Heads in Vision-Language-Action Policies
New in Vision-language-action models; no direction yet. Vision-language-action models
Abstract (arXiv)
Dense affordance supervision is an appealing auxiliary signal for vision-language-action (VLA) policies, yet naively co-training an affordance head can severely damage instruction following. We present a controlled study of how to wire such a head into a modern VLA on the LIBERO benchmark. Our recipe reads the backbone through a stop-gradient and re-injects an intermediate head feature into the action expert via a learned bridge. The stop-gradient is a precondition: letting affordance gradients reach the backbone drops the policy below the headless base (85.5% vs. 93.1%). With the backbone protected, a same-budget 2*2 ablation over injection topology (concatenation vs. residual) and bridge initialization (zero vs. random) shows initialization is the dominant lever. The best wiring, an actively initialized residual bridge, reaches 96.2%, matching the far more elaborate three-expert AffordanceVLA (95.8%) with under 1% extra parameters. Two probes explain the mechanism: ground-truth affordances fed as an input hurt, and inference-time zeroing shows a lazy bridge acts only as a training-time regularizer while an active bridge becomes load-bearing.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). First posted on arXiv 5 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AffordVLA: Injecting Affordance Representations into Vision-Language-Action Models via Implicit Feature Alignment
- 2026Benchmarking Affordance Generalization with BusyBox
- 2026Afford-VLA: Action-Aligned Visual Planning via Internalized Affordance
- 2026AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordance-Aware Understanding
- 2025Affordance Field Intervention: Enabling VLAs to Escape Memory Traps in Robotic Manipulation
- 2026The Layer Mystery of VLA: An Information-Theoretical Analysis of VLA Latent Interface
- 2024CoA-VLA: Improving Vision-Language-Action Models via Visual-Textual Chain-of-Affordance
- 2026Part Grounding, Not Action Knowledge: Locating the Bottleneck in VLM Affordance Prediction