mlsanityData to 14 Oct 2026

BridgeWAM: Bridging Video and Action Experts via Latent Bridge Queries

arXiv 2610.14746 ↗First posted 10 Oct 2026cs.RO cs.CVcited by 0

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World Action Models (WAMs) commonly couple video and action experts through dense, layer-wise Mixture-of-Transformers (MoT) attention, exposing action prediction to irrelevant visual features while enforcing matched expert depths. This coupling hinders selective visual-feature use and introduces redundant computation. We introduce Bridge-of-Experts (BoE), instantiated as BridgeWAM, which aggregates visual, language, and proprioceptive priors through 32 Latent Bridge Queries (LBQs) into a shared, limited latent space. Joint video-action supervision lets action gradients guide the Video Expert toward representations better suited for action prediction, while the Action Expert learns to selectively retrieve task-relevant information through cross-attention. Decoupling expert depths and reusing LBQs during action denoising yield a 5.06B model with a 30-layer Video Expert and a two-layer Action Expert, achieving 98.25% success on LIBERO and 72.24% pooled success on LIBERO-Plus, demonstrating effective task execution and strong generalization with an ultralight action head. Ablations support joint representation adaptation and unified LBQ conditioning. Relative to Fast-WAM, BridgeWAM reduces single-sample inference FLOPs by 28.72% in simulation profiling and real-robot latency to 77.1 ms (a 2.47-fold speedup). Qualitative experimental results further indicate preferential attention to target objects and task destinations across perturbations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 27 of its 29 references that are in the map. First posted on arXiv 10 Oct 2026.

Builds on

27 of 29 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining7 Sep
  2. 2026Faster-WAM: Efficient Inference-Time Future Conditioning for Robust World Action Models5 Aug
  3. 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing8 Jun
  4. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  5. 2026World Action Models are Zero-shot Policies17 Feb
  6. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos6 Feb
  7. 2026Causal World Modeling for Robot Control29 Jan
  8. 2025Motus: A Unified Latent Action World Model15 Dec
  9. 2025WorldVLA: Towards Autoregressive Action World Model26 Jun

Other references · 18

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  5. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  6. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  8. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  9. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  10. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  11. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
  12. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
6 more
  1. 2025Transfer between Modalities with MetaQueriescited by 236
  2. 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 179
  3. 2026Native Video-Action Pretraining for Generalizable Robot Controlcited by 36
  4. 2026Video Generation Models are General-Purpose Vision Learnerscited by 14
  5. 2026DTP: A Simple yet Effective Distracting Token Pruning Framework for Vision-Language Action Modelscited by 8
  6. 2026Artificial Foveated Perception for Mitigating Shortcut Learning in Robotic Foundation Modelscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Chain of World: World Model Thinking in Latent Motion
  2. 2026Olaf-World: Orienting Latent Actions for Video World Modeling
  3. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  4. 2026Native Action-Prior Learning from Videos for World Action Models
  5. 2026LARY: A Latent Action Representation Yielding Benchmark for Generalizable Vision-to-Action Alignment
  6. 2026The Right Future for Action: Learning Action-Relevant Predictive States in World Action Models
  7. 2026VideoNet: A Large-Scale Dataset for Domain-Specific Action Recognition
  8. 2026MT-WAM: Reorienting the One-Pass Predictive Representation Toward Action Generation