CKT-WAM: Parameter-Efficient Context Knowledge Transfer Between World Action Models
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World action models (WAMs) provide a powerful generative framework for embodied control, yet transferring knowledge across heterogeneous WAMs remains challenging due to mismatched latent interfaces, high adaptation cost, and the rigidity of conventional distillation objectives. We propose CKT-WAM, a parameter-efficient Context Knowledge Transfer framework that transfers teacher WAM's knowledge into a student WAM through a compact context in the text embedding space, rather than output imitation or dense hidden-state matching. Specifically, CKT-WAM extracts intermediate teacher hidden states, reduces the number of tokens via compressors' learnable-query cross attention (LQCA), and transforms them through an always-on generalized adapter, a lightweight router, and sparsely activated specialized adapters. The resulting context is then appended to the student's conditioning textual embeddings, thereby injecting the transferred knowledge into the student with minimal architectural modification. Experiments show that CKT-WAM consistently improves zero-shot generalization and achieves the best overall performance on LIBERO-Plus, reaching 86.1% total success rate with only 1.17% trainable parameters, while approaching full fine-tuning performance. Beyond simulation, CKT-WAM also demonstrates strong real-world long-horizon manipulation ability, achieving the best average success rate of 83.3% across four multi-step and long-horizon tasks. Code is available at https://github.com/YuhuaJiang2002/CKT-WAM.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 27 of its 51 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
27 of 51 references.
Closest ancestors · 6
Same direction, newest first
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
Other references · 21
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2018World Modelscited by 1,444
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 278
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
9 more
- 2025Unified Video Action Modelcited by 195
- 2025Interactive Post-Training for Vision-Language-Action Modelscited by 129
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 129
- 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 119
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
- 2025Vidar: Embodied Video Diffusion Model for Generalist Manipulationcited by 58
- 2026HoloBrain-0 Technical Reportcited by 20
- 2025AsyncVLA: Asynchronous Flow Matching for Vision-Language-Action Modelscited by 16
- 2026VLANeXt: Recipes for Building Strong VLA Modelscited by 12
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026World Action Models: The Next Frontier in Embodied AI
- 2026World-Language-Action Model for Unified World Modeling, Language Reasoning, and Action Synthesis
- 2026OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining
- 2026WorldScape Policy 2.0: Empowering Steerable World Action Modeling with Reasoning-Augmented Memory and In-Context Learning
- 2026Enhancing Policy Learning with World-Action Model
- 2026RealtimeWAM: One-Step Asynchronous World Action Models
- 2026CWM: Contrastive World Models for Action Feasibility Learning in Embodied Agent Pipelines
- 2026HarnessWAM: Bridging Prediction and Deliberation in World Action Models