Q-WAM: 4-Bit Quantization of World Action Models with Action-Subspace Protection
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World Action Models (WAMs) jointly generate video and robot actions through iterative diffusion and perform strongly in robotic manipulation. However, their prohibitive compute and memory costs pose substantial deployment challenges. Post-training quantization (PTQ) can reduce these costs, but existing PTQ methods such as smoothing and rotation are insufficient to maintain the precision of action generation. To overcome this limitation, we propose Q-WAM, a new 4-bit weight-activation quantization for WAMs that preserves the actions the model generates. Specifically, we introduce the textitAction Observability Gramian (AOG), which measures how much rounding errors in each weighted combination of a layer's input channels change the final action through all denoising steps. We also develop Action-Subspace Protection (ASP), which keeps the few most action-sensitive channel combinations in a tiny 16-bit low-rank branch and quantizes the complementary weights and activations to 4 bits, both as dense matrix multiplications that run efficiently on GPUs. Finally, to preserve action quality with minimal overhead, we identify the experts that matter most for the generated action by aggregating the AOG-derived action mass across the layers of each expert and apply ASP only to those experts. We evaluate Q-WAM on three WAMs, both in simulation and in real-world deployment. On the RoboTwin 2.0 benchmark, it reaches 89.6--93.0% average success rate, within 1.1 percentage points of the 16-bit models, while reducing the memory of the quantized blocks by 3.1--3.4×. Our method outperforms the strongest baseline, SVDQuant, by 2.5--8.7 percentage points. On a Unitree G1 humanoid and a bimanual UR3 robot, it improves success over SVDQuant by 12.8-17.6 percentage points.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 28 of its 41 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
28 of 41 references.
Closest ancestors · 11
Same direction, newest first
- 2026DIDO: Distilling Interaction-Centric Dynamics into One-Step Denoising for World Action Models14 Sep
- 2026Faster-WAM: Do World Action Models Need Deep Action Modules?3 Aug
- 2026QuantWAMs: Calibrating at the Right Granularity for World Action Models30 Jul
- 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?17 Jun
- 2026Flash-WAM: Modality-Aware Distillation for World Action Models3 Jun
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
Other references · 17
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,919
- 2022SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Modelscited by 1,386
- 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,298
- 2024QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMscited by 634
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2021BRECQ: Pushing the Limit of Post-Training Quantization by Block Reconstructioncited by 479
- 2024SpinQuant: LLM quantization with learned rotationscited by 471
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
- 2023Q-Diffusion: Quantizing Diffusion Modelscited by 273
- 2024SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Modelscited by 170
- 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 163
5 more
- 2024ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generationcited by 115
- 2024PTQ4DiT: Post-training Quantization for Diffusion Transformerscited by 79
- 2026QuantVLA: Scale-Calibrated Post-Training Quantization for Vision-Language-Action Modelscited by 30
- 2026QVLA: Not All Channels Are Equal in Vision-Language-Action Model's Quantizationcited by 28
- 2026ActQuant: Sub-4-bit Action-Guided Quantization for Vision-Language-Action Modelscited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SteerQuant: Steering Quantization Error with Action-Guided Scaling in World-Action Models
- 2026C3ache: Accelerating World Action Models with Cross Inference Chunk Cache
- 20261Step-WAM: Your World Action Model but Faster using 1-Step Action Generation
- 2026FoldQuantVLA: Native Low-Bit Quantization of Vision-Language-Action Models via Consistent Folding
- 2026HBVLA: Pushing 1-Bit Post-Training Quantization for Vision-Language-Action Models
- 2026WAM-Cache: Staleness-Bounded KV Reuse for Efficient World Action Models
- 2026Sparse-WAM: Accelerating World Action Models via Action-Guided Sparse Imagination
- 2026Rolling-WAM: World Action Models with Rolling Imagination