Cache-Aware Conv3D Lowering Across Embedded World-Model Decoders
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Generative world models can provide visual rollouts for embodied planning, yet their feasibility on edge devices depends not only on the learned model but also on how the execution runtime represents its operations. We introduce a cache-aware lowering that expresses supported causal Conv3D calls as batched spatial Conv2D operations while preserving pretrained weights, temporal-cache semantics, convolution parameters, bias placement, and output layout. Across the complete Cosmos3-Edge image-to-video pipeline on a 64-GB NVIDIA Jetson AGX Orin, the proposed route accelerates VAE decoding by approximately 7× and reduces complete-generation latency by more than 2×, while repeated decoder evaluations maintain complete fast-path coverage without fallbacks. The unchanged lowering also improves Cosmos3-Nano and transfers to LingBot-World's architecturally distinct Wan2.1 VAE. A clean-device comparison against fully specialized TensorRT shows that TensorRT provides a further 1.36× steady-state improvement, but requires substantially greater per-module and per-runtime-state AOT specialization. Same-latent BF16 and FP32 evaluations characterize the finite-precision differences introduced by the alternative execution order. Together, these results position cache-aware lowering as a lightweight runtime optimization that recovers most of the available decoder acceleration without modifying the learned models themselves.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 7 of its 18 references that are in the map. First posted on arXiv 25 Sep 2026.
Builds on
7 of 18 references.
Closest ancestors · 3
Same direction, newest first
- 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun
- 2026Advancing Open-source World Models28 Jan
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
Other references · 4
- 2018World Modelscited by 1,444
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2026vLLM-Omni: Fully Disaggregated Serving for Any-to-Any Multimodal Modelscited by 15
- 2025Edge Computing and its Application in Robotics: A Surveycited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026OVGGT: O(1) Constant-Cost Streaming Visual Geometry Transformer
- 2026MoWorld: A Flash World Model
- 2026Flex-π: A Multi-Stream World-Action Model with Compute Flexibility
- 2025Toward Lightweight and Fast Decoders for Diffusion Models in Image and Video Generation
- 2025SSD: Spatial-Semantic Head Decoupling for Efficient Autoregressive Image Generation
- 2026vidax: A Unified JAX Framework for Video Generative Models on Accelerator Meshes
- 2025LightCache: Memory-Efficient, Training-Free Acceleration for Video Generation
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory