Planning in 8 Tokens: A Compact Discrete Tokenizer for Latent World Model
On the map: World models → Latent predictive world models
Abstract (arXiv)
World models provide a powerful framework for simulating environment dynamics conditioned on actions or instructions, enabling downstream tasks such as action planning or policy learning. Recent approaches leverage world models as learned simulators, but its application to decision-time planning remains computationally prohibitive for real-time control. A key bottleneck lies in latent representations: conventional tokenizers encode each observation into hundreds of tokens, making planning both slow and resource-intensive. To address this, we propose CompACT, a discrete tokenizer that compresses each observation into as few as 8 tokens, drastically reducing computational cost while preserving essential information for planning. An action-conditioned world model that occupies CompACT tokenizer achieves competitive planning performance with orders-of-magnitude faster planning, offering a practical step toward real-world deployment of world models.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 68 of its 81 references that are in the map. First posted on arXiv 5 Mar 2026.
Builds on
68 of 81 references.
Closest ancestors · 1
Same direction, newest first
Other references · 67
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2017Neural Discrete Representation Learningcited by 4,650
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
38 more
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2018World Modelscited by 1,444
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
- 2022MaskGIT: Masked Generative Image Transformercited by 1,082
- 2020Mastering Atari with Discrete World Modelscited by 990
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
- 2022Autoregressive Image Generation using Residual Quantizationcited by 706
- 2024Genie: Generative Interactive Environmentscited by 706
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 699
- 2021Vector-quantized Image Modeling with Improved VQGANcited by 656
- 2024Autoregressive Image Generation without Vector Quantizationcited by 644
- 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
- 2023Learning Interactive Real-World Simulatorscited by 440
- 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 425
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 337
- 2022Transformers are Sample-Efficient World Modelscited by 317
- 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 295
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
- 2024Diffusion Models Are Real-Time Game Enginescited by 282
- 2025Diffusion Transformers with Representation Autoencoderscited by 275
- 2019RoboNet: Large-Scale Multi-Robot Learningcited by 268
- 2024Navigation World Modelscited by 262
- 2023MDTv2: Masked Diffusion Transformer is a Strong Image Synthesizercited by 260
- 2022MAGE: MAsked Generative Encoder to Unify Representation Learning and Image Synthesiscited by 222
- 2023Video Language Planningcited by 160
- 2023Learning to Act from Actionless Videos through Dense Correspondencescited by 159
- 2024Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokenscited by 147
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026ACID: Action Consistency via Inverse Dynamics for Planning with World Modelscited by 4
- 2026WavCube: Unifying Speech Representation for Understanding and Generation via Semantic-Acoustic Joint Modelingcited by 3
- 2026UniNav: A Unified World-Action Diffusion Model for Visual Navigationcited by 2
- 2026Drift-Resistant Navigation World Model with Anchored Epipolar Guidancecited by 1
- 2026Structured State-Space Regularization for Generation-Friendly Image Tokenizationcited by 0
- 2026Learning What to Recall: Adaptive Multi-Cue Episodic Memory for World Modelscited by 0
- 2026Learning What to Recall: Adaptive Multi-Cue Episodic Memory for World Models28 Sep 2026
- 2026UniNav: A Unified World-Action Diffusion Model for Visual Navigation4 Aug 2026
- 2026ACID: Action Consistency via Inverse Dynamics for Planning with World Models2 Jul 2026
- 2026Drift-Resistant Navigation World Model with Anchored Epipolar Guidance23 May 2026
- 2026WavCube: Unifying Speech Representation for Understanding and Generation via Semantic-Acoustic Joint Modeling7 May 2026
- 2026Structured State-Space Regularization for Generation-Friendly Image Tokenization13 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Sparse Planning in Visual World Models via Cost Gradients
- 2026JEPA-TTT: Persistent Test-Time Training of Latent World Models for Planning under Dynamics Shifts
- 2026SAGE: Subgoal-Conditioned Action Generation for Latent World Model Planning
- 2026Beyond the Next Step: Variable-Length Latent World Models for Long-Horizon Planning
- 2026Discrete-WAM: Unified Discrete Vision-Action Token Editing for World-Policy Learning
- 2026ATM: Action-Consistency Transfer Matrix for Diagnosing and Improving Latent World Models
- 2025From Forecasting to Planning: Policy World Model for Collaborative State-Action Prediction
- 2026Beyond a single latent space: a dual-latent world model for long-horizon planning