INTACT: Isomorphic Intent-to-Action Learning for Search-Free World Models
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Forward latent world models predict how actions change a scene, but recover actions for a desired change only through expensive test-time search. We introduce INTACT (INtent-To-ACTion), an end-to-end JEPA that turns action-labeled, reward-free trajectories into a deployable intent-to-action interface. Each transition supplies physical intent zt+1-zt, while a future goal supplies deployment intent operatornamesg(zg)-zt. The architecture is isomorphic between the local and goal motion-intent backbone-input graphs through an identical four-slot grammar and shared parameters, and between supported local and goal motion-intent families through action-law semantics induced by the same predictor rather than pointwise latent equality. INTACT also provides intact transfer from RGB evidence to action-effective latent intent coordinates and from intent families to their corresponding action-law families. Asymmetric endpoint gradients ground physical successors and fix future goals as anchors, joining representation learning and control without pointwise latent matching or globally linear dynamics. The resulting coordinates support a robust distributional action law: its conditional mean serves directly as a search-free policy, while sampling remains available for diversity or optional verification. On the four official LeWM tasks, one-epoch, zero-search models reach 85.78%, 100.00%, 97.67%, and 97.89% success. Optional local CEM centered on the Direct plan reaches 96.86% macro success using 384 instead of 9,000 candidate sequences, reducing sampling by 23.44× while improving pure CEM by 16.00 points. One shared four-task encoder reaches 89.39% E5 Direct macro and improves every task over jointly trained LeWM, while predicted--expert action-family kNN tracks Direct success at r=0.954. Direct inference takes 2.9--5.5 ms.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 16 of its 39 references that are in the map. First posted on arXiv 28 Jul 2026.
Builds on
16 of 39 references.
Closest ancestors · 3
Same direction, newest first
- 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
- 2016Learning to Poke by Poking: Experiential Learning of Intuitive Physics23 Jun
Other references · 13
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 512
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 386
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 273
- 2020Planning from Pixels using Inverse Dynamics Modelscited by 36
- 2026Causal-JEPA: Learning World Models through Object-Level Latent Maskingcited by 29
- 2026Sensorimotor World Models: Perception for Action via Inverse Dynamicscited by 20
- 2026Latent Geometry Beyond Search: Amortizing Planning in World Modelscited by 15
- 2026What Makes Video World Model Latents Action-Relevant: Prediction over Reconstructioncited by 9
- 2026PRISM: PRior-guided Imagination Sampling in world Modelscited by 8
- 2026QuoVLA: Quotient Space for Vision-Language-Action Modelscited by 2
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026VIScore: Diagnosing Planning-Relevant Quality in Latent World Modelscited by 2
- 2026Representation World Model: Learning States, Transition and Executable Plans in Representationcited by 0
- 2026AD-WM: Action-Discriminative World Models for Counterfactual Model Predictive Controlcited by 0
- 2026FlexiWorld: Learning and Planning via Flexible Action Chunks Across Multiple Time Scalescited by 0
- 2026Control-Geometry Straightening for Sampling-Based Latent Planningcited by 0
- 2026Beyond a single latent space: a dual-latent world model for long-horizon planningcited by 0
- 2026Social-WM: Safety-Aware Latent World Models for Robot Social Navigationcited by 0
- 2026Action-Consequence Alignment for Reliable Planning and Self-Improving in Latent World Modelscited by 0
- 2026Action-Consequence Alignment for Reliable Planning and Self-Improving in Latent World Models3 Oct 2026
- 2026Social-WM: Safety-Aware Latent World Models for Robot Social Navigation30 Sep 2026
- 2026Beyond a single latent space: a dual-latent world model for long-horizon planning29 Sep 2026
- 2026Control-Geometry Straightening for Sampling-Based Latent Planning28 Sep 2026
- 2026FlexiWorld: Learning and Planning via Flexible Action Chunks Across Multiple Time Scales28 Sep 2026
- 2026AD-WM: Action-Discriminative World Models for Counterfactual Model Predictive Control24 Sep 2026
- 2026Representation World Model: Learning States, Transition and Executable Plans in Representation24 Sep 2026
- 2026VIScore: Diagnosing Planning-Relevant Quality in Latent World Models11 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Mimic Intent, Not Just Trajectories
- 2026AIM: Intent-Aware Unified world action Modeling with Spatial Value Maps
- 2026ARC-Bench: Closed-Loop Replanning Masks Broken Action Ranking in Frozen JEPA World Models
- 2026PAVE: Predictive Alignment and Value-Guided Evolution for World-Action Policies
- 2026ω-EVA: Envision, Verify, and Act with Latent Interactive World Models
- 2026Delta-JEPA: Learning Action-Sensitive World Models via Latent Difference Decoding
- 2026Act with Intent: Distilling Behavior Intent for Vision-Language-Action Models
- 2026Decoupling Intention from Trajectory: A Representational Deduction Framework for World Action Models