mlsanityData to 14 Oct 2026

Qantara: Bridge-Flow Training for Multi-Paradigm JEPA Control

arXiv 2607.04978 ↗First posted 6 Jul 2026cs.LG cs.CV cs.ROcited by 4

On the map: World models → Latent predictive world models

Abstract (arXiv)

Joint-Embedding Predictive Architectures (JEPAs) underpin a growing family of latent world models for control from raw pixels. Published JEPA world models for pixel-based control (PLDM, DINO-WM, LeWM, V-JEPA-2-AC) each commit at training time to a single inference paradigm, trajectory optimisation in a learned dynamics model, so a checkpoint trained to plan cannot be read off as a policy without retraining. Deferring that choice to inference would let the constraints that bind at deployment, per-step latency and whether a goal observation can be supplied, pick the path. We present Qantara, an end-to-end JEPA of about 21M parameters whose joint training objective pairs a Brownian-bridge interpolant between consecutive clean latents on the state axis with noise-to-data flow matching on the action axis. One checkpoint serves three inference paradigms without retraining: latent planning, behaviour-cloning action sampling, and a video-inverse composition that predicts the next latent without action conditioning, then recovers the action bridging the two. Training samples the two noise levels along the edges of the (action-noise, state-noise) square, one edge per inference dispatch, so each path is trained where it is queried. Replacing that sampler with uniform sampling over the square at matched compute drops Push-T planning from 90.1 to 53.3 success rate (SR). On the LeWM control suite at a matched 10-epoch budget, Qantara averages 91.2 SR over the four environments and reaches 93.7 on OGBench-Cube, +7.7 over DINO-WM and +17.0 over LeWM, each measured against the stronger of that baseline's published score and our retrain of it. From the same weights the two goal-blind paths, which receive no goal image, reach 82.1-83.2 SR on Push-T and 70.8-72.8 on Cube at roughly 15-65x lower inference cost, and fall to near-noise on Reacher, whose released training corpus comes from a random policy.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 23 of its 44 references that are in the map. First posted on arXiv 6 Jul 2026.

Builds on

23 of 44 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels13 Mar
  2. 2026Causal-JEPA: Learning World Models through Object-Level Latent Masking11 Feb
  3. 2025What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?30 Dec
  4. 2025Value-guided action planning with JEPA world models28 Dec
  5. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning7 Nov

Other references · 18

  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  2. 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,061
  3. 2018DeepMind Control Suitecited by 956
  4. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  5. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  6. 2022Is Conditional Generative Modeling all you need for Decision-Making?cited by 516
  7. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 512
  8. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
  9. 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 254
  10. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 240
  11. 2024OGBench: Benchmarking Offline Goal-Conditioned RLcited by 238
  12. 2023I2SB: Image-to-Image Schr"odinger Bridgecited by 218
6 more
  1. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
  2. 2025Training Agents Inside of Scalable World Modelscited by 136
  3. 2025RynnVLA-002: A Unified Vision-Language-Action and World Modelcited by 74
  4. 2025Dual-Stream Diffusion for World-Model Augmented Vision-Language-Action Modelcited by 36
  5. 2025World Models for Learning Dexterous Hand-Object Interactions from Human Videoscited by 31
  6. 2025OSVI-WM: One-Shot Visual Imitation for Unseen Tasks using World-Model-Guided Trajectory Generationcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Hamiltonian JEPA: Action-Conditioned World Models with an Inherited Control State
  2. 2026JEPA-x: Cross-Predictive Physics Grounding for Forecastable Latent Dynamics
  3. 2026LeWAM: End-to-End World and Action Modeling with JEPAs
  4. 2026Toward Physically Grounded JEPA World Models for Goal-Conditioned Robotic Planning
  5. 2026LRC-JEPA: Disentangling Dynamics and Residual Context for Efficient World Models
  6. 2026Diagnosing JEPA World Models with Action-Conditioned Predictive Consistency
  7. 2026JEPA-TTT: Persistent Test-Time Training of Latent World Models for Planning under Dynamics Shifts
  8. 2026Temporal-Distance JEPA: Plan-Aware Representation Learning for Latent World Model Predictive Control