mlsanityData to 14 Oct 2026

TERRA: Task-Embedded Reasoning and Representation Architecture for Cross-Domain Applications

arXiv 2606.01520 ↗First posted 1 Jun 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

A single action-conditioned latent predictive architecture can in principle be trained on the structured state of a driving scene, a robot workspace, or a financial order book. The ingredients for doing so within any one domain already exist and are individually validated: masked-latent prediction, action-conditioned latent world models, discrete action tokenization, and joint-embedding prediction on voxelized state. What is not established, and what TERRA addresses, is the transfer question: when does a representation or predictor learned in one structured-state domain carry over to a structurally analogous but otherwise unrelated domain, and by how much. We give this question a formal treatment. We model each domain as a controlled Markov process on a graded latent grid, factor any instantiation into thin domain adapters and a shared domain-invariant core, and identify a cross-domain correspondence with an approximate Markov decision process homomorphism whose quality is measured by a lax bisimulation discrepancy and, for domains lacking a shared coordinate system, by a Gromov-Wasserstein distance between their action-conditioned transition operators. Under a Lipschitz predictor we derive a transfer bound that separates source-model error from structural mismatch, grows geometrically in the prediction horizon, and is certified from below by the Gromov-Wasserstein distance; we then connect latent error to decision regret through the Lipschitz value property of bisimulation metrics. The resulting Structured-State Transfer Hypothesis is stated as a falsifiable claim with a preregistered experimental program, centered on a transfer test from driving scenes to order books, including conditions under which it is refuted. We present no empirical results: this is a research proposal that converts a widely repeated intuition into testable theory.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 27 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

20 of 27 references.

References · 20

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  6. 2018World Modelscited by 1,513
  7. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  8. 2023Mastering Diverse Domains through World Modelscited by 1,253
  9. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
  10. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
  11. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  12. 2020Learning Invariant Representations for Reinforcement Learning without Reconstructioncited by 436
8 more
  1. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 386
  2. 2019DeepMDP: Learning Continuous Latent Space Models for Representation Learningcited by 207
  3. 2023GeoMAE: Masked Geometric Target Prediction for Self-supervised Point Cloud Pre-Trainingcited by 38
  4. 2024Point-JEPA: A Joint Embedding Predictive Architecture for Self-Supervised Learning on Point Cloudcited by 30
  5. 2022Continuous MDP Homomorphisms and Homomorphic Policy Gradientcited by 27
  6. 20243D-JEPA: A Joint Embedding Predictive Architecture for 3D Self-Supervised Representation Learningcited by 14
  7. 2026Self-Supervised JEPA-based World Models for LiDAR Occupancy Completion and Forecastingcited by 5
  8. 2025A Generalized Bisimulation Metric of State Similarity between Markov Decision Processes: From Theoretical Propositions to Applicationscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards Predictive, Aligned, and Scalable Robot Learning
  2. 2026Back to Parsimonious Latents: Learning Task-Centric World Models from Visual Foundations
  3. 2026Reasoning Without Inference Cost: Latent Semantic Scaffolding for Robot VLA Policies
  4. 2026JEPA-x: Cross-Predictive Physics Grounding for Forecastable Latent Dynamics
  5. 2026InternVLA-A1.5: Unifying Understanding, Latent Foresight, and Action for Compositional Generalization
  6. 2026LeapBot-WA: World-Anchor Action Models via Predictive Latent Alignments
  7. 2026INTACT: Isomorphic Intent-to-Action Learning for Search-Free World Models
  8. 2026Subspace-Decomposed JEPAs: Disentangling Progression and Content in Latent World Models