mlsanityData to 7 Oct 2026

Exact equivariance, kept through training, buys zero-shot generalisation across the symmetry group

arXiv 2606.03003 ↗First posted 2 Jun 2026cs.LG cs.AI cs.ROcited by 0

On the map: World models → Latent predictive world models

Abstract (arXiv)

A latent world model built from an equivariant encoder and predictor inherits a provable symmetry of its training loss: when the dynamics carries a group G acting on latents by an orthogonal representation ρ(g), the one-step prediction relMSE is exactly invariant across the whole group, so fitting a restricted slice of orientations mathematically determines it on the entire orbit. The symmetry survives a real Muon/AdamW+EMA+VICReg run -- composed residual ~ 10-6 after training, under any optimiser (intrinsic Vector-Neuron/e3nn parametrisation) -- and one-step error is flat across the group (5-seed medians: equivariant × 1.00 vs a higher-capacity non-equivariant baseline × 12.7 in 2D, × 17.2 in 3D), while that baseline fits the slice but breaks out-of-distribution. The flatness is not a synthetic artefact: on real-robot DROID end-effector trajectories the equivariant model stays flat across the orbit (× 1.000, rotation residual 1.5× 10-16) while a 4.5×-larger baseline degrades × 11. One caution is load-bearing: flatness is necessary, not sufficient -- the theorem transports the in-distribution error level unchanged but does not lower it (3D relMSE ≈ 0.43): across-group error is constant, not low. The same isometry lifts to a closed-loop corollary: under a matching equivariant planner the control error is invariant across the group -- float-floor-exact in 2D/SO(2), statistically flat in 3D/SE(3). Stress-tested against Sutton's Bitter Lesson (augmentation, scale, soft-equivariance), each closes at most the across-group task metric, never the float-floor exactness. This is the generalisation-side foundation of a certified-world-models programme (arXiv:2606.13092, 2606.24945, 2606.24946): flatness transports competence, and the trust bounds built on it are downstream products.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. First posted on arXiv 2 Jun 2026.

Builds on

0 of 0 references.

No references here yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Training Dynamics of Learning 3D-Rotational Equivariance
  2. 2025Improving Equivariant Networks with Probabilistic Symmetry Breaking
  3. 2022Learning Symmetric Embeddings for Equivariant World Models
  4. 2026Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routers
  5. 2025SE(3)-Equivariant Robot Learning and Control: A Tutorial Survey
  6. 2026Geometric Priors for Generalizable World Models via Vector Symbolic Architecture
  7. 2026Neural Quadratic Forms: A Unified Minimal Model for Sudden Learning and Scaling Laws
  8. 2025Symmetry-Aware Steering of Equivariant Diffusion Policies: Benefits and Limits