mlsanityData to 7 Oct 2026

EgoGenesis: Egocentric World-Action Modeling with Online Anchored Projective Memory and Action-3D RoPE

arXiv 2607.28243 ↗First posted 30 Jul 2026cs.CV cs.AIcited by 2

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Egocentric video offers rich manipulation experience for embodied AI, yet collecting diverse egocentric data across scenes, objects, motions, and embodiments remains costly. We present method, an egocentric world-action simulator that synthesizes controllable, high-quality manipulation videos to expand scarce real-world training data. method builds on a pretrained video generation prior and introduces two geometry-aware conditioning mechanisms. Online Anchored Projective Memory (OAPM) preserves a first-frame 3D scene anchor while periodically refreshing a recent state during autoregressive generation. Action-3D Rotary Position Embedding (A3D-RoPE) encodes end-effector motion with camera-aware 3D rotary coordinates, injecting action geometry into skeleton-to-video cross-attention for precise control. Together, these components improve visual fidelity, geometric stability, and action alignment in long egocentric rollouts. Moreover, augmenting 400 real trajectories with 400 method-generated trajectories improves out-of-distribution real-robot success from 77% to 84% on single-arm tasks and from 53% to 70% on dual-arm tasks, demonstrating that the synthesized data substantially improve downstream WAM generalization.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 17 of its 51 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

17 of 51 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026Masked Visual Actions for Unified World Modeling21 Jul
  2. 2026EgoWAM: World Action Models Beyond Pixels with In-the-Wild Egocentric Human Data8 Jul
  3. 2026RynnWorld-Teleop: An Action-Conditioned World Model for Digital Teleoperation7 Jul
  4. 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?17 Jun
  5. 2026Egocentric World Model for Photorealistic Hand-Object Interaction Synthesis13 Mar
  6. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb
  7. 2026Causal World Modeling for Robot Control29 Jan
  8. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation11 Oct

Other references · 9

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  3. 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
  4. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 137
  5. 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 117
  6. 2025Cameras as Relative Positional Encodingcited by 94
  7. 2024InterDyn: Controllable Interactive Dynamics with Video Diffusion Modelscited by 11
  8. 2026EgoSim: Egocentric World Simulator for Embodied Interaction Generationcited by 11
  9. 2026EgoInfinity: A Web-Scale 4D Hand-Object Interaction Data Engine for Any-View Robot Retargeting and Video-to-Action Robot Learningcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Ego2Act: Evaluating Goal-Directed Manipulation in Egocentric Video Generation
  2. 2025EgoDemoGen: Egocentric Demonstration Generation for Viewpoint Generalization in Robotic Manipulation
  3. 2025Developing Vision-Language-Action Model from Egocentric Videos
  4. 2026Walk through Paintings: Egocentric World Models from Internet Priors
  5. 2026AnyWorld: Factorized Egocentric World Models for Cross-Embodiment Generalization
  6. 2025EgoControl: Controllable Egocentric Video Generation via 3D Full-Body Poses
  7. 2026E3C: Video Generation with 3D Environmental Memory and Ego-Exo Human Pose Control
  8. 2026Open-AoE: An Open Egocentric Manipulation Dataset and Toolchain for Embodied Learning