mlsanityData to 14 Oct 2026

OmniX: Any-view and Any-time 4D Reconstruction via Feed-forward Trajectory Fields

arXiv 2607.10840 ↗First posted 12 Jul 2026cs.CVcited by 4

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Previous feed-forward 4D reconstruction methods either predict per-frame static point clouds, ignoring foreground motion, or estimate point cloud trajectories while being limited to small camera motions. This restricts their ability to aggregate observations over time and reconstruct complete dynamic scenes under large viewpoint changes. To address this limitation, we propose OmniX, a feed-forward 4D reconstruction framework that predicts dense 3D point trajectories for every pixel from videos with large camera motion. OmniX decouples dynamic motion modeling from static geometry prediction and represents motion using a compact set of dynamic tokens. By leveraging the sparse and low-rank structure of 3D motion, these tokens generate trajectory fields for all pixels across all images while efficiently preserving global interactions. To facilitate training, we further build an automatic UE5-based 4D data engine and introduce a large-scale dataset containing 80K scenes and 1.28M multi-view videos with full geometric annotations. OmniX achieves state-of-the-art performance on dense 3D point trajectory prediction and 3D point tracking, while also demonstrating competitive results on video depth estimation and camera pose estimation.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 42 of its 51 references that are in the map. First posted on arXiv 12 Jul 2026.

Builds on

42 of 51 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds15 Apr
  2. 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modeling15 Sep
  3. 2022Scalable Diffusion Models with Transformers19 Dec

Other references · 39

  1. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  2. 2021Vision Transformers for Dense Predictioncited by 1,803
  3. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  4. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  5. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  6. 2025Continuous 3D Perception Model with Persistent Statecited by 548
  7. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
  8. 2023CoTracker: It is Better to Track Togethercited by 522
  9. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
  10. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
  11. 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 327
  12. 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 325
27 more
  1. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
  2. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 314
  3. 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 276
  4. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
  5. 2023Tracking Everything Everywhere All at Oncecited by 193
  6. 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 181
  7. 2016Panoptic Studio: A Massively Multiview System for Social Interaction Capturecited by 173
  8. 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
  9. 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 167
  10. 2025Streaming 4D Visual Geometry Transformercited by 161
  11. 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 148
  12. 2025VGGT-Long: Chunk it, Loop it, Align it -- Pushing VGGT's Limits on Kilometer-scale Long RGB Sequencescited by 115
  13. 2024Stereo4D: Learning How Things Move in 3D from Internet Stereo Videoscited by 89
  14. 2025St4RTrack: Simultaneous 4D Reconstruction and Tracking in the Worldcited by 89
  15. 2024TAPVid-3D: A Benchmark for Tracking Any Point in 3Dcited by 72
  16. 2025TAPIP3D: Tracking Any Point in Persistent 3D Geometrycited by 69
  17. 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Promptingcited by 67
  18. 2024DELTA: Dense Efficient Long-range 3D Tracking for any videocited by 65
  19. 2025Efficiently Reconstructing Dynamic Scenes One D4RT at a Timecited by 54
  20. 2025Dynamic Point Maps: A Versatile Representation for Dynamic 3D Reconstructioncited by 44
  21. 2025Any4D: Unified Feed-Forward Metric 4D Reconstructioncited by 35
  22. 2026V-DPM: 4D Video Reconstruction with Dynamic Point Mapscited by 34
  23. 2025Trace Anything: Representing Any Video in 4D via Trajectory Fieldscited by 33
  24. 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstructioncited by 28
  25. 20264RC: 4D Reconstruction via Conditional Querying Anytime and Anywherecited by 22
  26. 2026Track4World: Feedforward World-centric Dense 3D Tracking of All Pixelscited by 13
  27. 2025DELTAv2: Accelerating Dense 3D Trackingcited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025OmniView: An All-Seeing Diffusion Model for 3D and 4D View Synthesis
  2. 20254DNeX: Feed-Forward 4D Generative Modeling Made Easy
  3. 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction
  4. 2026Mesh4D: 4D Mesh Reconstruction and Tracking from Monocular Video
  5. 2026FreeOrbit4D: Training-Free Arbitrary Camera Redirection for Monocular Videos via Foreground-Complete 4D Reconstruction
  6. 2026MotionCrafter: Dense Geometry and Motion Reconstruction with a 4D VAE
  7. 2026Lift4D: Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild
  8. 2026One Video, One World: Turning Monocular Video into Physical 4D Scenes