OmniX: Any-view and Any-time 4D Reconstruction via Feed-forward Trajectory Fields
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Previous feed-forward 4D reconstruction methods either predict per-frame static point clouds, ignoring foreground motion, or estimate point cloud trajectories while being limited to small camera motions. This restricts their ability to aggregate observations over time and reconstruct complete dynamic scenes under large viewpoint changes. To address this limitation, we propose OmniX, a feed-forward 4D reconstruction framework that predicts dense 3D point trajectories for every pixel from videos with large camera motion. OmniX decouples dynamic motion modeling from static geometry prediction and represents motion using a compact set of dynamic tokens. By leveraging the sparse and low-rank structure of 3D motion, these tokens generate trajectory fields for all pixels across all images while efficiently preserving global interactions. To facilitate training, we further build an automatic UE5-based 4D data engine and introduce a large-scale dataset containing 80K scenes and 1.28M multi-view videos with full geometric annotations. OmniX achieves state-of-the-art performance on dense 3D point trajectory prediction and 3D point tracking, while also demonstrating competitive results on video depth estimation and camera pose estimation.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 42 of its 51 references that are in the map. First posted on arXiv 12 Jul 2026.
Builds on
42 of 51 references.
Closest ancestors · 3
Same direction, newest first
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds15 Apr
- 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modeling15 Sep
- 2022Scalable Diffusion Models with Transformers19 Dec
Other references · 39
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 327
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 325
27 more
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 314
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 276
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
- 2023Tracking Everything Everywhere All at Oncecited by 193
- 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 181
- 2016Panoptic Studio: A Massively Multiview System for Social Interaction Capturecited by 173
- 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
- 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 167
- 2025Streaming 4D Visual Geometry Transformercited by 161
- 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 148
- 2025VGGT-Long: Chunk it, Loop it, Align it -- Pushing VGGT's Limits on Kilometer-scale Long RGB Sequencescited by 115
- 2024Stereo4D: Learning How Things Move in 3D from Internet Stereo Videoscited by 89
- 2025St4RTrack: Simultaneous 4D Reconstruction and Tracking in the Worldcited by 89
- 2024TAPVid-3D: A Benchmark for Tracking Any Point in 3Dcited by 72
- 2025TAPIP3D: Tracking Any Point in Persistent 3D Geometrycited by 69
- 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Promptingcited by 67
- 2024DELTA: Dense Efficient Long-range 3D Tracking for any videocited by 65
- 2025Efficiently Reconstructing Dynamic Scenes One D4RT at a Timecited by 54
- 2025Dynamic Point Maps: A Versatile Representation for Dynamic 3D Reconstructioncited by 44
- 2025Any4D: Unified Feed-Forward Metric 4D Reconstructioncited by 35
- 2026V-DPM: 4D Video Reconstruction with Dynamic Point Mapscited by 34
- 2025Trace Anything: Representing Any Video in 4D via Trajectory Fieldscited by 33
- 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstructioncited by 28
- 20264RC: 4D Reconstruction via Conditional Querying Anytime and Anywherecited by 22
- 2026Track4World: Feedforward World-centric Dense 3D Tracking of All Pixelscited by 13
- 2025DELTAv2: Accelerating Dense 3D Trackingcited by 10
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026WorldRover: A Scalable Synthetic Video Data Engine for World Exploration with Rich Annotationscited by 2
- 2026UniQuery4R: Unified 4D Scene Reconstruction from a Single Querycited by 1
- 2026TAPVid-MV: A Benchmark for Tracking Any Point in 3D Across Multiple Viewscited by 1
- 2026ARROW: Arbitrary Reconstruction and Tracking of 4D Observations in the Wildcited by 0
- 2026ARROW: Arbitrary Reconstruction and Tracking of 4D Observations in the Wild1 Oct 2026
- 2026TAPVid-MV: A Benchmark for Tracking Any Point in 3D Across Multiple Views1 Sep 2026
- 2026UniQuery4R: Unified 4D Scene Reconstruction from a Single Query18 Aug 2026
- 2026WorldRover: A Scalable Synthetic Video Data Engine for World Exploration with Rich Annotations16 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2025OmniView: An All-Seeing Diffusion Model for 3D and 4D View Synthesis
- 20254DNeX: Feed-Forward 4D Generative Modeling Made Easy
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction
- 2026Mesh4D: 4D Mesh Reconstruction and Tracking from Monocular Video
- 2026FreeOrbit4D: Training-Free Arbitrary Camera Redirection for Monocular Videos via Foreground-Complete 4D Reconstruction
- 2026MotionCrafter: Dense Geometry and Motion Reconstruction with a 4D VAE
- 2026Lift4D: Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenes