mlsanityData to 7 Oct 2026

World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible

arXiv 2606.13652 ↗First posted 11 Jun 2026cs.CV cs.GRcited by 3

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Image-to-3D methods often trade off faithfulness and completeness: depth estimators are anchored to input pixels but stop at the visible surface, while image-to-3D models generate complete shapes that are often misaligned with the input. We introduce World Tracing, a generative pixel-aligned geometry representation that predicts 3D points aligned with observed pixels while completing geometry beyond the visible surface. For each input pixel, World Tracing predicts an ordered stack of camera-space 3D points, where the first layer represents the visible surface and subsequent layers represent front-to-back intersections with occluded surfaces. We instantiate this representation with a world-tracing diffusion transformer, WT-DiT, which treats multiple geometry layers as separate denoising tokens coupled through factorized and global attention. WT-DiT is trained with pixel-space flow matching and a mixed noise schedule that balances visible-surface reconstruction with occluded-geometry generation. World Tracing achieves strong performance on visible-surface reconstruction and complete geometry generation across object, scene, and dynamic benchmarks, outperforming both depth predictors and image-to-3D generators. It also preserves 2D-to-3D correspondence, enabling text-driven 3D scene editing, geometry-conditioned novel-view video synthesis, and training-free integration with textured-mesh generators.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 78 of its 92 references that are in the map. First posted on arXiv 11 Jun 2026.

Builds on

78 of 92 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025Gaussian Variation Field Diffusion for High-fidelity Video-to-4D Synthesis31 Jul
  2. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Models7 Mar
  3. 2024Wonderland: Navigating 3D Scenes from a Single Image16 Dec
  4. 2024X-Ray: A Sequential 3D Representation For Generation22 Apr
  5. 2024StructLDM: Structured Latent Diffusion for 3D Human Generation1 Apr
  6. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Image18 Mar
  7. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation4 Dec
  8. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion14 Nov
  9. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model23 Oct
  10. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct
  11. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image7 Sep
  12. 2023LDM3D: Latent Diffusion Model for 3D18 May
3 more
  1. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  2. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  3. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 63

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2022Flow Matching for Generative Modelingcited by 5,426
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  5. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  6. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  7. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  8. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  9. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  10. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  11. 2024Depth Anything V2cited by 1,385
  12. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
38 more
  1. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  2. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  3. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  4. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
  5. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  6. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  7. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  8. 2021Going deeper with Image Transformerscited by 759
  9. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  10. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
  11. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  12. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
  13. 2018Taskonomy: Disentangling Task Transfer Learningcited by 631
  14. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  15. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
  16. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
  17. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  18. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
  19. 2025VACE: All-in-One Video Creation and Editingcited by 467
  20. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
  21. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
  22. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  23. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
  24. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
  25. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 306
  26. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
  27. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
  28. 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
  29. 2025SAM 3D: 3Dfy Anything in Imagescited by 230
  30. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
  31. 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
  32. 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 195
  33. 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 163
  34. 2025Native and Compact Structured Latents for 3D Generationcited by 157
  35. 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 124
  36. 2021Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Biascited by 115
  37. 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 115
  38. 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstructioncited by 84

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior
  2. 2026WorldFlow3D: Flowing Through 3D Distributions for Unbounded World Generation
  3. 2026PixWorld: Unifying 3D Scene Generation and Reconstruction in Pixel Space
  4. 2026World Reconstruction From Inconsistent Views
  5. 2025WorldWarp: Propagating 3D Geometry with Asynchronous Video Diffusion
  6. 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modeling
  7. 2026GTA: Advancing Image-to-3D World Generation via Geometry Then Appearance Video Diffusion
  8. 2026From Feed-Forward to Flow: Unifying Reconstruction and Generation Is Easier Than You Think