mlsanityData to 14 Oct 2026

From Feed-Forward to Flow: Unifying Reconstruction and Generation Is Easier Than You Think

arXiv 2609.32761 ↗First posted 26 Sep 2026cs.CVcited by 0

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Reconstruct where the images provide evidence, and generate where they do not: recent success of spatial world models such as Atlas (World Labs Team, 2026) highlights the value of unifying reconstruction and generation in one model. Yet the two have long lived in separate paradigms with distinctive failure modes: feed-forward reconstruction averages ambiguity into blur, while conditional generation invents plausible but scene-inconsistent detail. In this work, we present a unified flow-based formulation for reconstruction and generation, where a shared clean-target predictor performs direct reconstruction at its single-step endpoint and unfolds conditional generation through multi-step flow. A controlled toy study reveals the mechanism: with a single step, the predictor collapses to the conditional mean just like feed-forward methods, favoring consistency over diversity. With multi-step inference, the fidelity of generated details grows with context richness: closer observations reduce ambiguity and yield better-matched details. We further instantiate the formulation in appearance and geometry 3D tasks. JiT-LVSM improves perceptual and distributional quality in novel view synthesis, while JUSt3R retains competitive single-step geometry prediction with additional multi-step inference capabilities that reduces veil and flying-pixel artifacts, producing cleaner surface structure with greater test-time compute. Together, they show that reconstruction and generation can share both a formulation and a backbone, with their behavior governed by denoising configuration---making unification surprisingly simple.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 48 of its 60 references that are in the map. First posted on arXiv 26 Sep 2026.

Builds on

48 of 60 references.

Closest ancestors · 5

Same direction, newest first

  1. 2022Scalable Diffusion Models with Transformers19 Dec
  2. 2022Flow Matching for Generative Modeling6 Oct
  3. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  5. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 43

  1. 2020Denoising Diffusion Implicit Modelscited by 9,781
  2. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  3. 2023Consistency Modelscited by 1,822
  4. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
  5. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  6. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  7. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  8. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
  9. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  10. 2022Denoising Diffusion Restoration Modelscited by 963
  11. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
  12. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
31 more
  1. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
  2. 2017The Perception-Distortion Tradeoffcited by 587
  3. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
  4. 2025Mean Flows for One-step Generative Modelingcited by 561
  5. 2025Continuous 3D Perception Model with Persistent Statecited by 548
  6. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
  7. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
  8. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
  9. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
  10. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
  11. 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
  12. 2023RoMa: Robust Dense Feature Matchingcited by 302
  13. 2022Novel View Synthesis with Diffusion Modelscited by 300
  14. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 274
  15. 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
  16. 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
  17. 2019Rethinking Lossy Compression: The Rate-Distortion-Perception Tradeoffcited by 211
  18. 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
  19. 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 181
  20. 2026Generative Modeling via Driftingcited by 116
  21. 2025PixelDiT: Pixel Diffusion Transformers for Image Generationcited by 83
  22. 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Modelscited by 79
  23. 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 77
  24. 2026One-step Latent-free Image Generation with Pixel Mean Flowscited by 53
  25. 2021A Theory of the Distortion-Perception Tradeoff in Wasserstein Spacecited by 52
  26. 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 33
  27. 2023UpFusion: Novel View Diffusion from Unposed Sparse View Observationscited by 14
  28. 2026SceneTok: A Compressed, Diffusable Token Space for 3D Scenescited by 10
  29. 2026PointDiT: Pixel-Space Diffusion for Monocular Geometry Estimationcited by 7
  30. 2025UMAMI: Unifying Masked Autoregressive Models and Deterministic Rendering for View Synthesiscited by 4
  31. 2026RnG: A Unified Transformer for Complete 3D Modeling from Partial Observationscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Gen3R: 3D Scene Generation Meets Feed-Forward Reconstruction
  2. 2026WorldFlow3D: Flowing Through 3D Distributions for Unbounded World Generation
  3. 2026FlowObject: Flow Steering for Bridging Generative Priors and Reconstruction Fidelity
  4. 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space
  5. 2026World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible
  6. 2025FaithFusion: Harmonizing Reconstruction and Generation via Pixel-wise Information Gain
  7. 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior
  8. 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective