From Feed-Forward to Flow: Unifying Reconstruction and Generation Is Easier Than You Think
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Reconstruct where the images provide evidence, and generate where they do not: recent success of spatial world models such as Atlas (World Labs Team, 2026) highlights the value of unifying reconstruction and generation in one model. Yet the two have long lived in separate paradigms with distinctive failure modes: feed-forward reconstruction averages ambiguity into blur, while conditional generation invents plausible but scene-inconsistent detail. In this work, we present a unified flow-based formulation for reconstruction and generation, where a shared clean-target predictor performs direct reconstruction at its single-step endpoint and unfolds conditional generation through multi-step flow. A controlled toy study reveals the mechanism: with a single step, the predictor collapses to the conditional mean just like feed-forward methods, favoring consistency over diversity. With multi-step inference, the fidelity of generated details grows with context richness: closer observations reduce ambiguity and yield better-matched details. We further instantiate the formulation in appearance and geometry 3D tasks. JiT-LVSM improves perceptual and distributional quality in novel view synthesis, while JUSt3R retains competitive single-step geometry prediction with additional multi-step inference capabilities that reduces veil and flying-pixel artifacts, producing cleaner surface structure with greater test-time compute. Together, they show that reconstruction and generation can share both a formulation and a backbone, with their behavior governed by denoising configuration---making unification surprisingly simple.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 48 of its 60 references that are in the map. First posted on arXiv 26 Sep 2026.
Builds on
48 of 60 references.
Closest ancestors · 5
Same direction, newest first
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022Flow Matching for Generative Modeling6 Oct
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 43
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2023Consistency Modelscited by 1,822
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2022Denoising Diffusion Restoration Modelscited by 963
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
31 more
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
- 2017The Perception-Distortion Tradeoffcited by 587
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
- 2025Mean Flows for One-step Generative Modelingcited by 561
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
- 2023RoMa: Robust Dense Feature Matchingcited by 302
- 2022Novel View Synthesis with Diffusion Modelscited by 300
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 274
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
- 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
- 2019Rethinking Lossy Compression: The Rate-Distortion-Perception Tradeoffcited by 211
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
- 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 181
- 2026Generative Modeling via Driftingcited by 116
- 2025PixelDiT: Pixel Diffusion Transformers for Image Generationcited by 83
- 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Modelscited by 79
- 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 77
- 2026One-step Latent-free Image Generation with Pixel Mean Flowscited by 53
- 2021A Theory of the Distortion-Perception Tradeoff in Wasserstein Spacecited by 52
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 33
- 2023UpFusion: Novel View Diffusion from Unposed Sparse View Observationscited by 14
- 2026SceneTok: A Compressed, Diffusable Token Space for 3D Scenescited by 10
- 2026PointDiT: Pixel-Space Diffusion for Monocular Geometry Estimationcited by 7
- 2025UMAMI: Unifying Masked Autoregressive Models and Deterministic Rendering for View Synthesiscited by 4
- 2026RnG: A Unified Transformer for Complete 3D Modeling from Partial Observationscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Gen3R: 3D Scene Generation Meets Feed-Forward Reconstruction
- 2026WorldFlow3D: Flowing Through 3D Distributions for Unbounded World Generation
- 2026FlowObject: Flow Steering for Bridging Generative Priors and Reconstruction Fidelity
- 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space
- 2026World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible
- 2025FaithFusion: Harmonizing Reconstruction and Generation via Pixel-wise Information Gain
- 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective