mlsanityData to 14 Oct 2026

FreeScale: Scaling 3D Scenes via Certainty-Aware Free-View Generation

arXiv 2604.10512 ↗First posted 12 Apr 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

The development of generalizable Novel View Synthesis (NVS) models is critically limited by the scarcity of large-scale training data featuring diverse and precise camera trajectories. While real-world captures are photorealistic, they are typically sparse and discrete. Conversely, synthetic data scales but suffers from a domain gap and often lacks realistic semantics. We introduce FreeScale, a novel framework that leverages the power of scene reconstruction to transform limited real-world image sequences into a scalable source of high-quality training data. Our key insight is that an imperfect reconstructed scene serves as a rich geometric proxy, but naively sampling from it amplifies artifacts. To this end, we propose a certainty-aware free-view sampling strategy identifying novel viewpoints that are both semantically meaningful and minimally affected by reconstruction errors. We demonstrate FreeScale's effectiveness by scaling up the training of feedforward NVS models, achieving a notable gain of 2.7 dB in PSNR on challenging out-of-distribution benchmarks. Furthermore, we show that the generated data can actively enhance per-scene 3D Gaussian Splatting optimization, leading to consistent improvements across multiple datasets. Our work provides a practical and powerful data generation engine to overcome a fundamental bottleneck in 3D vision. Project page: https://mvp-ai-lab.github.io/FreeScale.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 46 of its 53 references that are in the map. First posted on arXiv 12 Apr 2026.

Builds on

46 of 53 references.

References · 46

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  3. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  4. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  5. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  6. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
  7. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
  8. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
  9. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
  10. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  11. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
  12. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
34 more
  1. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
  2. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
  3. 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
  4. 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 302
  5. 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 286
  6. 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
  7. 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
  8. 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 243
  9. 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
  10. 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
  11. 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 165
  12. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
  13. 2024WildGaussians: 3D Gaussian Splatting in the Wildcited by 152
  14. 2023Compact 3D Scene Representation via Self-Organizing Gaussian Gridscited by 151
  15. 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 137
  16. 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 116
  17. 2024Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splatscited by 114
  18. 2024Pixel-GS: Density Control with Pixel-aware Gradient for 3D Gaussian Splattingcited by 113
  19. 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
  20. 2023Bayes' Rays: Uncertainty Quantification for Neural Radiance Fieldscited by 91
  21. 2024MVSGaussian: Fast Generalizable Gaussian Splatting Reconstruction from Multi-View Stereocited by 87
  22. 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 77
  23. 2023Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFscited by 76
  24. 2023FisherRF: Active View Selection and Uncertainty Quantification for Radiance Fields using Fisher Informationcited by 64
  25. 2023DBARF: Deep Bundle-Adjusting Generalizable Neural Radiance Fieldscited by 60
  26. 2024Wild-GS: Real-Time Novel View Synthesis from Unconstrained Photo Collectionscited by 56
  27. 2024GeoGaussian: Geometry-aware Gaussian Splatting for Scene Renderingcited by 52
  28. 2024DOGS: Distributed-Oriented Gaussian Splatting for Large-Scale 3D Reconstruction Via Gaussian Consensuscited by 51
  29. 2024LRM-Zero: Training Large Reconstruction Models with Synthesized Datacited by 35
  30. 2024Bilateral Guided Radiance Field Processingcited by 28
  31. 2024SAGS: Structure-Aware 3D Gaussian Splattingcited by 21
  32. 2024MegaSynth: Scaling Up 3D Scene Reconstruction with Synthesized Datacited by 21
  33. 2025Unifying Appearance Codes and Bilateral Grids for Driving Scene Gaussian Splattingcited by 15
  34. 2025Scaling Transformer-Based Novel View Synthesis Models with Token Disentanglement and Synthetic Datacited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.