OrbitForge: Text-to-3D Scene Generation via Reconstruction-Anchored Video Synthesis
Not on the map. Why?
Abstract (arXiv)
Generic text-to-video models can be used as rich open-world scene priors. Despite the high quality of today's generated videos, they do not directly yield reliable 3D assets: camera motion is difficult to control, view coverage is partial, and frames often contain inconsistencies across time. We introduce OrbitForge, an adapter built from frozen video priors and per-prompt Gaussian Splatting reconstruction optimization that converts a single text-generated video into a canonical closed-orbit 3D Gaussian Splatting scene. We use 3D reconstruction as an anchor to improve the 3D consistency of the generated video. We obtain a preliminary 3D reconstruction from a first generated video via Deformable Gaussian Splatting with a robust MedianGS proxy. We render views from a prescribed orbit to detect missing viewpoints. OrbitForge uses the text-to-video model to complete only the missing views, and reconstructs the completed orbit into a final Gaussian Splatting scene. This design requires no task-specific video or multiview fine-tuning, avoids per-prompt score-distillation optimization, and does not progressively generate views one step at a time. We further argue that this setting demands coverage-aware evaluation: local smoothness alone rewards methods that never attempt a full orbit. On a frozen 300-prompt T3Bench-derived audit, OrbitForge reconstruction attains a 359.0-degree measured median span, raises originally unsupported-bin Q10 ImageReward from 8.07 to 16.36 relative to MedianGS-only reconstruction, while remaining competitive with VideoMV on the coverage-quality.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 21 references that are in the map. First posted on arXiv 23 Jun 2026.
Builds on
19 of 21 references.
References · 19
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 143
7 more
- 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 89
- 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Modelscited by 58
- 2023T3Bench: Benchmarking Current Progress in Text-to-3D Generationcited by 57
- 2024VideoMV: Consistent Multi-View Generation Based on Large Video Generative Modelcited by 45
- 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priorscited by 19
- 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Priorcited by 10
- 2025Text-to-3D Generation using Jensen-Shannon Score Distillationcited by 2
Built on by
Not cited yet.