3DCarGen: Scalable 3D Car Generation via 3D-consistent Multi-view Synthesis
Not on the map. Why?
Abstract (arXiv)
High-quality 3D vehicle assets are essential for autonomous driving simulation. Although multi-view diffusion-based paradigms enable controllable single-image reconstruction, they typically produce limited viewpoints and exhibit cross-view geometric inconsistencies, thereby reducing reconstruction fidelity in real-world scenarios. In this work, we introduce 3DCarGen, a scalable single-view 3D car generation framework designed for real-world images by synthesizing an arbitrary number of 3D-consistent multi-view images. Specifically, given a single image as input, we first synthesize a set of images from fixed viewpoints. These images are then fed into a feed-forward reconstruction model, resulting in a coarse 3D representation based on 3D Gaussian Splatting. Conditioned on this explicit 3D prior, our multi-view diffusion model generates 3D-consistent images from arbitrary camera viewpoints. We further extend a fast mesh reconstruction algorithm by incorporating color-normal joint optimization to recover detailed and coherent 3D vehicle models from the synthesized dense views. Extensive experiments on synthetic and real-world datasets demonstrate that our approach achieves robust geometric consistency and reconstruction fidelity compared to existing methods. Project page: https://honglixiao.github.io/3dcargen.github.io/.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 35 of its 40 references that are in the map. First posted on arXiv 23 Jun 2026.
Builds on
35 of 40 references.
References · 35
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
23 more
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
- 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 364
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 274
- 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
- 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 135
- 2023Free3D: Consistent Novel View Synthesis without 3D Representationcited by 72
- 2022Multi-View Mesh Reconstruction with Neural Deferred Shadingcited by 44
- 20243DRealCar: An In-the-wild RGB-D Car Dataset with 360-degree Viewscited by 39
- 2023CADSim: Robust and Scalable in-the-wild 3D Reconstruction for Controllable Sensor Simulationcited by 26
- 2023GINA-3D: Learning to Generate Implicit Neural Assets in the Wildcited by 25
- 20243D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generationcited by 19
- 2024DreamCar: Leveraging Car-specific Prior for in-the-wild 3D Car Reconstructioncited by 16
- 2024Drive-1-to-3: Enriching Diffusion Priors for Novel View Synthesis of Real Vehiclescited by 10
- 2024RGM: Reconstructing High-fidelity 3D Car Assets with Relightable 3D-GS Generative Model from a Single Imagecited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025WorldSplat: Gaussian-Centric Feed-Forward 4D Scene Generation for Autonomous Driving
- 2025DriveGen3D: Boosting Feed-Forward Driving Scene Generation with Efficient Video Diffusion
- 2026HiFiVe: High-Fidelity Vehicle Generation Leveraging Auto-Regressive 2D Generative Priors
- 2024MagicDrive3D: Controllable 3D Generation for Any-View Rendering in Street Scenes
- 2025BEV-VAE: Multi-view Image Generation with Spatial Consistency for Autonomous Driving
- 2023DrivingDiffusion: Layout-Guided multi-view driving scene video generation with latent diffusion model
- 2026SEM-ROVER: Semantic Voxel-Guided Diffusion for Large-Scale Driving Scene Generation
- 2025FreeGen: Feed-Forward Reconstruction-Generation Co-Training for Free-Viewpoint Driving Scene Synthesis