Car-Studio: Learning Car Radiance Fields from Single-View and Endless In-the-wild Images
Not on the map. Why?
Abstract (arXiv)
Compositional neural scene graph studies have shown that radiance fields can be an efficient tool in an editable autonomous driving simulator. However, previous studies learned within a sequence of autonomous driving datasets, resulting in unsatisfactory blurring when rotating the car in the simulator. In this letter, we propose a pipeline for learning unconstrained images and building a dataset from processed images. To meet the requirements of the simulator, which demands that the vehicle maintain clarity when the perspective changes and that the contour remains sharp from the background to avoid artifacts when editing, we design a radiation field of the vehicle, a crucial part of the urban scene foreground. Through experiments, we demonstrate that our model achieves competitive performance compared to baselines. Using the datasets built from in-the-wild images, our method gradually presents a controllable appearance editing function. We will release the dataset and code on https://lty2226262.github.io/car-studio/ to facilitate further research in the field.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 40 of its 51 references that are in the map. First posted on arXiv 26 Jul 2023.
Builds on
40 of 51 references.
References · 40
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Segment Anythingcited by 8,234
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 772
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 724
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
28 more
- 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 523
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
- 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
- 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
- 2022Novel View Synthesis with Diffusion Modelscited by 300
- 2020Neural Scene Graphs for Dynamic Scenescited by 298
- 2021Is Pseudo-Lidar needed for Monocular 3D Object detection?cited by 249
- 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
- 2021Learning Object-Compositional Neural Radiance Field for Editable Scene Renderingcited by 228
- 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 227
- 2021CodeNeRF: Disentangled Neural Radiance Fields for Object Categoriescited by 183
- 2019Unsupervised Learning of Probably Symmetric Deformable 3D Objects from Images in the Wildcited by 180
- 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 180
- 2023SUDS: Scalable Urban Dynamic Scenescited by 151
- 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
- 2023StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Viewscited by 120
- 2023S-NeRF: Neural Radiance Fields for Street Viewscited by 116
- 2022Vision Transformer for NeRF-Based View Synthesis from a Single Input Imagecited by 104
- 2023Neural Fields meet Explicit Geometric Representation for Inverse Rendering of Urban Scenescited by 90
- 2021GeoSim: Realistic Video Simulation via Geometry-Aware Composition for Self-Drivingcited by 75
- 2020Leveraging 2D Data to Learn Textured 3D Mesh Generationcited by 69
- 2022DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesiscited by 61
- 2022AutoRF: Learning 3D Object Radiance Fields from Single View Observationscited by 59
- 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstructioncited by 39
- 2023UrbanGIRAFFE: Representing Urban Scenes as Compositional Generative Neural Feature Fieldscited by 26
- 2023GINA-3D: Learning to Generate Implicit Neural Assets in the Wildcited by 25
- 2021DVM-CAR: A large-scale automotive dataset for visual marketing research and applicationscited by 17
Built on by
Citing papers per year: 2024: 3.
3 papers.
- 2024Drive-1-to-3: Enriching Diffusion Priors for Novel View Synthesis of Real Vehiclescited by 10
- 2024Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Reviewcited by 9
- 2024RGM: Reconstructing High-fidelity 3D Car Assets with Relightable 3D-GS Generative Model from a Single Imagecited by 7
- 2024Drive-1-to-3: Enriching Diffusion Priors for Novel View Synthesis of Real Vehicles19 Dec 2024
- 2024RGM: Reconstructing High-fidelity 3D Car Assets with Relightable 3D-GS Generative Model from a Single Image10 Oct 2024
- 2024Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review17 Feb 2024