mlsanityData to 14 Oct 2026

Car-Studio: Learning Car Radiance Fields from Single-View and Endless In-the-wild Images

arXiv 2307.14009 ↗First posted 26 Jul 2023cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Compositional neural scene graph studies have shown that radiance fields can be an efficient tool in an editable autonomous driving simulator. However, previous studies learned within a sequence of autonomous driving datasets, resulting in unsatisfactory blurring when rotating the car in the simulator. In this letter, we propose a pipeline for learning unconstrained images and building a dataset from processed images. To meet the requirements of the simulator, which demands that the vehicle maintain clarity when the perspective changes and that the contour remains sharp from the background to avoid artifacts when editing, we design a radiation field of the vehicle, a crucial part of the urban scene foreground. Through experiments, we demonstrate that our model achieves competitive performance compared to baselines. Using the datasets built from in-the-wild images, our method gradually presents a controllable appearance editing function. We will release the dataset and code on https://lty2226262.github.io/car-studio/ to facilitate further research in the field.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 40 of its 51 references that are in the map. First posted on arXiv 26 Jul 2023.

Builds on

40 of 51 references.

References · 40

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2023Segment Anythingcited by 8,234
  4. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  5. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  6. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
  7. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  8. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  9. 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 772
  10. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
  11. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 724
  12. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
28 more
  1. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 523
  2. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  3. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
  4. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
  5. 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
  6. 2022Novel View Synthesis with Diffusion Modelscited by 300
  7. 2020Neural Scene Graphs for Dynamic Scenescited by 298
  8. 2021Is Pseudo-Lidar needed for Monocular 3D Object detection?cited by 249
  9. 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
  10. 2021Learning Object-Compositional Neural Radiance Field for Editable Scene Renderingcited by 228
  11. 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 227
  12. 2021CodeNeRF: Disentangled Neural Radiance Fields for Object Categoriescited by 183
  13. 2019Unsupervised Learning of Probably Symmetric Deformable 3D Objects from Images in the Wildcited by 180
  14. 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 180
  15. 2023SUDS: Scalable Urban Dynamic Scenescited by 151
  16. 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
  17. 2023StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Viewscited by 120
  18. 2023S-NeRF: Neural Radiance Fields for Street Viewscited by 116
  19. 2022Vision Transformer for NeRF-Based View Synthesis from a Single Input Imagecited by 104
  20. 2023Neural Fields meet Explicit Geometric Representation for Inverse Rendering of Urban Scenescited by 90
  21. 2021GeoSim: Realistic Video Simulation via Geometry-Aware Composition for Self-Drivingcited by 75
  22. 2020Leveraging 2D Data to Learn Textured 3D Mesh Generationcited by 69
  23. 2022DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesiscited by 61
  24. 2022AutoRF: Learning 3D Object Radiance Fields from Single View Observationscited by 59
  25. 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstructioncited by 39
  26. 2023UrbanGIRAFFE: Representing Urban Scenes as Compositional Generative Neural Feature Fieldscited by 26
  27. 2023GINA-3D: Learning to Generate Implicit Neural Assets in the Wildcited by 25
  28. 2021DVM-CAR: A large-scale automotive dataset for visual marketing research and applicationscited by 17

Built on by

Cited by year

Citing papers per year: 2024: 3.

3 papers.