mlsanityData to 7 Oct 2026

3DRealCar: An In-the-wild RGB-D Car Dataset with 360-degree Views

arXiv 2406.04875 ↗First posted 7 Jun 2024cs.CVcited by 37

Not on the map. Why?

Abstract (arXiv)

3D cars are commonly used in self-driving systems, virtual/augmented reality, and games. However, existing 3D car datasets are either synthetic or low-quality, limiting their applications in practical scenarios and presenting a significant gap toward high-quality real-world 3D car datasets. In this paper, we propose the first large-scale 3D real car dataset, termed 3DRealCar, offering three distinctive features. (1) High-Volume: 2,500 cars are meticulously scanned by smartphones, obtaining car images and point clouds with real-world dimensions; (2) High-Quality: Each car is captured in an average of 200 dense, high-resolution 360-degree RGB-D views, enabling high-fidelity 3D reconstruction; (3) High-Diversity: The dataset contains various cars from over 100 brands, collected under three distinct lighting conditions, including reflective, standard, and dark. Additionally, we offer detailed car parsing maps for each instance to promote research in car parsing tasks. Moreover, we remove background point clouds and standardize the car orientation to a unified axis for the reconstruction only on cars and controllable rendering without background. We benchmark 3D reconstruction results with state-of-the-art methods across different lighting conditions in 3DRealCar. Extensive experiments demonstrate that the standard lighting condition part of 3DRealCar can be used to produce a large number of high-quality 3D cars, improving various 2D and 3D tasks related to cars. Notably, our dataset brings insight into the fact that recent 3D reconstruction methods face challenges in reconstructing high-quality 3D cars under reflective and dark lighting conditions. textcolorredhrefhttps://xiaobiaodu.github.io/3drealcar/Our dataset is here.

Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Builds on 77 of its 109 references that are in the map. First posted on arXiv 7 Jun 2024.

Builds on

77 of 109 references.

References · 77

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2023Segment Anythingcited by 8,158
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  5. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  6. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  7. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  8. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  9. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  10. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  11. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  12. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
38 more
  1. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  2. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  3. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  4. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  5. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  6. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  7. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  8. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  9. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
  10. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  11. 2024VMamba: Visual State Space Modelcited by 955
  12. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  13. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  14. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  15. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  16. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  17. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  18. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
  19. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  20. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
  21. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
  22. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  23. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  24. 2022Vision Transformer Adapter for Dense Predictionscited by 564
  25. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  26. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
  27. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  28. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  29. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  30. 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 479
  31. 2019PointRend: Image Segmentation as Renderingcited by 439
  32. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  33. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
  34. 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
  35. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  36. 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 273
  37. 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 249
  38. 20243D Gaussian Splatting as Markov Chain Monte Carlocited by 210

50 most cited of 77 All 77 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 17; 2026: 17.

37 papers.

Sort:

By area:

  1. 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Drivingcited by 84
  2. 2024MVGS: Multi-view Regulated Gaussian Splatting for Novel View Synthesiscited by 19
  3. 2025Unraveling the Effects of Synthetic Data on End-to-End Autonomous Drivingcited by 12
  4. 2024Drive-1-to-3: Enriching Diffusion Priors for Novel View Synthesis of Real Vehiclescited by 10
  5. 2025RealEngine: Simulating Autonomous Driving in Realistic Contextcited by 10
  6. 2026Mobile-GS: Real-time Gaussian Splatting for Mobile Devicescited by 10
  7. 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Surveycited by 9
  8. 2025A Theory of Initialisation's Impact on Specialisationcited by 6
  9. 2025Car-GS: Addressing Reflective and Transparent Surface Challenges in 3D Car Reconstructioncited by 3
  10. 2025Industrial-Grade Sensor Simulation via Gaussian Splatting: A Modular Framework for Scalable Editing and Full-Stack Validationcited by 3
  11. 2025MADrive: Memory-Augmented Driving Scene Modelingcited by 3
  12. 2025HiNeuS: High-fidelity Neural Surface Mitigating Low-texture and Reflective Ambiguitycited by 3
25 more
  1. 2025Gaussian Splatting is an Effective Data Generator for 3D Object Detectioncited by 2
  2. 2025GeoDiffusion: A Training-Free Framework for Accurate 3D Geometric Conditioning in Image Generationcited by 2
  3. 2025SymDrive: Realistic and Controllable Driving Simulator via Symmetric Auto-regressive Online Restorationcited by 2
  4. 2025MeshFleet: Filtered and Annotated 3D Vehicle Dataset for Domain Specific Generative Modelingcited by 1
  5. 2025Segment Any Vehicle: Semantic and Visual Context Driven SAM and A Benchmarkcited by 1
  6. 2025SynthDrive: Scalable Real2Sim2Real Sensor Simulation Pipeline for High-Fidelity Asset Generation and Driving Data Synthesiscited by 1
  7. 2025HybridWorldSim: A Scalable and Controllable High-fidelity Simulator for Autonomous Drivingcited by 1
  8. 2026An Instance-Centric Panoptic Occupancy Prediction Benchmark for Autonomous Drivingcited by 1
  9. 2026Unposed-to-3D: Learning Simulation-Ready Vehicles from Real-World Imagescited by 1
  10. 20263DCarGen: Scalable 3D Car Generation via 3D-consistent Multi-view Synthesiscited by 1
  11. 2026SSMNBench: Diagnosing Image-based Cross-View Human-Object Understanding via Single-View Sufficiency and Multi-View Necessitycited by 1
  12. 2026Monte Carlo Energy Aggregation for Mobile 3D Gaussian Splattingcited by 1
  13. 2025ToosiCubix: Monocular 3D Cuboid Labeling via Vehicle Part Annotationscited by 0
  14. 2025MultiEditor: Controllable Multimodal Object Editing for Driving Scenarios Using 3D Gaussian Splatting Priorscited by 0
  15. 2026XSPLAIN: XAI-enabling Splat-based Prototype Learning for Attribute-aware INterpretabilitycited by 0
  16. 2026Cross-Instance Gaussian Splatting Registration via Geometry-Aware Feature-Guided Alignmentcited by 0
  17. 2026Part-Level 3D Gaussian Vehicle Generation with Joint and Hinge Axis Estimationcited by 0
  18. 2026REAP: Reinforcement-Learning End-to-End Autonomous Parking with Gaussian Splatting Simulator for Real2Sim2Real Transfercited by 0
  19. 2026MM-TRELLIS: Point-Cloud Guided Multi-Modal 3D Vehicle Generation in Autonomous Drivingcited by 0
  20. 2026HiFiVe: High-Fidelity Vehicle Generation Leveraging Auto-Regressive 2D Generative Priorscited by 0
  21. 2026DriveWeaver: Point-Conditioned Video Inpainting for Controllable Vehicle Insertion in Autonomous Driving Simulationcited by 0
  22. 2026DecoupleGS: Interactive 3D Gaussian Splatting for End-to-End Autonomous Driving Testingcited by 0
  23. 2026Leveraging Visual and Geometric Priors for Metric-scale and Complete Vehicle Gaussian Reconstruction from Limited Viewscited by 0
  24. 2026RGS: Reflection-aware Gaussian Splatting via Learning Geometry Continuity for Reflective Objectscited by 0
  25. 2026RECAST: From Log Replay to Closed-Loop Driving Simulation with View-Complete Actorscited by 0