3DRealCar: An In-the-wild RGB-D Car Dataset with 360-degree Views
Not on the map. Why?
Abstract (arXiv)
3D cars are commonly used in self-driving systems, virtual/augmented reality, and games. However, existing 3D car datasets are either synthetic or low-quality, limiting their applications in practical scenarios and presenting a significant gap toward high-quality real-world 3D car datasets. In this paper, we propose the first large-scale 3D real car dataset, termed 3DRealCar, offering three distinctive features. (1) High-Volume: 2,500 cars are meticulously scanned by smartphones, obtaining car images and point clouds with real-world dimensions; (2) High-Quality: Each car is captured in an average of 200 dense, high-resolution 360-degree RGB-D views, enabling high-fidelity 3D reconstruction; (3) High-Diversity: The dataset contains various cars from over 100 brands, collected under three distinct lighting conditions, including reflective, standard, and dark. Additionally, we offer detailed car parsing maps for each instance to promote research in car parsing tasks. Moreover, we remove background point clouds and standardize the car orientation to a unified axis for the reconstruction only on cars and controllable rendering without background. We benchmark 3D reconstruction results with state-of-the-art methods across different lighting conditions in 3DRealCar. Extensive experiments demonstrate that the standard lighting condition part of 3DRealCar can be used to produce a large number of high-quality 3D cars, improving various 2D and 3D tasks related to cars. Notably, our dataset brings insight into the fact that recent 3D reconstruction methods face challenges in reconstructing high-quality 3D cars under reflective and dark lighting conditions. textcolorredhrefhttps://xiaobiaodu.github.io/3drealcar/Our dataset is here.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Builds on 77 of its 109 references that are in the map. First posted on arXiv 7 Jun 2024.
Builds on
77 of 109 references.
References · 77
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023Segment Anythingcited by 8,158
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
38 more
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2024VMamba: Visual State Space Modelcited by 955
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
- 2022Vision Transformer Adapter for Dense Predictionscited by 564
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 479
- 2019PointRend: Image Segmentation as Renderingcited by 439
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 273
- 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 249
- 20243D Gaussian Splatting as Markov Chain Monte Carlocited by 210
50 most cited of 77 All 77 (JSON)
Built on by
Citing papers per year: 2024: 3; 2025: 17; 2026: 17.
37 papers.
Sort:
By area:
- 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Drivingcited by 84
- 2024MVGS: Multi-view Regulated Gaussian Splatting for Novel View Synthesiscited by 19
- 2025Unraveling the Effects of Synthetic Data on End-to-End Autonomous Drivingcited by 12
- 2024Drive-1-to-3: Enriching Diffusion Priors for Novel View Synthesis of Real Vehiclescited by 10
- 2025RealEngine: Simulating Autonomous Driving in Realistic Contextcited by 10
- 2026Mobile-GS: Real-time Gaussian Splatting for Mobile Devicescited by 10
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Surveycited by 9
- 2025A Theory of Initialisation's Impact on Specialisationcited by 6
- 2025Car-GS: Addressing Reflective and Transparent Surface Challenges in 3D Car Reconstructioncited by 3
- 2025Industrial-Grade Sensor Simulation via Gaussian Splatting: A Modular Framework for Scalable Editing and Full-Stack Validationcited by 3
- 2025MADrive: Memory-Augmented Driving Scene Modelingcited by 3
- 2025HiNeuS: High-fidelity Neural Surface Mitigating Low-texture and Reflective Ambiguitycited by 3
25 more
- 2025Gaussian Splatting is an Effective Data Generator for 3D Object Detectioncited by 2
- 2025GeoDiffusion: A Training-Free Framework for Accurate 3D Geometric Conditioning in Image Generationcited by 2
- 2025SymDrive: Realistic and Controllable Driving Simulator via Symmetric Auto-regressive Online Restorationcited by 2
- 2025MeshFleet: Filtered and Annotated 3D Vehicle Dataset for Domain Specific Generative Modelingcited by 1
- 2025Segment Any Vehicle: Semantic and Visual Context Driven SAM and A Benchmarkcited by 1
- 2025SynthDrive: Scalable Real2Sim2Real Sensor Simulation Pipeline for High-Fidelity Asset Generation and Driving Data Synthesiscited by 1
- 2025HybridWorldSim: A Scalable and Controllable High-fidelity Simulator for Autonomous Drivingcited by 1
- 2026An Instance-Centric Panoptic Occupancy Prediction Benchmark for Autonomous Drivingcited by 1
- 2026Unposed-to-3D: Learning Simulation-Ready Vehicles from Real-World Imagescited by 1
- 20263DCarGen: Scalable 3D Car Generation via 3D-consistent Multi-view Synthesiscited by 1
- 2026SSMNBench: Diagnosing Image-based Cross-View Human-Object Understanding via Single-View Sufficiency and Multi-View Necessitycited by 1
- 2026Monte Carlo Energy Aggregation for Mobile 3D Gaussian Splattingcited by 1
- 2025ToosiCubix: Monocular 3D Cuboid Labeling via Vehicle Part Annotationscited by 0
- 2025MultiEditor: Controllable Multimodal Object Editing for Driving Scenarios Using 3D Gaussian Splatting Priorscited by 0
- 2026XSPLAIN: XAI-enabling Splat-based Prototype Learning for Attribute-aware INterpretabilitycited by 0
- 2026Cross-Instance Gaussian Splatting Registration via Geometry-Aware Feature-Guided Alignmentcited by 0
- 2026Part-Level 3D Gaussian Vehicle Generation with Joint and Hinge Axis Estimationcited by 0
- 2026REAP: Reinforcement-Learning End-to-End Autonomous Parking with Gaussian Splatting Simulator for Real2Sim2Real Transfercited by 0
- 2026MM-TRELLIS: Point-Cloud Guided Multi-Modal 3D Vehicle Generation in Autonomous Drivingcited by 0
- 2026HiFiVe: High-Fidelity Vehicle Generation Leveraging Auto-Regressive 2D Generative Priorscited by 0
- 2026DriveWeaver: Point-Conditioned Video Inpainting for Controllable Vehicle Insertion in Autonomous Driving Simulationcited by 0
- 2026DecoupleGS: Interactive 3D Gaussian Splatting for End-to-End Autonomous Driving Testingcited by 0
- 2026Leveraging Visual and Geometric Priors for Metric-scale and Complete Vehicle Gaussian Reconstruction from Limited Viewscited by 0
- 2026RGS: Reflection-aware Gaussian Splatting via Learning Geometry Continuity for Reflective Objectscited by 0
- 2026RECAST: From Log Replay to Closed-Loop Driving Simulation with View-Complete Actorscited by 0
- 2026RECAST: From Log Replay to Closed-Loop Driving Simulation with View-Complete Actors25 Sep 2026
- 2026RGS: Reflection-aware Gaussian Splatting via Learning Geometry Continuity for Reflective Objects16 Sep 2026
- 2026Leveraging Visual and Geometric Priors for Metric-scale and Complete Vehicle Gaussian Reconstruction from Limited Views8 Sep 2026
- 2026DecoupleGS: Interactive 3D Gaussian Splatting for End-to-End Autonomous Driving Testing3 Aug 2026
- 2026DriveWeaver: Point-Conditioned Video Inpainting for Controllable Vehicle Insertion in Autonomous Driving Simulation30 Jun 2026
- 2026Monte Carlo Energy Aggregation for Mobile 3D Gaussian Splatting29 Jun 2026
- 2026SSMNBench: Diagnosing Image-based Cross-View Human-Object Understanding via Single-View Sufficiency and Multi-View Necessity24 Jun 2026
- 2026HiFiVe: High-Fidelity Vehicle Generation Leveraging Auto-Regressive 2D Generative Priors24 Jun 2026
- 2026MM-TRELLIS: Point-Cloud Guided Multi-Modal 3D Vehicle Generation in Autonomous Driving23 Jun 2026
- 20263DCarGen: Scalable 3D Car Generation via 3D-consistent Multi-view Synthesis23 Jun 2026
- 2026REAP: Reinforcement-Learning End-to-End Autonomous Parking with Gaussian Splatting Simulator for Real2Sim2Real Transfer9 May 2026
- 2026Unposed-to-3D: Learning Simulation-Ready Vehicles from Real-World Images21 Apr 2026
25 more
- 2026Part-Level 3D Gaussian Vehicle Generation with Joint and Hinge Axis Estimation6 Apr 2026
- 2026An Instance-Centric Panoptic Occupancy Prediction Benchmark for Autonomous Driving28 Mar 2026
- 2026Cross-Instance Gaussian Splatting Registration via Geometry-Aware Feature-Guided Alignment23 Mar 2026
- 2026Mobile-GS: Real-time Gaussian Splatting for Mobile Devices12 Mar 2026
- 2026XSPLAIN: XAI-enabling Splat-based Prototype Learning for Attribute-aware INterpretability10 Feb 2026
- 2025SymDrive: Realistic and Controllable Driving Simulator via Symmetric Auto-regressive Online Restoration25 Dec 2025
- 2025HybridWorldSim: A Scalable and Controllable High-fidelity Simulator for Autonomous Driving27 Nov 2025
- 2025GeoDiffusion: A Training-Free Framework for Accurate 3D Geometric Conditioning in Image Generation25 Oct 2025
- 2025SynthDrive: Scalable Real2Sim2Real Sensor Simulation Pipeline for High-Fidelity Asset Generation and Driving Data Synthesis8 Sep 2025
- 2025Segment Any Vehicle: Semantic and Visual Context Driven SAM and A Benchmark6 Aug 2025
- 2025MultiEditor: Controllable Multimodal Object Editing for Driving Scenarios Using 3D Gaussian Splatting Priors29 Jul 2025
- 2025HiNeuS: High-fidelity Neural Surface Mitigating Low-texture and Reflective Ambiguity30 Jun 2025
- 2025MADrive: Memory-Augmented Driving Scene Modeling26 Jun 2025
- 2025ToosiCubix: Monocular 3D Cuboid Labeling via Vehicle Part Annotations26 Jun 2025
- 2025RealEngine: Simulating Autonomous Driving in Realistic Context22 May 2025
- 2025Gaussian Splatting is an Effective Data Generator for 3D Object Detection23 Apr 2025
- 2025Unraveling the Effects of Synthetic Data on End-to-End Autonomous Driving23 Mar 2025
- 2025MeshFleet: Filtered and Annotated 3D Vehicle Dataset for Domain Specific Generative Modeling18 Mar 2025
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Survey17 Mar 2025
- 2025Industrial-Grade Sensor Simulation via Gaussian Splatting: A Modular Framework for Scalable Editing and Full-Stack Validation14 Mar 2025
- 2025A Theory of Initialisation's Impact on Specialisation4 Mar 2025
- 2025Car-GS: Addressing Reflective and Transparent Surface Challenges in 3D Car Reconstruction19 Jan 2025
- 2024Drive-1-to-3: Enriching Diffusion Priors for Novel View Synthesis of Real Vehicles19 Dec 2024
- 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Driving2 Dec 2024
- 2024MVGS: Multi-view Regulated Gaussian Splatting for Novel View Synthesis2 Oct 2024
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Surveycited by 9
- 2025HybridWorldSim: A Scalable and Controllable High-fidelity Simulator for Autonomous Drivingcited by 1
- 2026DecoupleGS: Interactive 3D Gaussian Splatting for End-to-End Autonomous Driving Testingcited by 0
- 2026RECAST: From Log Replay to Closed-Loop Driving Simulation with View-Complete Actorscited by 0
- 2026RECAST: From Log Replay to Closed-Loop Driving Simulation with View-Complete Actors25 Sep 2026
- 2026DecoupleGS: Interactive 3D Gaussian Splatting for End-to-End Autonomous Driving Testing3 Aug 2026
- 2025HybridWorldSim: A Scalable and Controllable High-fidelity Simulator for Autonomous Driving27 Nov 2025
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Survey17 Mar 2025
- 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Drivingcited by 84
- 2025Unraveling the Effects of Synthetic Data on End-to-End Autonomous Drivingcited by 12
- 2025RealEngine: Simulating Autonomous Driving in Realistic Contextcited by 10
- 2026DriveWeaver: Point-Conditioned Video Inpainting for Controllable Vehicle Insertion in Autonomous Driving Simulationcited by 0
- 2026DriveWeaver: Point-Conditioned Video Inpainting for Controllable Vehicle Insertion in Autonomous Driving Simulation30 Jun 2026
- 2025RealEngine: Simulating Autonomous Driving in Realistic Context22 May 2025
- 2025Unraveling the Effects of Synthetic Data on End-to-End Autonomous Driving23 Mar 2025
- 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Driving2 Dec 2024
- 2024MVGS: Multi-view Regulated Gaussian Splatting for Novel View Synthesiscited by 19
- 2026Mobile-GS: Real-time Gaussian Splatting for Mobile Devicescited by 10
- 2025A Theory of Initialisation's Impact on Specialisationcited by 6
- 2025Car-GS: Addressing Reflective and Transparent Surface Challenges in 3D Car Reconstructioncited by 3
- 2025Industrial-Grade Sensor Simulation via Gaussian Splatting: A Modular Framework for Scalable Editing and Full-Stack Validationcited by 3
- 2025MADrive: Memory-Augmented Driving Scene Modelingcited by 3
- 2025HiNeuS: High-fidelity Neural Surface Mitigating Low-texture and Reflective Ambiguitycited by 3
- 2025Gaussian Splatting is an Effective Data Generator for 3D Object Detectioncited by 2
- 2025GeoDiffusion: A Training-Free Framework for Accurate 3D Geometric Conditioning in Image Generationcited by 2
- 2025SymDrive: Realistic and Controllable Driving Simulator via Symmetric Auto-regressive Online Restorationcited by 2
- 2025MeshFleet: Filtered and Annotated 3D Vehicle Dataset for Domain Specific Generative Modelingcited by 1
- 2025Segment Any Vehicle: Semantic and Visual Context Driven SAM and A Benchmarkcited by 1
12 most cited of 27 All 27 (JSON)
- 2026RGS: Reflection-aware Gaussian Splatting via Learning Geometry Continuity for Reflective Objects16 Sep 2026
- 2026Leveraging Visual and Geometric Priors for Metric-scale and Complete Vehicle Gaussian Reconstruction from Limited Views8 Sep 2026
- 2026Monte Carlo Energy Aggregation for Mobile 3D Gaussian Splatting29 Jun 2026
- 2026HiFiVe: High-Fidelity Vehicle Generation Leveraging Auto-Regressive 2D Generative Priors24 Jun 2026
- 2026MM-TRELLIS: Point-Cloud Guided Multi-Modal 3D Vehicle Generation in Autonomous Driving23 Jun 2026
- 20263DCarGen: Scalable 3D Car Generation via 3D-consistent Multi-view Synthesis23 Jun 2026
- 2026REAP: Reinforcement-Learning End-to-End Autonomous Parking with Gaussian Splatting Simulator for Real2Sim2Real Transfer9 May 2026
- 2026Unposed-to-3D: Learning Simulation-Ready Vehicles from Real-World Images21 Apr 2026
- 2026Part-Level 3D Gaussian Vehicle Generation with Joint and Hinge Axis Estimation6 Apr 2026
- 2026An Instance-Centric Panoptic Occupancy Prediction Benchmark for Autonomous Driving28 Mar 2026
- 2026Cross-Instance Gaussian Splatting Registration via Geometry-Aware Feature-Guided Alignment23 Mar 2026
- 2026Mobile-GS: Real-time Gaussian Splatting for Mobile Devices12 Mar 2026
12 newest of 27 All 27 (JSON)