Part-Level 3D Gaussian Vehicle Generation with Joint and Hinge Axis Estimation
Not on the map. Why?
Abstract (arXiv)
Simulation is essential for autonomous driving, yet current frameworks often model vehicles as rigid assets and fail to capture part-level articulation. With perception algorithms increasingly leveraging dynamics such as wheel steering or door opening, realistic simulation requires animatable vehicle representations. Existing CAD-based pipelines are limited by library coverage and fixed templates, preventing faithful reconstruction of in-the-wild instances. We propose a generative framework that, from a single image or sparse multi-view input, synthesizes an animatable 3D Gaussian vehicle. Our method addresses two challenges: (i) large 3D asset generators are optimized for static quality but not articulation, leading to distortions at part boundaries when animated; and (ii) segmentation alone cannot provide the kinematic parameters required for motion. To overcome this, we introduce a part-edge refinement module that enforces exclusive Gaussian ownership and a kinematic reasoning head that predicts joint positions and hinge axes of movable parts. Together, these components enable faithful part-aware simulation, bridging the gap between static generation and animatable vehicle models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 48 references that are in the map. First posted on arXiv 6 Apr 2026.
Builds on
42 of 48 references.
References · 42
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
30 more
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
- 2021Grounded Language-Image Pre-trainingcited by 1,147
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2018PointConv: Deep Convolutional Networks on 3D Point Cloudscited by 656
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
- 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
- 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 340
- 2023Segment Any 3D Gaussianscited by 158
- 2020LiDARsim: Realistic LiDAR Simulation by Leveraging the Real Worldcited by 137
- 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 117
- 2024SAMPart3D: Segment Any Part in 3D Objectscited by 95
- 2020Object-Centric Neural Scene Renderingcited by 90
- 2024Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splattingcited by 81
- 2023PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimationcited by 37
- 20243DRealCar: An In-the-wild RGB-D Car Dataset with 360-degree Viewscited by 37
- 2024Find Any Part in 3Dcited by 30
- 2024SAGD: Boundary-Enhanced Segment Anything in 3D Gaussian via Gaussian Decompositioncited by 29
- 2023CADSim: Robust and Scalable in-the-wild 3D Reconstruction for Controllable Sensor Simulationcited by 26
- 2025OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splattingcited by 19
- 2025GeoSAM2: Unleashing the Power of SAM2 for 3D Part Segmentationcited by 10
- 2024UrbanCAD: Towards Highly Controllable and Photorealistic 3D Vehicles for Urban Scene Simulationcited by 7
Built on by
Not cited yet.