mlsanityData to 7 Oct 2026

Part-Level 3D Gaussian Vehicle Generation with Joint and Hinge Axis Estimation

arXiv 2604.05070 ↗First posted 6 Apr 2026cs.AI cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Simulation is essential for autonomous driving, yet current frameworks often model vehicles as rigid assets and fail to capture part-level articulation. With perception algorithms increasingly leveraging dynamics such as wheel steering or door opening, realistic simulation requires animatable vehicle representations. Existing CAD-based pipelines are limited by library coverage and fixed templates, preventing faithful reconstruction of in-the-wild instances. We propose a generative framework that, from a single image or sparse multi-view input, synthesizes an animatable 3D Gaussian vehicle. Our method addresses two challenges: (i) large 3D asset generators are optimized for static quality but not articulation, leading to distortions at part boundaries when animated; and (ii) segmentation alone cannot provide the kinematic parameters required for motion. To overcome this, we introduce a part-edge refinement module that enforces exclusive Gaussian ownership and a kinematic reasoning head that predicts joint positions and hinge axes of movable parts. Together, these components enable faithful part-aware simulation, bridging the gap between static generation and animatable vehicle models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 48 references that are in the map. First posted on arXiv 6 Apr 2026.

Builds on

42 of 48 references.

References · 42

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2023Segment Anythingcited by 8,158
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  6. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  7. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  8. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  9. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  10. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  11. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  12. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
30 more
  1. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  2. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  3. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  4. 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
  5. 2021Grounded Language-Image Pre-trainingcited by 1,147
  6. 2018PointCNN: Convolution On X-Transformed Pointscited by 764
  7. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  8. 2018PointConv: Deep Convolutional Networks on 3D Point Cloudscited by 656
  9. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
  10. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
  11. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
  12. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
  13. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
  14. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
  15. 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 340
  16. 2023Segment Any 3D Gaussianscited by 158
  17. 2020LiDARsim: Realistic LiDAR Simulation by Leveraging the Real Worldcited by 137
  18. 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
  19. 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 117
  20. 2024SAMPart3D: Segment Any Part in 3D Objectscited by 95
  21. 2020Object-Centric Neural Scene Renderingcited by 90
  22. 2024Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splattingcited by 81
  23. 2023PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimationcited by 37
  24. 20243DRealCar: An In-the-wild RGB-D Car Dataset with 360-degree Viewscited by 37
  25. 2024Find Any Part in 3Dcited by 30
  26. 2024SAGD: Boundary-Enhanced Segment Anything in 3D Gaussian via Gaussian Decompositioncited by 29
  27. 2023CADSim: Robust and Scalable in-the-wild 3D Reconstruction for Controllable Sensor Simulationcited by 26
  28. 2025OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splattingcited by 19
  29. 2025GeoSAM2: Unleashing the Power of SAM2 for 3D Part Segmentationcited by 10
  30. 2024UrbanCAD: Towards Highly Controllable and Photorealistic 3D Vehicles for Urban Scene Simulationcited by 7

Built on by

Not cited yet.