TFusionOcc: T-Primitive Based Object-Centric Multi-Sensor Fusion Framework for 3D Occupancy Prediction
Not on the map. Why?
Abstract (arXiv)
The prediction of 3D semantic occupancy enables autonomous vehicles (AVs) to perceive the fine-grained geometric and semantic scene structure for safe navigation and decision-making. Existing methods mainly rely on either voxel-based representations, which incur redundant computation over empty regions, or on object-centric Gaussian primitives, which are limited in modeling complex, non-convex, and asymmetric structures. In this paper, we present TFusionOcc, a T-primitive-based object-centric multi-sensor fusion framework for 3D semantic occupancy prediction. Specifically, we introduce a family of Students t-distribution-based T-primitives, including the plain T-primitive, T-Superquadric, and deformable T-Superquadric with inverse warping, where the deformable T-Superquadric serves as the key geometry-enhancing primitive. We further develop a unified probabilistic formulation based on the Students t-distribution and the T-mixture model (TMM) to jointly model occupancy and semantics, and design a tightly coupled multi-stage fusion architecture to effectively integrate camera and LiDAR cues. Extensive experiments on nuScenes show state-of-the-art performance, while additional evaluations on nuScenes-C demonstrate strong robustness under most corruption scenarios. The code will be available at: https://github.com/DanielMing123/TFusionOcc
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 42 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
33 of 42 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
- 2021FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detectioncited by 447
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
- 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 221
- 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
21 more
- 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 188
- 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 165
- 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
- 2023RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervisioncited by 128
- 2020Cylinder3D: An Effective 3D Framework for Driving-scene LiDAR Semantic Segmentationcited by 112
- 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 86
- 2024Co-Occ: Coupling Explicit Feature Fusion with Volume Rendering Regularization for Multi-Modal 3D Semantic Occupancy Predictioncited by 48
- 2024Benchmarking and Improving Bird's Eye View Perception Robustness in Autonomous Drivingcited by 41
- 2024OccFusion: Multi-Sensor Fusion Framework for 3D Semantic Occupancy Predictioncited by 32
- 2024OccMamba: Semantic Occupancy Prediction with State Space Modelscited by 30
- 2023RadOcc: Learning Cross-Modality Occupancy Knowledge through Rendering Assisted Distillationcited by 27
- 2025Doracamom: Joint 3D Detection and Occupancy Prediction with Multi-view 4D Radars and Cameras for Omnidirectional Perceptioncited by 22
- 2025QuadricFormer: Scene as Superquadrics for 3D Semantic Occupancy Predictioncited by 20
- 2024DAOcc: 3D Object Detection Assisted Multi-Sensor Fusion for 3D Occupancy Predictioncited by 15
- 2024InverseMatrixVT3D: An Efficient Projection Matrix-Based Approach for 3D Occupancy Predictioncited by 14
- 2025GaussianFormer3D: Multi-Modal Gaussian-based Semantic Occupancy Prediction with 3D Deformable Attentioncited by 14
- 2024EFFOcc: Learning Efficient Occupancy Networks from Minimal Labels for Autonomous Drivingcited by 8
- 2025OccCylindrical: Multi-Modal Fusion with Cylindrical Representation for 3D Semantic Occupancy Predictioncited by 5
- 2025Inverse++: Vision-Centric 3D Semantic Occupancy Prediction Assisted with 3D Object Detectioncited by 4
- 2025GaussianFusionOcc: A Seamless Sensor Fusion Approach for 3D Occupancy Prediction Using 3D Gaussianscited by 3
- 2025GraphGSOcc: Semantic-Geometric Graph Transformer with Dynamic-Static Decoupling for 3D Gaussian Splatting-based Occupancy Predictioncited by 2
Built on by
Not cited yet.