Deflickering Vision-Based Occupancy Networks through Lightweight Spatio-Temporal Correlation
Not on the map. Why?
Abstract (arXiv)
Vision-based occupancy networks (VONs) provide an end-to-end solution for reconstructing 3D environments in autonomous driving. However, existing methods often suffer from temporal inconsistencies, manifesting as flickering effects that degrade temporal coherence and adversely affect downstream decision-making. While recent approaches incorporate historical information to alleviate this issue, they often incur high computational costs and may introduce misaligned or redundant features that interfere with object detection. We propose OccLinker, a novel plugin framework that can be easily integrated into existing VONs to improve performance. Our method efficiently consolidates historical static and motion cues, learns sparse latent correlations with current features through a dual cross-attention mechanism, and generates correction occupancy components to refine the base network predictions. In addition, we introduce a new temporal consistency metric to quantitatively measure flickering effects. Extensive experiments on two benchmark datasets demonstrate that our method achieves superior performance with minimal computational overhead while effectively reducing flickering artifacts.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 79 references that are in the map. First posted on arXiv 21 Feb 2025.
Builds on
52 of 79 references.
References · 52
- 2017Attention Is All You Needcited by 60,361
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Mask R-CNNcited by 7,277
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 724
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
- 2019On Variational Bounds of Mutual Informationcited by 559
38 more
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 341
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
- 2021Neural RGB-D Surface Reconstructioncited by 313
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
- 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 212
- 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
- 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 165
- 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
- 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
- 2023RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervisioncited by 128
- 2020Anisotropic Convolutional Networks for 3D Semantic Scene Completioncited by 127
- 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 115
- 2021Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentationcited by 107
- 2020S3CNet: A Sparse Semantic Scene Completion Network for LiDAR Point Cloudscited by 102
- 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Drivingcited by 93
- 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 90
- 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 86
- 2024OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous Drivingcited by 78
- 2023Fully Sparse 3D Occupancy Predictioncited by 64
- 2024Volumetric Environment Representation for Vision-Language Navigationcited by 63
- 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
- 2019RGBD Based Dimensional Decomposition Residual Network for 3D Semantic Scene Completioncited by 55
- 2023PointOcc: Cylindrical Tri-Perspective View for Point-based 3D Semantic Occupancy Predictioncited by 52
- 2023Cam4DOcc: Benchmark for Camera-Only 4D Occupancy Forecasting in Autonomous Driving Applicationscited by 52
- 2024GaussianOcc: Fully Self-supervised and Efficient 3D Occupancy Estimation with Gaussian Splattingcited by 50
- 2018Two Stream 3D Semantic Scene Completioncited by 48
- 2024GaussTR: Foundation Model-Aligned Gaussian Transformer for Self-Supervised 3D Spatial Understandingcited by 46
- 2023OccNeRF: Advancing 3D Occupancy Prediction in LiDAR-Free Environmentscited by 41
- 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Networkcited by 40
- 2024Occupancy as Set of Pointscited by 38
- 2020Depth Based Semantic Scene Completion with Position Importance Aware Losscited by 37
- 2024ViewFormer: Exploring Spatiotemporal Modeling for Multi-View 3D Occupancy Perception via View-Guided Transformerscited by 37
- 2024OccMamba: Semantic Occupancy Prediction with State Space Modelscited by 30
- 2020Attention-based Multi-modal Fusion Network for Semantic Scene Completioncited by 28
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.