mlsanityData to 14 Oct 2026

Deflickering Vision-Based Occupancy Networks through Lightweight Spatio-Temporal Correlation

arXiv 2502.15438 ↗First posted 21 Feb 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Vision-based occupancy networks (VONs) provide an end-to-end solution for reconstructing 3D environments in autonomous driving. However, existing methods often suffer from temporal inconsistencies, manifesting as flickering effects that degrade temporal coherence and adversely affect downstream decision-making. While recent approaches incorporate historical information to alleviate this issue, they often incur high computational costs and may introduce misaligned or redundant features that interfere with object detection. We propose OccLinker, a novel plugin framework that can be easily integrated into existing VONs to improve performance. Our method efficiently consolidates historical static and motion cues, learns sparse latent correlations with current features through a dual cross-attention mechanism, and generates correction occupancy components to refine the base network predictions. In addition, we introduce a new temporal consistency metric to quantitatively measure flickering effects. Extensive experiments on two benchmark datasets demonstrate that our method achieves superior performance with minimal computational overhead while effectively reducing flickering artifacts.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 79 references that are in the map. First posted on arXiv 21 Feb 2025.

Builds on

52 of 79 references.

References · 52

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2017Mask R-CNNcited by 7,277
  5. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  6. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  7. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  8. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  9. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
  10. 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 724
  11. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
  12. 2019On Variational Bounds of Mutual Informationcited by 559
38 more
  1. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
  2. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
  3. 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 341
  4. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
  5. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
  6. 2021Neural RGB-D Surface Reconstructioncited by 313
  7. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
  8. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
  9. 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 212
  10. 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
  11. 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 165
  12. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
  13. 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
  14. 2023RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervisioncited by 128
  15. 2020Anisotropic Convolutional Networks for 3D Semantic Scene Completioncited by 127
  16. 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 115
  17. 2021Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentationcited by 107
  18. 2020S3CNet: A Sparse Semantic Scene Completion Network for LiDAR Point Cloudscited by 102
  19. 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Drivingcited by 93
  20. 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 90
  21. 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 86
  22. 2024OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous Drivingcited by 78
  23. 2023Fully Sparse 3D Occupancy Predictioncited by 64
  24. 2024Volumetric Environment Representation for Vision-Language Navigationcited by 63
  25. 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
  26. 2019RGBD Based Dimensional Decomposition Residual Network for 3D Semantic Scene Completioncited by 55
  27. 2023PointOcc: Cylindrical Tri-Perspective View for Point-based 3D Semantic Occupancy Predictioncited by 52
  28. 2023Cam4DOcc: Benchmark for Camera-Only 4D Occupancy Forecasting in Autonomous Driving Applicationscited by 52
  29. 2024GaussianOcc: Fully Self-supervised and Efficient 3D Occupancy Estimation with Gaussian Splattingcited by 50
  30. 2018Two Stream 3D Semantic Scene Completioncited by 48
  31. 2024GaussTR: Foundation Model-Aligned Gaussian Transformer for Self-Supervised 3D Spatial Understandingcited by 46
  32. 2023OccNeRF: Advancing 3D Occupancy Prediction in LiDAR-Free Environmentscited by 41
  33. 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Networkcited by 40
  34. 2024Occupancy as Set of Pointscited by 38
  35. 2020Depth Based Semantic Scene Completion with Position Importance Aware Losscited by 37
  36. 2024ViewFormer: Exploring Spatiotemporal Modeling for Multi-View 3D Occupancy Perception via View-Guided Transformerscited by 37
  37. 2024OccMamba: Semantic Occupancy Prediction with State Space Modelscited by 30
  38. 2020Attention-based Multi-modal Fusion Network for Semantic Scene Completioncited by 28

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.