AMVNet: Assertion-based Multi-View Fusion Network for LiDAR Semantic Segmentation
Not on the map. Why?
Abstract (arXiv)
In this paper, we present an Assertion-based Multi-View Fusion network (AMVNet) for LiDAR semantic segmentation which aggregates the semantic features of individual projection-based networks using late fusion. Given class scores from different projection-based networks, we perform assertion-guided point sampling on score disagreements and pass a set of point-level features for each sampled point to a simple point head which refines the predictions. This modular-and-hierarchical late fusion approach provides the flexibility of having two independent networks with a minor overhead from a light-weight network. Such approaches are desirable for robotic systems, e.g. autonomous vehicles, for which the computational and memory resources are often limited. Extensive experiments show that AMVNet achieves state-of-the-art results in both the SemanticKITTI and nuScenes benchmark datasets and that our approach outperforms the baseline method of combining the class scores of the projection-based networks.
Key facts. Cited by 87 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 17; 2023: 25; 2024: 21; 2025: 15; 2026: 2.
87 papers.
Sort:
By area:
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 230
- 2021RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentationcited by 173
- 2022Trusted Multi-View Classification with Dynamic Evidential Fusioncited by 167
- 2021Panoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Trackingcited by 165
- 2021(AF)2-S3Net: Attentive Feature Fusion with Adaptive Feature Selection for Sparse Semantic Segmentation Networkcited by 164
- 20222DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Cloudscited by 157
- 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 128
- 2023Rethinking Range View Representation for LiDAR Segmentationcited by 126
- 2023Spherical Transformer for LiDAR-based 3D Recognitioncited by 124
38 more
- 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Modelscited by 123
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 114
- 2022LaserMix for Semi-Supervised LiDAR Semantic Segmentationcited by 92
- 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 83
- 2022LidarMultiNet: Towards a Unified Multi-Task Network for LiDAR Perceptioncited by 74
- 2022Scribble-Supervised LiDAR Semantic Segmentationcited by 69
- 2023MSeg3D: Multi-modal 3D Semantic Segmentation for Autonomous Drivingcited by 68
- 2021EPMF: Efficient Perception-aware Multi-sensor Fusion for 3D Semantic Segmentationcited by 59
- 2023UniSeg: A Unified Multi-Modal LiDAR Segmentation Network and the OpenPCSeg Codebasecited by 57
- 2023Using a Waffle Iron for Automotive Point Cloud Semantic Segmentationcited by 53
- 2024Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous Drivingcited by 53
- 2023PointOcc: Cylindrical Tri-Perspective View for Point-based 3D Semantic Occupancy Predictioncited by 51
- 2023FRNet: Frustum-Range Networks for Scalable LiDAR Segmentationcited by 50
- 2021FIDNet: LiDAR Point Cloud Semantic Segmentation with Fully Interpolation Decodingcited by 46
- 2022LESS: Label-Efficient Semantic Segmentation for LiDAR Point Cloudscited by 41
- 2024Benchmarking and Improving Bird's Eye View Perception Robustness in Autonomous Drivingcited by 39
- 2022GFNet: Geometric Flow Network for 3D Point Cloud Semantic Segmentationcited by 36
- 2021LIF-Seg: LiDAR and Camera Image Fusion for 3D LiDAR Semantic Segmentationcited by 34
- 2023Less is More: Reducing Task and Model Complexity for 3D Point Cloud Semantic Segmentationcited by 33
- 2024OccFusion: Multi-Sensor Fusion Framework for 3D Semantic Occupancy Predictioncited by 32
- 20244D Contrastive Superflows are Dense 3D Representation Learnerscited by 32
- 2022Frame Mining: a Free Lunch for Learning Robotic Manipulation from 3D Point Cloudscited by 31
- 2025Semi-Supervised Vision-Centric 3D Occupancy World Model for Autonomous Drivingcited by 29
- 2024Is Your LiDAR Placement Optimized for 3D Scene Understanding?cited by 25
- 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunitiescited by 24
- 2024Multi-Space Alignments Towards Universal LiDAR Segmentationcited by 24
- 2022Meta-RangeSeg: LiDAR Sequence Semantic Segmentation Using Multiple Feature Aggregationcited by 23
- 2024An End-to-End Robust Point Cloud Semantic Segmentation Network with Single-Step Conditional Diffusion Modelscited by 22
- 2025LiMoE: Mixture of LiDAR Representation Learners from Automotive Scenescited by 19
- 2025QuadricFormer: Scene as Superquadrics for 3D Semantic Occupancy Predictioncited by 19
- 2021MVFuseNet: Improving End-to-End Object Detection and Motion Forecasting through Multi-View Fusion of LiDAR Datacited by 18
- 2023Benchmarking the Robustness of LiDAR Semantic Segmentation Modelscited by 18
- 2023ConDaFormer: Disassembled Transformer with Local Structure Enhancement for 3D Point Cloud Understandingcited by 16
- 2022CPGNet: Cascade Point-Grid Fusion Network for Real-Time LiDAR Semantic Segmentationcited by 15
- 2022Image Understands Point Cloud: Weakly Supervised 3D Semantic Segmentation via Association Learningcited by 15
- 2024LSK3DNet: Towards Effective and Efficient 3D Perception with Large Sparse Kernelscited by 15
- 2024Dense Multimodal Alignment for Open-Vocabulary 3D Scene Understandingcited by 15
50 most cited of 87 All 87 (JSON)
- 2026Vanilla ViT for Automotive Point Cloud Semantic Segmentation29 May 2026
- 2026OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generation13 May 2026
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences2 Dec 2025
- 2025nuScenes Revisited: Progress and Challenges in Autonomous Driving2 Dec 2025
- 2025HD2-SSC: High-Dimension High-Density Semantic Scene Completion for Autonomous Driving11 Nov 2025
- 20253EED: Ground Everything Everywhere in 3D3 Nov 2025
- 2025DAGLFNet: Deep Feature Attention Guided Global and Local Feature Fusion for Pseudo-Image Point Cloud Segmentation12 Oct 2025
- 2025QuadricFormer: Scene as Superquadrics for 3D Semantic Occupancy Prediction12 Jun 2025
- 2025NUC-Net: Non-uniform Cylindrical Partition Network for Efficient LiDAR Semantic Segmentation30 May 2025
- 2025SPIRAL: Semantic-Aware Progressive LiDAR Scene Generation and Understanding28 May 2025
- 2025Multimodal Point Cloud Semantic Segmentation With Virtual Point Enhancement2 Apr 2025
- 2025Enhanced Spatiotemporal Consistency for Image-to-LiDAR Data Pretraining25 Mar 2025
38 more
- 2025Point Cloud Based Scene Segmentation: A Survey16 Mar 2025
- 2025FLARES: Fast and Accurate LiDAR Multi-Range Semantic Segmentation13 Feb 2025
- 2025Semi-Supervised Vision-Centric 3D Occupancy World Model for Autonomous Driving11 Feb 2025
- 2025LargeAD: Large-Scale Cross-Sensor Data Pretraining for Autonomous Driving7 Jan 2025
- 2025LiMoE: Mixture of LiDAR Representation Learners from Automotive Scenes7 Jan 2025
- 2024PC-BEV: An Efficient Polar-Cartesian BEV Fusion Framework for LiDAR Semantic Segmentation19 Dec 2024
- 2024GSRender: Deduplicated Occupancy Prediction via Weakly Supervised 3D Gaussian Splatting19 Dec 2024
- 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Prediction5 Dec 2024
- 2024An End-to-End Robust Point Cloud Semantic Segmentation Network with Single-Step Conditional Diffusion Models25 Nov 2024
- 2024Learning from Spatio-temporal Correlation for Semi-Supervised LiDAR Semantic Segmentation9 Oct 2024
- 2024SFPNet: Sparse Focal Point Network for Semantic Segmentation on General LiDAR Point Clouds16 Jul 2024
- 2024RAPiD-Seg: Range-Aware Pointwise Distance Distribution Networks for 3D LiDAR Segmentation14 Jul 2024
- 2024Dense Multimodal Alignment for Open-Vocabulary 3D Scene Understanding13 Jul 2024
- 2024Uplifting Range-View-based 3D Semantic Segmentation in Real-Time with Multi-Sensor Fusion12 Jul 2024
- 20244D Contrastive Superflows are Dense 3D Representation Learners8 Jul 2024
- 2024Benchmarking and Improving Bird's Eye View Perception Robustness in Autonomous Driving27 May 2024
- 2024An Empirical Study of Training State-of-the-Art LiDAR Segmentation Models23 May 2024
- 2024Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous Driving8 May 2024
- 2024Multi-Space Alignments Towards Universal LiDAR Segmentation2 May 2024
- 2024Weakly Supervised LiDAR Semantic Segmentation via Scatter Image Annotation19 Apr 2024
- 2024Calib3D: Calibrating Model Preferences for Reliable 3D Scene Understanding25 Mar 2024
- 2024Is Your LiDAR Placement Optimized for 3D Scene Understanding?25 Mar 2024
- 2024LSK3DNet: Towards Effective and Efficient 3D Perception with Large Sparse Kernels22 Mar 2024
- 2024OccFusion: Multi-Sensor Fusion Framework for 3D Semantic Occupancy Prediction3 Mar 2024
- 2024InverseMatrixVT3D: An Efficient Projection Matrix-Based Approach for 3D Occupancy Prediction23 Jan 2024
- 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities16 Jan 2024
- 2023ConDaFormer: Disassembled Transformer with Local Structure Enhancement for 3D Point Cloud Understanding18 Dec 2023
- 2023FRNet: Frustum-Range Networks for Scalable LiDAR Segmentation7 Dec 2023
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving27 Nov 2023
- 20232D Feature Distillation for Weakly- and Semi-Supervised 3D Semantic Segmentation27 Nov 2023
- 2023SOccDPT: Semi-Supervised 3D Semantic Occupancy from Dense Prediction Transformers trained under memory constraints19 Nov 2023
- 2023Revisiting Multi-modal 3D Semantic Segmentation in Real-world Autonomous Driving13 Oct 2023
- 2023APNet: Urban-level Scene Segmentation of Aerial Images and Point Clouds29 Sep 2023
- 2023UniSeg: A Unified Multi-Modal LiDAR Segmentation Network and the OpenPCSeg Codebase11 Sep 2023
- 2023PointOcc: Cylindrical Tri-Perspective View for Point-based 3D Semantic Occupancy Prediction31 Aug 2023
- 2023OCTraN: 3D Occupancy Convolutional Transformer Network in Unstructured Traffic Scenarios20 Jul 2023
- 2023CMDFusion: Bidirectional Fusion Network with Cross-modality Knowledge Distillation for LIDAR Semantic Segmentation9 Jul 2023
- 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentation16 Jun 2023
50 newest of 87 All 87 (JSON)
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 230
- 2023Rethinking Range View Representation for LiDAR Segmentationcited by 126
- 2025Semi-Supervised Vision-Centric 3D Occupancy World Model for Autonomous Drivingcited by 29
- 2025SPIRAL: Semantic-Aware Progressive LiDAR Scene Generation and Understandingcited by 10
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequencescited by 5
- 2026OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generationcited by 0
- 2026OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generation13 May 2026
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences2 Dec 2025
- 2025SPIRAL: Semantic-Aware Progressive LiDAR Scene Generation and Understanding28 May 2025
- 2025Semi-Supervised Vision-Centric 3D Occupancy World Model for Autonomous Driving11 Feb 2025
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving27 Nov 2023
- 2023Rethinking Range View Representation for LiDAR Segmentation9 Mar 2023
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
- 2021RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentationcited by 173
- 2022Trusted Multi-View Classification with Dynamic Evidential Fusioncited by 167
- 2021Panoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Trackingcited by 165
- 2021(AF)2-S3Net: Attentive Feature Fusion with Adaptive Feature Selection for Sparse Semantic Segmentation Networkcited by 164
- 20222DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Cloudscited by 157
- 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 128
- 2023Spherical Transformer for LiDAR-based 3D Recognitioncited by 124
- 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Modelscited by 123
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
12 most cited of 76 All 76 (JSON)
- 2026Vanilla ViT for Automotive Point Cloud Semantic Segmentation29 May 2026
- 2025nuScenes Revisited: Progress and Challenges in Autonomous Driving2 Dec 2025
- 20253EED: Ground Everything Everywhere in 3D3 Nov 2025
- 2025DAGLFNet: Deep Feature Attention Guided Global and Local Feature Fusion for Pseudo-Image Point Cloud Segmentation12 Oct 2025
- 2025QuadricFormer: Scene as Superquadrics for 3D Semantic Occupancy Prediction12 Jun 2025
- 2025NUC-Net: Non-uniform Cylindrical Partition Network for Efficient LiDAR Semantic Segmentation30 May 2025
- 2025Multimodal Point Cloud Semantic Segmentation With Virtual Point Enhancement2 Apr 2025
- 2025Enhanced Spatiotemporal Consistency for Image-to-LiDAR Data Pretraining25 Mar 2025
- 2025Point Cloud Based Scene Segmentation: A Survey16 Mar 2025
- 2025FLARES: Fast and Accurate LiDAR Multi-Range Semantic Segmentation13 Feb 2025
- 2025LargeAD: Large-Scale Cross-Sensor Data Pretraining for Autonomous Driving7 Jan 2025
- 2024PC-BEV: An Efficient Polar-Cartesian BEV Fusion Framework for LiDAR Semantic Segmentation19 Dec 2024
12 newest of 76 All 76 (JSON)