(AF)2-S3Net: Attentive Feature Fusion with Adaptive Feature Selection for Sparse Semantic Segmentation Network
Not on the map. Why?
Abstract (arXiv)
Autonomous robotic systems and self driving cars rely on accurate perception of their surroundings as the safety of the passengers and pedestrians is the top priority. Semantic segmentation is one the essential components of environmental perception that provides semantic information of the scene. Recently, several methods have been introduced for 3D LiDAR semantic segmentation. While, they can lead to improved performance, they are either afflicted by high computational complexity, therefore are inefficient, or lack fine details of smaller instances. To alleviate this problem, we propose AF2-S3Net, an end-to-end encoder-decoder CNN network for 3D LiDAR semantic segmentation. We present a novel multi-branch attentive feature fusion module in the encoder and a unique adaptive feature selection module with feature map re-weighting in the decoder. Our AF2-S3Net fuses the voxel based learning and point-based learning into a single framework to effectively process the large 3D scene. Our experimental results show that the proposed method outperforms the state-of-the-art approaches on the large-scale SemanticKITTI benchmark, ranking 1st on the competitive public leaderboard competition upon publication.
Key facts. Cited by 164 papers in the map (data through 7 Oct 2026). Builds on 32 of its 47 references that are in the map. First posted on arXiv 8 Feb 2021.
Builds on
32 of 47 references.
References · 32
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,054
- 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 584
- 2017Progressive Neural Architecture Searchcited by 483
20 more
- 2020Searching Efficient 3D Architectures with Sparse Point-Voxel Convolutioncited by 422
- 2019Relation-Shape Convolutional Neural Network for Point Cloud Analysiscited by 346
- 2020PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentationcited by 274
- 2016Volumetric and Multi-View CNNs for Object Classification on 3D Datacited by 240
- 2017SqueezeSeg: Convolutional Neural Nets with Recurrent CRF for Real-Time Road-Object Segmentation from 3D LiDAR Point Cloudcited by 231
- 2018SqueezeSegV2: Improved Model Structure and Unsupervised Domain Adaptation for Road-Object Segmentation from a LiDAR Point Cloudcited by 228
- 2020SqueezeSegV3: Spatially-Adaptive Convolution for Efficient Point-Cloud Segmentationcited by 170
- 2020Cylinder3D: An Effective 3D Framework for Driving-scene LiDAR Semantic Segmentationcited by 112
- 2020S3CNet: A Sparse Semantic Scene Completion Network for LiDAR Point Cloudscited by 102
- 2020AMVNet: Assertion-based Multi-View Fusion Network for LiDAR Semantic Segmentationcited by 87
- 20203D-MiniNet: Learning a 2D Representation from Point Clouds for Fast and Efficient 3D LIDAR Semantic Segmentationcited by 58
- 2019SalsaNet: Fast Road and Vehicle Segmentation in LiDAR Point Clouds for Autonomous Drivingcited by 57
- 2020KPRNet: Improving projection-based LiDAR semantic segmentationcited by 47
- 20183D Segmentation with Exponential Logarithmic Loss for Highly Unbalanced Object Sizescited by 42
- 2019LatticeNet: Fast Point Cloud Segmentation Using Permutohedral Latticescited by 38
- 2018VoxSegNet: Volumetric CNNs for Semantic Part Segmentation of 3D Shapescited by 37
- 2020Depth Based Semantic Scene Completion with Position Importance Aware Losscited by 36
- 2020TORNADO-Net: mulTiview tOtal vaRiatioN semAntic segmentation with Diamond inceptiOn modulecited by 36
- 2019Bayesian Spatial Kernel Smoothing for Scalable Dense Semantic Mappingcited by 34
- 2020MVLidarNet: Real-Time Multi-Class Scene Understanding for Autonomous Driving Using Multiple Viewscited by 20
Built on by
Citing papers per year: 2021: 17; 2022: 35; 2023: 60; 2024: 30; 2025: 20; 2026: 2.
164 papers.
Sort:
By area:
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 230
- 2023CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIPcited by 178
- 2021RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentationcited by 173
- 2021Panoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Trackingcited by 165
- 20222DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Cloudscited by 157
- 2023Rethinking Range View Representation for LiDAR Segmentationcited by 126
- 2023Spherical Transformer for LiDAR-based 3D Recognitioncited by 124
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
38 more
- 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Modelscited by 123
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2021NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenescited by 119
- 2022Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentationcited by 118
- 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 114
- 2021FusionPainting: Multimodal Fusion with Adaptive Attention for 3D Object Detectioncited by 92
- 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 83
- 2023SCPNet: Semantic Scene Completion on Point Cloudcited by 80
- 2022LidarMultiNet: Towards a Unified Multi-Task Network for LiDAR Perceptioncited by 74
- 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Drivingcited by 72
- 2023MSeg3D: Multi-modal 3D Semantic Segmentation for Autonomous Drivingcited by 68
- 2021SQN: Weakly-Supervised Semantic Segmentation of Large-Scale 3D Point Cloudscited by 64
- 2021Learning 3D Semantic Segmentation with only 2D Image Supervisioncited by 60
- 2021EPMF: Efficient Perception-aware Multi-sensor Fusion for 3D Semantic Segmentationcited by 59
- 2022Panoptic-PHNet: Towards Real-Time and High-Precision LiDAR Panoptic Segmentation via Clustering Pseudo Heatmapcited by 59
- 2023UniSeg: A Unified Multi-Modal LiDAR Segmentation Network and the OpenPCSeg Codebasecited by 57
- 2023Towards Label-free Scene Understanding by Vision Foundation Modelscited by 54
- 2023Using a Waffle Iron for Automotive Point Cloud Semantic Segmentationcited by 53
- 2023PointOcc: Cylindrical Tri-Perspective View for Point-based 3D Semantic Occupancy Predictioncited by 51
- 2023FRNet: Frustum-Range Networks for Scalable LiDAR Segmentationcited by 50
- 2022SensatUrban: Learning Semantics from Urban-Scale Photogrammetric Point Cloudscited by 49
- 2021FIDNet: LiDAR Point Cloud Semantic Segmentation with Fully Interpolation Decodingcited by 46
- 20233D Semantic Segmentation in the Wild: Learning Generalized Models for Adverse-Condition Point Cloudscited by 46
- 2022LESS: Label-Efficient Semantic Segmentation for LiDAR Point Cloudscited by 41
- 2021GP-S3Net: Graph-based Panoptic Sparse Semantic Segmentation Networkcited by 37
- 2022GFNet: Geometric Flow Network for 3D Point Cloud Semantic Segmentationcited by 36
- 2023TorchSparse++: Efficient Training and Inference Framework for Sparse Convolution on GPUscited by 36
- 2021LIF-Seg: LiDAR and Camera Image Fusion for 3D LiDAR Semantic Segmentationcited by 34
- 2024OccFusion: Multi-Sensor Fusion Framework for 3D Semantic Occupancy Predictioncited by 32
- 20244D Contrastive Superflows are Dense 3D Representation Learnerscited by 32
- 2022Open-world Semantic Segmentation for LIDAR Point Cloudscited by 29
- 2022PointConvFormer: Revenge of the Point-based Convolutioncited by 29
- 2023LinK: Linear Kernel for LiDAR-based 3D Perceptioncited by 26
- 2024Multi-Space Alignments Towards Universal LiDAR Segmentationcited by 24
- 2021DRINet++: Efficient Voxel-as-point Point Cloud Segmentationcited by 23
- 2022Meta-RangeSeg: LiDAR Sequence Semantic Segmentation Using Multiple Feature Aggregationcited by 23
- 2023Spatiotemporal Self-supervised Learning for Point Clouds in the Wildcited by 23
- 2023Clustering based Point Cloud Representation Learning for 3D Analysiscited by 23
50 most cited of 164 All 164 (JSON)
- 2026Vanilla ViT for Automotive Point Cloud Semantic Segmentation29 May 2026
- 2026Learning to Identify Out-of-Distribution Objects for 3D LiDAR Anomaly Segmentation26 Apr 2026
- 2025LitePT: Lighter Yet Stronger Point Transformer15 Dec 2025
- 2025DAGLFNet: Deep Feature Attention Guided Global and Local Feature Fusion for Pseudo-Image Point Cloud Segmentation12 Oct 2025
- 2025Point-Plane Projections for Accurate LiDAR Semantic Segmentation in Small Data Scenarios13 Sep 2025
- 2025Guided Model-based LiDAR Super-Resolution for Resource-Efficient Automotive scene Segmentation1 Sep 2025
- 2025Domain Adaptation-Based Crossmodal Knowledge Distillation for 3D Semantic Segmentation30 Aug 2025
- 2025HybridTM: Combining Transformer and Mamba for 3D Semantic Segmentation24 Jul 2025
- 2025Beyond One Shot, Beyond One Perspective: Cross-View and Long-Horizon Distillation for Better LiDAR Representations7 Jul 2025
- 2025Heterogeneous-Modal Unsupervised Domain Adaptation via Latent Space Bridging19 Jun 2025
- 2025QuadricFormer: Scene as Superquadrics for 3D Semantic Occupancy Prediction12 Jun 2025
- 2025Enhancing Human-Robot Collaboration: A Sim2Real Domain Adaptation Algorithm for Point Cloud Segmentation in Industrial Environments11 Jun 2025
38 more
- 2025NUC-Net: Non-uniform Cylindrical Partition Network for Efficient LiDAR Semantic Segmentation30 May 2025
- 2025Multimodal Point Cloud Semantic Segmentation With Virtual Point Enhancement2 Apr 2025
- 2025SALT: A Flexible Semi-Automatic Labeling Tool for General LiDAR Point Clouds with Cross-Scene Adaptability and 4D Consistency31 Mar 2025
- 2025Enhanced Spatiotemporal Consistency for Image-to-LiDAR Data Pretraining25 Mar 2025
- 2025Is clustering enough for LiDAR instance segmentation? A state-of-the-art training-free baseline17 Mar 2025
- 2025Point Cloud Based Scene Segmentation: A Survey16 Mar 2025
- 2025Multi-Scale Neighborhood Occupancy Masked Autoencoder for Self-Supervised Learning in LiDAR Point Clouds27 Feb 2025
- 2025You Only Click Once: Single Point Weakly Supervised 3D Instance Segmentation for Autonomous Driving27 Feb 2025
- 2025LeAP: Consistent multi-domain 3D labeling using Foundation Models6 Feb 2025
- 2025LargeAD: Large-Scale Cross-Sensor Data Pretraining for Autonomous Driving7 Jan 2025
- 2024PanoSLAM: Panoptic 3D Scene Reconstruction via Gaussian SLAM31 Dec 2024
- 2024Flash3D: Super-scaling Point Transformers through Joint Hardware-Geometry Locality21 Dec 2024
- 2024GSRender: Deduplicated Occupancy Prediction via Weakly Supervised 3D Gaussian Splatting19 Dec 2024
- 2024SP2T: Sparse Proxy Attention for Dual-stream Point Transformer16 Dec 2024
- 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Prediction5 Dec 2024
- 2024Calibrated and Efficient Sampling-Free Confidence Estimation for LiDAR Scene Semantic Segmentation18 Nov 2024
- 2024Deep Learning on 3D Semantic Segmentation: A Detailed Review4 Nov 2024
- 2024Exploring contextual modeling with linear complexity for point cloud segmentation28 Oct 2024
- 2024Fusion-then-Distillation: Toward Cross-modal Positive Distillation for Domain Adaptive 3D Semantic Segmentation25 Oct 2024
- 2024LiOn-XA: Unsupervised Domain Adaptation via LiDAR-Only Cross-Modal Adversarial Training21 Oct 2024
- 2024Exploiting Local Features and Range Images for Small Data Real-Time Point Cloud Semantic Segmentation14 Oct 2024
- 2024Are We Ready for Real-Time LiDAR Semantic Segmentation in Autonomous Driving?10 Oct 2024
- 2024Efficiently Expanding Receptive Fields: Local Split Attention and Parallel Aggregation for Enhanced Large-scale Point Cloud Semantic Segmentation3 Sep 2024
- 2024Exploring Scene Affinity for Semi-Supervised LiDAR Semantic Segmentation21 Aug 2024
- 2024SFPNet: Sparse Focal Point Network for Semantic Segmentation on General LiDAR Point Clouds16 Jul 2024
- 2024RAPiD-Seg: Range-Aware Pointwise Distance Distribution Networks for 3D LiDAR Segmentation14 Jul 2024
- 2024TASeg: Temporal Aggregation Network for LiDAR Semantic Segmentation13 Jul 2024
- 2024Uplifting Range-View-based 3D Semantic Segmentation in Real-Time with Multi-Sensor Fusion12 Jul 2024
- 20244D Contrastive Superflows are Dense 3D Representation Learners8 Jul 2024
- 2024LiSD: An Efficient Multi-Task Learning Framework for LiDAR Segmentation and Detection11 Jun 2024
- 2024An Empirical Study of Training State-of-the-Art LiDAR Segmentation Models23 May 2024
- 2024ELiTe: Efficient Image-to-LiDAR Knowledge Transfer for Semantic Segmentation7 May 2024
- 2024Multi-Space Alignments Towards Universal LiDAR Segmentation2 May 2024
- 2024Hierarchical Insights: Exploiting Structural Similarities for Reliable 3D Semantic Segmentation9 Apr 2024
- 2024Calib3D: Calibrating Model Preferences for Reliable 3D Scene Understanding25 Mar 2024
- 2024LSK3DNet: Towards Effective and Efficient 3D Perception with Large Sparse Kernels22 Mar 2024
- 2024Soft Masked Transformer for Point Cloud Processing with Skip Attention-Based Upsampling21 Mar 2024
- 2024OccFusion: Multi-Sensor Fusion Framework for 3D Semantic Occupancy Prediction3 Mar 2024
50 newest of 164 All 164 (JSON)
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 230
- 2023Rethinking Range View Representation for LiDAR Segmentationcited by 126
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
- 2023CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIPcited by 178
- 2021RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentationcited by 173
- 2021Panoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Trackingcited by 165
- 20222DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Cloudscited by 157
- 2023Spherical Transformer for LiDAR-based 3D Recognitioncited by 124
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Modelscited by 123
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
12 most cited of 158 All 158 (JSON)
- 2026Vanilla ViT for Automotive Point Cloud Semantic Segmentation29 May 2026
- 2026Learning to Identify Out-of-Distribution Objects for 3D LiDAR Anomaly Segmentation26 Apr 2026
- 2025LitePT: Lighter Yet Stronger Point Transformer15 Dec 2025
- 2025DAGLFNet: Deep Feature Attention Guided Global and Local Feature Fusion for Pseudo-Image Point Cloud Segmentation12 Oct 2025
- 2025Point-Plane Projections for Accurate LiDAR Semantic Segmentation in Small Data Scenarios13 Sep 2025
- 2025Guided Model-based LiDAR Super-Resolution for Resource-Efficient Automotive scene Segmentation1 Sep 2025
- 2025Domain Adaptation-Based Crossmodal Knowledge Distillation for 3D Semantic Segmentation30 Aug 2025
- 2025Beyond One Shot, Beyond One Perspective: Cross-View and Long-Horizon Distillation for Better LiDAR Representations7 Jul 2025
- 2025Heterogeneous-Modal Unsupervised Domain Adaptation via Latent Space Bridging19 Jun 2025
- 2025QuadricFormer: Scene as Superquadrics for 3D Semantic Occupancy Prediction12 Jun 2025
- 2025Enhancing Human-Robot Collaboration: A Sim2Real Domain Adaptation Algorithm for Point Cloud Segmentation in Industrial Environments11 Jun 2025
- 2025NUC-Net: Non-uniform Cylindrical Partition Network for Efficient LiDAR Semantic Segmentation30 May 2025
12 newest of 158 All 158 (JSON)