3D Semantic Segmentation with Submanifold Sparse Convolutional Networks
Not on the map. Why?
Abstract (arXiv)
Convolutional networks are the de-facto standard for analyzing spatio-temporal data such as images, videos, and 3D shapes. Whilst some of this data is naturally dense (e.g., photos), many other data sources are inherently sparse. Examples include 3D point clouds that were obtained using a LiDAR scanner or RGB-D camera. Standard "dense" implementations of convolutional networks are very inefficient when applied on such sparse data. We introduce new sparse convolutional operations that are designed to process spatially-sparse data more efficiently, and use them to develop spatially-sparse convolutional networks. We demonstrate the strong performance of the resulting models, called submanifold sparse convolutional networks (SSCNs), on two tasks involving semantic segmentation of 3D point clouds. In particular, our models outperform all prior state-of-the-art on the test set of a recent semantic segmentation competition.
Key facts. Cited by 748 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 135; 2022: 178; 2023: 173; 2024: 119; 2025: 90; 2026: 53.
748 papers.
Sort:
By area:
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 436
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 388
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 303
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 289
- 2021PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformerscited by 286
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
- 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 262
- 2022Language-Grounded Indoor 3D Semantic Segmentation in the Wildcited by 246
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
38 more
- 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
- 2023VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Trackingcited by 222
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2022Omnivore: A Single Model for Many Visual Modalitiescited by 215
- 2021PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Cloudscited by 211
- 2023ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understandingcited by 202
- 2022SoftGroup for 3D Instance Segmentation on Point Cloudscited by 200
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
- 2022PLA: Language-Driven Open-Vocabulary 3D Scene Understandingcited by 177
- 2022Stratified Transformer for 3D Point Cloud Segmentationcited by 167
- 2021Multimodal Virtual Point 3D Detectioncited by 166
- 2023Towards Open Vocabulary Learning: A Surveycited by 166
- 20222DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Cloudscited by 158
- 2022Focal Sparse Convolutional Networks for 3D Object Detectioncited by 142
- 2021InstanceRefer: Cooperative Holistic Understanding for Visual Grounding on Point Clouds through Instance Multi-level Contextual Referringcited by 141
- 2024SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understandingcited by 133
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2021Hierarchical Aggregation for 3D Instance Segmentationcited by 127
- 2021Mix3D: Out-of-Context Data Augmentation for 3D Scenescited by 126
- 2023Spherical Transformer for LiDAR-based 3D Recognitioncited by 125
- 20214DComplete: Non-Rigid Motion Estimation Beyond the Observable Surfacecited by 124
- 2023Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidancecited by 124
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2023DSVT: Dynamic Sparse Voxel Transformer with Rotated Setscited by 122
- 2021SE-SSD: Self-Ensembling Single-Stage Object Detector From Point Cloudcited by 119
- 2021NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenescited by 119
- 2022Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generationcited by 119
- 2022Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentationcited by 119
- 2022AEGNN: Asynchronous Event-based Graph Neural Networkscited by 118
- 2022Superpoint Transformer for 3D Scene Instance Segmentationcited by 116
- 2024Grounded 3D-LLM with Referent Tokenscited by 115
- 20223D-SPS: Single-Stage 3D Visual Grounding via Referred Point Progressive Selectioncited by 110
- 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 110
- 2023OctFormer: Octree-based Transformers for 3D Point Cloudscited by 109
- 2022K-Radar: 4D Radar Object Detection for Autonomous Driving in Various Weather Conditionscited by 108
- 2022ConvMAE: Masked Convolution Meets Masked Autoencoderscited by 105
- 2021Fast Point Transformercited by 104
- 2021Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networkscited by 99
50 most cited of 748 All 748 (JSON)
- 2026Rationally Linearized MLPs9 Oct 2026
- 2026RYOPO: Bringing End-to-End Category-Level Object Pose Estimation into Real Time2 Oct 2026
- 2026FILIGREE3D: Scaling Sparse Latent Flow Matching for Ultra-High-Resolution Image-to-3D Generation28 Sep 2026
- 2026Privacy-Preserving Semantic Segmentation from High-Resolution Depth and Ultra-Low-Resolution RGB23 Sep 2026
- 2026Toward a foundation model for forest point clouds21 Sep 2026
- 2026VS-Splat: Voxel-Selective feed-forward Gaussian Splatting for end-to-end 3D object reconstruction from sparse-views11 Sep 2026
- 2026MSSP: Multi-Scale Spatially-Constrained Partition for Unsupervised Semantic Segmentation of 3D Point Clouds7 Sep 2026
- 2026VoxelFix: Post-Hoc Semantic Correction of Completed 3D Voxel Maps4 Sep 2026
- 2026AQ3D: Adaptive Query Transformer for 3D Instance Segmentation31 Aug 2026
- 2026TADP: Task-Aware Deformable Prediction for Single-Stage 3D Object Detection27 Aug 2026
- 2026COSTA: A Cluster-Centric Paradigm for Annotation-Free Open-Set Semantic Segmentation of Aerial Point Clouds with Domain Shifts19 Aug 2026
- 2026Efficient Human-Contact Representation for Human-Scene Interaction10 Aug 2026
38 more
- 2026Rethinking 3D Segmentation from Individual LiDAR Scans: Incidence-Aware Sampling on the SIP Benchmark7 Aug 2026
- 2026TravKAN: Fast and Interpretable Nonlinear Traversability Analysis with Kolmogorov-Arnold Networks3 Aug 2026
- 2026P2Voxel: Pyramid Pivot Voxelization for 3D Mesh Tokenization1 Aug 2026
- 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamics22 Jul 2026
- 2026MoGe-3: Fine-Detail Monocular Geometry Estimation with Self-Guided Sparse Volumetric Refinement20 Jul 2026
- 2026Training-Free Open-Vocabulary 3D Point-Cloud Segmentation on the Generalized Few-Shot Benchmark16 Jul 2026
- 2026DeGuNet: Depth-Guided Ultra-Compact Backbones for Efficient LiDAR-Camera 3D Detection14 Jul 2026
- 2026NegROI: Click-Centric Uncertainty-Guided Refinement with Scene-Conditioned Negative Prompts for Robust Interactive 3D Segmentation7 Jul 2026
- 2026FlowMark: Mask-Guided Video Watermarking6 Jul 2026
- 2026SelectAnyTree: A Promptable Instance Segmentation Model for 3D Forest LiDAR Point Clouds25 Jun 2026
- 2026Heterogeneous and Adept Snapshot Distillation for 3D Semantic Segmentation24 Jun 2026
- 2026Neural Events: Discrete Asynchronous Autoencoders for Event-Based Vision18 Jun 2026
- 2026Segment and Select: Vision-Language Segmentation in 3D Scenarios9 Jun 2026
- 2026GVC-Seg: Training-Free 3D Instance Segmentation via Geometric Visual Correspondence6 Jun 2026
- 2026ForestMamba: Sparse Mamba with Geometry-guided Queries for 3D Forest Point Cloud Segmentation1 Jun 2026
- 2026ESAM++: Efficient Online 3D Perception on the Edge28 May 2026
- 2026Every9D-21M: Large-Scale Real-World 9D Canonicalization of Everyday Objects27 May 2026
- 2026FoundObj: Self-supervised Foundation Models as Rewards for Label-free 3D Object Segmentation26 May 2026
- 2026Resolving Long-Tail Ambiguity in Unsupervised 3D Point Cloud Segmentation with Language Priors20 May 2026
- 2026EvObj: Learning Evolving Object-centric Representations for 3D Instance Segmentation without Scene Supervision13 May 2026
- 2026RelFlexformer: Efficient Attention 3D-Transformers for Integrable Relative Positional Encodings11 May 2026
- 2026UniD-Shift: Towards Unified Semantic Segmentation via Interpretable Share-Private Multimodal Decomposition8 May 2026
- 2026From Spherical to Gaussian: A Comparative Analysis of Point Cloud Cropping Strategies in Large-Scale 3D Environments3 May 2026
- 2026Semantic Foam: Unifying Spatial and Semantic Scene Decomposition29 Apr 2026
- 2026BIMStruct3D: A Fully Automated Hybrid Learning Scan-to-BIM Pipeline with Integrated Topology Refinement27 Apr 2026
- 2026Volume Transformer: Revisiting Vanilla Transformers for 3D Scene Understanding21 Apr 2026
- 2026Towards foundation-style models for energy-frontier heterogeneous neutrino detectors via self-supervised pre-training8 Apr 2026
- 2026Geometrical Cross-Attention and Nonvoid Voxelization for Efficient 3D Medical Image Segmentation7 Apr 2026
- 2026SparseVoxelDet: Fully Sparse Voxel Networks for Efficient Event-Based Drone Detection23 Mar 2026
- 2026Mamba Learns in Context: Structure-Aware Domain Generalization for Multi-Task Point Cloud Understanding21 Mar 2026
- 2026Pointy - A Lightweight Transformer for Point Cloud Foundation Models11 Mar 2026
- 2026P-SLCR: Unsupervised Point Cloud Semantic Segmentation via Prototypes Structure Learning and Consistent Reasoning6 Mar 2026
- 2026Hierarchical Collaborative Fusion for 3D Instance-aware Referring Expression Segmentation6 Mar 2026
- 20263D-DRES: Detailed 3D Referring Expression Segmentation3 Mar 2026
- 2026Adaptive Augmentation-Aware Latent Learning for Robust LiDAR Semantic Segmentation1 Mar 2026
- 2026Point Virtual Transformer4 Feb 2026
- 2026Bonnet: Ultra-fast whole-body bone segmentation from CT scans30 Jan 2026
- 2026Open-Vocabulary Functional 3D Human-Scene Interaction Generation28 Jan 2026
50 newest of 748 All 748 (JSON)
- 2024Point Mamba: A Novel Point Cloud Backbone Based on State Space Model with Octree-Based Ordering Strategycited by 73
- 2024Point Cloud Mamba: Point Cloud Learning via State Space Modelcited by 66
- 2024QuadMamba: Learning Quadtree-based Selective Scan for Visual State Space Modelcited by 18
- 2024Serialized Point Mamba: A Serialized Point Cloud Mamba Segmentation Modelcited by 4
- 2026ForestMamba: Sparse Mamba with Geometry-guided Queries for 3D Forest Point Cloud Segmentationcited by 4
- 2024Exploring contextual modeling with linear complexity for point cloud segmentationcited by 1
- 2025HybridTM: Combining Transformer and Mamba for 3D Semantic Segmentationcited by 0
- 2025Minkowski-MambaNet: A Point Cloud Framework with Selective State Space Models for Forest Biomass Quantificationcited by 0
- 2026Mamba Learns in Context: Structure-Aware Domain Generalization for Multi-Task Point Cloud Understandingcited by 0
- 2026ForestMamba: Sparse Mamba with Geometry-guided Queries for 3D Forest Point Cloud Segmentation1 Jun 2026
- 2026Mamba Learns in Context: Structure-Aware Domain Generalization for Multi-Task Point Cloud Understanding21 Mar 2026
- 2025Minkowski-MambaNet: A Point Cloud Framework with Selective State Space Models for Forest Biomass Quantification10 Oct 2025
- 2025HybridTM: Combining Transformer and Mamba for 3D Semantic Segmentation24 Jul 2025
- 2024Exploring contextual modeling with linear complexity for point cloud segmentation28 Oct 2024
- 2024QuadMamba: Learning Quadtree-based Selective Scan for Visual State Space Model9 Oct 2024
- 2024Serialized Point Mamba: A Serialized Point Cloud Mamba Segmentation Model17 Jul 2024
- 2024Point Mamba: A Novel Point Cloud Backbone Based on State Space Model with Octree-Based Ordering Strategy11 Mar 2024
- 2024Point Cloud Mamba: Point Cloud Learning via State Space Model1 Mar 2024
- 2025Generalized Few-shot 3D Point Cloud Segmentation with Vision-Language Modelcited by 17
- 2025Cross-Modal and Uncertainty-Aware Agglomeration for Open-Vocabulary 3D Scene Understandingcited by 13
- 2024PARIS3D: Reasoning-based 3D Part Segmentation Using Large Multimodal Modelcited by 9
- 2025LEO-VL: Efficient Scene Representation for Scalable 3D Vision-Language Learningcited by 5
- 2023Generalized Robot 3D Vision-Language Model with Fast Rendering and Pre-Training Vision-Language Alignmentcited by 1
- 2025Parameter-Efficient CLIP Adaptation for 3D Understanding via Unified Tokenizationcited by 1
- 2025GeoPurify: A Data-Efficient Geometric Distillation Framework for Open-Vocabulary 3D Segmentationcited by 1
- 2025MR-COSMO: Visual-Text Memory Recall and Direct CrOSs-MOdal Alignment Method for Query-Driven 3D Segmentationcited by 0
- 2025GeoPurify: A Data-Efficient Geometric Distillation Framework for Open-Vocabulary 3D Segmentation2 Oct 2025
- 2025MR-COSMO: Visual-Text Memory Recall and Direct CrOSs-MOdal Alignment Method for Query-Driven 3D Segmentation26 Jun 2025
- 2025LEO-VL: Efficient Scene Representation for Scalable 3D Vision-Language Learning11 Jun 2025
- 2025Parameter-Efficient CLIP Adaptation for 3D Understanding via Unified Tokenization24 May 2025
- 2025Cross-Modal and Uncertainty-Aware Agglomeration for Open-Vocabulary 3D Scene Understanding20 Mar 2025
- 2025Generalized Few-shot 3D Point Cloud Segmentation with Vision-Language Model20 Mar 2025
- 2024PARIS3D: Reasoning-based 3D Part Segmentation Using Large Multimodal Model4 Apr 2024
- 2023Generalized Robot 3D Vision-Language Model with Fast Rendering and Pre-Training Vision-Language Alignment1 Dec 2023
- 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 436
- 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
- 2022Learning to Generate Realistic LiDAR Point Cloudscited by 93
- 2022MotionSC: Data Set and Network for Real-Time Semantic Mapping in Dynamic Environmentscited by 40
- 2023MUVO: A Multimodal Generative World Model for Autonomous Driving with Geometric Representationscited by 33
- 2024OccGen: Generative Multi-modal 3D Occupancy Prediction for Autonomous Drivingcited by 29
- 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamicscited by 1
- 2025LiSTAR: Ray-Centric World Models for 4D LiDAR Sequences in Autonomous Drivingcited by 0
- 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamics22 Jul 2026
- 2025LiSTAR: Ray-Centric World Models for 4D LiDAR Sequences in Autonomous Driving20 Nov 2025
- 2024OccGen: Generative Multi-modal 3D Occupancy Prediction for Autonomous Driving23 Apr 2024
- 2024GenAD: Generative End-to-End Autonomous Driving18 Feb 2024
- 2023MUVO: A Multimodal Generative World Model for Autonomous Driving with Geometric Representations20 Nov 2023
- 2022Learning to Generate Realistic LiDAR Point Clouds8 Sep 2022
- 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategies9 Jun 2022
- 2022MotionSC: Data Set and Network for Real-Time Semantic Mapping in Dynamic Environments14 Mar 2022
- 2023Pyramid Diffusion for Fine 3D Large Scene Generationcited by 44
- 2023DiffComplete: Diffusion-based Generative 3D Shape Completioncited by 35
- 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creationcited by 23
- 2024Open-Vocabulary 3D Semantic Segmentation with Text-to-Image Diffusion Modelscited by 12
- 2025Harnessing Text-to-Image Diffusion Models for Point Cloud Self-Supervised Learningcited by 3
- 20243D-VirtFusion: Synthetic 3D Data Augmentation through Generative Diffusion Models and Controllable Editingcited by 0
- 2026FILIGREE3D: Scaling Sparse Latent Flow Matching for Ultra-High-Resolution Image-to-3D Generationcited by 0
- 2026FILIGREE3D: Scaling Sparse Latent Flow Matching for Ultra-High-Resolution Image-to-3D Generation28 Sep 2026
- 2025Harnessing Text-to-Image Diffusion Models for Point Cloud Self-Supervised Learning12 Jul 2025
- 20243D-VirtFusion: Synthetic 3D Data Augmentation through Generative Diffusion Models and Controllable Editing25 Aug 2024
- 2024Open-Vocabulary 3D Semantic Segmentation with Text-to-Image Diffusion Models18 Jul 2024
- 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creation9 Jan 2024
- 2023Pyramid Diffusion for Fine 3D Large Scene Generation20 Nov 2023
- 2023DiffComplete: Diffusion-based Generative 3D Shape Completion28 Jun 2023
- 2022Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentationcited by 119
- 2024Open Vocabulary 3D Scene Understanding via Geometry Guided Self-Distillationcited by 17
- 2023CMDFusion: Bidirectional Fusion Network with Cross-modality Knowledge Distillation for LIDAR Semantic Segmentationcited by 6
- 2023Knowledge Distillation from 3D to Bird's-Eye-View for LiDAR Semantic Segmentationcited by 4
- 2023Smaller3d: Smaller Models for 3D Semantic Segmentation Using Minkowski Engine and Knowledge Distillation Methodscited by 0
- 2026Heterogeneous and Adept Snapshot Distillation for 3D Semantic Segmentationcited by 0
- 2026Heterogeneous and Adept Snapshot Distillation for 3D Semantic Segmentation24 Jun 2026
- 2024Open Vocabulary 3D Scene Understanding via Geometry Guided Self-Distillation18 Jul 2024
- 2023CMDFusion: Bidirectional Fusion Network with Cross-modality Knowledge Distillation for LIDAR Semantic Segmentation9 Jul 2023
- 2023Smaller3d: Smaller Models for 3D Semantic Segmentation Using Minkowski Engine and Knowledge Distillation Methods4 May 2023
- 2023Knowledge Distillation from 3D to Bird's-Eye-View for LiDAR Semantic Segmentation22 Apr 2023
- 2022Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentation5 Jun 2022
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 388
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 303
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 289
- 2021PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformerscited by 286
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
- 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 262
- 2022Language-Grounded Indoor 3D Semantic Segmentation in the Wildcited by 246
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2023VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Trackingcited by 222
12 most cited of 705 All 705 (JSON)
- 2026Rationally Linearized MLPs9 Oct 2026
- 2026RYOPO: Bringing End-to-End Category-Level Object Pose Estimation into Real Time2 Oct 2026
- 2026Privacy-Preserving Semantic Segmentation from High-Resolution Depth and Ultra-Low-Resolution RGB23 Sep 2026
- 2026Toward a foundation model for forest point clouds21 Sep 2026
- 2026VS-Splat: Voxel-Selective feed-forward Gaussian Splatting for end-to-end 3D object reconstruction from sparse-views11 Sep 2026
- 2026MSSP: Multi-Scale Spatially-Constrained Partition for Unsupervised Semantic Segmentation of 3D Point Clouds7 Sep 2026
- 2026VoxelFix: Post-Hoc Semantic Correction of Completed 3D Voxel Maps4 Sep 2026
- 2026AQ3D: Adaptive Query Transformer for 3D Instance Segmentation31 Aug 2026
- 2026TADP: Task-Aware Deformable Prediction for Single-Stage 3D Object Detection27 Aug 2026
- 2026COSTA: A Cluster-Centric Paradigm for Annotation-Free Open-Set Semantic Segmentation of Aerial Point Clouds with Domain Shifts19 Aug 2026
- 2026Efficient Human-Contact Representation for Human-Scene Interaction10 Aug 2026
- 2026Rethinking 3D Segmentation from Individual LiDAR Scans: Incidence-Aware Sampling on the SIP Benchmark7 Aug 2026
12 newest of 705 All 705 (JSON)