Submanifold Sparse Convolutional Networks
Not on the map. Why?
Abstract (arXiv)
Convolutional network are the de-facto standard for analysing spatio-temporal data such as images, videos, 3D shapes, etc. Whilst some of this data is naturally dense (for instance, photos), many other data sources are inherently sparse. Examples include pen-strokes forming on a piece of paper, or (colored) 3D point clouds that were obtained using a LiDAR scanner or RGB-D camera. Standard "dense" implementations of convolutional networks are very inefficient when applied on such sparse data. We introduce a sparse convolutional operation tailored to processing sparse data that differs from prior work on sparse convolutional networks in that it operates strictly on submanifolds, rather than "dilating" the observation with every layer in the network. Our empirical analysis of the resulting submanifold sparse convolutional networks shows that they perform on par with state-of-the-art methods whilst requiring substantially less computation.
Key facts. Cited by 223 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Jun 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 38; 2022: 53; 2023: 54; 2024: 38; 2025: 23; 2026: 17.
223 papers.
Sort:
By area:
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 703
- 2022Kubric: A scalable dataset generatorcited by 373
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 299
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2024Mini-Splatting: Representing Scenes with a Constrained Number of Gaussianscited by 208
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
- 2021Embracing Single Stride 3D Object Detector with Sparse Transformercited by 193
- 2022PLA: Language-Driven Open-Vocabulary 3D Scene Understandingcited by 176
- 2022Stratified Transformer for 3D Point Cloud Segmentationcited by 166
- 2021Deep Parametric Continuous Convolutional Neural Networkscited by 161
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
38 more
- 2022Not All Points Are Equal: Learning Highly Efficient Point-based Detectors for 3D LiDAR Point Cloudscited by 131
- 2023Spherical Transformer for LiDAR-based 3D Recognitioncited by 124
- 20214DComplete: Non-Rigid Motion Estimation Beyond the Observable Surfacecited by 123
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2023DSVT: Dynamic Sparse Voxel Transformer with Rotated Setscited by 122
- 2021NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenescited by 119
- 2021RSN: Range Sparse Net for Efficient, Accurate LiDAR 3D Object Detectioncited by 115
- 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
- 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 114
- 2022ConvMAE: Masked Convolution Meets Masked Autoencoderscited by 105
- 2023Neural Kernel Surface Reconstructioncited by 102
- 2022PillarNet: Real-Time and High-Performance Pillar-based 3D Object Detectioncited by 99
- 2022SWFormer: Sparse Window Transformer for 3D Object Detection in Point Cloudscited by 92
- 2023Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modelingcited by 92
- 2021AFDetV2: Rethinking the Necessity of the Second Stage for Object Detection from Point Cloudscited by 88
- 2022Surface Representation for Point Cloudscited by 84
- 2021Spatially-Adaptive Image Restoration using Distortion-Guided Networkscited by 77
- 2022MM-TTA: Multi-Modal Test-Time Adaptation for 3D Semantic Segmentationcited by 76
- 2022LidarMultiNet: Towards a Unified Multi-Task Network for LiDAR Perceptioncited by 74
- 2021PointMixer: MLP-Mixer for Point Cloud Understandingcited by 71
- 2021QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detectioncited by 70
- 2021Sparse Tensor-based Multiscale Representation for Point Cloud Geometry Compressioncited by 69
- 2022MSMDFusion: Fusing LiDAR and Camera at Multiple Scales with Multi-Depth Seeds for 3D Object Detectioncited by 62
- 2022CAGroup3D: Class-Aware Grouping for 3D Object Detection on Point Cloudscited by 58
- 2022Contrastive Boundary Learning for Point Cloud Segmentationcited by 56
- 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplatscited by 56
- 2022CoSMix: Compositional Semantic Mix for Domain Adaptation in 3D LiDAR Segmentationcited by 54
- 2021CaTGrasp: Learning Category-Level Task-Relevant Grasping in Clutter from Simulationcited by 49
- 2022VISTA: Boosting 3D Object Detection via Dual Cross-VIew SpaTial Attentioncited by 48
- 2023SMURF: Spatial Multi-Representation Fusion for 3D Object Detection with 4D Imaging Radarcited by 48
- 2023Understanding Imbalanced Semantic Segmentation Through Neural Collapsecited by 46
- 2021Keypoints-Based Deep Feature Fusion for Cooperative Vehicle Detection of Autonomous Drivingcited by 45
- 2023HEDNet: A Hierarchical Encoder-Decoder Network for 3D Object Detection in Point Cloudscited by 45
- 2021Multimodal End-to-End Sparse Model for Emotion Recognitioncited by 40
- 2023PartManip: Learning Cross-Category Generalizable Part Manipulation Policy from Point Cloud Observationscited by 40
- 2021To the Point: Efficient 3D Object Detection in the Range Image with Graph Convolution Kernelscited by 39
- 2023FastPillars: A Deployment-friendly Pillar-based 3D Detectorcited by 39
- 2023Lowis3D: Language-Driven Open-World Instance-Level 3D Scene Understandingcited by 38
50 most cited of 223 All 223 (JSON)
- 2026SV-TAD: Native Sparse Convs for Efficient Temporal Action Detection8 Oct 2026
- 2026TriO: Tri-Modal Unsupervised Occupancy World Model for Anything Perception25 Sep 2026
- 2026CRUISE: Vision-Language Model-Guided Uncertainty-Aware Cross-Modal Sensor Fusion for Robust Autonomous Driving10 Aug 2026
- 2026LoDA: A Level of Detection Aware Method and a Multimodal Sensing Benchmark for Object Level Change Detection5 Aug 2026
- 2026InfiniVerse: Occupancy Guided Unbounded Scene Generation for Autonomous Driving30 Jun 2026
- 2026Adaptive Densification for High-Fidelity and Efficient Sparse Gaussian Splatting in Arbitrary-Scale Super-Resolution28 Jun 2026
- 2026Deep Learning Approaches for 3D Medical Scene Completion: From Geometric Modeling to Generative Paradigms23 Jun 2026
- 2026A Cookbook of 3D Vision: Data, Learning Paradigms, and Application2 Jun 2026
- 2026VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matching29 May 2026
- 2026ShardTensor: Domain Parallelism for Scientific Machine Learning11 May 2026
- 2026JRM: Joint Reconstruction Model for Multiple Objects without Alignment27 Mar 2026
- 2026ScanDP: Generalizable 3D Scanning with Diffusion Policy11 Mar 2026
38 more
- 2026DRIFT: Dual-Representation Inter-Fusion Transformer for Automated Driving Perception with 4D Radar Point Clouds10 Mar 2026
- 2026LaSSM: Efficient Semantic-Spatial Query Decoding via Local Aggregation and State Space Models for 3D Instance Segmentation11 Feb 2026
- 2026Bonnet: Ultra-fast whole-body bone segmentation from CT scans30 Jan 2026
- 2026Resolving Primitive-Sharing Ambiguity in Long-Tailed TLS-Based Industrial MEP Point Cloud Segmentation via Spatial Context Constraints27 Jan 2026
- 2026SUG-Occ: Explicit Semantics and Uncertainty Guided Sparse Learning for Efficient 3D Occupancy Prediction16 Jan 2026
- 2025PointCNN++: Performant Convolution on Native Points28 Nov 2025
- 2025Inverse Rendering for High-Genus Surface Meshes from Multi-View Images24 Nov 2025
- 2025Neural Geometry Image-Based Representations with Optimal Transport (OT)24 Nov 2025
- 2025Submanifold Sparse Convolutional Networks for Automated 3D Segmentation of Kidneys and Kidney Tumours in Computed Tomography6 Nov 2025
- 2025LiDAR-based 3D Change Detection at City Scale24 Oct 2025
- 2025CrossRay3D: Geometry and Distribution Guidance for Efficient Multimodal 3D Detection14 Oct 2025
- 2025Human Action Recognition from Point Clouds over Time7 Oct 2025
- 2025PointSlice: Accurate and Efficient Slice-Based Representation for 3D Object Detection from Point Clouds1 Sep 2025
- 2025Remove360: Benchmarking Residuals After Object Removal in 3D Gaussian Splatting15 Aug 2025
- 2025GaussianCross: Cross-modal Self-supervised 3D Representation Learning via Gaussian Splatting4 Aug 2025
- 2025NeuroVoxel-LM: Language-Aligned 3D Perception via Dynamic Voxelization and Meta-Embedding27 Jul 2025
- 2025Self-Supervised Enhancement for Depth from a Lightweight ToF Sensor with Monocular Images16 Jun 2025
- 2025Semi-Tensor-Product Based Convolutional Neural Networks12 Jun 2025
- 2025Towards Streaming LiDAR Object Detection with Point Clouds as Egocentric Sequences7 Jun 2025
- 2025COGNATE: Acceleration of Sparse Tensor Programs on Emerging Hardware using Transfer Learning31 May 2025
- 2025SVL: Empowering Spiking Neural Networks for Efficient 3D Open-World Understanding23 May 2025
- 2025MFSeg: Efficient Multi-frame 3D Semantic Segmentation7 May 2025
- 2025Which2comm: An Efficient Collaborative Perception Framework for 3D Object Detection21 Mar 2025
- 2025Point Cloud Based Scene Segmentation: A Survey16 Mar 2025
- 2025SFMNet: Sparse Focal Modulation for 3D Object Detection15 Mar 2025
- 2025ConcreTizer: Model Inversion Attack via Occupancy Classification and Dispersion Control for 3D Point Cloud Restoration10 Mar 2025
- 2025Escaping The Big Data Paradigm in Self-Supervised Representation Learning25 Feb 2025
- 2025SSF: Sparse Long-Range Scene Flow for Autonomous Driving29 Jan 2025
- 2024Efficient 3D Recognition with Event-driven Spike Sparse Convolution10 Dec 2024
- 2024Sparse Voxels Rasterization: Real-time High-fidelity Radiance Field Rendering5 Dec 2024
- 2024TREND: Unsupervised 3D Representation Learning via Temporal Forecasting for LiDAR Perception4 Dec 2024
- 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplats26 Oct 2024
- 2024Learning Efficient Representations of Neutrino Telescope Events17 Oct 2024
- 2024VALO: A Versatile Anytime Framework for LiDAR-based Object Detection Deep Neural Networks17 Sep 2024
- 2024FSMDet: Vision-guided feature diffusion for fully sparse 3D detector11 Sep 2024
- 2024SPiKE: 3D Human Pose from Point Cloud Sequences3 Sep 2024
- 2024Towards Modality-agnostic Label-efficient Segmentation with Entropy-Regularized Distribution Alignment29 Aug 2024
- 2024Panoptic Perception for Autonomous Driving: A Survey27 Aug 2024
50 newest of 223 All 223 (JSON)
- 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplatscited by 56
- 2024Efficient and Scalable Point Cloud Generation with Sparse Point-Voxel Diffusion Modelscited by 7
- 2026ScanDP: Generalizable 3D Scanning with Diffusion Policycited by 0
- 2026VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matchingcited by 0
- 2026VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matching29 May 2026
- 2026ScanDP: Generalizable 3D Scanning with Diffusion Policy11 Mar 2026
- 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplats26 Oct 2024
- 2024Efficient and Scalable Point Cloud Generation with Sparse Point-Voxel Diffusion Models12 Aug 2024
- 2024PARIS3D: Reasoning-based 3D Part Segmentation Using Large Multimodal Modelcited by 9
- 2025NeuroVoxel-LM: Language-Aligned 3D Perception via Dynamic Voxelization and Meta-Embeddingcited by 1
- 2026CRUISE: Vision-Language Model-Guided Uncertainty-Aware Cross-Modal Sensor Fusion for Robust Autonomous Drivingcited by 0
- 2026CRUISE: Vision-Language Model-Guided Uncertainty-Aware Cross-Modal Sensor Fusion for Robust Autonomous Driving10 Aug 2026
- 2025NeuroVoxel-LM: Language-Aligned 3D Perception via Dynamic Voxelization and Meta-Embedding27 Jul 2025
- 2024PARIS3D: Reasoning-based 3D Part Segmentation Using Large Multimodal Model4 Apr 2024
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 703
- 2022Kubric: A scalable dataset generatorcited by 373
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 299
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2024Mini-Splatting: Representing Scenes with a Constrained Number of Gaussianscited by 208
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
- 2021Embracing Single Stride 3D Object Detector with Sparse Transformercited by 193
- 2022PLA: Language-Driven Open-Vocabulary 3D Scene Understandingcited by 176
- 2022Stratified Transformer for 3D Point Cloud Segmentationcited by 166
- 2021Deep Parametric Continuous Convolutional Neural Networkscited by 161
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
12 most cited of 213 All 213 (JSON)
- 2026SV-TAD: Native Sparse Convs for Efficient Temporal Action Detection8 Oct 2026
- 2026LoDA: A Level of Detection Aware Method and a Multimodal Sensing Benchmark for Object Level Change Detection5 Aug 2026
- 2026InfiniVerse: Occupancy Guided Unbounded Scene Generation for Autonomous Driving30 Jun 2026
- 2026Adaptive Densification for High-Fidelity and Efficient Sparse Gaussian Splatting in Arbitrary-Scale Super-Resolution28 Jun 2026
- 2026Deep Learning Approaches for 3D Medical Scene Completion: From Geometric Modeling to Generative Paradigms23 Jun 2026
- 2026A Cookbook of 3D Vision: Data, Learning Paradigms, and Application2 Jun 2026
- 2026ShardTensor: Domain Parallelism for Scientific Machine Learning11 May 2026
- 2026JRM: Joint Reconstruction Model for Multiple Objects without Alignment27 Mar 2026
- 2026DRIFT: Dual-Representation Inter-Fusion Transformer for Automated Driving Perception with 4D Radar Point Clouds10 Mar 2026
- 2026LaSSM: Efficient Semantic-Spatial Query Decoding via Local Aggregation and State Space Models for 3D Instance Segmentation11 Feb 2026
- 2026Bonnet: Ultra-fast whole-body bone segmentation from CT scans30 Jan 2026
- 2026Resolving Primitive-Sharing Ambiguity in Long-Tailed TLS-Based Industrial MEP Point Cloud Segmentation via Spatial Context Constraints27 Jan 2026
12 newest of 213 All 213 (JSON)