SVT-Net: Super Light-Weight Sparse Voxel Transformer for Large Scale Place Recognition
Not on the map. Why?
Abstract (arXiv)
Point cloud-based large scale place recognition is fundamental for many applications like Simultaneous Localization and Mapping (SLAM). Although many models have been proposed and have achieved good performance by learning short-range local features, long-range contextual properties have often been neglected. Moreover, the model size has also become a bottleneck for their wide applications. To overcome these challenges, we propose a super light-weight network model termed SVT-Net for large scale place recognition. Specifically, on top of the highly efficient 3D Sparse Convolution (SP-Conv), an Atom-based Sparse Voxel Transformer (ASVT) and a Cluster-based Sparse Voxel Transformer (CSVT) are proposed to learn both short-range local features and long-range contextual features in this model. Consisting of ASVT and CSVT, SVT-Net can achieve state-of-the-art on benchmark datasets in terms of both accuracy and speed with a super-light model size (0.9M). Meanwhile, two simplified versions of SVT-Net are introduced, which also achieve state-of-the-art and further reduce the model size to 0.8M and 0.4M respectively.
Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). Builds on 26 of its 45 references that are in the map. First posted on arXiv 1 May 2021.
Builds on
26 of 45 references.
References · 26
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
- 2020Point Transformercited by 1,470
- 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,230
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
14 more
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 941
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2020PCT: Point cloud transformercited by 732
- 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 499
- 2019A Survey of Deep Learning Techniques for Autonomous Drivingcited by 403
- 2020Visual Transformers: Token-based Image Representation and Processing for Computer Visioncited by 334
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 238
- 2018PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognitioncited by 198
- 2018A2-Nets: Double Attention Networkscited by 136
- 2020MinkLoc3D: Point Cloud Based Large-Scale Place Recognitioncited by 115
- 2019PCAN: 3D Attention Map Learning Using Contextual Information for Point Cloud Based Retrievalcited by 68
- 2020SOE-Net: A Self-Attention and Orientation Encoding Network for Point Cloud based Place Recognitioncited by 66
Built on by
Citing papers per year: 2021: 2; 2022: 8; 2023: 9; 2024: 8; 2025: 8; 2026: 1.
36 papers.
Sort:
By area:
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2023R2Former: Unified Retrieval and Reranking Transformer for Place Recognitioncited by 102
- 2022Bridging the Domain Gap for Multi-Agent Perceptioncited by 60
- 2022Improving Point Cloud Based Place Recognition with Ranking-based Loss and Large Batch Trainingcited by 45
- 2023Text2Loc: 3D Point Cloud Localization from Natural Languagecited by 35
- 2022Transformers in 3D Point Clouds: A Surveycited by 31
- 2024General Place Recognition Survey: Towards Real-World Autonomycited by 23
- 2022CASSPR: Cross Attention Single Scan Place Recognitioncited by 22
- 2022Recent Advances in Vision Transformer: A Survey and Outlook of Recent Workcited by 21
- 2023CVTNet: A Cross-View Transformer Network for Place Recognition Using LiDAR Datacited by 19
- 2022AutoMerge: A Framework for Map Assembling and Smoothing in City-scale Environmentscited by 10
- 2023CrossLoc3D: Aerial-Ground Cross-Source 3D Place Recognitioncited by 10
24 more
- 2025CMMLoc: Advancing Text-to-PointCloud Localization with Cauchy-Mixture-Model Based Frameworkcited by 8
- 2024MSSPlace: Multi-Sensor Place Recognition with Visual and Text Semanticscited by 7
- 2024MinkUNeXt: Point Cloud-based Large-scale Place Recognition using 3D Sparse Convolutionscited by 6
- 2025ForestLPR: LiDAR Place Recognition in Forests Attentioning Multiple BEV Density Imagescited by 6
- 2021RPR-Net: A Point Cloud-based Rotation-aware Large Scale Place Recognition Networkcited by 5
- 2024VXP: Voxel-Cross-Pixel Large-scale Image-LiDAR Place Recognitioncited by 5
- 2024Point Tree Transformer for Point Cloud Registrationcited by 5
- 2026VLM-Loc: Localization in Point Cloud Maps via Vision-Language Modelscited by 4
- 2023SAT: Size-Aware Transformer for 3D Point Cloud Semantic Segmentationcited by 3
- 2024Instance-free Text to Point Cloud Localization with Relative Position Awarenesscited by 3
- 2023SelFLoc: Selective Feature Fusion for Large-scale Point Cloud-based Place Recognitioncited by 2
- 2023Pose-Graph Attentional Graph Neural Network for Lidar Place Recognitioncited by 2
- 2024PRISM-TopoMap: Online Topological Mapping with Place Recognition and Scan Matchingcited by 2
- 2025L2RSI: Cross-view LiDAR-based Place Recognition for Large-scale Urban Scenes via Remote Sensing Imagerycited by 2
- 2025LifelongPR: Lifelong point cloud place recognition based on sample replay and prompt learningcited by 2
- 2021DSC: Deep Scan Context Descriptor for Large-Scale Place Recognitioncited by 1
- 2023BPT: Binary Point Cloud Transformer for Place Recognitioncited by 1
- 2023VNI-Net: Vector Neurons-based Rotation-Invariant Descriptor for LiDAR Place Recognitioncited by 1
- 2025M3DMap: Object-aware Multimodal 3D Mapping for Dynamic Environmentscited by 1
- 2025MCI-Net: A Robust Multi-Domain Context Integration Network for Point Cloud Registrationcited by 1
- 2022GIDP: Learning a Good Initialization and Inducing Descriptor Post-enhancing for Large-scale Place Recognitioncited by 0
- 2024A Deeper Look into Second-Order Feature Aggregation for LiDAR Place Recognitioncited by 0
- 2025PRISM-Loc: a Lightweight Long-range LiDAR Localization in Urban Environments with Topological Mapscited by 0
- 2025Text2Loc++: Generalizing 3D Point Cloud Localization from Natural Languagecited by 0
- 2026VLM-Loc: Localization in Point Cloud Maps via Vision-Language Models10 Mar 2026
- 2025MCI-Net: A Robust Multi-Domain Context Integration Network for Point Cloud Registration29 Dec 2025
- 2025Text2Loc++: Generalizing 3D Point Cloud Localization from Natural Language19 Nov 2025
- 2025M3DMap: Object-aware Multimodal 3D Mapping for Dynamic Environments23 Aug 2025
- 2025LifelongPR: Lifelong point cloud place recognition based on sample replay and prompt learning14 Jul 2025
- 2025PRISM-Loc: a Lightweight Long-range LiDAR Localization in Urban Environments with Topological Maps18 Jun 2025
- 2025L2RSI: Cross-view LiDAR-based Place Recognition for Large-scale Urban Scenes via Remote Sensing Imagery14 Mar 2025
- 2025ForestLPR: LiDAR Place Recognition in Forests Attentioning Multiple BEV Density Images6 Mar 2025
- 2025CMMLoc: Advancing Text-to-PointCloud Localization with Cauchy-Mixture-Model Based Framework4 Mar 2025
- 2024A Deeper Look into Second-Order Feature Aggregation for LiDAR Place Recognition24 Sep 2024
- 2024MSSPlace: Multi-Sensor Place Recognition with Visual and Text Semantics22 Jul 2024
- 2024Point Tree Transformer for Point Cloud Registration25 Jun 2024
24 more
- 2024General Place Recognition Survey: Towards Real-World Autonomy8 May 2024
- 2024Instance-free Text to Point Cloud Localization with Relative Position Awareness27 Apr 2024
- 2024PRISM-TopoMap: Online Topological Mapping with Place Recognition and Scan Matching2 Apr 2024
- 2024VXP: Voxel-Cross-Pixel Large-scale Image-LiDAR Place Recognition21 Mar 2024
- 2024MinkUNeXt: Point Cloud-based Large-scale Place Recognition using 3D Sparse Convolutions12 Mar 2024
- 2023Text2Loc: 3D Point Cloud Localization from Natural Language27 Nov 2023
- 2023Pose-Graph Attentional Graph Neural Network for Lidar Place Recognition31 Aug 2023
- 2023VNI-Net: Vector Neurons-based Rotation-Invariant Descriptor for LiDAR Place Recognition24 Aug 2023
- 2023SelFLoc: Selective Feature Fusion for Large-scale Point Cloud-based Place Recognition1 Jun 2023
- 2023R2Former: Unified Retrieval and Reranking Transformer for Place Recognition6 Apr 2023
- 2023CrossLoc3D: Aerial-Ground Cross-Source 3D Place Recognition31 Mar 2023
- 2023BPT: Binary Point Cloud Transformer for Place Recognition2 Mar 2023
- 2023CVTNet: A Cross-View Transformer Network for Place Recognition Using LiDAR Data3 Feb 2023
- 2023SAT: Size-Aware Transformer for 3D Point Cloud Semantic Segmentation17 Jan 2023
- 2022CASSPR: Cross Attention Single Scan Place Recognition22 Nov 2022
- 2022Bridging the Domain Gap for Multi-Agent Perception16 Oct 2022
- 2022GIDP: Learning a Good Initialization and Inducing Descriptor Post-enhancing for Large-scale Place Recognition23 Sep 2022
- 2022AutoMerge: A Framework for Map Assembling and Smoothing in City-scale Environments14 Jul 2022
- 2022Transformers in 3D Point Clouds: A Survey16 May 2022
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer20 Mar 2022
- 2022Recent Advances in Vision Transformer: A Survey and Outlook of Recent Work3 Mar 2022
- 2022Improving Point Cloud Based Place Recognition with Ranking-based Loss and Large Batch Training2 Mar 2022
- 2021DSC: Deep Scan Context Descriptor for Large-Scale Place Recognition27 Nov 2021
- 2021RPR-Net: A Point Cloud-based Rotation-aware Large Scale Place Recognition Network29 Aug 2021
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2023R2Former: Unified Retrieval and Reranking Transformer for Place Recognitioncited by 102
- 2022Bridging the Domain Gap for Multi-Agent Perceptioncited by 60
- 2022Improving Point Cloud Based Place Recognition with Ranking-based Loss and Large Batch Trainingcited by 45
- 2023Text2Loc: 3D Point Cloud Localization from Natural Languagecited by 35
- 2022Transformers in 3D Point Clouds: A Surveycited by 31
- 2024General Place Recognition Survey: Towards Real-World Autonomycited by 23
- 2022CASSPR: Cross Attention Single Scan Place Recognitioncited by 22
- 2022Recent Advances in Vision Transformer: A Survey and Outlook of Recent Workcited by 21
- 2023CVTNet: A Cross-View Transformer Network for Place Recognition Using LiDAR Datacited by 19
- 2022AutoMerge: A Framework for Map Assembling and Smoothing in City-scale Environmentscited by 10
- 2023CrossLoc3D: Aerial-Ground Cross-Source 3D Place Recognitioncited by 10
12 most cited of 35 All 35 (JSON)
- 2025MCI-Net: A Robust Multi-Domain Context Integration Network for Point Cloud Registration29 Dec 2025
- 2025Text2Loc++: Generalizing 3D Point Cloud Localization from Natural Language19 Nov 2025
- 2025M3DMap: Object-aware Multimodal 3D Mapping for Dynamic Environments23 Aug 2025
- 2025LifelongPR: Lifelong point cloud place recognition based on sample replay and prompt learning14 Jul 2025
- 2025PRISM-Loc: a Lightweight Long-range LiDAR Localization in Urban Environments with Topological Maps18 Jun 2025
- 2025L2RSI: Cross-view LiDAR-based Place Recognition for Large-scale Urban Scenes via Remote Sensing Imagery14 Mar 2025
- 2025ForestLPR: LiDAR Place Recognition in Forests Attentioning Multiple BEV Density Images6 Mar 2025
- 2025CMMLoc: Advancing Text-to-PointCloud Localization with Cauchy-Mixture-Model Based Framework4 Mar 2025
- 2024A Deeper Look into Second-Order Feature Aggregation for LiDAR Place Recognition24 Sep 2024
- 2024MSSPlace: Multi-Sensor Place Recognition with Visual and Text Semantics22 Jul 2024
- 2024Point Tree Transformer for Point Cloud Registration25 Jun 2024
- 2024General Place Recognition Survey: Towards Real-World Autonomy8 May 2024
12 newest of 35 All 35 (JSON)