mlsanityData to 14 Oct 2026

SVT-Net: Super Light-Weight Sparse Voxel Transformer for Large Scale Place Recognition

arXiv 2105.00149 ↗First posted 1 May 2021cs.CVcited by 36

Not on the map. Why?

Abstract (arXiv)

Point cloud-based large scale place recognition is fundamental for many applications like Simultaneous Localization and Mapping (SLAM). Although many models have been proposed and have achieved good performance by learning short-range local features, long-range contextual properties have often been neglected. Moreover, the model size has also become a bottleneck for their wide applications. To overcome these challenges, we propose a super light-weight network model termed SVT-Net for large scale place recognition. Specifically, on top of the highly efficient 3D Sparse Convolution (SP-Conv), an Atom-based Sparse Voxel Transformer (ASVT) and a Cluster-based Sparse Voxel Transformer (CSVT) are proposed to learn both short-range local features and long-range contextual features in this model. Consisting of ASVT and CSVT, SVT-Net can achieve state-of-the-art on benchmark datasets in terms of both accuracy and speed with a super-light model size (0.9M). Meanwhile, two simplified versions of SVT-Net are introduced, which also achieve state-of-the-art and further reduce the model size to 0.8M and 0.4M respectively.

Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). Builds on 26 of its 45 references that are in the map. First posted on arXiv 1 May 2021.

Builds on

26 of 45 references.

References · 26

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  6. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  7. 2017Squeeze-and-Excitation Networkscited by 4,789
  8. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  9. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
  10. 2020Point Transformercited by 1,470
  11. 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,230
  12. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
14 more
  1. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
  2. 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 941
  3. 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
  4. 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
  5. 2020PCT: Point cloud transformercited by 732
  6. 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 499
  7. 2019A Survey of Deep Learning Techniques for Autonomous Drivingcited by 403
  8. 2020Visual Transformers: Token-based Image Representation and Processing for Computer Visioncited by 334
  9. 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 238
  10. 2018PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognitioncited by 198
  11. 2018A2-Nets: Double Attention Networkscited by 136
  12. 2020MinkLoc3D: Point Cloud Based Large-Scale Place Recognitioncited by 115
  13. 2019PCAN: 3D Attention Map Learning Using Contextual Information for Point Cloud Based Retrievalcited by 68
  14. 2020SOE-Net: A Self-Attention and Orientation Encoding Network for Point Cloud based Place Recognitioncited by 66

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 2; 2022: 8; 2023: 9; 2024: 8; 2025: 8; 2026: 1.

36 papers.

Sort:

By area:

  1. 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
  2. 2023R2Former: Unified Retrieval and Reranking Transformer for Place Recognitioncited by 102
  3. 2022Bridging the Domain Gap for Multi-Agent Perceptioncited by 60
  4. 2022Improving Point Cloud Based Place Recognition with Ranking-based Loss and Large Batch Trainingcited by 45
  5. 2023Text2Loc: 3D Point Cloud Localization from Natural Languagecited by 35
  6. 2022Transformers in 3D Point Clouds: A Surveycited by 31
  7. 2024General Place Recognition Survey: Towards Real-World Autonomycited by 23
  8. 2022CASSPR: Cross Attention Single Scan Place Recognitioncited by 22
  9. 2022Recent Advances in Vision Transformer: A Survey and Outlook of Recent Workcited by 21
  10. 2023CVTNet: A Cross-View Transformer Network for Place Recognition Using LiDAR Datacited by 19
  11. 2022AutoMerge: A Framework for Map Assembling and Smoothing in City-scale Environmentscited by 10
  12. 2023CrossLoc3D: Aerial-Ground Cross-Source 3D Place Recognitioncited by 10
24 more
  1. 2025CMMLoc: Advancing Text-to-PointCloud Localization with Cauchy-Mixture-Model Based Frameworkcited by 8
  2. 2024MSSPlace: Multi-Sensor Place Recognition with Visual and Text Semanticscited by 7
  3. 2024MinkUNeXt: Point Cloud-based Large-scale Place Recognition using 3D Sparse Convolutionscited by 6
  4. 2025ForestLPR: LiDAR Place Recognition in Forests Attentioning Multiple BEV Density Imagescited by 6
  5. 2021RPR-Net: A Point Cloud-based Rotation-aware Large Scale Place Recognition Networkcited by 5
  6. 2024VXP: Voxel-Cross-Pixel Large-scale Image-LiDAR Place Recognitioncited by 5
  7. 2024Point Tree Transformer for Point Cloud Registrationcited by 5
  8. 2026VLM-Loc: Localization in Point Cloud Maps via Vision-Language Modelscited by 4
  9. 2023SAT: Size-Aware Transformer for 3D Point Cloud Semantic Segmentationcited by 3
  10. 2024Instance-free Text to Point Cloud Localization with Relative Position Awarenesscited by 3
  11. 2023SelFLoc: Selective Feature Fusion for Large-scale Point Cloud-based Place Recognitioncited by 2
  12. 2023Pose-Graph Attentional Graph Neural Network for Lidar Place Recognitioncited by 2
  13. 2024PRISM-TopoMap: Online Topological Mapping with Place Recognition and Scan Matchingcited by 2
  14. 2025L2RSI: Cross-view LiDAR-based Place Recognition for Large-scale Urban Scenes via Remote Sensing Imagerycited by 2
  15. 2025LifelongPR: Lifelong point cloud place recognition based on sample replay and prompt learningcited by 2
  16. 2021DSC: Deep Scan Context Descriptor for Large-Scale Place Recognitioncited by 1
  17. 2023BPT: Binary Point Cloud Transformer for Place Recognitioncited by 1
  18. 2023VNI-Net: Vector Neurons-based Rotation-Invariant Descriptor for LiDAR Place Recognitioncited by 1
  19. 2025M3DMap: Object-aware Multimodal 3D Mapping for Dynamic Environmentscited by 1
  20. 2025MCI-Net: A Robust Multi-Domain Context Integration Network for Point Cloud Registrationcited by 1
  21. 2022GIDP: Learning a Good Initialization and Inducing Descriptor Post-enhancing for Large-scale Place Recognitioncited by 0
  22. 2024A Deeper Look into Second-Order Feature Aggregation for LiDAR Place Recognitioncited by 0
  23. 2025PRISM-Loc: a Lightweight Long-range LiDAR Localization in Urban Environments with Topological Mapscited by 0
  24. 2025Text2Loc++: Generalizing 3D Point Cloud Localization from Natural Languagecited by 0