mlsanityData to 7 Oct 2026

BPT: Binary Point Cloud Transformer for Place Recognition

arXiv 2303.01166 ↗First posted 2 Mar 2023cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Place recognition, an algorithm to recognize the re-visited places, plays the role of back-end optimization trigger in a full SLAM system. Many works equipped with deep learning tools, such as MLP, CNN, and transformer, have achieved great improvements in this research field. Point cloud transformer is one of the excellent frameworks for place recognition applied in robotics, but with large memory consumption and expensive computation, it is adverse to widely deploy the various point cloud transformer networks in mobile or embedded devices. To solve this issue, we propose a binary point cloud transformer for place recognition. As a result, a 32-bit full-precision model can be reduced to a 1-bit model with less memory occupation and faster binarized bitwise operations. To our best knowledge, this is the first binary point cloud transformer that can be deployed on mobile devices for online applications such as place recognition. Experiments on several standard benchmarks demonstrate that the proposed method can get comparable results with the corresponding full-precision transformer model and even outperform some full-precision deep learning methods. For example, the proposed method achieves 93.28% at the top @1% and 85.74% at the top @1% on the Oxford RobotCar dataset in terms of the metric of the average recall rate. Meanwhile, the size and floating point operations of the model with the same transformer structure reduce 56.1% and 34.1% respectively from original precision to binary precision.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 48 of its 61 references that are in the map. First posted on arXiv 2 Mar 2023.

Builds on

48 of 61 references.

References · 48

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  7. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  8. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  9. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  10. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  11. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
  12. 2020Point Transformercited by 1,462
36 more
  1. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,153
  2. 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
  3. 2019Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Prunedcited by 844
  4. 2016XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networkscited by 829
  5. 2019Are Sixteen Heads Really Better than One?cited by 803
  6. 2020PCT: Point cloud transformercited by 730
  7. 2019Patient Knowledge Distillation for BERT Model Compressioncited by 502
  8. 2019Reducing Transformer Depth on Demand with Structured Dropoutcited by 434
  9. 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
  10. 2019Q-BERT: Hessian Based Ultra Low Precision Quantization of BERTcited by 355
  11. 2019Q8BERT: Quantized 8Bit BERTcited by 296
  12. 2020DynaBERT: Dynamic BERT with Adaptive Width and Depthcited by 246
  13. 2020FastBERT: a Self-distilling BERT with Adaptive Inference Timecited by 224
  14. 2018PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognitioncited by 197
  15. 2020BinaryBERT: Pushing the Limit of BERT Quantizationcited by 175
  16. 2020TernaryBERT: Distillation-aware Ultra-low Bit BERTcited by 145
  17. 2020MinkLoc3D: Point Cloud Based Large-Scale Place Recognitioncited by 114
  18. 2022Q-ViT: Accurate and Fully Quantized Low-bit Vision Transformercited by 106
  19. 2019A Tensorized Transformer for Language Modelingcited by 85
  20. 2021OverlapNet: Loop Closing for LiDAR-based SLAMcited by 72
  21. 2022BiBERT: Accurate Fully Binarized BERTcited by 70
  22. 2019PCAN: 3D Attention Map Learning Using Contextual Information for Point Cloud Based Retrievalcited by 68
  23. 2020SOE-Net: A Self-Attention and Orientation Encoding Network for Point Cloud based Place Recognitioncited by 66
  24. 2022BiT: Robustly Binarized Multi-distilled Transformercited by 51
  25. 2016SegMatch: Segment based loop-closure for 3D point cloudscited by 48
  26. 2020DH3D: Deep Hierarchical 3D Descriptors for Robust Large-Scale 6DoF Relocalizationcited by 42
  27. 2019LiDAR Iris for Loop-Closure Detectioncited by 39
  28. 2020Locus: LiDAR-based Place Recognition using Spatiotemporal Higher-Order Poolingcited by 38
  29. 2021NDT-Transformer: Large-Scale 3D Point Cloud Localisation using the Normal Distribution Transform Representationcited by 38
  30. 2021SVT-Net: Super Light-Weight Sparse Voxel Transformer for Large Scale Place Recognitioncited by 36
  31. 2022Q-ViT: Fully Differentiable Quantization for Vision Transformercited by 36
  32. 2020BiPointNet: Binary Neural Network for Point Cloudscited by 30
  33. 2021Efficient 3D Point Cloud Feature Learning for Large-Scale Place Recognitioncited by 21
  34. 2022HiTPR: Hierarchical Transformer for Place Recognition in Point Cloudcited by 10
  35. 2022SVNet: Where SO(3) Equivariance Meets Binarization on Point Cloud Representationcited by 10
  36. 2021POEM: 1-bit Point-wise Operations based on Expectation-Maximization for Efficient Point Cloud Processingcited by 6

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.