BPT: Binary Point Cloud Transformer for Place Recognition
Not on the map. Why?
Abstract (arXiv)
Place recognition, an algorithm to recognize the re-visited places, plays the role of back-end optimization trigger in a full SLAM system. Many works equipped with deep learning tools, such as MLP, CNN, and transformer, have achieved great improvements in this research field. Point cloud transformer is one of the excellent frameworks for place recognition applied in robotics, but with large memory consumption and expensive computation, it is adverse to widely deploy the various point cloud transformer networks in mobile or embedded devices. To solve this issue, we propose a binary point cloud transformer for place recognition. As a result, a 32-bit full-precision model can be reduced to a 1-bit model with less memory occupation and faster binarized bitwise operations. To our best knowledge, this is the first binary point cloud transformer that can be deployed on mobile devices for online applications such as place recognition. Experiments on several standard benchmarks demonstrate that the proposed method can get comparable results with the corresponding full-precision transformer model and even outperform some full-precision deep learning methods. For example, the proposed method achieves 93.28% at the top @1% and 85.74% at the top @1% on the Oxford RobotCar dataset in terms of the metric of the average recall rate. Meanwhile, the size and floating point operations of the model with the same transformer structure reduce 56.1% and 34.1% respectively from original precision to binary precision.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 48 of its 61 references that are in the map. First posted on arXiv 2 Mar 2023.
Builds on
48 of 61 references.
References · 48
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
- 2020Point Transformercited by 1,462
36 more
- 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,153
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2019Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Prunedcited by 844
- 2016XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networkscited by 829
- 2019Are Sixteen Heads Really Better than One?cited by 803
- 2020PCT: Point cloud transformercited by 730
- 2019Patient Knowledge Distillation for BERT Model Compressioncited by 502
- 2019Reducing Transformer Depth on Demand with Structured Dropoutcited by 434
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
- 2019Q-BERT: Hessian Based Ultra Low Precision Quantization of BERTcited by 355
- 2019Q8BERT: Quantized 8Bit BERTcited by 296
- 2020DynaBERT: Dynamic BERT with Adaptive Width and Depthcited by 246
- 2020FastBERT: a Self-distilling BERT with Adaptive Inference Timecited by 224
- 2018PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognitioncited by 197
- 2020BinaryBERT: Pushing the Limit of BERT Quantizationcited by 175
- 2020TernaryBERT: Distillation-aware Ultra-low Bit BERTcited by 145
- 2020MinkLoc3D: Point Cloud Based Large-Scale Place Recognitioncited by 114
- 2022Q-ViT: Accurate and Fully Quantized Low-bit Vision Transformercited by 106
- 2019A Tensorized Transformer for Language Modelingcited by 85
- 2021OverlapNet: Loop Closing for LiDAR-based SLAMcited by 72
- 2022BiBERT: Accurate Fully Binarized BERTcited by 70
- 2019PCAN: 3D Attention Map Learning Using Contextual Information for Point Cloud Based Retrievalcited by 68
- 2020SOE-Net: A Self-Attention and Orientation Encoding Network for Point Cloud based Place Recognitioncited by 66
- 2022BiT: Robustly Binarized Multi-distilled Transformercited by 51
- 2016SegMatch: Segment based loop-closure for 3D point cloudscited by 48
- 2020DH3D: Deep Hierarchical 3D Descriptors for Robust Large-Scale 6DoF Relocalizationcited by 42
- 2019LiDAR Iris for Loop-Closure Detectioncited by 39
- 2020Locus: LiDAR-based Place Recognition using Spatiotemporal Higher-Order Poolingcited by 38
- 2021NDT-Transformer: Large-Scale 3D Point Cloud Localisation using the Normal Distribution Transform Representationcited by 38
- 2021SVT-Net: Super Light-Weight Sparse Voxel Transformer for Large Scale Place Recognitioncited by 36
- 2022Q-ViT: Fully Differentiable Quantization for Vision Transformercited by 36
- 2020BiPointNet: Binary Neural Network for Point Cloudscited by 30
- 2021Efficient 3D Point Cloud Feature Learning for Large-Scale Place Recognitioncited by 21
- 2022HiTPR: Hierarchical Transformer for Place Recognition in Point Cloudcited by 10
- 2022SVNet: Where SO(3) Equivariance Meets Binarization on Point Cloud Representationcited by 10
- 2021POEM: 1-bit Point-wise Operations based on Expectation-Maximization for Efficient Point Cloud Processingcited by 6
Built on by
Citing papers per year: 2024: 1.
1 paper.