mlsanityData to 7 Oct 2026

EffLoc: Lightweight Vision Transformer for Efficient 6-DOF Camera Relocalization

arXiv 2402.13537 ↗First posted 21 Feb 2024cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Camera relocalization is pivotal in computer vision, with applications in AR, drones, robotics, and autonomous driving. It estimates 3D camera position and orientation (6-DoF) from images. Unlike traditional methods like SLAM, recent strides use deep learning for direct end-to-end pose estimation. We propose EffLoc, a novel efficient Vision Transformer for single-image camera relocalization. EffLoc's hierarchical layout, memory-bound self-attention, and feed-forward layers boost memory efficiency and inter-channel communication. Our introduced sequential group attention (SGA) module enhances computational efficiency by diversifying input features, reducing redundancy, and expanding model capacity. EffLoc excels in efficiency and accuracy, outperforming prior methods, such as AtLoc and MapNet. It thrives on large-scale outdoor car-driving scenario, ensuring simplicity, end-to-end trainability, and eliminating handcrafted loss functions.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 36 of its 46 references that are in the map. First posted on arXiv 21 Feb 2024.

Builds on

36 of 46 references.

References · 36

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  6. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  7. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,153
  8. 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
  9. 2019Are Sixteen Heads Really Better than One?cited by 803
  10. 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 636
  11. 2018Rethinking the Value of Network Pruningcited by 595
  12. 2021Early Convolutions Help Transformers See Bettercited by 395
24 more
  1. 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
  2. 2022EfficientFormer: Vision Transformers at MobileNet Speedcited by 240
  3. 2017Geometric Loss Functions for Camera Pose Regression with Deep Learningcited by 224
  4. 2019Understanding the Limitations of CNN-based Absolute Camera Pose Regressioncited by 177
  5. 2017DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networkscited by 173
  6. 2023EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attentioncited by 172
  7. 2022Separable Self-attention for Mobile Vision Transformerscited by 163
  8. 2017Geometry-Aware Learning of Maps for Camera Localizationcited by 161
  9. 2016Image-based localization using LSTMs for structured feature correlationcited by 136
  10. 2015Modelling Uncertainty in Deep Learning for Camera Relocalizationcited by 133
  11. 2020Data Movement Is All You Need: A Case Study on Optimizing Transformerscited by 108
  12. 2021Learning Multi-Scene Absolute Pose Regression with Transformerscited by 108
  13. 2019AtLoc: Attention Guided Camera Localizationcited by 92
  14. 2022MiniViT: Compressing Vision Transformers with Weight Multiplexingcited by 88
  15. 2022Next-ViT: Next Generation Vision Transformer for Efficient Deployment in Realistic Industrial Scenarioscited by 65
  16. 2017VidLoc: A Deep Spatio-Temporal Model for 6-DoF Video-Clip Relocalizationcited by 58
  17. 2019A Comprehensive guide to Bayesian Convolutional Neural Network with Variational Inferencecited by 51
  18. 2022MobileViTv3: Mobile-Friendly Vision Transformer with Simple and Effective Fusion of Local, Global and Input Featurescited by 44
  19. 2019Selective Sensor Fusion for Neural Visual-Inertial Odometrycited by 34
  20. 2022ParC-Net: Position Aware Circular Convolution with Merits from ConvNets and Transformercited by 28
  21. 2022Camera Pose Auto-Encoders for Improving Pose Regressioncited by 28
  22. 2019CMRNet: Camera to LiDAR-Map Registrationcited by 25
  23. 2022RobustLoc: Robust Camera Pose Regression in Challenging Driving Environmentscited by 18
  24. 2019ORBSLAM-Atlas: a robust and accurate multi-map systemcited by 9

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 2.

3 papers.