mlsanityData to 7 Oct 2026

MARs: Multi-view Attention Regularizations for Patch-based Feature Recognition of Space Terrain

arXiv 2410.05182 ↗First posted 7 Oct 2024cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The visual detection and tracking of surface terrain is required for spacecraft to safely land on or navigate within close proximity to celestial objects. Current approaches rely on template matching with pre-gathered patch-based features, which are expensive to obtain and a limiting factor in perceptual capability. While recent literature has focused on in-situ detection methods to enhance navigation and operational autonomy, robust description is still needed. In this work, we explore metric learning as the lightweight feature description mechanism and find that current solutions fail to address inter-class similarity and multi-view observational geometry. We attribute this to the view-unaware attention mechanism and introduce Multi-view Attention Regularizations (MARs) to constrain the channel and spatial attention across multiple feature views, regularizing the what and where of attention focus. We thoroughly analyze many modern metric learning losses with and without MARs and demonstrate improved terrain-feature recognition performance by upwards of 85%. We additionally introduce the Luna-1 dataset, consisting of Moon crater landmarks and reference navigation frames from NASA mission data to support future research in this difficult task. Luna-1 and source code are publicly available at https://droneslab.github.io/mars/.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 74 of its 122 references that are in the map. First posted on arXiv 7 Oct 2024.

Builds on

74 of 122 references.

References · 74

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  6. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  7. 2017Squeeze-and-Excitation Networkscited by 4,763
  8. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  9. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  10. 2020Supervised Contrastive Learningcited by 2,803
  11. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
  12. 2017Billion-scale similarity search with GPUscited by 2,477
38 more
  1. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  2. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  3. 2017Deformable Convolutional Networkscited by 1,481
  4. 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 791
  5. 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 497
  6. 2019General E(2)-Equivariant Steerable CNNscited by 441
  7. 2020Circle Loss: A Unified Perspective of Pair Similarity Optimizationcited by 402
  8. 2019Multi-Similarity Loss with General Pair Weighting for Deep Metric Learningcited by 368
  9. 2020Google Landmarks Dataset v2 -- A Large-Scale Benchmark for Instance-Level Recognition and Retrievalcited by 305
  10. 2020Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentationcited by 299
  11. 2016Steerable CNNscited by 298
  12. 2021Coordinate Attention for Efficient Mobile Network Designcited by 239
  13. 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 236
  14. 2020Proxy Anchor Loss for Deep Metric Learningcited by 195
  15. 2020Eigen-CAM: Class Activation Map using Principal Componentscited by 188
  16. 2022CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labelscited by 177
  17. 2022Rethinking Visual Geo-localization for Large-Scale Applicationscited by 160
  18. 2023MixVPR: Feature Mixing for Visual Place Recognitioncited by 160
  19. 2023AnyLoc: Towards Universal Visual Place Recognitioncited by 159
  20. 2016Deep Image Retrieval: Learning global representations for image searchcited by 147
  21. 2021Fine-Grained Image Analysis with Deep Learning: A Surveycited by 135
  22. 2023EigenPlaces: Training Viewpoint Robust Models for Visual Place Recognitioncited by 109
  23. 2016A Survey of Multi-View Representation Learningcited by 107
  24. 2020ProxyNCA++: Revisiting and Revitalizing Proxy Neighborhood Component Analysiscited by 107
  25. 2020LieTransformer: Equivariant self-attention for Lie Groupscited by 100
  26. 2020Unsupervised Pre-training for Person Re-identificationcited by 94
  27. 2023Beyond Appearance: a Semantic Controllable Self-Supervised Learning Framework for Human-Centric Visual Taskscited by 94
  28. 2016Exploiting Cyclic Symmetry in Convolutional Neural Networkscited by 91
  29. 2017Polar Transformer Networkscited by 81
  30. 2021Deep Learning for Instance Retrieval: A Surveycited by 70
  31. 2016SIFT Meets CNN: A Decade Survey of Instance Retrievalcited by 66
  32. 2021Instance-level Image Retrieval using Reranking Transformerscited by 63
  33. 2020PyTorch Metric Learningcited by 57
  34. 2018Spatial-Temporal Person Re-identificationcited by 45
  35. 2021Learning Partial Equivariances from Datacited by 44
  36. 2023OmniVec: Learning robust representations with cross modal sharingcited by 44
  37. 2021Eliminate Deviation with Deviation for Data Augmentation and a General Multi-modal Data Learning Methodcited by 42
  38. 2023Unicom: Universal and Compact Representation Learning for Image Retrievalcited by 36

50 most cited of 74 All 74 (JSON)

Built on by

Not cited yet.