MARs: Multi-view Attention Regularizations for Patch-based Feature Recognition of Space Terrain
Not on the map. Why?
Abstract (arXiv)
The visual detection and tracking of surface terrain is required for spacecraft to safely land on or navigate within close proximity to celestial objects. Current approaches rely on template matching with pre-gathered patch-based features, which are expensive to obtain and a limiting factor in perceptual capability. While recent literature has focused on in-situ detection methods to enhance navigation and operational autonomy, robust description is still needed. In this work, we explore metric learning as the lightweight feature description mechanism and find that current solutions fail to address inter-class similarity and multi-view observational geometry. We attribute this to the view-unaware attention mechanism and introduce Multi-view Attention Regularizations (MARs) to constrain the channel and spatial attention across multiple feature views, regularizing the what and where of attention focus. We thoroughly analyze many modern metric learning losses with and without MARs and demonstrate improved terrain-feature recognition performance by upwards of 85%. We additionally introduce the Luna-1 dataset, consisting of Moon crater landmarks and reference navigation frames from NASA mission data to support future research in this difficult task. Luna-1 and source code are publicly available at https://droneslab.github.io/mars/.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 74 of its 122 references that are in the map. First posted on arXiv 7 Oct 2024.
Builds on
74 of 122 references.
References · 74
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2020Supervised Contrastive Learningcited by 2,803
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
- 2017Billion-scale similarity search with GPUscited by 2,477
38 more
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2017Deformable Convolutional Networkscited by 1,481
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 791
- 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 497
- 2019General E(2)-Equivariant Steerable CNNscited by 441
- 2020Circle Loss: A Unified Perspective of Pair Similarity Optimizationcited by 402
- 2019Multi-Similarity Loss with General Pair Weighting for Deep Metric Learningcited by 368
- 2020Google Landmarks Dataset v2 -- A Large-Scale Benchmark for Instance-Level Recognition and Retrievalcited by 305
- 2020Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentationcited by 299
- 2016Steerable CNNscited by 298
- 2021Coordinate Attention for Efficient Mobile Network Designcited by 239
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 236
- 2020Proxy Anchor Loss for Deep Metric Learningcited by 195
- 2020Eigen-CAM: Class Activation Map using Principal Componentscited by 188
- 2022CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labelscited by 177
- 2022Rethinking Visual Geo-localization for Large-Scale Applicationscited by 160
- 2023MixVPR: Feature Mixing for Visual Place Recognitioncited by 160
- 2023AnyLoc: Towards Universal Visual Place Recognitioncited by 159
- 2016Deep Image Retrieval: Learning global representations for image searchcited by 147
- 2021Fine-Grained Image Analysis with Deep Learning: A Surveycited by 135
- 2023EigenPlaces: Training Viewpoint Robust Models for Visual Place Recognitioncited by 109
- 2016A Survey of Multi-View Representation Learningcited by 107
- 2020ProxyNCA++: Revisiting and Revitalizing Proxy Neighborhood Component Analysiscited by 107
- 2020LieTransformer: Equivariant self-attention for Lie Groupscited by 100
- 2020Unsupervised Pre-training for Person Re-identificationcited by 94
- 2023Beyond Appearance: a Semantic Controllable Self-Supervised Learning Framework for Human-Centric Visual Taskscited by 94
- 2016Exploiting Cyclic Symmetry in Convolutional Neural Networkscited by 91
- 2017Polar Transformer Networkscited by 81
- 2021Deep Learning for Instance Retrieval: A Surveycited by 70
- 2016SIFT Meets CNN: A Decade Survey of Instance Retrievalcited by 66
- 2021Instance-level Image Retrieval using Reranking Transformerscited by 63
- 2020PyTorch Metric Learningcited by 57
- 2018Spatial-Temporal Person Re-identificationcited by 45
- 2021Learning Partial Equivariances from Datacited by 44
- 2023OmniVec: Learning robust representations with cross modal sharingcited by 44
- 2021Eliminate Deviation with Deviation for Data Augmentation and a General Multi-modal Data Learning Methodcited by 42
- 2023Unicom: Universal and Compact Representation Learning for Image Retrievalcited by 36
50 most cited of 74 All 74 (JSON)
Built on by
Not cited yet.