# Multi-Attention Multi-Class Constraint for Fine-grained Image Recognition

arXiv: https://arxiv.org/abs/1806.05372 · HTML: https://mlsanity.com/paper/1806.05372/

## Key facts

- Cited by 58 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Jun 2018.

## Built on by (most cited first, 30 of 58)

- [Fine-Grained Image Analysis with Deep Learning: A Survey](https://mlsanity.com/paper/2111.06119/) (2021)
- [Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identification](https://mlsanity.com/paper/2108.08728/) (2021)
- [Dual Cross-Attention Learning for Fine-Grained Visual Categorization and Object Re-Identification](https://mlsanity.com/paper/2205.02151/) (2022)
- [Unsupervised Part Discovery from Contrastive Reconstruction](https://mlsanity.com/paper/2111.06349/) (2021)
- [Context-aware Attentional Pooling (CAP) for Fine-grained Visual Classification](https://mlsanity.com/paper/2101.06635/) (2021)
- [Attention Diversification for Domain Generalization](https://mlsanity.com/paper/2210.04206/) (2022)
- [Fine-Grained Object Classification via Self-Supervised Pose Alignment](https://mlsanity.com/paper/2203.15987/) (2022)
- [Fine-grained Visual Classification with High-temperature Refinement and Background Suppression](https://mlsanity.com/paper/2303.06442/) (2023)
- [Human Attention in Fine-grained Classification](https://mlsanity.com/paper/2111.01628/) (2021)
- [A Quality Aware Sample-to-Sample Comparison for Face Recognition](https://mlsanity.com/paper/2306.04000/) (2023)
- [Fashionformer: A simple, Effective and Unified Baseline for Human Fashion Segmentation and Recognition](https://mlsanity.com/paper/2204.04654/) (2022)
- [Learning Gabor Texture Features for Fine-Grained Recognition](https://mlsanity.com/paper/2308.05396/) (2023)
- [MemSAC: Memory Augmented Sample Consistency for Large Scale Unsupervised Domain Adaptation](https://mlsanity.com/paper/2207.12389/) (2022)
- [CAM-loss: Towards Learning Spatially Discriminative Feature Representations](https://mlsanity.com/paper/2109.01359/) (2021)
- [A Novel Plug-in Module for Fine-Grained Visual Classification](https://mlsanity.com/paper/2202.03822/) (2022)
- [Mask Guided Attention For Fine-Grained Patchy Image Classification](https://mlsanity.com/paper/2102.02771/) (2021)
- [Object-aware Long-short-range Spatial Alignment for Few-Shot Fine-Grained Image Classification](https://mlsanity.com/paper/2108.13098/) (2021)
- [Fine-Grained Visual Classification using Self Assessment Classifier](https://mlsanity.com/paper/2205.10529/) (2022)
- [Hierarchical Few-Shot Object Detection: Problem, Benchmark and Method](https://mlsanity.com/paper/2210.03940/) (2022)
- [Learning Canonical 3D Object Representation for Fine-Grained Recognition](https://mlsanity.com/paper/2108.04628/) (2021)
- [Part-guided Relational Transformers for Fine-grained Visual Recognition](https://mlsanity.com/paper/2212.13685/) (2022)
- [Making a Bird AI Expert Work for You and Me](https://mlsanity.com/paper/2112.02747/) (2021)
- [Progressive Co-Attention Network for Fine-grained Visual Classification](https://mlsanity.com/paper/2101.08527/) (2021)
- [Weakly Supervised Keypoint Discovery](https://mlsanity.com/paper/2109.13423/) (2021)
- [Convolutional Fine-Grained Classification with Self-Supervised Target Relation Regularization](https://mlsanity.com/paper/2208.01997/) (2022)
- [Soccer Event Detection Using Deep Learning](https://mlsanity.com/paper/2102.04331/) (2021)
- [Multi-Granularity Archaeological Dating of Chinese Bronze Dings Based on a Knowledge-Guided Relation Graph](https://mlsanity.com/paper/2303.15266/) (2023)
- [Car-1000: A New Large Scale Fine-Grained Visual Categorization Dataset](https://mlsanity.com/paper/2503.12385/) (2025)
- [Fine-Grained Visual Classification via Simultaneously Learning of Multi-regional Multi-grained Features](https://mlsanity.com/paper/2102.00367/) (2021)
- [Context-Semantic Quality Awareness Network for Fine-Grained Visual Categorization](https://mlsanity.com/paper/2403.10298/) (2024)

## Abstract (arXiv)

Attention-based learning for fine-grained image recognition remains a challenging task, where most of the existing methods treat each object part in isolation, while neglecting the correlations among them. In addition, the multi-stage or multi-scale mechanisms involved make the existing methods less efficient and hard to be trained end-to-end. In this paper, we propose a novel attention-based convolutional neural network (CNN) which regulates multiple object parts among different input images. Our method first learns multiple attention region features of each input image through the one-squeeze multi-excitation (OSME) module, and then apply the multi-attention multi-class constraint (MAMC) in a metric learning framework. For each anchor feature, the MAMC functions by pulling same-attention same-class features closer, while pushing different-attention or different-class features away. Our method can be easily trained end-to-end, and is highly efficient which requires only one training stage. Moreover, we introduce Dogs-in-the-Wild, a comprehensive dog species dataset that surpasses similar existing datasets by category coverage, data volume and annotation quality. This dataset will be released upon acceptance to facilitate the research of fine-grained image recognition. Extensive experiments are conducted to show the substantial improvements of our method on four benchmark datasets.
