# Embedding Label Structures for Fine-Grained Feature Representation

arXiv: https://arxiv.org/abs/1512.02895 · HTML: https://mlsanity.com/paper/1512.02895/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 9 Dec 2015.

## Built on by (most cited first, 17 of 17)

- [Learning Intra-Batch Connections for Deep Metric Learning](https://mlsanity.com/paper/2102.07753/) (2021)
- [Label Relation Graphs Enhanced Hierarchical Residual Network for Hierarchical Multi-Granularity Classification](https://mlsanity.com/paper/2201.03194/) (2022)
- [Dynamic Modeling of Hand-Object Interactions via Tactile Sensing](https://mlsanity.com/paper/2109.04378/) (2021)
- [Contrastive Bayesian Analysis for Deep Metric Learning](https://mlsanity.com/paper/2210.04402/) (2022)
- [The Group Loss++: A deeper look into group loss for deep metric learning](https://mlsanity.com/paper/2204.01509/) (2022)
- [Convolutional Fine-Grained Classification with Self-Supervised Target Relation Regularization](https://mlsanity.com/paper/2208.01997/) (2022)
- [Learning Structured Representations by Embedding Class Hierarchy with Fast Optimal Transport](https://mlsanity.com/paper/2410.03052/) (2024)
- [Learning Twofold Heterogeneous Multi-Task by Sharing Similar Convolution Kernel Pairs](https://mlsanity.com/paper/2101.12431/) (2021)
- [Modality-Aware Triplet Hard Mining for Zero-shot Sketch-Based Image Retrieval](https://mlsanity.com/paper/2112.07966/) (2021)
- [Expert-LaSTS: Expert-Knowledge Guided Latent Space for Traffic Scenarios](https://mlsanity.com/paper/2207.09120/) (2022)
- [Parsing Objects at a Finer Granularity: A Survey](https://mlsanity.com/paper/2212.13693/) (2022)
- [Multi-Level Visual Similarity Based Personalized Tourist Attraction Recommendation Using Geo-Tagged Photos](https://mlsanity.com/paper/2109.08275/) (2021)
- [Cascading Hierarchical Networks with Multi-task Balanced Loss for Fine-grained hashing](https://mlsanity.com/paper/2303.11274/) (2023)
- [Hybrid Losses for Hierarchical Embedding Learning](https://mlsanity.com/paper/2501.12796/) (2025)
- [Improving Deep Representation Learning via Auxiliary Learnable Target Coding](https://mlsanity.com/paper/2305.18680/) (2023)
- [Re-thinking Human Activity Recognition with Hierarchy-aware Label Relationship Modeling](https://mlsanity.com/paper/2403.05557/) (2024)
- [DAAL: Density-Aware Adaptive Line Margin Loss for Multi-Modal Deep Metric Learning](https://mlsanity.com/paper/2410.05438/) (2024)

## Abstract (arXiv)

Recent algorithms in convolutional neural networks (CNN) considerably advance the fine-grained image classification, which aims to differentiate subtle differences among subordinate classes. However, previous studies have rarely focused on learning a fined-grained and structured feature representation that is able to locate similar images at different levels of relevance, e.g., discovering cars from the same make or the same model, both of which require high precision. In this paper, we propose two main contributions to tackle this problem. 1) A multi-task learning framework is designed to effectively learn fine-grained feature representations by jointly optimizing both classification and similarity constraints. 2) To model the multi-level relevance, label structures such as hierarchy or shared attributes are seamlessly embedded into the framework by generalizing the triplet loss. Extensive and thorough experiments have been conducted on three fine-grained datasets, i.e., the Stanford car, the car-333, and the food datasets, which contain either hierarchical labels or shared attributes. Our proposed method has achieved very competitive performance, i.e., among state-of-the-art classification accuracy. More importantly, it significantly outperforms previous fine-grained feature representations for image retrieval at different levels of relevance.