Hierarchical Image Classification using Entailment Cone Embeddings
Not on the map. Why?
Abstract (arXiv)
Image classification has been studied extensively, but there has been limited work in using unconventional, external guidance other than traditional image-label pairs for training. We present a set of methods for leveraging information about the semantic hierarchy embedded in class labels. We first inject label-hierarchy knowledge into an arbitrary CNN-based classifier and empirically show that availability of such external semantic information in conjunction with the visual semantics from images boosts overall performance. Taking a step further in this direction, we model more explicitly the label-label and label-image interactions using order-preserving embeddings governed by both Euclidean and hyperbolic geometries, prevalent in natural language, and tailor them to hierarchical image classification and representation learning. We empirically validate all the models on the hierarchical ETHEC dataset.
Key facts. Cited by 46 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 7; 2023: 8; 2024: 6; 2025: 9; 2026: 8.
46 papers.
Sort:
By area:
- 2022Hyperbolic Image Segmentationcited by 101
- 2023Hyperbolic Deep Learning in Computer Vision: A Surveycited by 72
- 2021Learning the Predictability of the Futurecited by 48
- 2024Hypformer: Exploring Efficient Transformer Fully in Hyperbolic Spacecited by 39
- 2023Poincar'e ResNetcited by 24
- 2023HGCLIP: Exploring Vision-Language Models with Graph Representations for Hierarchical Understandingcited by 21
- 2023From Isolated Islands to Pangea: Unifying Semantic Space for Human Action Understandingcited by 19
- 2024Emergent Visual-Semantic Hierarchies in Image-Text Representationscited by 19
- 2024HYPE: Hyperbolic Entailment Filtering for Underspecified Images and Textscited by 17
- 2024Learning Structured Representations with Hyperbolic Embeddingscited by 16
- 2021Leveraging Hierarchical Structures for Few-Shot Musical Instrument Recognitioncited by 13
- 2025Taxonomy-Aware Evaluation of Vision-Language Modelscited by 11
34 more
- 2021Hierarchical Knowledge Guided Learning for Real-world Retinal Diseases Recognitioncited by 10
- 2023Optimization of Rank Losses for Image Retrievalcited by 10
- 2022Hierarchical Average Precision Training for Pertinent Image Retrievalcited by 8
- 2023Geometric Relational Embeddings: A Surveycited by 8
- 2024Learning Visual Hierarchies in Hyperbolic Space for Image Retrievalcited by 8
- 2022A Survey of Neural Treescited by 7
- 2025Low-distortion and GPU-compatible Tree Embeddings in Hyperbolic Spacecited by 6
- 2021Digital Taxonomist: Identifying Plant Species in Community Scientists' Photographscited by 4
- 2022What is Your Metric Telling You? Evaluating Classifier Calibration under Context-Specific Definitions of Reliabilitycited by 4
- 2022A Capsule Network for Hierarchical Multi-Label Image Classificationcited by 4
- 2025Continual Hyperbolic Learning of Instances and Classescited by 4
- 2025One Swallow Does Not Make a Summer: Understanding Semantic Structures in Embedding Spacescited by 4
- 2021United We Learn Better: Harvesting Learning Improvements From Class Hierarchies Across Taskscited by 3
- 2021Label Hierarchy Transition: Delving into Class Hierarchies to Enhance Deep Classifierscited by 3
- 2021Encoding Hierarchical Information in Neural Networks helps in Subpopulation Shiftcited by 3
- 2022All Mistakes Are Not Equal: Comprehensive Hierarchy Aware Multi-label Predictions (CHAMP)cited by 3
- 2024Adversarial Attacks on Hyperbolic Networkscited by 3
- 2023Unsupervised Feature Learning with Emergent Data-Driven Prototypicalitycited by 2
- 2025Hyperbolic Large Language Modelscited by 2
- 2022Is Medieval Distant Viewing Possible? : Extending and Enriching Annotation of Legacy Image Collections using Visual Analyticscited by 1
- 2025Balanced Hyperbolic Embeddings Are Natural Out-of-Distribution Detectorscited by 1
- 2025Minimizing Hyperbolic Embedding Distortion with LLM-Guided Hierarchy Restructuringcited by 1
- 2021Graceful Degradation and Related Fieldscited by 0
- 2023Enhancing Classification with Hierarchical Scalable Query on Fusion Transformercited by 0
- 2025HMID-Net: An Exploration of Masked Image Modeling and Knowledge Distillation in Hyperbolic Spacecited by 0
- 2025Native Hierarchical and Compositional Representations with Subspace Embeddingscited by 0
- 2026Learning Action Hierarchies via Hybrid Geometric Diffusioncited by 0
- 2026HypCBC: Domain-Invariant Hyperbolic Cross-Branch Consistency for Generalizable Medical Image Analysiscited by 0
- 2026Explaining, Verifying, and Aligning Semantic Hierarchies in Vision-Language Model Embeddingscited by 0
- 2026MAPLE: Multi-Path Adaptive Propagation with Level-Aware Embeddings for Hierarchical Multi-Label Image Classificationcited by 0
- 2026Hyperbolic Concept Bottleneck Modelscited by 0
- 2026Label Granularity Skew in Federated Learning with Hierarchical Image Classificationcited by 0
- 2026Hierarchical Prompt Learning for Hyperbolic Vision-Language Modelscited by 0
- 2026Geometry-Aware Hyperbolic Residual-Quantized Variational Autoencoderscited by 0
- 2026Geometry-Aware Hyperbolic Residual-Quantized Variational Autoencoders22 Sep 2026
- 2026Hierarchical Prompt Learning for Hyperbolic Vision-Language Models21 Sep 2026
- 2026Label Granularity Skew in Federated Learning with Hierarchical Image Classification10 Aug 2026
- 2026Hyperbolic Concept Bottleneck Models7 May 2026
- 2026MAPLE: Multi-Path Adaptive Propagation with Level-Aware Embeddings for Hierarchical Multi-Label Image Classification31 Mar 2026
- 2026Explaining, Verifying, and Aligning Semantic Hierarchies in Vision-Language Model Embeddings26 Mar 2026
- 2026HypCBC: Domain-Invariant Hyperbolic Cross-Branch Consistency for Generalizable Medical Image Analysis3 Feb 2026
- 2026Learning Action Hierarchies via Hybrid Geometric Diffusion5 Jan 2026
- 2025One Swallow Does Not Make a Summer: Understanding Semantic Structures in Embedding Spaces30 Nov 2025
- 2025Minimizing Hyperbolic Embedding Distortion with LLM-Guided Hierarchy Restructuring16 Nov 2025
- 2025Hyperbolic Large Language Models6 Sep 2025
- 2025Native Hierarchical and Compositional Representations with Subspace Embeddings21 Aug 2025
34 more
- 2025HMID-Net: An Exploration of Masked Image Modeling and Knowledge Distillation in Hyperbolic Space13 Jul 2025
- 2025Continual Hyperbolic Learning of Instances and Classes12 Jun 2025
- 2025Balanced Hyperbolic Embeddings Are Natural Out-of-Distribution Detectors11 Jun 2025
- 2025Taxonomy-Aware Evaluation of Vision-Language Models7 Apr 2025
- 2025Low-distortion and GPU-compatible Tree Embeddings in Hyperbolic Space24 Feb 2025
- 2024Adversarial Attacks on Hyperbolic Networks2 Dec 2024
- 2024Learning Structured Representations with Hyperbolic Embeddings2 Dec 2024
- 2024Learning Visual Hierarchies in Hyperbolic Space for Image Retrieval26 Nov 2024
- 2024Emergent Visual-Semantic Hierarchies in Image-Text Representations11 Jul 2024
- 2024Hypformer: Exploring Efficient Transformer Fully in Hyperbolic Space1 Jul 2024
- 2024HYPE: Hyperbolic Entailment Filtering for Underspecified Images and Texts26 Apr 2024
- 2023HGCLIP: Exploring Vision-Language Models with Graph Representations for Hierarchical Understanding23 Nov 2023
- 2023Optimization of Rank Losses for Image Retrieval15 Sep 2023
- 2023Unsupervised Feature Learning with Emergent Data-Driven Prototypicality4 Jul 2023
- 2023Hyperbolic Deep Learning in Computer Vision: A Survey11 May 2023
- 2023Geometric Relational Embeddings: A Survey24 Apr 2023
- 2023From Isolated Islands to Pangea: Unifying Semantic Space for Human Action Understanding2 Apr 2023
- 2023Poincar'e ResNet24 Mar 2023
- 2023Enhancing Classification with Hierarchical Scalable Query on Fusion Transformer28 Feb 2023
- 2022A Capsule Network for Hierarchical Multi-Label Image Classification13 Sep 2022
- 2022A Survey of Neural Trees7 Sep 2022
- 2022Is Medieval Distant Viewing Possible? : Extending and Enriching Annotation of Legacy Image Collections using Visual Analytics20 Aug 2022
- 2022Hierarchical Average Precision Training for Pertinent Image Retrieval5 Jul 2022
- 2022All Mistakes Are Not Equal: Comprehensive Hierarchy Aware Multi-label Predictions (CHAMP)17 Jun 2022
- 2022What is Your Metric Telling You? Evaluating Classifier Calibration under Context-Specific Definitions of Reliability23 May 2022
- 2022Hyperbolic Image Segmentation11 Mar 2022
- 2021Encoding Hierarchical Information in Neural Networks helps in Subpopulation Shift20 Dec 2021
- 2021Label Hierarchy Transition: Delving into Class Hierarchies to Enhance Deep Classifiers4 Dec 2021
- 2021Hierarchical Knowledge Guided Learning for Real-world Retinal Diseases Recognition17 Nov 2021
- 2021United We Learn Better: Harvesting Learning Improvements From Class Hierarchies Across Tasks28 Jul 2021
- 2021Leveraging Hierarchical Structures for Few-Shot Musical Instrument Recognition14 Jul 2021
- 2021Graceful Degradation and Related Fields21 Jun 2021
- 2021Digital Taxonomist: Identifying Plant Species in Community Scientists' Photographs7 Jun 2021
- 2021Learning the Predictability of the Future1 Jan 2021
- 2023HGCLIP: Exploring Vision-Language Models with Graph Representations for Hierarchical Understandingcited by 21
- 2025Taxonomy-Aware Evaluation of Vision-Language Modelscited by 11
- 2026Explaining, Verifying, and Aligning Semantic Hierarchies in Vision-Language Model Embeddingscited by 0
- 2026Hierarchical Prompt Learning for Hyperbolic Vision-Language Modelscited by 0
- 2026Hierarchical Prompt Learning for Hyperbolic Vision-Language Models21 Sep 2026
- 2026Explaining, Verifying, and Aligning Semantic Hierarchies in Vision-Language Model Embeddings26 Mar 2026
- 2025Taxonomy-Aware Evaluation of Vision-Language Models7 Apr 2025
- 2023HGCLIP: Exploring Vision-Language Models with Graph Representations for Hierarchical Understanding23 Nov 2023
- 2022Hyperbolic Image Segmentationcited by 101
- 2023Hyperbolic Deep Learning in Computer Vision: A Surveycited by 72
- 2021Learning the Predictability of the Futurecited by 48
- 2024Hypformer: Exploring Efficient Transformer Fully in Hyperbolic Spacecited by 39
- 2023Poincar'e ResNetcited by 24
- 2023From Isolated Islands to Pangea: Unifying Semantic Space for Human Action Understandingcited by 19
- 2024Emergent Visual-Semantic Hierarchies in Image-Text Representationscited by 19
- 2024HYPE: Hyperbolic Entailment Filtering for Underspecified Images and Textscited by 17
- 2024Learning Structured Representations with Hyperbolic Embeddingscited by 16
- 2021Leveraging Hierarchical Structures for Few-Shot Musical Instrument Recognitioncited by 13
- 2021Hierarchical Knowledge Guided Learning for Real-world Retinal Diseases Recognitioncited by 10
- 2023Optimization of Rank Losses for Image Retrievalcited by 10
12 most cited of 42 All 42 (JSON)
- 2026Geometry-Aware Hyperbolic Residual-Quantized Variational Autoencoders22 Sep 2026
- 2026Label Granularity Skew in Federated Learning with Hierarchical Image Classification10 Aug 2026
- 2026Hyperbolic Concept Bottleneck Models7 May 2026
- 2026MAPLE: Multi-Path Adaptive Propagation with Level-Aware Embeddings for Hierarchical Multi-Label Image Classification31 Mar 2026
- 2026HypCBC: Domain-Invariant Hyperbolic Cross-Branch Consistency for Generalizable Medical Image Analysis3 Feb 2026
- 2026Learning Action Hierarchies via Hybrid Geometric Diffusion5 Jan 2026
- 2025One Swallow Does Not Make a Summer: Understanding Semantic Structures in Embedding Spaces30 Nov 2025
- 2025Minimizing Hyperbolic Embedding Distortion with LLM-Guided Hierarchy Restructuring16 Nov 2025
- 2025Hyperbolic Large Language Models6 Sep 2025
- 2025Native Hierarchical and Compositional Representations with Subspace Embeddings21 Aug 2025
- 2025HMID-Net: An Exploration of Masked Image Modeling and Knowledge Distillation in Hyperbolic Space13 Jul 2025
- 2025Continual Hyperbolic Learning of Instances and Classes12 Jun 2025
12 newest of 42 All 42 (JSON)