Hyperspherical Prototype Networks
Not on the map. Why?
Abstract (arXiv)
This paper introduces hyperspherical prototype networks, which unify classification and regression with prototypes on hyperspherical output spaces. For classification, a common approach is to define prototypes as the mean output vector over training examples per class. Here, we propose to use hyperspheres as output spaces, with class prototypes defined a priori with large margin separation. We position prototypes through data-independent optimization, with an extension to incorporate priors from class semantics. By doing so, we do not require any prototype updating, we can handle any training size, and the output dimensionality is no longer constrained to the number of classes. Furthermore, we generalize to regression, by optimizing outputs as an interpolation between two prototypes on the hypersphere. Since both tasks are now defined by the same loss function, they can be jointly trained for multi-task problems. Experimentally, we show the benefit of hyperspherical prototype networks for classification, regression, and their combination over other prototype methods, softmax cross-entropy, and mean squared error approaches.
Key facts. Cited by 86 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 18; 2023: 20; 2024: 13; 2025: 11; 2026: 13.
86 papers.
Sort:
By area:
- 2022Rethinking Semantic Segmentation: A Prototype Viewcited by 140
- 2021Fully Hyperbolic Neural Networkscited by 108
- 2023Hyperbolic Deep Learning in Computer Vision: A Surveycited by 73
- 2024nGPT: Normalized Transformer with Representation Learning on the Hyperspherecited by 70
- 2021Dissecting Supervised Contrastive Learningcited by 64
- 2022A Neuro-vector-symbolic Architecture for Solving Raven's Progressive Matricescited by 64
- 2022Visual Recognition with Deep Nearest Centroidscited by 59
- 2021von Mises-Fisher Loss: An Exploration of Embedding Geometries for Supervised Learningcited by 42
- 2021Hyperbolic Busemann Learning with Ideal Prototypescited by 41
- 2023Rotating Features for Object Discoverycited by 29
- 2021SphereFace Revived: Unifying Hyperspherical Face Recognitioncited by 23
- 2022Maximum Class Separation as Inductive Bias in One Matrixcited by 21
38 more
- 2022SphereFed: Hyperspherical Federated Learningcited by 19
- 2024ID3: Identity-Preserving-yet-Diversified Diffusion Models for Synthetic Face Recognitioncited by 18
- 2023VNE: An Effective Method for Improving Deep Representation by Manipulating Eigenvalue Distributioncited by 17
- 2022Hyperbolic Sliced-Wasserstein via Geodesic and Horospherical Projectionscited by 16
- 2023Latent SDEs on Homogeneous Spacescited by 16
- 2022COARSE3D: Class-Prototypes for Contrastive Learning in Weakly-Supervised 3D Point Cloud Segmentationcited by 15
- 2023A step towards understanding why classification helps regressioncited by 15
- 2021Detecting Anomalies in Semantic Segmentation with Prototypescited by 13
- 2024HYPO: Hyperspherical Out-of-Distribution Generalizationcited by 13
- 2021Distance-based Hyperspherical Classification for Multi-source Open-Set Domain Adaptationcited by 10
- 2023Prototype-based Dataset Comparisoncited by 9
- 2025Raising the Bar in Graph OOD Generalization: Invariant Learning Beyond Explicit Environment Modelingcited by 9
- 2023HyperFed: Hyperbolic Prototypes Exploration with Consistent Aggregation for Non-IID Data in Federated Learningcited by 8
- 2023FedFN: Feature Normalization for Alleviating Data Heterogeneity Problem in Federated Learningcited by 8
- 2023Equiangular Basis Vectorscited by 7
- 2024Temporal Test-Time Adaptation with State-Space Modelscited by 7
- 2025Low-distortion and GPU-compatible Tree Embeddings in Hyperbolic Spacecited by 6
- 2022Learning Towards the Largest Marginscited by 5
- 2022Automatically Discovering Novel Visual Categories with Self-supervised Prototype Learningcited by 5
- 2023Improving Adversarial Robustness with Hypersphere Embedding and Angular-based Regularizationscited by 5
- 2023Learning Representations on the Unit Sphere: Investigating Angular Gaussian and von Mises-Fisher Distributions for Online Continual Learningcited by 5
- 2024DPA: Dual Prototypes Alignment for Unsupervised Adaptation of Vision-Language Modelscited by 5
- 2024An Overview of Prototype Formulations for Interpretable Deep Learningcited by 5
- 2022Prototype Based Classification from Hierarchy to Fairnesscited by 4
- 2022Data-Efficient Learning via Minimizing Hyperspherical Energycited by 4
- 2023Factorizers for Distributed Sparse Block Codescited by 4
- 2023ProtoDiffusion: Classifier-Free Diffusion Guidance with Prototype Learningcited by 4
- 2023Pairwise Similarity Learning is SimPLEcited by 4
- 2024Your Classifier Can Be Secretly a Likelihood-Based OOD Detectorcited by 4
- 2025ASIL: Augmented Structural Information Learning for Deep Graph Clustering in Hyperbolic Spacecited by 4
- 2021United We Learn Better: Harvesting Learning Improvements From Class Hierarchies Across Taskscited by 3
- 2021Attention Guided Cosine Margin For Overcoming Class-Imbalance in Few-Shot Road Object Detectioncited by 3
- 2023Robust Text Classification: Analyzing Prototype-Based Networkscited by 3
- 2023AMES: A Differentiable Embedding Space Selection Framework for Latent Graph Inferencecited by 3
- 2025Generalized Category Discovery via Token Manifold Capacity Learningcited by 3
- 2021Deep Repulsive Prototypes for Adversarial Robustnesscited by 2
- 2022Self-supervised learning with rotation-invariant kernelscited by 2
- 2022Beyond Learning from Next Item: Sequential Recommendation via Personalized Interest Sustainabilitycited by 2
50 most cited of 86 All 86 (JSON)
- 2026The Implicit Bias of Hyperbolic Representation Learning for Multiclass Data: A Busemann Risk Perspective5 Oct 2026
- 2026Curvature Under Attack in hZACH-ViT: Gauge Symmetry, Boundary Saturation, and Adversarial Failure30 Sep 2026
- 2026What Do Scan-Derived Class Prototypes Add? Disentangling Supervision, Prototype Content and Query Protocol in Recognition over Frozen Foundation Features3 Sep 2026
- 2026OPAL: Orthonormal Prototype Alignment Learning for Interpretable Image Classification30 Aug 2026
- 2026Training nGPT2 Aug 2026
- 2026RED-Sphere: Hyperspherical Residual Edge Debiasing for Cross-Population Fundus Disease Domain Generalization12 Jul 2026
- 2026SFDATrack: Generalized Source-Free Domain Adaptive Tracking Under Adverse Weather Conditions1 Jul 2026
- 2026Generative Archetype-Grounded Item Representations for Sequential Recommendation9 Jun 2026
- 2026Geodesic Flow Matching for Denoising High-Dimensional Structured Representations29 May 2026
- 2026MARGIN: Margin-Aware Regularized Geometry for Imbalanced Vulnerability Detection11 May 2026
- 2026Polaris: Coupled Orbital Polar Embeddings for Hierarchical Concept Learning30 Apr 2026
- 2026Local learning for stable backpropagation-free neural network training towards physical learning25 Mar 2026
38 more
- 2026Hyperspectral Smoke Segmentation via Mixture of Prototypes11 Feb 2026
- 2025The Affine Divergence: Aligning Activation Updates Beyond Normalisation24 Dec 2025
- 2025Angular Constraint Embedding via SpherePair Loss for Constrained Clustering8 Oct 2025
- 2025Proto-FG3D: Prototype-based Interpretable Fine-Grained 3D Shape Classification23 May 2025
- 2025Generalized Category Discovery via Token Manifold Capacity Learning20 May 2025
- 2025GIF: Generative Inspiration for Face Recognition at Scale5 May 2025
- 2025ASIL: Augmented Structural Information Learning for Deep Graph Clustering in Hyperbolic Space14 Apr 2025
- 2025Normalized Matching Transformer22 Mar 2025
- 2025Low-distortion and GPU-compatible Tree Embeddings in Hyperbolic Space24 Feb 2025
- 2025Raising the Bar in Graph OOD Generalization: Invariant Learning Beyond Explicit Environment Modeling15 Feb 2025
- 2025Keep your distance: learning dispersed embeddings on mathbbSm12 Feb 2025
- 2025A Deep Positive-Negative Prototype Approach to Integrated Prototypical Discriminative Learning5 Jan 2025
- 2024An Overview of Prototype Formulations for Interpretable Deep Learning11 Oct 2024
- 2024Distribution Guidance Network for Weakly Supervised Point Cloud Semantic Segmentation10 Oct 2024
- 2024nGPT: Normalized Transformer with Representation Learning on the Hypersphere1 Oct 2024
- 2024An Enhanced Federated Prototype Learning Method under Domain Shift27 Sep 2024
- 2024ID3: Identity-Preserving-yet-Diversified Diffusion Models for Synthetic Face Recognition26 Sep 2024
- 2024DPA: Dual Prototypes Alignment for Unsupervised Adaptation of Vision-Language Models16 Aug 2024
- 2024Your Classifier Can Be Secretly a Likelihood-Based OOD Detector9 Aug 2024
- 2024Lightweight Uncertainty Quantification with Simplex Semantic Segmentation for Terrain Traversability18 Jul 2024
- 2024Temporal Test-Time Adaptation with State-Space Models17 Jul 2024
- 2024A Coding-Theoretic Analysis of Hyperspherical Prototypical Learning Geometry10 Jul 2024
- 2024Improving Data-aware and Parameter-aware Robustness for Continual Learning27 May 2024
- 2024Mitigating Distributional Shift in Semantic Segmentation via Uncertainty Estimation from Unlabelled Data27 Feb 2024
- 2024HYPO: Hyperspherical Out-of-Distribution Generalization12 Feb 2024
- 2023Refine, Discriminate and Align: Stealing Encoders via Sample-Wise Prototypes and Multi-Relational Extraction1 Dec 2023
- 2023FedFN: Feature Normalization for Alleviating Data Heterogeneity Problem in Federated Learning22 Nov 2023
- 2023AMES: A Differentiable Embedding Space Selection Framework for Latent Graph Inference20 Nov 2023
- 2023Robust Text Classification: Analyzing Prototype-Based Networks11 Nov 2023
- 2023Pairwise Similarity Learning is SimPLE13 Oct 2023
- 2023Coloring Deep CNN Layers with Activation Hue Loss5 Oct 2023
- 2023Prototype-based Dataset Comparison5 Sep 2023
- 2023A step towards understanding why classification helps regression21 Aug 2023
- 2023HyperFed: Hyperbolic Prototypes Exploration with Consistent Aggregation for Non-IID Data in Federated Learning26 Jul 2023
- 2023ProtoDiffusion: Classifier-Free Diffusion Guidance with Prototype Learning4 Jul 2023
- 2023Latent SDEs on Homogeneous Spaces28 Jun 2023
- 2023Learning Representations on the Unit Sphere: Investigating Angular Gaussian and von Mises-Fisher Distributions for Online Continual Learning6 Jun 2023
- 2023Rotating Features for Object Discovery1 Jun 2023
50 newest of 86 All 86 (JSON)
- 2026Training nGPTcited by 0
- 2026Training nGPT2 Aug 2026
- 2022Rethinking Semantic Segmentation: A Prototype Viewcited by 140
- 2021Fully Hyperbolic Neural Networkscited by 108
- 2023Hyperbolic Deep Learning in Computer Vision: A Surveycited by 73
- 2024nGPT: Normalized Transformer with Representation Learning on the Hyperspherecited by 70
- 2021Dissecting Supervised Contrastive Learningcited by 64
- 2022A Neuro-vector-symbolic Architecture for Solving Raven's Progressive Matricescited by 64
- 2022Visual Recognition with Deep Nearest Centroidscited by 59
- 2021von Mises-Fisher Loss: An Exploration of Embedding Geometries for Supervised Learningcited by 42
- 2021Hyperbolic Busemann Learning with Ideal Prototypescited by 41
- 2023Rotating Features for Object Discoverycited by 29
- 2021SphereFace Revived: Unifying Hyperspherical Face Recognitioncited by 23
- 2022Maximum Class Separation as Inductive Bias in One Matrixcited by 21
12 most cited of 81 All 81 (JSON)
- 2026The Implicit Bias of Hyperbolic Representation Learning for Multiclass Data: A Busemann Risk Perspective5 Oct 2026
- 2026Curvature Under Attack in hZACH-ViT: Gauge Symmetry, Boundary Saturation, and Adversarial Failure30 Sep 2026
- 2026What Do Scan-Derived Class Prototypes Add? Disentangling Supervision, Prototype Content and Query Protocol in Recognition over Frozen Foundation Features3 Sep 2026
- 2026OPAL: Orthonormal Prototype Alignment Learning for Interpretable Image Classification30 Aug 2026
- 2026RED-Sphere: Hyperspherical Residual Edge Debiasing for Cross-Population Fundus Disease Domain Generalization12 Jul 2026
- 2026SFDATrack: Generalized Source-Free Domain Adaptive Tracking Under Adverse Weather Conditions1 Jul 2026
- 2026Generative Archetype-Grounded Item Representations for Sequential Recommendation9 Jun 2026
- 2026MARGIN: Margin-Aware Regularized Geometry for Imbalanced Vulnerability Detection11 May 2026
- 2026Polaris: Coupled Orbital Polar Embeddings for Hierarchical Concept Learning30 Apr 2026
- 2026Local learning for stable backpropagation-free neural network training towards physical learning25 Mar 2026
- 2026Hyperspectral Smoke Segmentation via Mixture of Prototypes11 Feb 2026
- 2025The Affine Divergence: Aligning Activation Updates Beyond Normalisation24 Dec 2025
12 newest of 81 All 81 (JSON)