mlsanityData to 7 Oct 2026

A Decidability-Based Loss Function

arXiv 2109.05524 ↗First posted 12 Sep 2021cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Nowadays, deep learning is the standard approach for a wide range of problems, including biometrics, such as face recognition and speech recognition, etc. Biometric problems often use deep learning models to extract features from images, also known as embeddings. Moreover, the loss function used during training strongly influences the quality of the generated embeddings. In this work, a loss function based on the decidability index is proposed to improve the quality of embeddings for the verification routine. Our proposal, the D-loss, avoids some Triplet-based loss disadvantages such as the use of hard samples and tricky parameter tuning, which can lead to slow convergence. The proposed approach is compared against the Softmax (cross-entropy), Triplets Soft-Hard, and the Multi Similarity losses in four different benchmarks: MNIST, Fashion-MNIST, CIFAR10 and CASIA-IrisV4. The achieved results show the efficacy of the proposal when compared to other popular metrics in the literature. The D-loss computation, besides being simple, non-parametric and easy to implement, favors both the inter-class and intra-class scenarios.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 17 of its 31 references that are in the map. First posted on arXiv 12 Sep 2021.

Builds on

17 of 31 references.

References · 17

  1. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  2. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  3. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
  4. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  5. 2015Deep Metric Learning via Lifted Structured Feature Embeddingcited by 449
  6. 2019Multi-Similarity Loss with General Pair Weighting for Deep Metric Learningcited by 368
  7. 2020A Metric Learning Reality Checkcited by 317
  8. 2014CNN Features off-the-shelf: an Astounding Baseline for Recognitioncited by 316
  9. 2017NormFace: L2 Hypersphere Embedding for Face Verificationcited by 237
  10. 2017L2-constrained Softmax Loss for Discriminative Face Verificationcited by 96
  11. 2019Ranked List Loss for Deep Metric Learningcited by 77
  12. 2018Triplet-Center Loss for Multi-View 3D Object Retrievalcited by 69
5 more
  1. 2016Learning Deep Embeddings with Histogram Losscited by 52
  2. 2021Recall@k Surrogate Loss with Large Batches and Similarity Mixupcited by 49
  3. 2016Hard-Aware Deeply Cascaded Embeddingcited by 44
  4. 2016Embedding Deep Metric for Person Re-identication A Study Against Large Variationscited by 16
  5. 2018Deep Metric Learning by Online Soft Mining and Class-Aware Attentioncited by 12

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.