mlsanityData to 7 Oct 2026

Efficient Deep Learning for Biometrics: Overview, Challenges and Trends in Ear of Frugal AI

arXiv 2602.08809 ↗First posted 9 Feb 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in deep learning, whether on discriminative or generative tasks have been beneficial for various applications, among which security and defense. However, their increasing computational demands during training and deployment translates directly into high energy consumption. As a consequence, this induces a heavy carbon footprint which hinders their widespread use and scalability, but also a limitation when deployed on resource-constrained edge devices for real-time use. In this paper, we briefly survey efficient deep learning methods for biometric applications. Specifically, we tackle the challenges one might incur when training and deploying deep learning approaches, and provide a taxonomy of the various efficient deep learning families. Additionally, we discuss complementary metrics for evaluating the efficiency of these models such as memory, computation, latency, throughput, and advocate for universal and reproducible metrics for better comparison. Last, we give future research directions to consider.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 49 references that are in the map. First posted on arXiv 9 Feb 2026.

Builds on

28 of 49 references.

References · 28

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  3. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  4. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
  5. 2018DARTS: Differentiable Architecture Searchcited by 1,782
  6. 2020Knowledge Distillation: A Surveycited by 1,578
  7. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
  8. 2016Pruning Filters for Efficient ConvNetscited by 1,129
  9. 2017Learning Transferable Architectures for Scalable Image Recognitioncited by 1,097
  10. 2020Simple and Deep Graph Convolutional Networkscited by 857
  11. 2020Efficient Transformers: A Surveycited by 784
  12. 2020Self-supervised Learning: Generative or Contrastivecited by 693
16 more
  1. 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 636
  2. 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 591
  3. 2022Dataset Distillation by Matching Training Trajectoriescited by 437
  4. 2016EIE: Efficient Inference Engine on Compressed Deep Neural Networkcited by 291
  5. 2018Dataset Distillationcited by 224
  6. 2019Low-bit Quantization of Neural Networks for Efficient Inferencecited by 185
  7. 2017Deep Learning for IoT Big Data and Streaming Analytics: A Surveycited by 59
  8. 2024A Survey on Deep Active Learning: Recent Advances and New Frontierscited by 53
  9. 2024A survey of synthetic data augmentation methods in computer visioncited by 34
  10. 2020HAPI: Hardware-Aware Progressive Inferencecited by 30
  11. 2022Predictive Exit: Prediction of Fine-Grained Early Exits for Computation- and Energy-Efficient Inferencecited by 24
  12. 2021Multi-Exit Semantic Segmentation Networkscited by 18
  13. 2024ActiveLLM: Large Language Model-based Active Learning for Textual Few-Shot Scenarioscited by 17
  14. 2022HADAS: Hardware-Aware Dynamic Neural Architecture Search for Edge Performance Scalingcited by 14
  15. 2025Energy-Aware Deep Learning on Resource-Constrained Hardwarecited by 3
  16. 2025A Comprehensive Re-Evaluation of Biometric Modality Properties in the Modern Eracited by 2

Built on by

Not cited yet.