mlsanityData to 7 Oct 2026

Lightweight Edge Learning via Dataset Pruning

arXiv 2602.00047 ↗First posted 19 Jan 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Edge learning facilitates ubiquitous intelligence by enabling model training and adaptation directly on data-generating devices, thereby mitigating privacy risks and communication latency. However, the high computational and energy overhead of on-device training hinders its deployment on battery-powered mobile systems with strict thermal and memory budgets. While prior research has extensively optimized model architectures for efficient inference, the training phase remains bottlenecked by the processing of massive, often redundant, local datasets. In this work, we propose a data-centric optimization framework that leverages dataset pruning to achieve resource-efficient edge learning. Unlike standard methods that process all available data, our approach constructs compact, highly informative training subsets via a lightweight, on-device importance evaluation. Specifically, we utilize average loss statistics derived from a truncated warm-up phase to rank sample importance, deterministically retaining only the most critical data points under a dynamic pruning ratio. This mechanism is model-agnostic and operates locally without inter-device communication. Extensive experiments on standard image classification benchmarks demonstrate that our framework achieves a near-linear reduction in training latency and energy consumption proportional to the pruning ratio, with negligible degradation in model accuracy. These results validate dataset pruning as a vital, complementary paradigm for enhancing the sustainability and scalability of learning on resource-constrained mobile edge devices.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 36 references that are in the map. First posted on arXiv 19 Jan 2026.

Builds on

26 of 36 references.

References · 26

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  3. 2014Going Deeper with Convolutionscited by 4,231
  4. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
  5. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
  6. 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,194
  7. 2019Relational Knowledge Distillationcited by 873
  8. 2017Learning Efficient Convolutional Networks through Network Slimmingcited by 673
  9. 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 669
  10. 2021Deep Learning on a Data Diet: Finding Important Examples Early in Trainingcited by 529
  11. 2018Adaptive Federated Learning in Resource Constrained Edge Computing Systemscited by 408
  12. 2019Federated Learning in Mobile Edge Networks: A Comprehensive Surveycited by 407
14 more
  1. 2019Selection via Proxy: Efficient Data Selection for Deep Learningcited by 337
  2. 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 320
  3. 2021Knowledge distillation: A good teacher is patient and consistentcited by 255
  4. 2017Incremental Network Quantization: Towards Lossless CNNs with Low-Precision Weightscited by 211
  5. 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 166
  6. 2019Convergence of Edge Computing and Deep Learning: A Comprehensive Surveycited by 120
  7. 2023InfoBatch: Lossless Training Speed Up by Unbiased Dynamic Data Pruningcited by 90
  8. 2019Stable Learning via Sample Reweightingcited by 70
  9. 2024A Survey on Deep Active Learning: Recent Advances and New Frontierscited by 53
  10. 2023Spanning Training Progress: Temporal Dual-Depth Scoring (TDDS) for Enhanced Dataset Pruningcited by 38
  11. 2025Automatic Joint Structured Pruning and Quantization for Efficient Neural Network Training and Compressioncited by 14
  12. 2024SNP: Structured Neuron-level Pruning to Preserve Attention Scorescited by 5
  13. 2021Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learningcited by 3
  14. 2021D3PG: Dirichlet DDPG for Task Partitioning and Offloading with Constrained Hybrid Action Space in Mobile Edge Computingcited by 3

Built on by

Not cited yet.