Age of Learning: Temporal Persistence of Prediction Errors as a Learning Signal
Not on the map. Why?
Abstract (arXiv)
Current machine learning algorithms primarily rely on instantaneous signals such as loss, margin, and prediction confidence to characterize model behavior. These signals indicate how difficult a prediction is at the current optimization step, but they do not capture how long the model has remained incorrect. We study this temporal dimension of learning and introduce Age of Learning (AoL), a learning-state variable that measures the persistence of prediction errors over time. AoL increases while an error remains unresolved and resets when a correct prediction is achieved, thereby distinguishing persistent under-learning from transient mistakes. We develop AoL-based training strategies for both offline and streaming settings. In offline learning, sample-level AoL is accumulated over training and aggregated into class-level states that guide adaptive reweighting and resampling. In streaming learning, where full historical access is unavailable, we maintain lightweight class-level AoL states using current and buffered observations. Across long-tailed classification settings, AoL improves or matches standard training baselines, with larger benefits when learning difficulty persists over time. Multi-seed streaming experiments further show reproducible gains under temporally stable imbalance. Analysis of class frequency, loss, and margin shows that AoL is related to conventional difficulty measures but captures additional information about error duration. These results suggest that temporal persistence provides a useful complementary signal for characterizing and controlling learning dynamics in imbalanced and non-stationary environments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 54 references that are in the map. First posted on arXiv 26 Sep 2026.
Builds on
40 of 54 references.
References · 40
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2017Gradient Episodic Memory for Continual Learningcited by 1,898
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
- 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 809
- 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 705
- 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 678
- 2018Learning to Reweight Examples for Robust Deep Learningcited by 675
- 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 579
28 more
- 2019Gradient based sample selection for online continual learningcited by 571
- 2021Deep Learning on a Data Diet: Finding Important Examples Early in Trainingcited by 533
- 2021Deep Long-Tailed Learning: A Surveycited by 417
- 2018Not All Samples Are Created Equal: Deep Learning with Importance Samplingcited by 328
- 2020Remix: Rebalanced Mixupcited by 144
- 2022Long-Tailed Recognition via Weight Balancingcited by 107
- 2024Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Modelscited by 80
- 2020Age of Information: An Introduction and Surveycited by 70
- 2020Online Continual Learning under Extreme Memory Constraintscited by 48
- 2023How Re-sampling Helps for Long-Tail Learning?cited by 36
- 2021VideoLT: Large-scale Long-tailed Video Recognitioncited by 35
- 2021Online Learning with Optimism and Delaycited by 33
- 2022Learning to Re-weight Examples with Optimal Transport for Imbalanced Classificationcited by 23
- 2018Scheduling Policies for Minimizing Age of Information in Broadcast Wireless Networkscited by 22
- 2021Reweighting Augmented Samples by Minimizing the Maximal Expected Losscited by 21
- 2025Dynamic Loss-Based Sample Reweighting for Improved Large Language Model Pretrainingcited by 16
- 2025Focal-SAM: Focal Sharpness-Aware Minimization for Long-Tailed Classificationcited by 14
- 2025Improved Balanced Classification with Theoretically Grounded Loss Functionscited by 9
- 2023Flexible Distribution Alignment: Towards Long-tailed Semi-supervised Learning with Proper Calibrationcited by 7
- 2024Predicting the Susceptibility of Examples to Catastrophic Forgettingcited by 7
- 2025Non-stationary Online Learning for Curved Losses: Improved Dynamic Regret via Mixabilitycited by 7
- 2023Label Delay in Online Continual Learningcited by 5
- 2025Online Learning of Neural Networkscited by 5
- 2024Stabilizing Linear Passive-Aggressive Online Learning with Weighted Reservoir Samplingcited by 4
- 2024Online Learning with Unknown Constraintscited by 2
- 2026Online Learning and Equilibrium Computation with Ranking Feedbackcited by 2
- 2026OrderDP: A Theoretically Guaranteed Lossless Dynamic Data Pruning Frameworkcited by 2
- 2026Streaming Stochastic Submodular Maximization with On-Demand User Requestscited by 1
Built on by
Not cited yet.