StreamFP: Learnable Fingerprint-guided Data Selection for Efficient Stream Learning
Not on the map. Why?
Abstract (arXiv)
Stream Learning (SL) requires models that can quickly adapt to continuously evolving data, posing significant challenges in both computational efficiency and learning accuracy. Effective data selection is critical in SL to ensure a balance between information retention and training efficiency. Traditional rule-based data selection methods struggle to accommodate the dynamic nature of streaming data, highlighting the necessity for innovative solutions that effectively address these challenges. Recent approaches to handling changing data distributions face challenges that limit their effectiveness in fast-paced environments. In response, we propose StreamFP, a novel approach that uniquely employs dynamic, learnable parameters called fingerprints to enhance data selection efficiency and adaptability in stream learning. StreamFP optimizes coreset selection through its unique fingerprint-guided mechanism for efficient training while ensuring robust buffer updates that adaptively respond to data dynamics, setting it apart from existing methods in stream learning. Experimental results demonstrate that StreamFP outperforms state-of-the-art methods by achieving accuracy improvements of 15.99%, 29.65%, and 51.24% compared to baseline models across varying data arrival rates, alongside a training throughput increase of 4.6x.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 50 references that are in the map. First posted on arXiv 11 Jun 2024.
Builds on
35 of 50 references.
References · 35
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2017Gradient Episodic Memory for Continual Learningcited by 1,871
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
- 2016Progressive Neural Networkscited by 1,332
- 2021Learning to Prompt for Continual Learningcited by 938
23 more
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
- 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
- 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
- 2021ImageNet-21K Pretraining for the Massescited by 607
- 2019Gradient based sample selection for online continual learningcited by 568
- 2020Learning under Concept Drift: A Reviewcited by 470
- 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
- 2019Online Continual Learning with Maximally Interfered Retrievalcited by 376
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 372
- 2019Learning Loss for Active Learningcited by 335
- 2017CORe50: a New Dataset and Benchmark for Continuous Object Recognitioncited by 287
- 2021GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Trainingcited by 269
- 2022S-Prompts Learning with Pre-trained Transformers: An Occam's Razor for Domain Incremental Learningcited by 246
- 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 211
- 2020Coresets via Bilevel Optimization for Continual Learning and Streamingcited by 191
- 2023Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimalitycited by 121
- 2022The CLEAR Benchmark: Continual LEArning on Real-World Imagerycited by 92
- 2023OneNet: Enhancing Time Series Forecasting Models under Concept Drift by Online Ensemblingcited by 71
- 2020Gradient-based Editing of Memory Examples for Online Task-free Continual Learningcited by 62
- 2023Real-Time Evaluation in Online Continual Learning: A New Hopecited by 47
- 2021Online Continual Learning For Visual Food Classificationcited by 39
- 2023Summarizing Stream Data for Memory-Constrained Online Continual Learningcited by 19
- 2023Towards Free Data Selection with General-Purpose Modelscited by 10
Built on by
Not cited yet.