mlsanityData to 7 Oct 2026

StreamFP: Learnable Fingerprint-guided Data Selection for Efficient Stream Learning

arXiv 2406.07590 ↗First posted 11 Jun 2024cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Stream Learning (SL) requires models that can quickly adapt to continuously evolving data, posing significant challenges in both computational efficiency and learning accuracy. Effective data selection is critical in SL to ensure a balance between information retention and training efficiency. Traditional rule-based data selection methods struggle to accommodate the dynamic nature of streaming data, highlighting the necessity for innovative solutions that effectively address these challenges. Recent approaches to handling changing data distributions face challenges that limit their effectiveness in fast-paced environments. In response, we propose StreamFP, a novel approach that uniquely employs dynamic, learnable parameters called fingerprints to enhance data selection efficiency and adaptability in stream learning. StreamFP optimizes coreset selection through its unique fingerprint-guided mechanism for efficient training while ensuring robust buffer updates that adaptively respond to data dynamics, setting it apart from existing methods in stream learning. Experimental results demonstrate that StreamFP outperforms state-of-the-art methods by achieving accuracy improvements of 15.99%, 29.65%, and 51.24% compared to baseline models across varying data arrival rates, alongside a training throughput increase of 4.6x.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 50 references that are in the map. First posted on arXiv 11 Jun 2024.

Builds on

35 of 50 references.

References · 35

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  7. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  8. 2017Gradient Episodic Memory for Continual Learningcited by 1,871
  9. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
  10. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
  11. 2016Progressive Neural Networkscited by 1,332
  12. 2021Learning to Prompt for Continual Learningcited by 938
23 more
  1. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
  2. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
  3. 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
  4. 2021ImageNet-21K Pretraining for the Massescited by 607
  5. 2019Gradient based sample selection for online continual learningcited by 568
  6. 2020Learning under Concept Drift: A Reviewcited by 470
  7. 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 446
  8. 2019Online Continual Learning with Maximally Interfered Retrievalcited by 376
  9. 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 372
  10. 2019Learning Loss for Active Learningcited by 335
  11. 2017CORe50: a New Dataset and Benchmark for Continuous Object Recognitioncited by 287
  12. 2021GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Trainingcited by 269
  13. 2022S-Prompts Learning with Pre-trained Transformers: An Occam's Razor for Domain Incremental Learningcited by 246
  14. 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 211
  15. 2020Coresets via Bilevel Optimization for Continual Learning and Streamingcited by 191
  16. 2023Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimalitycited by 121
  17. 2022The CLEAR Benchmark: Continual LEArning on Real-World Imagerycited by 92
  18. 2023OneNet: Enhancing Time Series Forecasting Models under Concept Drift by Online Ensemblingcited by 71
  19. 2020Gradient-based Editing of Memory Examples for Online Task-free Continual Learningcited by 62
  20. 2023Real-Time Evaluation in Online Continual Learning: A New Hopecited by 47
  21. 2021Online Continual Learning For Visual Food Classificationcited by 39
  22. 2023Summarizing Stream Data for Memory-Constrained Online Continual Learningcited by 19
  23. 2023Towards Free Data Selection with General-Purpose Modelscited by 10

Built on by

Not cited yet.