mlsanityData to 7 Oct 2026

CrowdTransfer: Enabling Crowd Knowledge Transfer in AIoT Community

arXiv 2407.06485 ↗First posted 9 Jul 2024cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Artificial Intelligence of Things (AIoT) is an emerging frontier based on the deep fusion of Internet of Things (IoT) and Artificial Intelligence (AI) technologies. Although advanced deep learning techniques enhance the efficient data processing and intelligent analysis of complex IoT data, they still suffer from notable challenges when deployed to practical AIoT applications, such as constrained resources, and diverse task requirements. Knowledge transfer is an effective method to enhance learning performance by avoiding the exorbitant costs associated with data recollection and model retraining. Notably, although there are already some valuable and impressive surveys on transfer learning, these surveys introduce approaches in a relatively isolated way and lack the recent advances of various knowledge transfer techniques for AIoT field. This survey endeavors to introduce a new concept of knowledge transfer, referred to as Crowd Knowledge Transfer (CrowdTransfer), which aims to transfer prior knowledge learned from a crowd of agents to reduce the training cost and as well as improve the performance of the model in real-world complicated scenarios. Particularly, we present four transfer modes from the perspective of crowd intelligence, including derivation, sharing, evolution and fusion modes. Building upon conventional transfer learning methods, we further delve into advanced crowd knowledge transfer models from three perspectives for various AIoT applications. Furthermore, we explore some applications of AIoT areas, such as human activity recognition, urban computing, multi-robot system, and smart factory. Finally, we discuss the open issues and outline future research directions of knowledge transfer in AIoT community.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 177 of its 372 references that are in the map. First posted on arXiv 9 Jul 2024.

Builds on

177 of 372 references.

References · 177

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  5. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  6. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  7. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  8. 2017Deep reinforcement learning from human preferencescited by 3,846
  9. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  10. 2015Fast R-CNNcited by 2,930
  11. 2016Learning without Forgettingcited by 2,465
  12. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
38 more
  1. 2016Matching Networks for One Shot Learningcited by 2,246
  2. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
  3. 2017Gradient Episodic Memory for Continual Learningcited by 1,871
  4. 2014FitNets: Hints for Thin Deep Netscited by 1,619
  5. 2016Generative Adversarial Imitation Learningcited by 1,576
  6. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
  7. 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,323
  8. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  9. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
  10. 2014How transferable are features in deep neural networks?cited by 1,216
  11. 2019A Comprehensive Survey on Transfer Learningcited by 1,154
  12. 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,139
  13. 2018Efficient Lifelong Learning with A-GEMcited by 1,044
  14. 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
  15. 2019Deep Leakage from Gradientscited by 1,004
  16. 2018On First-Order Meta-Learning Algorithmscited by 1,003
  17. 2020Meta-Learning in Neural Networks: A Surveycited by 944
  18. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
  19. 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 844
  20. 2014Deep Learning in Neural Networks: An Overviewcited by 765
  21. 2017Counterfactual Multi-Agent Policy Gradientscited by 733
  22. 2020Ensemble Distillation for Robust Model Fusion in Federated Learningcited by 678
  23. 2018Overcoming catastrophic forgetting with hard attention to the taskcited by 672
  24. 2017Federated Multi-Task Learningcited by 669
  25. 2017Deep Mutual Learningcited by 621
  26. 2018Born Again Neural Networkscited by 539
  27. 2022Continual Test-Time Domain Adaptationcited by 520
  28. 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 485
  29. 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
  30. 2017End-to-end Driving via Conditional Imitation Learningcited by 479
  31. 2020Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 475
  32. 2022Efficient Test-Time Model Adaptation without Forgettingcited by 467
  33. 2016Cross-stitch Networks for Multi-task Learningcited by 466
  34. 2019FedMD: Heterogenous Federated Learning via Model Distillationcited by 454
  35. 2017Time-Contrastive Networks: Self-Supervised Learning from Videocited by 453
  36. 2017Differentially Private Federated Learning: A Client Level Perspectivecited by 451
  37. 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 441
  38. 2018A Survey on Deep Transfer Learningcited by 417

50 most cited of 177 All 177 (JSON)

Built on by

Not cited yet.