mlsanityData to 7 Oct 2026

Continual Learning for Smart City: A Survey

arXiv 2404.00983 ↗First posted 1 Apr 2024cs.LG cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

With the digitization of modern cities, large data volumes and powerful computational resources facilitate the rapid update of intelligent models deployed in smart cities. Continual learning (CL) is a novel machine learning paradigm that constantly updates models to adapt to changing environments, where the learning tasks, data, and distributions can vary over time. Our survey provides a comprehensive review of continual learning methods that are widely used in smart city development. The content consists of three parts: 1) Methodology-wise. We categorize a large number of basic CL methods and advanced CL frameworks in combination with other learning paradigms including graph learning, spatial-temporal learning, multi-modal learning, and federated learning. 2) Application-wise. We present numerous CL applications covering transportation, environment, public health, safety, networks, and associated datasets related to urban computing. 3) Challenges. We discuss current problems and challenges and envision several promising research directions. We believe this survey can help relevant researchers quickly familiarize themselves with the current state of continual learning research used in smart city development and direct them to future research trends.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 140 of its 251 references that are in the map. First posted on arXiv 1 Apr 2024.

Builds on

140 of 251 references.

References · 140

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  5. 2020Language Models are Few-Shot Learnerscited by 32,199
  6. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  7. 2023GPT-4 Technical Reportcited by 18,132
  8. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  9. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  10. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  11. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  12. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
38 more
  1. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  2. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  3. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  4. 2015VQA: Visual Question Answeringcited by 2,489
  5. 2016Learning without Forgettingcited by 2,465
  6. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  7. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  8. 2017Gradient Episodic Memory for Continual Learningcited by 1,871
  9. 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,461
  10. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  11. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  12. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  13. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
  14. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
  15. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
  16. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  17. 2023A Survey on Multimodal Large Language Modelscited by 898
  18. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
  19. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
  20. 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 780
  21. 2018Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigencecited by 734
  22. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
  23. 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 636
  24. 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
  25. 2019Three scenarios for continual learningcited by 610
  26. 2019Gradient based sample selection for online continual learningcited by 568
  27. 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 560
  28. 2019Object Detection in 20 Years: A Surveycited by 528
  29. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
  30. 2022Transformers in Time Series: A Surveycited by 489
  31. 2018A Corpus for Reasoning About Natural Language Grounded in Photographscited by 457
  32. 2018T-GCN: A Temporal Graph ConvolutionalNetwork for Traffic Predictioncited by 399
  33. 2016Visual Dialogcited by 377
  34. 2021Attention Bottlenecks for Multimodal Fusioncited by 361
  35. 2021DER: Dynamically Expandable Representation for Class Incremental Learningcited by 355
  36. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 327
  37. 2019Video Classification with Channel-Separated Convolutional Networkscited by 290
  38. 2020Towards Continual Reinforcement Learning: A Review and Perspectivescited by 268

50 most cited of 140 All 140 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 4; 2026: 3.

9 papers.