Continual Learning for Smart City: A Survey
Not on the map. Why?
Abstract (arXiv)
With the digitization of modern cities, large data volumes and powerful computational resources facilitate the rapid update of intelligent models deployed in smart cities. Continual learning (CL) is a novel machine learning paradigm that constantly updates models to adapt to changing environments, where the learning tasks, data, and distributions can vary over time. Our survey provides a comprehensive review of continual learning methods that are widely used in smart city development. The content consists of three parts: 1) Methodology-wise. We categorize a large number of basic CL methods and advanced CL frameworks in combination with other learning paradigms including graph learning, spatial-temporal learning, multi-modal learning, and federated learning. 2) Application-wise. We present numerous CL applications covering transportation, environment, public health, safety, networks, and associated datasets related to urban computing. 3) Challenges. We discuss current problems and challenges and envision several promising research directions. We believe this survey can help relevant researchers quickly familiarize themselves with the current state of continual learning research used in smart city development and direct them to future research trends.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 140 of its 251 references that are in the map. First posted on arXiv 1 Apr 2024.
Builds on
140 of 251 references.
References · 140
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023GPT-4 Technical Reportcited by 18,132
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
38 more
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2015VQA: Visual Question Answeringcited by 2,489
- 2016Learning without Forgettingcited by 2,465
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2017Gradient Episodic Memory for Continual Learningcited by 1,871
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,461
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
- 2023A Survey on Multimodal Large Language Modelscited by 898
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
- 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 780
- 2018Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigencecited by 734
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
- 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 636
- 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
- 2019Three scenarios for continual learningcited by 610
- 2019Gradient based sample selection for online continual learningcited by 568
- 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 560
- 2019Object Detection in 20 Years: A Surveycited by 528
- 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
- 2022Transformers in Time Series: A Surveycited by 489
- 2018A Corpus for Reasoning About Natural Language Grounded in Photographscited by 457
- 2018T-GCN: A Temporal Graph ConvolutionalNetwork for Traffic Predictioncited by 399
- 2016Visual Dialogcited by 377
- 2021Attention Bottlenecks for Multimodal Fusioncited by 361
- 2021DER: Dynamically Expandable Representation for Class Incremental Learningcited by 355
- 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 327
- 2019Video Classification with Channel-Separated Convolutional Networkscited by 290
- 2020Towards Continual Reinforcement Learning: A Review and Perspectivescited by 268
50 most cited of 140 All 140 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 4; 2026: 3.
9 papers.
- 2024Towards Lifelong Learning of Large Language Models: A Surveycited by 60
- 2025Out-of-Distribution Generalization in Time Series: A Surveycited by 15
- 2025Edge-Cloud Collaborative Computing on Distributed Intelligence and Model Optimization: A Surveycited by 13
- 2024Modeling Temporal Dependencies within the Target for Long-Term Time Series Forecastingcited by 6
- 2025A Survey on Cloud-Edge-Terminal Collaborative Intelligence in AIoT Networkscited by 3
- 2026Fed-ADE: Adaptive Learning Rate for Federated Post-adaptation under Distribution Shiftcited by 2
- 2025UrbanMind: Towards Urban General Intelligence via Tool-Enhanced Retrieval-Augmented Generation and Multilevel Optimizationcited by 0
- 2026Swarm-Driven Multi-Agent Reasoning for Smart City Securitycited by 0
- 2026DSETA: A Dual-Stage Continual Learning Framework for Travel Time Prediction in Dynamic Traffic Environmentscited by 0
- 2026DSETA: A Dual-Stage Continual Learning Framework for Travel Time Prediction in Dynamic Traffic Environments1 Aug 2026
- 2026Swarm-Driven Multi-Agent Reasoning for Smart City Security3 Jul 2026
- 2026Fed-ADE: Adaptive Learning Rate for Federated Post-adaptation under Distribution Shift1 Mar 2026
- 2025A Survey on Cloud-Edge-Terminal Collaborative Intelligence in AIoT Networks26 Aug 2025
- 2025UrbanMind: Towards Urban General Intelligence via Tool-Enhanced Retrieval-Augmented Generation and Multilevel Optimization7 Jul 2025
- 2025Edge-Cloud Collaborative Computing on Distributed Intelligence and Model Optimization: A Survey3 May 2025
- 2025Out-of-Distribution Generalization in Time Series: A Survey18 Mar 2025
- 2024Towards Lifelong Learning of Large Language Models: A Survey10 Jun 2024
- 2024Modeling Temporal Dependencies within the Target for Long-Term Time Series Forecasting7 Jun 2024