CLAD: A realistic Continual Learning benchmark for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
In this paper we describe the design and the ideas motivating a new Continual Learning benchmark for Autonomous Driving (CLAD), that focuses on the problems of object classification and object detection. The benchmark utilises SODA10M, a recently released large-scale dataset that concerns autonomous driving related problems. First, we review and discuss existing continual learning benchmarks, how they are related, and show that most are extreme cases of continual learning. To this end, we survey the benchmarks used in continual learning papers at three highly ranked computer vision conferences. Next, we introduce CLAD-C, an online classification benchmark realised through a chronological data stream that poses both class and domain incremental challenges; and CLAD-D, a domain incremental continual object detection benchmark. We examine the inherent difficulties and challenges posed by the benchmark, through a survey of the techniques and methods used by the top-3 participants in a CLAD-challenge workshop at ICCV 2021. We conclude with possible pathways to improve the current continual learning state of the art, and which directions we deem promising for future research.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 53 of its 74 references that are in the map. First posted on arXiv 7 Oct 2022.
Builds on
53 of 74 references.
References · 53
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2016Learning without Forgettingcited by 2,465
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
38 more
- 2017Gradient Episodic Memory for Continual Learningcited by 1,871
- 2019Natural Adversarial Examplescited by 1,401
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
- 2019When Does Label Smoothing Help?cited by 985
- 2017Deeper, Broader and Artier Domain Generalizationcited by 983
- 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 895
- 2019Three scenarios for continual learningcited by 610
- 2018Bag of Tricks for Image Classification with Convolutional Neural Networkscited by 430
- 2019Online Continual Learning with Maximally Interfered Retrievalcited by 376
- 2021DyTox: Transformers for Continual Learning with DYnamic TOken eXpansioncited by 291
- 2017CORe50: a New Dataset and Benchmark for Continuous Object Recognitioncited by 287
- 2021Rainbow Memory: Continual Learning with a Memory of Diverse Samplescited by 273
- 2021Co2L: Contrastive Continual Learningcited by 243
- 2015YFCC100M: The New Data in Multimedia Researchcited by 234
- 2018Task-Free Continual Learningcited by 219
- 2017Incremental Learning of Object Detectors without Catastrophic Forgettingcited by 208
- 2021Vision Transformers are Robust Learnerscited by 208
- 2020PLOP: Learning without Forgetting for Continual Semantic Segmentationcited by 177
- 2020Continual Prototype Evolution: Learning Online from Non-Stationary Data Streamscited by 143
- 2021An Empirical Investigation of the Role of Pre-training in Lifelong Learningcited by 134
- 2021Online Coreset Selection for Rehearsal-based Continual Learningcited by 114
- 2018Continuous Learning in Single-Incremental-Task Scenarioscited by 109
- 2022The CLEAR Benchmark: Continual LEArning on Real-World Imagerycited by 92
- 2019Lifelong Machine Learning with Deep Streaming Linear Discriminant Analysiscited by 91
- 2020GAN Memory with No Forgettingcited by 84
- 2021Online Continual Learning with Natural Distribution Shifts: An Empirical Study with Visual Datacited by 67
- 2020Faster ILOD: Incremental Learning for Object Detectors based on Faster RCNNcited by 61
- 2022Class-Incremental Learning with Strong Pre-trained Modelscited by 60
- 2020Incremental Object Detection via Meta-Learningcited by 58
- 2021Self-Supervised Training Enhances Online Continual Learningcited by 53
- 2022Architecture Matters in Continual Learningcited by 46
- 2021Understanding Continual Learning Settings with Data Distribution Drift Analysiscited by 38
- 2021Wanderlust: Online Continual Object Detection in the Real Worldcited by 34
- 2019OpenLORIS-Object: A Robotic Vision Dataset and Benchmark for Lifelong Deep Learningcited by 28
- 2022Towards Exemplar-Free Continual Learning in Vision Transformers: an Account of Attention, Functional and Weight Regularizationcited by 23
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 8; 2024: 9; 2025: 14; 2026: 3.
35 papers.
Sort:
By area:
- 2023TiC-CLIP: Continual Training of CLIP Modelscited by 38
- 2023Prototype-Sample Relation Distillation: Towards Replay-Free Continual Learningcited by 34
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 32
- 2024Beyond Prompt Learning: Continual Adapter for Efficient Rehearsal-Free Continual Learningcited by 29
- 2024A Practitioner's Guide to Continual Multimodal Pretrainingcited by 22
- 2025Optimal Task Order for Continual Learning of Multiple Taskscited by 14
- 2025Parameter-Efficient Continual Fine-Tuning: A Surveycited by 11
- 2024Continual Learning in the Presence of Repetitioncited by 10
- 2023AR-TTA: A Simple Method for Real-World Continual Test-Time Adaptationcited by 8
- 2025DualCP: Rehearsal-Free Domain-Incremental Learning via Dual-Level Concept Prototypecited by 7
- 2026FIRE: Frobenius-Isometry Reinitialization for Balancing the Stability-Plasticity Tradeoffcited by 7
- 2024Replay Consolidation with Label Propagation for Continual Object Detectioncited by 6
23 more
- 2025RICO: Two Realistic Benchmarks and an In-Depth Analysis for Incremental Learning in Object Detectioncited by 5
- 2025PLAN: Proactive Low-Rank Allocation for Continual Learningcited by 5
- 2023ScrollNet: Dynamic Weight Importance for Continual Learningcited by 4
- 2024Online Analytic Exemplar-Free Continual Learning with Large Models for Imbalanced Autonomous Driving Taskcited by 4
- 2025Continual Hyperbolic Learning of Instances and Classescited by 4
- 20223rd Continual Learning Workshop Challenge on Egocentric Category and Instance Level Object Understandingcited by 3
- 2023Infinite dSprites for Disentangled Continual Learning: Separating Memory Edits from Generalizationcited by 3
- 2024CEL: A Continual Learning Model for Disease Outbreak Prediction by Leveraging Domain Adaptation via Elastic Weight Consolidationcited by 3
- 2025Global Convergence of Continual Learning on Non-IID Datacited by 3
- 2024Lifelong Learning of Video Diffusion Models From a Single Video Streamcited by 2
- 2024TiROD: Tiny Robotics Dataset and Benchmark for Continual Object Detectioncited by 2
- 2026A Practical Guide to Streaming Continual Learningcited by 2
- 2023TADIL: Task-Agnostic Domain-Incremental Learning through Task-ID Inference using Transformer Nearest-Centroid Embeddingscited by 1
- 2023EgoAdapt: A multi-stream evaluation study of adaptation to real-world egocentric user videocited by 1
- 2025CRAM: Large-scale Video Continual Learning with Bootstrapped Compressioncited by 1
- 2025Chat with UAV -- Human-UAV Interaction Based on Large Language Modelscited by 1
- 2023Continual Cross-Dataset Adaptation in Road Surface Classificationcited by 0
- 2024Continual Learning for Adaptable Car-Following in Dynamic Traffic Environmentscited by 0
- 2025Enhancing knowledge retention for continual learning with domain-specific adapters and features gatingcited by 0
- 2025Semi-parametric Memory Consolidation: Towards Brain-like Deep Continual Learningcited by 0
- 2025GradMix: Gradient-based Selective Mixup for Robust Data Augmentation in Class-Incremental Learningcited by 0
- 2025Monte Carlo Functional Regularisation for Continual Learningcited by 0
- 2026A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platformcited by 0
- 2026A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platform1 Oct 2026
- 2026A Practical Guide to Streaming Continual Learning2 Mar 2026
- 2026FIRE: Frobenius-Isometry Reinitialization for Balancing the Stability-Plasticity Tradeoff8 Feb 2026
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future18 Dec 2025
- 2025Chat with UAV -- Human-UAV Interaction Based on Large Language Models9 Dec 2025
- 2025PLAN: Proactive Low-Rank Allocation for Continual Learning24 Oct 2025
- 2025RICO: Two Realistic Benchmarks and an In-Depth Analysis for Incremental Learning in Object Detection19 Aug 2025
- 2025Monte Carlo Functional Regularisation for Continual Learning18 Aug 2025
- 2025CRAM: Large-scale Video Continual Learning with Bootstrapped Compression7 Aug 2025
- 2025Continual Hyperbolic Learning of Instances and Classes12 Jun 2025
- 2025GradMix: Gradient-based Selective Mixup for Robust Data Augmentation in Class-Incremental Learning13 May 2025
- 2025Semi-parametric Memory Consolidation: Towards Brain-like Deep Continual Learning20 Apr 2025
23 more
- 2025Parameter-Efficient Continual Fine-Tuning: A Survey18 Apr 2025
- 2025Enhancing knowledge retention for continual learning with domain-specific adapters and features gating11 Apr 2025
- 2025Global Convergence of Continual Learning on Non-IID Data24 Mar 2025
- 2025DualCP: Rehearsal-Free Domain-Incremental Learning via Dual-Level Concept Prototype23 Mar 2025
- 2025Optimal Task Order for Continual Learning of Multiple Tasks5 Feb 2025
- 2024TiROD: Tiny Robotics Dataset and Benchmark for Continual Object Detection24 Sep 2024
- 2024Replay Consolidation with Label Propagation for Continual Object Detection9 Sep 2024
- 2024A Practitioner's Guide to Continual Multimodal Pretraining26 Aug 2024
- 2024Continual Learning for Adaptable Car-Following in Dynamic Traffic Environments17 Jul 2024
- 2024Beyond Prompt Learning: Continual Adapter for Efficient Rehearsal-Free Continual Learning14 Jul 2024
- 2024Lifelong Learning of Video Diffusion Models From a Single Video Stream7 Jun 2024
- 2024Online Analytic Exemplar-Free Continual Learning with Large Models for Imbalanced Autonomous Driving Task28 May 2024
- 2024Continual Learning in the Presence of Repetition7 May 2024
- 2024CEL: A Continual Learning Model for Disease Outbreak Prediction by Leveraging Domain Adaptation via Elastic Weight Consolidation17 Jan 2024
- 2023Infinite dSprites for Disentangled Continual Learning: Separating Memory Edits from Generalization27 Dec 2023
- 2023TiC-CLIP: Continual Training of CLIP Models24 Oct 2023
- 2023AR-TTA: A Simple Method for Real-World Continual Test-Time Adaptation18 Sep 2023
- 2023Continual Cross-Dataset Adaptation in Road Surface Classification5 Sep 2023
- 2023ScrollNet: Dynamic Weight Importance for Continual Learning31 Aug 2023
- 2023EgoAdapt: A multi-stream evaluation study of adaptation to real-world egocentric user video11 Jul 2023
- 2023TADIL: Task-Agnostic Domain-Incremental Learning through Task-ID Inference using Transformer Nearest-Centroid Embeddings21 Jun 2023
- 2023Prototype-Sample Relation Distillation: Towards Replay-Free Continual Learning26 Mar 2023
- 20223rd Continual Learning Workshop Challenge on Egocentric Category and Instance Level Object Understanding13 Dec 2022
- 2023TiC-CLIP: Continual Training of CLIP Modelscited by 38
- 2023Prototype-Sample Relation Distillation: Towards Replay-Free Continual Learningcited by 34
- 2024Beyond Prompt Learning: Continual Adapter for Efficient Rehearsal-Free Continual Learningcited by 29
- 2024A Practitioner's Guide to Continual Multimodal Pretrainingcited by 22
- 2025Optimal Task Order for Continual Learning of Multiple Taskscited by 14
- 2025Parameter-Efficient Continual Fine-Tuning: A Surveycited by 11
- 2024Continual Learning in the Presence of Repetitioncited by 10
- 2023AR-TTA: A Simple Method for Real-World Continual Test-Time Adaptationcited by 8
- 2025DualCP: Rehearsal-Free Domain-Incremental Learning via Dual-Level Concept Prototypecited by 7
- 2026FIRE: Frobenius-Isometry Reinitialization for Balancing the Stability-Plasticity Tradeoffcited by 7
- 2024Replay Consolidation with Label Propagation for Continual Object Detectioncited by 6
- 2025RICO: Two Realistic Benchmarks and an In-Depth Analysis for Incremental Learning in Object Detectioncited by 5
12 most cited of 32 All 32 (JSON)
- 2026A Practical Guide to Streaming Continual Learning2 Mar 2026
- 2026FIRE: Frobenius-Isometry Reinitialization for Balancing the Stability-Plasticity Tradeoff8 Feb 2026
- 2025Chat with UAV -- Human-UAV Interaction Based on Large Language Models9 Dec 2025
- 2025PLAN: Proactive Low-Rank Allocation for Continual Learning24 Oct 2025
- 2025RICO: Two Realistic Benchmarks and an In-Depth Analysis for Incremental Learning in Object Detection19 Aug 2025
- 2025Monte Carlo Functional Regularisation for Continual Learning18 Aug 2025
- 2025CRAM: Large-scale Video Continual Learning with Bootstrapped Compression7 Aug 2025
- 2025Continual Hyperbolic Learning of Instances and Classes12 Jun 2025
- 2025GradMix: Gradient-based Selective Mixup for Robust Data Augmentation in Class-Incremental Learning13 May 2025
- 2025Semi-parametric Memory Consolidation: Towards Brain-like Deep Continual Learning20 Apr 2025
- 2025Parameter-Efficient Continual Fine-Tuning: A Survey18 Apr 2025
- 2025Enhancing knowledge retention for continual learning with domain-specific adapters and features gating11 Apr 2025
12 newest of 32 All 32 (JSON)