Incremental Learning of Object Detectors without Catastrophic Forgetting
Not on the map. Why?
Abstract (arXiv)
Despite their success for object detection, convolutional neural networks are ill-equipped for incremental learning, i.e., adapting the original model trained on a set of classes to additionally detect objects of new classes, in the absence of the initial training data. They suffer from "catastrophic forgetting" - an abrupt degradation of performance on the original set of classes, when the training objective is adapted to the new classes. We present a method to address this issue, and learn object detectors incrementally, when neither the original training data nor annotations for the original classes in the new training set are available. The core of our proposed solution is a loss function to balance the interplay between predictions on the new classes and a new distillation loss which minimizes the discrepancy between responses for old classes from the original and the updated networks. This incremental learning can be performed multiple times, for a new set of classes in each step, with a moderate drop in performance compared to the baseline network trained on the ensemble of data. We present object detection results on the PASCAL VOC 2007 and COCO datasets, along with a detailed empirical analysis of the approach.
Key facts. Cited by 208 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Aug 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 45; 2022: 43; 2023: 44; 2024: 33; 2025: 22; 2026: 21.
208 papers.
Sort:
By area:
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
- 2021Towards Open World Object Detectioncited by 297
- 2021Online Continual Learning in Image Classification: An Empirical Surveycited by 245
- 2023Class-Incremental Learning: A Surveycited by 209
- 2023SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Modelcited by 180
- 2021OW-DETR: Open-world Detection Transformercited by 129
- 2022Federated Class-Incremental Learningcited by 127
- 2021AutoNovel: Automatically Discovering and Learning Novel Visual Categoriescited by 116
- 2021Semantic-aware Knowledge Distillation for Few-Shot Class-Incremental Learningcited by 115
- 2021Continual Semantic Segmentation via Repulsion-Attraction of Sparse and Disentangled Latent Representationscited by 96
- 2021RECALL: Replay-based Continual Learning in Semantic Segmentationcited by 83
- 2022Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillationcited by 72
38 more
- 2023Continual Detection Transformer for Incremental Object Detectioncited by 59
- 2021Lifelong Person Re-Identification via Adaptive Knowledge Accumulationcited by 57
- 2022PROB: Probabilistic Objectness for Open World Object Detectioncited by 57
- 2021Recent Advances of Continual Learning in Computer Vision: An Overviewcited by 55
- 2021Factors of Influence for Transfer Learning across Diverse Appearance Domains and Task Typescited by 54
- 2021Self-Supervised Training Enhances Online Continual Learningcited by 54
- 2023No One Left Behind: Real-World Federated Class-Incremental Learningcited by 53
- 2021Layerwise Optimization by Gradient Decomposition for Continual Learningcited by 51
- 2023A Survey on Few-Shot Class-Incremental Learningcited by 48
- 2022Class-Incremental Learning for Action Recognition in Videoscited by 46
- 2024SDDGR: Stable Diffusion-based Deep Generative Replay for Class Incremental Object Detectioncited by 44
- 2022Memory Efficient Continual Learning with Transformerscited by 43
- 2022On the Effectiveness of Lipschitz-Driven Rehearsal in Continual Learningcited by 39
- 2022Uncertainty-aware Contrastive Distillation for Incremental Semantic Segmentationcited by 37
- 2022Energy-based Latent Aligner for Incremental Learningcited by 37
- 2021Multi-View Correlation Distillation for Incremental Object Detectioncited by 36
- 2022CLAD: A realistic Continual Learning benchmark for Autonomous Drivingcited by 36
- 2021Wanderlust: Online Continual Object Detection in the Real Worldcited by 34
- 2023Augmented Box Replay: Overcoming Foreground Shift for Incremental Object Detectioncited by 32
- 2022Revisiting Open World Object Detectioncited by 30
- 2022Learning with Recoverable Forgettingcited by 30
- 2022Open-world Semantic Segmentation for LIDAR Point Cloudscited by 29
- 2023CAT: LoCalization and IdentificAtion Cascade Detection Transformer for Open-World Object Detectioncited by 28
- 2021Dynamic Language Models for Continuously Evolving Contentcited by 27
- 2023Towards Continual Egocentric Activity Recognition: A Multi-modal Egocentric Activity Dataset for Continual Learningcited by 26
- 2023Teacher-Student Architecture for Knowledge Distillation: A Surveycited by 26
- 2024AIDE: An Automatic Data Engine for Object Detection in Autonomous Drivingcited by 26
- 2021Optimizing Reusable Knowledge for Continual Learning via Metalearningcited by 25
- 2021Continual Semi-Supervised Learning through Contrastive Interpolation Consistencycited by 25
- 2022Continual Object Detection: A review of definitions, strategies, and challengescited by 25
- 2022Modeling Missing Annotations for Incremental Learning in Object Detectioncited by 23
- 2023FedET: A Communication-Efficient Federated Class-Incremental Learning Framework Based on Enhanced Transformercited by 23
- 2024VLM-PL: Advanced Pseudo Labeling Approach for Class Incremental Object Detection via Vision-Language Modelcited by 23
- 2022Interactron: Embodied Adaptive Object Detectioncited by 21
- 2022Attribution-aware Weight Transfer: A Warm-Start Initialization for Class-Incremental Semantic Segmentationcited by 21
- 2022Continual Object Detection via Prototypical Task Correlation Guided Gating Mechanismcited by 20
- 2022Learning Incrementally to Segment Multiple Organs in a CT Imagecited by 19
- 2021Objects in Semantic Topologycited by 18
50 most cited of 208 All 208 (JSON)
- 2026Losing the name before the box: measuring and repairing what narrow fine-tuning costs a detector outside its deployment vocabulary29 Sep 2026
- 2026Knowing Beyond the Known: Reinforced Knowledge Specification for Multi-Label Class-Incremental Learning31 Aug 2026
- 2026Socialized Detector Learning: Trajectory-Guided and Reciprocal Distillation for Heterogeneous Object Detectors26 Aug 2026
- 2026C2Path: Class-Conditional Pathway Decoupling for Vision-Language Incremental Object Detection22 Aug 2026
- 2026Multimodal Semantic-Probabilistic Objectness for Open World Object Detection27 Jul 2026
- 2026Breaking the Model Forgetting Cycle in Long-Incremental 3D Object Detection16 Jul 2026
- 2026Position: Stop Reactively Patching Your Model Every Time and Start Proactive Test-Driven AI Development10 Jul 2026
- 2026REAL-OW: Rehearsal-free Open World Object Detection with Low-Rank Adaptation and Dual-Stage Objectness Modeling3 Jul 2026
- 2026Focus, Align, and Sustain: Counteracting Gradient Dilution in Incremental Object Detection13 Jun 2026
- 2026STAR-IOD: Scale-decoupled Topology Alignment with Pseudo-label Refinement for Remote Sensing Incremental Object Detection20 May 2026
- 2026Dual-Stage Invariant Continual Learning under Extreme Visual Sparsity27 Mar 2026
- 2026Vision-Language Attribute Disentanglement and Reinforcement for Lifelong Person Re-Identification20 Mar 2026
38 more
- 2026Class-Incremental Motion Forecasting10 Mar 2026
- 2026SPREAD: Subspace Representation Distillation for Lifelong Imitation Learning9 Mar 2026
- 2026Beyond Prompt Degradation: Prototype-guided Dual-pool Prompting for Incremental Object Detection2 Mar 2026
- 2026Better Matching, Less Forgetting: A Quality-Guided Matcher for Transformer-based Incremental Object Detection2 Mar 2026
- 2026AHC: Meta-Learned Adaptive Compression for Continual Object Detection on Memory-Constrained Microcontrollers24 Feb 2026
- 2026EW-DETR: Evolving World Object Detection via Incremental Low-Rank DEtection TRansformer24 Feb 2026
- 2026Knowing the Unknown: Interpretable Open-World Object Detection via Concept Decomposition Model24 Feb 2026
- 2026Evolving Without Ending: Unifying Multimodal Incremental Learning for Continual Panoptic Perception22 Jan 2026
- 2026P2L-CA: An Effective Parameter Tuning Framework for Rehearsal-Free Multi-Label Class-Incremental Learning19 Jan 2026
- 2025Distillation-Guided Structural Transfer for Continual Learning Beyond Sparse Distributed Memory17 Dec 2025
- 2025ZeBROD: Zero-Retraining Based Recognition and Object Detection Framework4 Dec 2025
- 2025Stable-Drift: A Patient-Aware Latent Drift Replay Method for Stabilizing Representations in Continual Learning27 Nov 2025
- 2025Parameterized Prompt for Incremental Object Detection31 Oct 2025
- 2025Looking Beyond the Known: Towards a Data Discovery Guided Open-World Object Detection30 Sep 2025
- 2025CL2GEC: A Multi-Discipline Benchmark for Continual Learning in Chinese Literature Grammatical Error Correction17 Sep 2025
- 2025MEGG: Replay via Maximally Extreme GGscore in Incremental Learning for Neural Recommendation Models9 Sep 2025
- 2025Index-Aligned Query Distillation for Transformer-based Incremental Object Detection15 Aug 2025
- 2025Hierarchical Visual Prompt Learning for Continual Video Instance Segmentation12 Aug 2025
- 2025Lifelong Learner: Discovering Versatile Neural Solvers for Vehicle Routing Problems8 Aug 2025
- 2025Decoupled PROB: Decoupled Query Initialization Tasks and Objectness-Class Learning for Open World Object Detection17 Jul 2025
- 2025Interaction-Merged Motion Planning: Effectively Leveraging Diverse Motion Datasets for Robust Planning7 Jul 2025
- 2025DuET: Dual Incremental Object Detection via Exemplar-Free Task Arithmetic26 Jun 2025
- 2025Hierarchical Neural Collapse Detection Transformer for Class Incremental Object Detection10 Jun 2025
- 2025iDPA: Instance Decoupled Prompt Attention for Incremental Medical Object Detection31 May 2025
- 2025GPS: Distilling Compact Memories via Grid-based Patch Sampling for Efficient Online Class-Incremental Learning14 Apr 2025
- 2025CO-DEFEND: Continuous Decentralized Federated Learning for Secure DoH-Based Threat Detection2 Apr 2025
- 2025DCA: Dividing and Conquering Amnesia in Incremental Object Detection19 Mar 2025
- 2025Teach YOLO to Remember: A Self-Distillation Approach for Continual Object Detection6 Mar 2025
- 2025Class-Independent Increment: An Efficient Approach for Multi-label Class-Incremental Learning1 Mar 2025
- 2025CLIMB-3D: Continual Learning for Imbalanced 3D Instance Segmentation24 Feb 2025
- 2025Federated Class-Incremental Learning: A Hybrid Approach Using Latent Exemplars and Data-Free Techniques to Address Local and Global Forgetting26 Jan 2025
- 2024From Open Vocabulary to Open World: Teaching Vision Language Models to Detect Novel Objects27 Nov 2024
- 2024CLFace: A Scalable and Resource-Efficient Continual Learning Framework for Lifelong Face Recognition21 Nov 2024
- 2024Open World Object Detection: A Survey15 Oct 2024
- 2024CASA: Class-Agnostic Shared Attributes in Vision-Language Models for Efficient Incremental Object Detection8 Oct 2024
- 2024M2Distill: Multi-Modal Distillation for Lifelong Imitation Learning30 Sep 2024
- 2024PoseAdapt: Sustainable Human Pose Estimation via Continual Learning Benchmarks and Toolkit30 Sep 2024
- 2024TiROD: Tiny Robotics Dataset and Benchmark for Continual Object Detection24 Sep 2024
50 newest of 208 All 208 (JSON)
- 2021Semantic-aware Knowledge Distillation for Few-Shot Class-Incremental Learningcited by 115
- 2023Continual Detection Transformer for Incremental Object Detectioncited by 59
- 2023Teacher-Student Architecture for Knowledge Distillation: A Surveycited by 26
- 2022Modeling Missing Annotations for Incremental Learning in Object Detectioncited by 23
- 2022Respecting Transfer Gap in Knowledge Distillationcited by 18
- 2021DnS: Distill-and-Select for Efficient and Accurate Video Indexing and Retrievalcited by 17
- 2022Continual Learning for Class- and Domain-Incremental Semantic Segmentationcited by 17
- 2024Bridge Past and Future: Overcoming Information Asymmetry in Incremental Object Detectioncited by 16
- 2023Inherit with Distillation and Evolve with Contrast: Exploring Class Incremental Semantic Segmentation Without Exemplar Memorycited by 12
- 2023Continual Learning for LiDAR Semantic Segmentation: Class-Incremental and Coarse-to-Fine strategies on Sparse Datacited by 9
- 2022Life-long Learning for Multilingual Neural Machine Translation with Knowledge Distillationcited by 5
- 2023SKDF: A Simple Knowledge Distillation Framework for Distilling Open-Vocabulary Knowledge to Open-world Object Detectorcited by 4
12 most cited of 16 All 16 (JSON)
- 2025Teach YOLO to Remember: A Self-Distillation Approach for Continual Object Detection6 Mar 2025
- 2024Bridge Past and Future: Overcoming Information Asymmetry in Incremental Object Detection16 Jul 2024
- 2023SKDF: A Simple Knowledge Distillation Framework for Distilling Open-Vocabulary Knowledge to Open-world Object Detector14 Dec 2023
- 2023Inherit with Distillation and Evolve with Contrast: Exploring Class Incremental Semantic Segmentation Without Exemplar Memory27 Sep 2023
- 2023Teacher-Student Architecture for Knowledge Distillation: A Survey8 Aug 2023
- 2023Class-Incremental Learning of Plant and Disease Detection: Growing Branches with Knowledge Distillation13 Apr 2023
- 2023Continual Learning for LiDAR Semantic Segmentation: Class-Incremental and Coarse-to-Fine strategies on Sparse Data8 Apr 2023
- 2023Continual Detection Transformer for Incremental Object Detection6 Apr 2023
- 2022Life-long Learning for Multilingual Neural Machine Translation with Knowledge Distillation6 Dec 2022
- 2022Respecting Transfer Gap in Knowledge Distillation23 Oct 2022
- 2022Continual Learning for Class- and Domain-Incremental Semantic Segmentation16 Sep 2022
- 2022A New Knowledge Distillation Network for Incremental Few-Shot Surface Defect Detection1 Sep 2022
12 newest of 16 All 16 (JSON)
- 2024VLM-PL: Advanced Pseudo Labeling Approach for Class Incremental Object Detection via Vision-Language Modelcited by 23
- 2024From Open Vocabulary to Open World: Teaching Vision Language Models to Detect Novel Objectscited by 5
- 2024CASA: Class-Agnostic Shared Attributes in Vision-Language Models for Efficient Incremental Object Detectioncited by 0
- 2024From Open Vocabulary to Open World: Teaching Vision Language Models to Detect Novel Objects27 Nov 2024
- 2024CASA: Class-Agnostic Shared Attributes in Vision-Language Models for Efficient Incremental Object Detection8 Oct 2024
- 2024VLM-PL: Advanced Pseudo Labeling Approach for Class Incremental Object Detection via Vision-Language Model8 Mar 2024
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
- 2021Towards Open World Object Detectioncited by 297
- 2021Online Continual Learning in Image Classification: An Empirical Surveycited by 245
- 2023Class-Incremental Learning: A Surveycited by 209
- 2023SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Modelcited by 180
- 2021OW-DETR: Open-world Detection Transformercited by 129
- 2022Federated Class-Incremental Learningcited by 127
- 2021AutoNovel: Automatically Discovering and Learning Novel Visual Categoriescited by 116
- 2021Continual Semantic Segmentation via Repulsion-Attraction of Sparse and Disentangled Latent Representationscited by 96
- 2021RECALL: Replay-based Continual Learning in Semantic Segmentationcited by 83
- 2022Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillationcited by 72
- 2021Lifelong Person Re-Identification via Adaptive Knowledge Accumulationcited by 57
12 most cited of 185 All 185 (JSON)
- 2026Losing the name before the box: measuring and repairing what narrow fine-tuning costs a detector outside its deployment vocabulary29 Sep 2026
- 2026Knowing Beyond the Known: Reinforced Knowledge Specification for Multi-Label Class-Incremental Learning31 Aug 2026
- 2026Socialized Detector Learning: Trajectory-Guided and Reciprocal Distillation for Heterogeneous Object Detectors26 Aug 2026
- 2026C2Path: Class-Conditional Pathway Decoupling for Vision-Language Incremental Object Detection22 Aug 2026
- 2026Multimodal Semantic-Probabilistic Objectness for Open World Object Detection27 Jul 2026
- 2026Breaking the Model Forgetting Cycle in Long-Incremental 3D Object Detection16 Jul 2026
- 2026Position: Stop Reactively Patching Your Model Every Time and Start Proactive Test-Driven AI Development10 Jul 2026
- 2026REAL-OW: Rehearsal-free Open World Object Detection with Low-Rank Adaptation and Dual-Stage Objectness Modeling3 Jul 2026
- 2026Focus, Align, and Sustain: Counteracting Gradient Dilution in Incremental Object Detection13 Jun 2026
- 2026STAR-IOD: Scale-decoupled Topology Alignment with Pseudo-label Refinement for Remote Sensing Incremental Object Detection20 May 2026
- 2026Dual-Stage Invariant Continual Learning under Extreme Visual Sparsity27 Mar 2026
- 2026Vision-Language Attribute Disentanglement and Reinforcement for Lifelong Person Re-Identification20 Mar 2026
12 newest of 185 All 185 (JSON)