Losing the name before the box: measuring and repairing what narrow fine-tuning costs a detector outside its deployment vocabulary
Not on the map. Why?
Abstract (arXiv)
A detector pretrained on a broad corpus is fine-tuned on a narrow domain, its in-domain accuracy improves, and it ships. We ask what happens meanwhile to its coverage of objects the vocabulary never names, which in obstacle detection and inspection carry the risk. No in-domain test set holds an example of one. We give a longitudinal protocol: one pretrained checkpoint against its own fine-tuned descendants. It tracks held-out top-K proposal coverage Cτ: of categories pretraining covered and the vocabulary omits, the share of boxes a detector's top K regions still cover. The quantity is the open-world proposal literature's; the longitudinal reading is not. Cτ falls while in-domain accuracy rises, on four architectures and three domains, by 5.12 to 63.35 points on boxes above 1024 px2. No in-domain number identifies the fall, and neither does detection average precision, which charges a missed and a misnamed box alike. On the one architecture scoring both, adaptation costs 87% of the AP against a fifth of the coverage, and the naming goes first at all six depths of its freeze ladder, every run. What breaks is structured: three architectures sharing no pretraining run agree on which categories lose coverage, and those a model never learned do not lose any. A repair follows and needs no training: mixing a quarter of the pretrained state back, normalisation statistics included, raises coverage on every cell swept for at most 2.47 points of in-domain accuracy. Seeing it costs one extra evaluation pass.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 44 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
34 of 44 references.
References · 34
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,209
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
- 2021Robust fine-tuning of zero-shot modelscited by 797
- 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 678
- 2019Linear Mode Connectivity and the Lottery Ticket Hypothesiscited by 637
- 2020Underspecification Presents Challenges for Credibility in Modern Machine Learningcited by 496
- 2020Improving robustness against common corruptions by covariate shift adaptationcited by 431
- 2020What is being transferred in transfer learning?cited by 368
22 more
- 2021Towards Open World Object Detectioncited by 297
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 249
- 2020Evaluating Prediction-Time Batch Normalization for Robustness under Covariate Shiftcited by 236
- 2017Incremental Learning of Object Detectors without Catastrophic Forgettingcited by 208
- 2022Surgical Fine-Tuning Improves Adaptation to Distribution Shiftscited by 205
- 2022Patching open-vocabulary models by interpolating weightscited by 190
- 2020TIDE: A General Toolbox for Identifying Object Detection Errorscited by 114
- 2021Learning Open-World Object Proposals without Learning to Classifycited by 109
- 2020Multivariate Confidence Calibration for Object Detectioncited by 98
- 2025RF-DETR: Neural Architecture Search for Real-Time Detection Transformerscited by 75
- 2023A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Futurecited by 61
- 2015What makes for effective detection proposals?cited by 38
- 2022Towards Improving Calibration in Object Detection Under Domain Shiftcited by 26
- 2024Fine-Tuning is Fine, if Calibratedcited by 24
- 2024Training-Free Model Merging for Multi-target Domain Adaptationcited by 15
- 2025Forget About It: Mitigating Forgetting Without Replay or Auxiliary Objectivescited by 14
- 2022Extending One-Stage Detection with Open-World Proposalscited by 9
- 2025Demystifying Catastrophic Forgetting in Two-Stage Incremental Object Detectorcited by 6
- 2025Textual Inversion for Efficient Adaptation of Open-Vocabulary Object Detectors Without Forgettingcited by 3
- 2026Mitigating Objectness Bias and Region-to-Text Misalignment for Open-Vocabulary Panoptic Segmentationcited by 2
- 2026A Closer Look at Cross-Domain Few-Shot Object Detection: Fine-Tuning Matters and Parallel Decoder Helpscited by 2
- 2026Orthogonal Knowledge Refreshing for Domain-Incremental Object Detectioncited by 1
Built on by
Not cited yet.