mlsanityData to 14 Oct 2026

Losing the name before the box: measuring and repairing what narrow fine-tuning costs a detector outside its deployment vocabulary

arXiv 2609.36426 ↗First posted 29 Sep 2026cs.RO cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

A detector pretrained on a broad corpus is fine-tuned on a narrow domain, its in-domain accuracy improves, and it ships. We ask what happens meanwhile to its coverage of objects the vocabulary never names, which in obstacle detection and inspection carry the risk. No in-domain test set holds an example of one. We give a longitudinal protocol: one pretrained checkpoint against its own fine-tuned descendants. It tracks held-out top-K proposal coverage Cτ: of categories pretraining covered and the vocabulary omits, the share of boxes a detector's top K regions still cover. The quantity is the open-world proposal literature's; the longitudinal reading is not. Cτ falls while in-domain accuracy rises, on four architectures and three domains, by 5.12 to 63.35 points on boxes above 1024 px2. No in-domain number identifies the fall, and neither does detection average precision, which charges a missed and a misnamed box alike. On the one architecture scoring both, adaptation costs 87% of the AP against a fifth of the coverage, and the naming goes first at all six depths of its freeze ladder, every run. What breaks is structured: three architectures sharing no pretraining run agree on which categories lose coverage, and those a model never learned do not lose any. A repair follows and needs no training: mixing a quarter of the pretrained state back, normalisation statistics included, raises coverage on every cell swept for at most 2.47 points of in-domain accuracy. Seeing it costs one extra evaluation pass.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 44 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

34 of 44 references.

References · 34

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  3. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  4. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
  5. 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,209
  6. 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
  7. 2021Robust fine-tuning of zero-shot modelscited by 797
  8. 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 678
  9. 2019Linear Mode Connectivity and the Lottery Ticket Hypothesiscited by 637
  10. 2020Underspecification Presents Challenges for Credibility in Modern Machine Learningcited by 496
  11. 2020Improving robustness against common corruptions by covariate shift adaptationcited by 431
  12. 2020What is being transferred in transfer learning?cited by 368
22 more
  1. 2021Towards Open World Object Detectioncited by 297
  2. 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 249
  3. 2020Evaluating Prediction-Time Batch Normalization for Robustness under Covariate Shiftcited by 236
  4. 2017Incremental Learning of Object Detectors without Catastrophic Forgettingcited by 208
  5. 2022Surgical Fine-Tuning Improves Adaptation to Distribution Shiftscited by 205
  6. 2022Patching open-vocabulary models by interpolating weightscited by 190
  7. 2020TIDE: A General Toolbox for Identifying Object Detection Errorscited by 114
  8. 2021Learning Open-World Object Proposals without Learning to Classifycited by 109
  9. 2020Multivariate Confidence Calibration for Object Detectioncited by 98
  10. 2025RF-DETR: Neural Architecture Search for Real-Time Detection Transformerscited by 75
  11. 2023A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Futurecited by 61
  12. 2015What makes for effective detection proposals?cited by 38
  13. 2022Towards Improving Calibration in Object Detection Under Domain Shiftcited by 26
  14. 2024Fine-Tuning is Fine, if Calibratedcited by 24
  15. 2024Training-Free Model Merging for Multi-target Domain Adaptationcited by 15
  16. 2025Forget About It: Mitigating Forgetting Without Replay or Auxiliary Objectivescited by 14
  17. 2022Extending One-Stage Detection with Open-World Proposalscited by 9
  18. 2025Demystifying Catastrophic Forgetting in Two-Stage Incremental Object Detectorcited by 6
  19. 2025Textual Inversion for Efficient Adaptation of Open-Vocabulary Object Detectors Without Forgettingcited by 3
  20. 2026Mitigating Objectness Bias and Region-to-Text Misalignment for Open-Vocabulary Panoptic Segmentationcited by 2
  21. 2026A Closer Look at Cross-Domain Few-Shot Object Detection: Fine-Tuning Matters and Parallel Decoder Helpscited by 2
  22. 2026Orthogonal Knowledge Refreshing for Domain-Incremental Object Detectioncited by 1

Built on by

Not cited yet.