mlsanityData to 14 Oct 2026

CapMap-MS-TTA: 3rd Place Solution for the MUMU Track of the 8th LSVOS Challenge at ECCV 2026

arXiv 2609.18206 ↗First posted 16 Sep 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The MUMU track of the 8th Large-scale Video Object Segmentation (LSVOS) Challenge requires a single unified multimodal model to jointly solve image tagging (Task A), open-vocabulary object detection (Task B), and English captioning (Task C) under strict resource constraints (<=0.5B parameters and <=8 GB peak GPU memory). We present CapMap-MS-TTA, a training-free submission built on Microsoft Florence-2-base (~231M parameters), combining caption keyword mapping with multi-scale flip test-time augmentation. Task C uses the native <DETAILED_CAPTION> pathway with length/token sanitization. Task A maps the same detailed caption into the official quality/scene/event vocabularies via an expanded keyword lexicon with whole-word matching and a lightweight expand-hints stage. Task B runs Florence-2 open detection (<OD>) with multi-scale and horizontal-flip test-time augmentation (TTA), followed by label-aware non-maximum suppression (NMS). Without fine-tuning, the system improves our reproduced Florence-2 baseline from 15.16 to a best public score of 16.4815, and ranks 3rd on the final MUMU leaderboard.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 8 references that are in the map. First posted on arXiv 16 Sep 2026.

Builds on

5 of 8 references.

References · 5

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  3. 2015SSD: Single Shot MultiBox Detectorcited by 3,130
  4. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
  5. 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 234

Built on by

Not cited yet.