mlsanityData to 14 Oct 2026

Heterogeneous Vision-Language Ensemble with Disagreement-Aware Reranking for Text-Based Person Anomaly Retrieval

arXiv 2608.12843 ↗First posted 13 Aug 2026cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Text-based person anomaly retrieval aims to retrieve pedestrians exhibiting anomalous behaviors from a large image gallery using natural language descriptions. Compared with conventional text-based person retrieval, this task requires fine-grained reasoning over pedestrian appearance, behaviors, object interactions, and scene context, making robust cross-modal matching significantly more challenging. This paper presents the GENAI4E team's solution to AI City Challenge 2026 Track 4. Our framework builds upon a strong retrieval backbone and progressively integrates heterogeneous vision-language embedding models through score alignment and iterative ensemble fusion, followed by disagreement-aware VLM reranking for ambiguous queries. On the official Pedestrian Anomaly Behavior (PAB) benchmark, our approach achieves 90.92% mAP, 85.13% Recall@1, 97.72% Recall@5, and 98.68% Recall@10, demonstrating the effectiveness of combining complementary vision-language representations with selective multimodal reasoning for large-scale text-based person anomaly retrieval.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 23 references that are in the map. First posted on arXiv 13 Aug 2026.

Builds on

18 of 23 references.

References · 18

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  3. 2025Qwen3-VL Technical Reportcited by 2,793
  4. 2019Passage Re-ranking with BERTcited by 645
  5. 2022Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Taskscited by 511
  6. 2021Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Conceptscited by 256
  7. 2017Dual-Path Convolutional Image-Text Embeddings with Instance Losscited by 145
  8. 2023Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrievalcited by 132
  9. 2024MegaPairs: Massive Data Synthesis For Universal Multimodal Retrievalcited by 84
  10. 2023Towards Unified Text-based Person Retrieval: A Large-scale Multi-Attribute and Language Search Benchmarkcited by 75
  11. 2023RaSa: Relation and Sensitivity Aware Representation Learning for Text-based Person Searchcited by 54
  12. 2024Beyond Walking: A Large-Scale Image-Text Benchmark for Text-based Person Anomaly Searchcited by 11
6 more
  1. 2025Hybrid, Unified and Iterative: A Novel Framework for Text-based Person Anomaly Retrievalcited by 9
  2. 2024Data Augmentation for Text-based Person Retrieval Using Large Language Modelscited by 4
  3. 2025AnomalyLMM: Bridging Generative Knowledge and Discriminative Retrieval for Text-Based Person Anomaly Searchcited by 4
  4. 2026Bridging the Pose-Semantic Gap: A Cascade Framework for Text-Based Person Anomaly Searchcited by 4
  5. 2026ITSELF: Attention Guided Fine-Grained Alignment for Vision-Language Retrievalcited by 3
  6. 2026ESC: Emotional Self-Correction for Reliable Vision-Language Modelscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026FaLCon: Facet-Anchored Retrieval with Late Consensus for Sim2Real Text-Based Person Anomaly Search
  2. 2025Efficient Vision Language Model Fine-tuning for Text-based Person Anomaly Search
  3. 2026Action-Aligned Retrieval with Pairwise Multimodal Reranking for Text-Based Person Anomaly Search
  4. 2023Exploiting the Textual Potential from Vision-Language Pre-training for Text-based Person Search
  5. 2025Boosting Weak Positives for Text Based Person Search
  6. 2024Multi-path Exploration and Feedback Adjustment for Text-to-Image Person Retrieval
  7. 2025ChatReID: Open-ended Interactive Person Retrieval via Hierarchical Progressive Tuning for Vision Language Models
  8. 2026Unified Multi-Dataset Training for TBPS