Heterogeneous Vision-Language Ensemble with Disagreement-Aware Reranking for Text-Based Person Anomaly Retrieval
Not on the map. Why?
Abstract (arXiv)
Text-based person anomaly retrieval aims to retrieve pedestrians exhibiting anomalous behaviors from a large image gallery using natural language descriptions. Compared with conventional text-based person retrieval, this task requires fine-grained reasoning over pedestrian appearance, behaviors, object interactions, and scene context, making robust cross-modal matching significantly more challenging. This paper presents the GENAI4E team's solution to AI City Challenge 2026 Track 4. Our framework builds upon a strong retrieval backbone and progressively integrates heterogeneous vision-language embedding models through score alignment and iterative ensemble fusion, followed by disagreement-aware VLM reranking for ambiguous queries. On the official Pedestrian Anomaly Behavior (PAB) benchmark, our approach achieves 90.92% mAP, 85.13% Recall@1, 97.72% Recall@5, and 98.68% Recall@10, demonstrating the effectiveness of combining complementary vision-language representations with selective multimodal reasoning for large-scale text-based person anomaly retrieval.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 23 references that are in the map. First posted on arXiv 13 Aug 2026.
Builds on
18 of 23 references.
References · 18
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2019Passage Re-ranking with BERTcited by 645
- 2022Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Taskscited by 511
- 2021Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Conceptscited by 256
- 2017Dual-Path Convolutional Image-Text Embeddings with Instance Losscited by 145
- 2023Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrievalcited by 132
- 2024MegaPairs: Massive Data Synthesis For Universal Multimodal Retrievalcited by 84
- 2023Towards Unified Text-based Person Retrieval: A Large-scale Multi-Attribute and Language Search Benchmarkcited by 75
- 2023RaSa: Relation and Sensitivity Aware Representation Learning for Text-based Person Searchcited by 54
- 2024Beyond Walking: A Large-Scale Image-Text Benchmark for Text-based Person Anomaly Searchcited by 11
6 more
- 2025Hybrid, Unified and Iterative: A Novel Framework for Text-based Person Anomaly Retrievalcited by 9
- 2024Data Augmentation for Text-based Person Retrieval Using Large Language Modelscited by 4
- 2025AnomalyLMM: Bridging Generative Knowledge and Discriminative Retrieval for Text-Based Person Anomaly Searchcited by 4
- 2026Bridging the Pose-Semantic Gap: A Cascade Framework for Text-Based Person Anomaly Searchcited by 4
- 2026ITSELF: Attention Guided Fine-Grained Alignment for Vision-Language Retrievalcited by 3
- 2026ESC: Emotional Self-Correction for Reliable Vision-Language Modelscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026The 10th AI City Challengecited by 8
- 2026The 10th AI City Challenge17 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026FaLCon: Facet-Anchored Retrieval with Late Consensus for Sim2Real Text-Based Person Anomaly Search
- 2025Efficient Vision Language Model Fine-tuning for Text-based Person Anomaly Search
- 2026Action-Aligned Retrieval with Pairwise Multimodal Reranking for Text-Based Person Anomaly Search
- 2023Exploiting the Textual Potential from Vision-Language Pre-training for Text-based Person Search
- 2025Boosting Weak Positives for Text Based Person Search
- 2024Multi-path Exploration and Feedback Adjustment for Text-to-Image Person Retrieval
- 2025ChatReID: Open-ended Interactive Person Retrieval via Hierarchical Progressive Tuning for Vision Language Models
- 2026Unified Multi-Dataset Training for TBPS