ARGOS: Who, Where, and When in Agentic Multi-Camera Person Search
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Existing person search methods assume access to complete visual queries or exhaustive tracking, yet real-world witness accounts are vague, partial, and spread across cameras and time. We introduce ARGOS (Agentic Retrieval with Grounded Observational Search), a benchmark and agent framework that recasts multi-camera person search from one-shot retrieval on a complete query into interactive reasoning from partial clues. To our knowledge, ARGOS is the first interactive benchmark to couple witness dialogue with camera-network topology, requiring an agent to plan, question, and eliminate under information asymmetry. An ARGOS agent receives a vague witness statement and must decide what to ask, when to invoke spatial or temporal tools, and how to interpret ambiguous natural-language responses, all within a limited turn budget. To ground reasoning in physical constraints, the agent accesses a Spatio-Temporal Topology Graph (STTG) encoding camera connectivity and empirically validated transition times. The benchmark comprises 2,691 tasks across 14 real-world scenarios in three progressive tracks: semantic perception (Who, 989 tasks), spatial reasoning (Where, 550 tasks), and temporal reasoning (When, 1,152 tasks). We propose Turn-Weighted Success (TWS) as the primary metric, jointly measuring correctness and turn efficiency. Experiments with four LLM backbones show the benchmark is far from solved: the best agent achieves TWS of 0.383 (Track~2) and 0.590 (Track~3). Ablations confirm each component is essential: removing domain-specific tools drops Top-1 accuracy by up to 49.6 percentage points, and removing strategic reasoning halves TWS while barely affecting Top-1.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 44 of its 53 references that are in the map. First posted on arXiv 14 Apr 2026.
Builds on
44 of 53 references.
Closest ancestors · 4
Same direction, newest first
- 2026Agentic Very Long Video Understanding26 Jan
- 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understanding23 May
- 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding18 Mar
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agent15 Mar
Other references · 40
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2025OpenAI GPT-5 System Cardcited by 989
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
- 2020Deep Learning for Person Re-identification: A Survey and Outlookcited by 549
- 2018On Evaluation of Embodied Navigation Agentscited by 547
- 2017Person Transfer GAN to Bridge Domain Gap for Person Re-Identificationcited by 480
28 more
- 2016Visual Dialogcited by 377
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 311
- 2017Person Search with Natural Language Descriptioncited by 149
- 2017Dual-Path Convolutional Image-Text Embeddings with Instance Losscited by 145
- 2023Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrievalcited by 132
- 2023Towards Unified Text-based Person Retrieval: A Large-scale Multi-Attribute and Language Search Benchmarkcited by 75
- 2017Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learningcited by 71
- 2022Learning Granularity-Unified Representations for Text-to-Image Person Re-identificationcited by 62
- 2021TIPCB: A Simple but Effective Part-based Convolutional Baseline for Text-based Person Searchcited by 57
- 2018Spatial-Temporal Person Re-identificationcited by 45
- 2024Harnessing the Power of MLLMs for Transferable Text-to-Image Person ReIDcited by 39
- 2023An Empirical Study of CLIP for Text-based Person Searchcited by 38
- 2025SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognitioncited by 35
- 2023Chatting Makes Perfect: Chat-based Image Retrievalcited by 25
- 2024Interactive Text-to-Image Retrieval with Large Language Models: A Plug-and-Play Approachcited by 25
- 2024Enhancing Interactive Image Retrieval With Query Rewriting Using Large Language Models and Vision Language Modelscited by 19
- 2022Learning to Retrieve Videos by Asking Questionscited by 18
- 2025ChatReID: Open-ended Interactive Person Retrieval via Hierarchical Progressive Tuning for Vision Language Modelscited by 16
- 2023Simple Baselines for Interactive Video Retrieval with Questions and Answerscited by 12
- 2021Ask&Confirm: Active Detail Enriching for Cross-Modal Retrieval with Partial Querycited by 9
- 2024MERLIN: Multimodal Embedding Refinement via LLM-based Iterative Navigation for Text-Video Retrieval-Rerank Pipelinecited by 9
- 2025LLaVA-ReID: Selective Multi-image Questioner for Interactive Person Re-Identificationcited by 9
- 2023BiLMa: Bidirectional Local-Matching for Text-based Person Re-identificationcited by 8
- 2020A Convolutional Baseline for Person Re-Identification Using Vision and Language Descriptionscited by 7
- 2017Joint Person Re-identification and Camera Network Topology Inference in Multiple Camerascited by 6
- 2024MTMMC: A Large-Scale Real-World Multi-Modal Camera Tracking Benchmarkcited by 5
- 2025Quantifying and Narrowing the Unknown: Interactive Text-to-Video Retrieval via Uncertainty Minimizationcited by 5
- 2025IVCR-200K: A Large-Scale Multi-turn Dialogue Benchmark for Interactive Video Corpus Retrievalcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AMIGO: Agentic Multi-Image Grounding Oracle Benchmark
- 2026InterLV-Search: Benchmarking Interleaved Multimodal Agentic Search
- 2025Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understanding
- 2026Finder: Agentic Closed-Loop Object Finding for Embodied Grounding
- 2026REVERSE: Reinforcing Evidence Verification and Search for Agentic Image geo-localization
- 2026Structured World-State Reasoning for Agentic Robotic Search
- 2026MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory
- 2026JRDB-AVR: An Active Visual Reasoning Benchmark for Embodied Agents in Real-World Environments