mlsanityData to 7 Oct 2026

IRSTD-Agent: Agentic Infrared Small Target Detection via Zoom-Guided Interaction Learning

arXiv 2610.05342 ↗First posted 4 Oct 2026cs.CV cs.AIcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

also in 1 more
Abstract (arXiv)

Infrared small-target detection plays an important role in maritime monitoring and aerial surveillance. Although multimodal large language models (MLLMs) offer promising capabilities for visual understanding, existing MLLM-based approaches struggle to precisely localize infrared small targets. In this paper, we propose IRSTD-Agent, an agentic framework for infrared small target detection through dynamic visual search. The framework enables an MLLM to adaptively determine where and at what scale to inspect an image and progressively gather fine-grained visual evidence for precise target localization. Five complementary visual tools (PROPOSAL, ZOOM, DETECT, DROP and REFINE) support object candidate discovery, adaptive observation, target localization, hypothesis rejection, and target extent refinement, together enabling a coordinated search process over original-resolution images. To teach the MLLMs to conduct this search, we introduce Zoom-guided Interaction Learning, which uses annotation-derived interaction trajectories to supervise tool selection and the corresponding arguments. Through extensive experiments on WideIRSTD-Full and IRSTD-1k datasets, we demonstrate that IRSTD-Agent outperforms the evaluated vision-language models and enhances the precise localization capabilities of MLLMs in IRSTD tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. First posted on arXiv 4 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Leveraging Language Prior for Infrared Small Target Detection
  2. 2025SAMamba: Adaptive State Space Modeling with Hierarchical Vision for Infrared Small Target Detection
  3. 2026HyTBE: Hyperbolic Target-Background Expert Model for Cross-Domain Infrared Small Target Detection
  4. 2026FeedbackSTS-Det: Sparse Frames-Based Spatio-Temporal Semantic Feedback Network for Moving Infrared Small Target Detection
  5. 2024RS-Agent: Automating Remote Sensing Tasks through Intelligent Agent
  6. 2024Visual-Linguistic Agent: Towards Collaborative Contextual Object Reasoning
  7. 2025Weakly-supervised Latent Models for Task-specific Visual-Language Control
  8. 2026TAPM-Net: Trajectory-Aware Perturbation Modeling for Infrared Small Target Detection