Person Search with Natural Language Description
Not on the map. Why?
Abstract (arXiv)
Searching persons in large-scale image databases with the query of natural language description has important applications in video surveillance. Existing methods mainly focused on searching persons with image-based or attribute-based queries, which have major limitations for a practical usage. In this paper, we study the problem of person search with natural language description. Given the textual description of a person, the algorithm of the person search is required to rank all the samples in the person database then retrieve the most relevant sample corresponding to the queried description. Since there is no person dataset or benchmark with textual description available, we collect a large-scale person description dataset with detailed natural language annotations and person samples from various sources, termed as CUHK Person Description Dataset (CUHK-PEDES). A wide range of possible models and baselines have been evaluated and compared on the person search benchmark. An Recurrent Neural Network with Gated Neural Attention mechanism (GNA-RNN) is proposed to establish the state-of-the art performance on person search.
Key facts. Cited by 149 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Feb 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 13; 2023: 33; 2024: 24; 2025: 39; 2026: 23.
149 papers.
Sort:
By area:
- 2022Open-Vocabulary DETR with Conditional Matchingcited by 220
- 2023Large-scale Multi-Modal Pre-trained Models: A Comprehensive Surveycited by 153
- 2023Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrievalcited by 131
- 2021Semantically Self-Aligned Network for Text-to-Image Part-aware Person Re-identificationcited by 108
- 2021DSSL: Deep Surroundings-person Separation Learning for Text-based Person Retrievalcited by 102
- 2022ARTEMIS: Attention-based Retrieval with Text-Explicit Matching and Implicit Similaritycited by 82
- 2022CLIP-Driven Fine-grained Text-Image Person Re-identificationcited by 79
- 2023Towards Unified Text-based Person Retrieval: A Large-scale Multi-Attribute and Language Search Benchmarkcited by 75
- 2022See Finer, See More: Implicit Modality Alignment for Text-based Person Retrievalcited by 65
- 2023What Matters in Training a GPT4-Style Language Model with Multimodal Inputs?cited by 64
- 2022Learning Granularity-Unified Representations for Text-to-Image Person Re-identificationcited by 62
- 2021Contextual Non-Local Alignment over Full-Scale Representation for Text-Based Person Searchcited by 60
38 more
- 2021TIPCB: A Simple but Effective Part-based Convolutional Baseline for Text-based Person Searchcited by 57
- 2023Noisy-Correspondence Learning for Text-to-Image Person Re-identificationcited by 55
- 2021Text-Based Person Search with Limited Datacited by 53
- 2023RaSa: Relation and Sensitivity Aware Representation Learning for Text-based Person Searchcited by 53
- 2023PLIP: Language-Image Pre-training for Person Representation Learningcited by 49
- 2023Instruct-ReID: A Multi-purpose Person Re-identification Task with Instructionscited by 46
- 2021Learning Semantic-Aligned Feature Representation for Text-based Person Searchcited by 40
- 2022CAIBC: Capturing All-round Information Beyond Color for Text-based Person Retrievalcited by 39
- 2022Image-Specific Information Suppression and Implicit Local Alignment for Text-based Person Searchcited by 38
- 2022Look Before You Leap: Improving Text-based Person Retrieval by Learning A Consistent Cross-modal Common Manifoldcited by 38
- 2023An Empirical Study of CLIP for Text-based Person Searchcited by 38
- 2021AXM-Net: Implicit Cross-Modal Feature Alignment for Person Re-identificationcited by 34
- 2025Chat-Driven Text Generation and Interaction for Person Retrievalcited by 34
- 2023HAP: Structure-Aware Masked Image Modeling for Human-Centric Perceptioncited by 33
- 2023UFineBench: Towards Text-based Person Retrieval with Ultra-fine Granularitycited by 30
- 2025IDEA: Inverted Text with Cooperative Deformable Aggregation for Multi-modal Object Re-Identificationcited by 27
- 2023Hulk: A Universal Knowledge Translator for Human-Centric Taskscited by 22
- 2024Transformer for Object Re-Identification: A Surveycited by 21
- 2023Unified Pre-training with Pseudo Texts for Text-To-Image Person Re-identificationcited by 19
- 2022Asymmetric Cross-Scale Alignment for Text-Based Person Searchcited by 18
- 2024All in One Framework for Multimodal Re-identification in the Wildcited by 18
- 2023Text-based Person Search without Parallel Image-Text Datacited by 17
- 2024PLOT: Text-based Person Search with Part Slot Attention for Corresponding Part Discoverycited by 15
- 2026CONQUER: Context-Aware Representation with Query Enhancement for Text-Based Person Searchcited by 15
- 2024From Data Deluge to Data Curation: A Filtering-WoRA Paradigm for Efficient Text-based Person Searchcited by 14
- 2021ASMR: Learning Attribute-Based Person Search with Adaptive Semantic Margin Regularizercited by 11
- 2023VGSG: Vision-Guided Semantic-Group Network for Text-based Person Searchcited by 11
- 2024MARS: Paying more attention to visual attributes for text-based person searchcited by 11
- 2024Beyond Walking: A Large-Scale Image-Text Benchmark for Text-based Person Anomaly Searchcited by 11
- 2025Dynamic Uncertainty Learning with Noisy Correspondence for Text-Based Person Searchcited by 11
- 2023CLIP-based Synergistic Knowledge Transfer for Text-based Person Retrievalcited by 10
- 2024Test-time Adaptation for Cross-modal Retrieval with Query Shiftcited by 10
- 2021Text-based Person Search in Full Images via Semantic-Driven Proposal Generationcited by 9
- 2021Benchmarks for Corruption Invariant Person Re-identificationcited by 9
- 2025DM-Adapter: Domain-Aware Mixture-of-Adapters for Text-Based Person Retrievalcited by 9
- 2025LLaVA-ReID: Selective Multi-image Questioner for Interactive Person Re-Identificationcited by 9
- 2025Human-centered Interactive Learning via MLLMs for Text-to-Image Person Re-identificationcited by 9
- 2023BiLMa: Bidirectional Local-Matching for Text-based Person Re-identificationcited by 8
50 most cited of 149 All 149 (JSON)
- 2026What Should We Ask Next? Retrieval-Aware Question Learning for Interactive ReID18 Sep 2026
- 2026Generative Retrieval for Unsupervised Text-Based Person Search11 Sep 2026
- 2026A-PAIR: A Benchmark and Identity-Consistent Grounding Framework for Air-Ground Cross-View Referring Person Detection28 Aug 2026
- 2026Rethinking Text-Based Image Retrieval in Specific Domain11 Aug 2026
- 2026FaLCon: Facet-Anchored Retrieval with Late Consensus for Sim2Real Text-Based Person Anomaly Search10 Aug 2026
- 2026Achieving Text-based Person Retrieval with Any Granularity23 Jul 2026
- 2026Cross-Resolution Semantic Transfer for Robust Text-to-Image Retrieval in Low-Resolution Surveillance29 Jun 2026
- 2026Zero-Shot Semantic Re-Identification for Autonomous Driving: A VLM Baseline Study8 Jun 2026
- 2026Towards Resolving Optimization Conflicts Between Image- and Text-Based Person Re-Identification1 Jun 2026
- 2026ROGLE: Robust Global-Local Alignment with Automated Region Supervision for Text-Based Person Search1 Jun 2026
- 2026T2I-VeRW: Part-level Fine-grained Perception for Text-to-Image Vehicle Retrieval7 May 2026
- 2026InterPartAbility: Phrase-Region Grounding for Interpretable Text-to-Image Person Re-Identification29 Apr 2026
38 more
- 2026Bridging the Pose-Semantic Gap: A Cascade Framework for Text-Based Person Anomaly Search25 Apr 2026
- 2026Towards Robust Text-to-Image Person Retrieval: Multi-View Reformulation for Semantic Compensation20 Apr 2026
- 2026ARGOS: Who, Where, and When in Agentic Multi-Camera Person Search14 Apr 2026
- 2026Harnessing Weak Pair Uncertainty for Text-based Person Search10 Apr 2026
- 2026Pretrain-then-Adapt: Uncertainty-Aware Test-Time Adaptation for Text-based Person Search7 Apr 2026
- 2026ForeSea: AI Forensic Search with Multi-modal Queries for Video Surveillance24 Mar 2026
- 2026Cross-modal Fuzzy Alignment Network for Text-Aerial Person Retrieval and A Large-scale Benchmark21 Mar 2026
- 2026CONQUER: Context-Aware Representation with Query Enhancement for Text-Based Person Search26 Jan 2026
- 2026Unified Multi-Dataset Training for TBPS21 Jan 2026
- 2026DiCo: Disentangled Concept Representation for Text-to-image Person Re-identification15 Jan 2026
- 2026ITSELF: Attention Guided Fine-Grained Alignment for Vision-Language Retrieval3 Jan 2026
- 2025Hierarchical Prompt Learning for Image- and Text-Based Person Re-Identification17 Nov 2025
- 2025Text-based Aerial-Ground Person Retrieval11 Nov 2025
- 2025FlexiReID: Adaptive Mixture of Expert for Multi-Modal Person Re-Identification17 Oct 2025
- 2025CalibCLIP: Contextual Calibration of Dominant Semantics for Text-Driven Image Retrieval7 Oct 2025
- 2025What Makes You Unique? Attribute Prompt Composition for Object Re-Identification23 Sep 2025
- 2025FitPro: A Zero-Shot Framework for Interactive Text-based Pedestrian Retrieval in Open World20 Sep 2025
- 2025Cross-modal Full-mode Fine-grained Alignment for Text-to-Image Person Retrieval17 Sep 2025
- 2025Chat-Driven Text Generation and Interaction for Person Retrieval16 Sep 2025
- 2025Cross-Modal Retrieval with Cauchy-Schwarz Divergence15 Sep 2025
- 2025Gradient-Attention Guided Dual-Masking Synergetic Framework for Robust Text-based Person Retrieval11 Sep 2025
- 2025Dynamic Pattern Alignment Learning for Pretraining Lightweight Human-Centric Vision Models10 Aug 2025
- 2025Find Them All: Unveiling MLLMs for Versatile Person Re-identification9 Aug 2025
- 2025Open-Attribute Person Retrieval: Finding People Through Distinctive and Novel Attributes2 Aug 2025
- 2025Minimizing the Pretraining Gap: Domain-aligned Text-Based Person Retrieval14 Jul 2025
- 2025Dual-Granularity Cross-Modal Identity Association for Weakly-Supervised Text-to-Person Image Matching9 Jul 2025
- 2025ReID5o: Achieving Omni Multi-modal Person Re-identification in a Single Model11 Jun 2025
- 2025SA-Person: Text-Based Person Retrieval with Scene-aware Re-ranking30 May 2025
- 2025Human-centered Interactive Learning via MLLMs for Text-to-Image Person Re-identification21 May 2025
- 2025Dynamic Uncertainty Learning with Noisy Correspondence for Text-Based Person Search10 May 2025
- 2025Uncertainty-Aware Prototype Semantic Decoupling for Text-Based Person Search in Full Images6 May 2025
- 2025CAMeL: Cross-modality Adaptive Meta-Learning for Text-based Person Retrieval26 Apr 2025
- 2025LLaVA-ReID: Selective Multi-image Questioner for Interactive Person Re-Identification14 Apr 2025
- 2025UP-Person: Unified Parameter-Efficient Transfer Learning for Text-based Person Retrieval14 Apr 2025
- 2025Multi-modal Reference Learning for Fine-grained Text-to-Image Retrieval10 Apr 2025
- 2025LATex: Leveraging Attribute-based Text Knowledge for Aerial-Ground Person Re-Identification31 Mar 2025
- 2025An Empirical Study of Validating Synthetic Data for Text-Based Person Retrieval28 Mar 2025
- 2025PS-ReID: Advancing Person Re-Identification and Precise Segmentation with Multimodal Retrieval27 Mar 2025
50 newest of 149 All 149 (JSON)
- 2024MLLMReID: Multimodal Large Language Model-based Person Re-identificationcited by 8
- 2025CILP-FGDI: Exploiting Vision-Language Model for Generalizable Person Re-Identificationcited by 7
- 2023Exploiting the Textual Potential from Vision-Language Pre-training for Text-based Person Searchcited by 6
- 2025CalibCLIP: Contextual Calibration of Dominant Semantics for Text-Driven Image Retrievalcited by 3
- 2026ITSELF: Attention Guided Fine-Grained Alignment for Vision-Language Retrievalcited by 3
- 2025Efficient Vision Language Model Fine-tuning for Text-based Person Anomaly Searchcited by 1
- 2025Boosting Weak Positives for Text Based Person Searchcited by 0
- 2026Unified Multi-Dataset Training for TBPScited by 0
- 2026Unified Multi-Dataset Training for TBPS21 Jan 2026
- 2026ITSELF: Attention Guided Fine-Grained Alignment for Vision-Language Retrieval3 Jan 2026
- 2025CalibCLIP: Contextual Calibration of Dominant Semantics for Text-Driven Image Retrieval7 Oct 2025
- 2025Efficient Vision Language Model Fine-tuning for Text-based Person Anomaly Search5 Feb 2025
- 2025Boosting Weak Positives for Text Based Person Search29 Jan 2025
- 2025CILP-FGDI: Exploiting Vision-Language Model for Generalizable Person Re-Identification27 Jan 2025
- 2024MLLMReID: Multimodal Large Language Model-based Person Re-identification24 Jan 2024
- 2023Exploiting the Textual Potential from Vision-Language Pre-training for Text-based Person Search8 Mar 2023
- 2022Open-Vocabulary DETR with Conditional Matchingcited by 220
- 2023Large-scale Multi-Modal Pre-trained Models: A Comprehensive Surveycited by 153
- 2021Semantically Self-Aligned Network for Text-to-Image Part-aware Person Re-identificationcited by 108
- 2021DSSL: Deep Surroundings-person Separation Learning for Text-based Person Retrievalcited by 102
- 2022ARTEMIS: Attention-based Retrieval with Text-Explicit Matching and Implicit Similaritycited by 82
- 2022CLIP-Driven Fine-grained Text-Image Person Re-identificationcited by 79
- 2023Towards Unified Text-based Person Retrieval: A Large-scale Multi-Attribute and Language Search Benchmarkcited by 75
- 2022See Finer, See More: Implicit Modality Alignment for Text-based Person Retrievalcited by 65
- 2023What Matters in Training a GPT4-Style Language Model with Multimodal Inputs?cited by 64
- 2022Learning Granularity-Unified Representations for Text-to-Image Person Re-identificationcited by 62
- 2021Contextual Non-Local Alignment over Full-Scale Representation for Text-Based Person Searchcited by 60
- 2021TIPCB: A Simple but Effective Part-based Convolutional Baseline for Text-based Person Searchcited by 57
12 most cited of 136 All 136 (JSON)
- 2026What Should We Ask Next? Retrieval-Aware Question Learning for Interactive ReID18 Sep 2026
- 2026Generative Retrieval for Unsupervised Text-Based Person Search11 Sep 2026
- 2026A-PAIR: A Benchmark and Identity-Consistent Grounding Framework for Air-Ground Cross-View Referring Person Detection28 Aug 2026
- 2026Rethinking Text-Based Image Retrieval in Specific Domain11 Aug 2026
- 2026FaLCon: Facet-Anchored Retrieval with Late Consensus for Sim2Real Text-Based Person Anomaly Search10 Aug 2026
- 2026Achieving Text-based Person Retrieval with Any Granularity23 Jul 2026
- 2026Cross-Resolution Semantic Transfer for Robust Text-to-Image Retrieval in Low-Resolution Surveillance29 Jun 2026
- 2026Towards Resolving Optimization Conflicts Between Image- and Text-Based Person Re-Identification1 Jun 2026
- 2026ROGLE: Robust Global-Local Alignment with Automated Region Supervision for Text-Based Person Search1 Jun 2026
- 2026T2I-VeRW: Part-level Fine-grained Perception for Text-to-Image Vehicle Retrieval7 May 2026
- 2026InterPartAbility: Phrase-Region Grounding for Interpretable Text-to-Image Person Re-Identification29 Apr 2026
- 2026Bridging the Pose-Semantic Gap: A Cascade Framework for Text-Based Person Anomaly Search25 Apr 2026
12 newest of 136 All 136 (JSON)