mlsanityData to 7 Oct 2026

Instruct-ReID: A Multi-purpose Person Re-identification Task with Instructions

arXiv 2306.07520 ↗First posted 13 Jun 2023cs.CVcited by 46

Not on the map. Why?

Abstract (arXiv)

Human intelligence can retrieve any person according to both visual and language descriptions. However, the current computer vision community studies specific person re-identification (ReID) tasks in different scenarios separately, which limits the applications in the real world. This paper strives to resolve this problem by proposing a new instruct-ReID task that requires the model to retrieve images according to the given image or language instructions. Our instruct-ReID is a more general ReID setting, where existing 6 ReID tasks can be viewed as special cases by designing different instructions. We propose a large-scale OmniReID benchmark and an adaptive triplet loss as a baseline method to facilitate research in this new setting. Experimental results show that the proposed multi-purpose ReID model, trained on our OmniReID benchmark without fine-tuning, can improve +0.5%, +0.6%, +7.7% mAP on Market1501, MSMT17, CUHK03 for traditional ReID, +6.4%, +7.1%, +11.2% mAP on PRCC, VC-Clothes, LTCC for clothes-changing ReID, +11.7% mAP on COCAS+ real2 for clothes template based clothes-changing ReID when using only RGB images, +24.9% mAP on COCAS+ real2 for our newly defined language-instructed ReID, +4.3% on LLCM for visible-infrared ReID, +2.6% on CUHK-PEDES for text-to-image ReID. The datasets, the model, and code will be available at https://github.com/hwz-zju/Instruct-ReID.

Key facts. Cited by 46 papers in the map (data through 7 Oct 2026). Builds on 55 of its 81 references that are in the map. First posted on arXiv 13 Jun 2023.

Builds on

55 of 81 references.

References · 55

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  4. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  5. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  6. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  7. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  8. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  9. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
  10. 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 776
  11. 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 596
  12. 2020Deep Learning for Person Re-identification: A Survey and Outlookcited by 547
38 more
  1. 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
  2. 2021Less is More: ClipBERT for Video-and-Language Learning via Sparse Samplingcited by 484
  3. 2017Person Transfer GAN to Bridge Domain Gap for Person Re-Identificationcited by 479
  4. 2017Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)cited by 472
  5. 2021TransReID: Transformer-based Object Re-Identificationcited by 432
  6. 2020HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-trainingcited by 362
  7. 2017Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in vitrocited by 280
  8. 2020Self-Supervised MultiModal Versatile Networkscited by 276
  9. 2020UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generationcited by 258
  10. 2018Harmonious Attention Network for Person Re-Identificationcited by 211
  11. 2016Person Re-identification: Past, Present and Futurecited by 180
  12. 2019Self-Correction for Human Parsingcited by 179
  13. 2017Person Search with Natural Language Descriptioncited by 149
  14. 2017Dual-Path Convolutional Image-Text Embeddings with Instance Losscited by 145
  15. 2019Relation-Aware Global Attention for Person Re-identificationcited by 124
  16. 2021VLM: Task-agnostic Video-Language Model Pre-training for Video Understandingcited by 102
  17. 2020COOT: Cooperative Hierarchical Transformer for Video-Text Representation Learningcited by 100
  18. 2022Clothes-Changing Person Re-identification with RGB Modality Onlycited by 98
  19. 2023Beyond Appearance: a Semantic Controllable Self-Supervised Learning Framework for Human-Centric Visual Taskscited by 94
  20. 2020Person Re-identification by Contour Sketch under Moderate Clothing Changecited by 91
  21. 2023Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning with Multimodal Modelscited by 91
  22. 2020Long-Term Cloth-Changing Person Re-identificationcited by 85
  23. 2019Interaction-and-Aggregation Network for Person Re-identificationcited by 80
  24. 2023Diverse Embedding Expansion Network and Low-Light Cross-Modality Benchmark for Visible-Infrared Person Re-identificationcited by 79
  25. 2023Towards Unified Text-based Person Retrieval: A Large-scale Multi-Attribute and Language Search Benchmarkcited by 75
  26. 2021Cloth-Changing Person Re-identification from A Single Image with Gait Prediction and Regularizationcited by 69
  27. 2023UniHCP: A Unified Model for Human-Centric Perceptionscited by 59
  28. 2021Text-Based Person Search with Limited Datacited by 53
  29. 2023RaSa: Relation and Sensitivity Aware Representation Learning for Text-based Person Searchcited by 53
  30. 2019Semantics-Aligned Representation Learning for Person Re-identificationcited by 51
  31. 2020When Person Re-identification Meets Changing Clothescited by 51
  32. 2023PLIP: Language-Image Pre-training for Person Representation Learningcited by 49
  33. 2021Large-Scale Spatio-Temporal Person Re-identification: Algorithms and Benchmarkcited by 47
  34. 2021Feature Erasing and Diffusion Network for Occluded Person Re-Identificationcited by 41
  35. 2021Learning Semantic-Aligned Feature Representation for Text-based Person Searchcited by 40
  36. 2023HumanBench: Towards General Human-centric Perception with Projector Assisted Pretrainingcited by 38
  37. 2017Person Re-Identification by Camera Correlation Aware Feature Augmentationcited by 35
  38. 2020COCAS: A Large-Scale Clothes Changing Person Dataset for Re-identificationcited by 35

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 4; 2025: 21; 2026: 18.

46 papers.

Sort:

By area:

  1. 2025IDEA: Inverted Text with Cooperative Deformable Aggregation for Multi-modal Object Re-Identificationcited by 27
  2. 2024Transformer for Object Re-Identification: A Surveycited by 21
  3. 2025ChatReID: Open-ended Interactive Person Retrieval via Hierarchical Progressive Tuning for Vision Language Modelscited by 15
  4. 2025SeCap: Self-Calibrating and Adaptive Prompts for Cross-view Person Re-Identification in Aerial-Ground Networkscited by 15
  5. 2025AG-VPReID: A Challenging Large-Scale Benchmark for Aerial-Ground Video-based Person Re-Identificationcited by 12
  6. 2025DIFFER: Disentangling Identity Features via Semantic Cues for Clothes-Changing Person Re-IDcited by 11
  7. 2025Human-Centric Foundation Models: Perception, Generation and Agentic Modelingcited by 10
  8. 2024CCUP: A Controllable Synthetic Data Generation Pipeline for Pretraining Cloth-Changing Person Re-Identification Modelscited by 6
  9. 2025Towards All-in-One Medical Image Re-Identificationcited by 6
  10. 2025ReID5o: Achieving Omni Multi-modal Person Re-identification in a Single Modelcited by 6
  11. 2025Colors See Colors Ignore: Clothes Changing ReID with Color Disentanglementcited by 6
  12. 2023Exploring Part-Informed Visual-Language Learning for Person Re-Identificationcited by 5
34 more
  1. 2024Instruct-ReID++: Towards Universal Purpose Instruction-Guided Person Re-identificationcited by 5
  2. 2025Generalizable Object Re-Identification via Visual In-Context Promptingcited by 4
  3. 2025One-Shot Knowledge Transfer for Scalable Person Re-Identificationcited by 4
  4. 2025DisenQ: Disentangling Q-Former for Activity-Biometricscited by 3
  5. 2025AnomalyLMM: Bridging Generative Knowledge and Discriminative Retrieval for Text-Based Person Anomaly Searchcited by 3
  6. 2025MOS: Mitigating Optical-SAR Modality Gap for Cross-Modal Ship Re-Identificationcited by 3
  7. 2026BIT: Matching-based Bi-directional Interaction Transformation Network for Visible-Infrared Person Re-Identificationcited by 3
  8. 2023PSDiff: Diffusion Model for Person Search with Iterative and Collaborative Refinementcited by 2
  9. 2023VILLS -- Video-Image Learning to Learn Semantics for Person Re-Identificationcited by 2
  10. 2025Multi-Domain Biometric Recognition using Body Embeddingscited by 1
  11. 2025One Object, Multiple Lies: A Benchmark for Cross-task Adversarial Attack on Unified Vision-Language Modelscited by 1
  12. 2026ReText: Text Boosts Generalization in Image-Based Person Re-identificationcited by 1
  13. 2026AR2-4FV: Anchored Referring and Re-identification for Long-Term Grounding in Fixed-View Videoscited by 1
  14. 2026CMCC-ReID: Cross-Modality Clothing-Change Person Re-Identificationcited by 1
  15. 2026Robust Onion: Peeling Open Vocab Object Detectors Under Noisecited by 1
  16. 2024See What You Seek: Semantic Contextual Integration for Cloth-Changing Person Re-Identificationcited by 0
  17. 2025Adept: Annotation-Denoising Auxiliary Tasks with Discrete Cosine Transform Map and Keypoint for Human-Centric Pretrainingcited by 0
  18. 2025Cross-Spectral Body Recognition with Side Information Embedding: Benchmarks on LLCM and Analyzing Range-Induced Occlusions on IJB-MDFcited by 0
  19. 2025Evolution of ReID: From Early Methods to LLM Integrationcited by 0
  20. 2025Find Them All: Unveiling MLLMs for Versatile Person Re-identificationcited by 0
  21. 2025Person Re-Identification via Generalized Class Prototypescited by 0
  22. 2026Person Re-ID in 2025: Supervised, Self-Supervised, and Language-Aligned. What Works?cited by 0
  23. 2026GTATrack: Winner Solution to SoccerTrack 2025 with Deep-EIoU and Global Tracklet Associationcited by 0
  24. 2026MSP-ReID: Hairstyle-Robust Cloth-Changing Person Re-Identificationcited by 0
  25. 2026Thinking Before Matching: A Reinforcement Reasoning Paradigm Towards General Person Re-Identificationcited by 0
  26. 2026DPM++: Dynamic Masked Metric Learning for Occluded Person Re-identificationcited by 0
  27. 2026Towards Resolving Optimization Conflicts Between Image- and Text-Based Person Re-Identificationcited by 0
  28. 2026Learning Instance-Adaptive Low-Rank Orthogonal Subspaces for Clothes-Changing Person Re-Identificationcited by 0
  29. 2026Multimodal LLM-Empowered Re-Ranking for Generalizable Person Re-Identificationcited by 0
  30. 2026Dual-Edged Homogeneous-Modality Similarity: Towards Visible-Infrared Modality-Incomplete Person Re-Identification with Modality Adaptive Matchingcited by 0
  31. 2026ANFI: Rethinking Neighbor Feature Interaction in Person Re-IDcited by 0
  32. 2026VR3D: View-Robust 3D Representation Learning for Aerial-Ground Person Re-Identificationcited by 0
  33. 2026Dual-Space Modality Consistency Learning for Universal Cross-Modal Re-Identificationcited by 0
  34. 2026Re:Cognize -- Open-Set Comic Character Re-Identificationcited by 0