# IDEA: Inverted Text with Cooperative Deformable Aggregation for Multi-modal Object Re-Identification

arXiv: https://arxiv.org/abs/2503.10324 · HTML: https://mlsanity.com/paper/2503.10324/

## Key facts

- Cited by 28 papers in the map (data through 14 Oct 2026).
- Builds on 44 of its 60 references that are in the map.
- First posted on arXiv 13 Mar 2025.

## Builds on (most cited first, 30 of 44)

- [Learning Transferable Visual Models From Natural Language Supervision](https://mlsanity.com/paper/2103.00020/) (2021)
- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [Rethinking the Inception Architecture for Computer Vision](https://mlsanity.com/paper/1512.00567/) (2015)
- [Gaussian Error Linear Units (GELUs)](https://mlsanity.com/paper/1606.08415/) (2016)
- [Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond](https://mlsanity.com/paper/2308.12966/) (2023)
- [Random Erasing Data Augmentation](https://mlsanity.com/paper/1708.04896/) (2017)
- [In Defense of the Triplet Loss for Person Re-Identification](https://mlsanity.com/paper/1703.07737/) (2017)
- [TransReID: Transformer-based Object Re-Identification](https://mlsanity.com/paper/2102.04378/) (2021)
- [Vision Transformer with Deformable Attention](https://mlsanity.com/paper/2201.00520/) (2022)
- [Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapters](https://mlsanity.com/paper/2403.11549/) (2024)
- [CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labels](https://mlsanity.com/paper/2211.13977/) (2022)
- [Zero-Shot Composed Image Retrieval with Textual Inversion](https://mlsanity.com/paper/2303.15247/) (2023)
- [Person Search with Natural Language Description](https://mlsanity.com/paper/1702.05729/) (2017)
- [Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrieval](https://mlsanity.com/paper/2303.12501/) (2023)
- [Semantically Self-Aligned Network for Text-to-Image Part-aware Person Re-identification](https://mlsanity.com/paper/2107.12666/) (2021)
- [Unveiling Encoder-Free Vision-Language Models](https://mlsanity.com/paper/2406.11832/) (2024)
- [Multimodal Fusion on Low-quality Data: A Comprehensive Survey](https://mlsanity.com/paper/2404.18947/) (2024)
- [Instruct-ReID: A Multi-purpose Person Re-identification Task with Instructions](https://mlsanity.com/paper/2306.07520/) (2023)
- [Watching You: Global-guided Reciprocal Learning for Video-based Person Re-identification](https://mlsanity.com/paper/2103.04337/) (2021)
- [Cross-Modality Perturbation Synergy Attack for Person Re-identification](https://mlsanity.com/paper/2401.10090/) (2024)
- [Eliminate Deviation with Deviation for Data Augmentation and a General Multi-modal Data Learning Method](https://mlsanity.com/paper/2101.08533/) (2021)
- [Learning Progressive Modality-shared Transformers for Effective Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2212.00226/) (2022)
- [TF-CLIP: Learning Text-free CLIP for Video-based Person Re-Identification](https://mlsanity.com/paper/2312.09627/) (2023)
- [HAT: Hierarchical Aggregation Transformers for Person Re-identification](https://mlsanity.com/paper/2107.05946/) (2021)
- [Harnessing the Power of MLLMs for Transferable Text-to-Image Person ReID](https://mlsanity.com/paper/2405.04940/) (2024)
- [Magic Tokens: Select Diverse Tokens for Multi-modal Object Re-Identification](https://mlsanity.com/paper/2403.10254/) (2024)
- [TOP-ReID: Multi-spectral Object Re-Identification with Token Permutation](https://mlsanity.com/paper/2312.09612/) (2023)
- [DeMo: Decoupled Feature-Based Mixture of Experts for Multi-Modal Object Re-Identification](https://mlsanity.com/paper/2412.10650/) (2024)
- [A Video Is Worth Three Views: Trigeminal Transformers for Video-based Person Re-identification](https://mlsanity.com/paper/2104.01745/) (2021)
- [Deeply-Coupled Convolution-Transformer with Spatial-temporal Complementary Learning for Video-based Person Re-identification](https://mlsanity.com/paper/2304.14122/) (2023)

## Built on by (most cited first, 28 of 28)

- [Video-Level Language-Driven Video-Based Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2506.02439/) (2025)
- [LATex: Leveraging Attribute-based Text Knowledge for Aerial-Ground Person Re-Identification](https://mlsanity.com/paper/2503.23722/) (2025)
- [SD-ReID: View-aware Stable Diffusion for Aerial-Ground Person Re-Identification](https://mlsanity.com/paper/2504.09549/) (2025)
- [NEXT: Multi-Grained Mixture of Experts via Text-Modulation for Multi-Modal Object Re-Identification](https://mlsanity.com/paper/2505.20001/) (2025)
- [Signal: Selective Interaction and Global-local Alignment for Multi-Modal Object Re-Identification](https://mlsanity.com/paper/2511.17965/) (2025)
- [Reliable Multi-Modal Object Re-Identification via Modality-Aware Graph Reasoning](https://mlsanity.com/paper/2504.14847/) (2025)
- [UGG-ReID: Uncertainty-Guided Graph Model for Multi-Modal Object Re-Identification](https://mlsanity.com/paper/2507.04638/) (2025)
- [When Person Re-Identification Meets Event Camera: A Benchmark Dataset and An Attribute-guided Re-Identification Framework](https://mlsanity.com/paper/2507.13659/) (2025)
- [X-ReID: Multi-granularity Information Interaction for Video-Based Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2511.17964/) (2025)
- [STMI: Segmentation-Guided Token Modulation with Cross-Modal Hypergraph Interaction for Multi-Modal Object Re-Identification](https://mlsanity.com/paper/2603.00695/) (2026)
- [SAS-VPReID: A Scale-Adaptive Framework with Shape Priors for Video-based Person Re-Identification at Extreme Far Distances](https://mlsanity.com/paper/2601.05535/) (2026)
- [Collaborative Enhancement Network for Low-quality Multi-spectral Vehicle Re-identification](https://mlsanity.com/paper/2504.14877/) (2025)
- [View-Aware Semantic Alignment for Aerial-Ground Person Re-Identification](https://mlsanity.com/paper/2605.18192/) (2026)
- [Zero-Shot Semantic Re-Identification for Autonomous Driving: A VLM Baseline Study](https://mlsanity.com/paper/2606.09362/) (2026)
- [Find Them All: Unveiling MLLMs for Versatile Person Re-identification](https://mlsanity.com/paper/2508.06908/) (2025)
- [What really matters for person re-identification? A Mixture-of-Experts Framework for Semantic Attribute Importance](https://mlsanity.com/paper/2512.08697/) (2025)
- [DCG ReID: Disentangling Collaboration and Guidance Fusion Representations for Multi-modal Vehicle Re-Identification](https://mlsanity.com/paper/2601.02924/) (2026)
- [ALADIN:Attribute-Language Distillation Network for Person Re-Identification](https://mlsanity.com/paper/2603.21482/) (2026)
- [Thinking Before Matching: A Reinforcement Reasoning Paradigm Towards General Person Re-Identification](https://mlsanity.com/paper/2604.19218/) (2026)
- [FUSE: Frequency-domain Unification and Spectral Energy Alignment for Multi-modal Object Re-Identification](https://mlsanity.com/paper/2606.20044/) (2026)
- [HiHR: Hierarchical Hyperbolic Representation for Aerial-Ground Person Re-Identification](https://mlsanity.com/paper/2607.09186/) (2026)
- [Multi-Modal Object Re-Identification with Prompt-S6 and Semantic-Aware Knowledge Guidance](https://mlsanity.com/paper/2607.23451/) (2026)
- [Multi-Modal Object Re-Identification with Dual Semantic Guidance and Global-Local Mutual Modulation](https://mlsanity.com/paper/2607.29207/) (2026)
- [VR3D: View-Robust 3D Representation Learning for Aerial-Ground Person Re-Identification](https://mlsanity.com/paper/2608.02598/) (2026)
- [Paths: Prompt-aware Spatio-temporal Transformer with Hierarchical Multi-modal Fusion for RGB-Event Video Person Re-Identification](https://mlsanity.com/paper/2608.13092/) (2026)
- [MODAL: Multi-Modal Object Re-ID via Model-Driven Sparse Decoupling and Text-Image Differential Filtering](https://mlsanity.com/paper/2608.15096/) (2026)
- [Incentive Noise and Structural Prior Infusion for Multi-modal Object Re-Identification](https://mlsanity.com/paper/2609.24539/) (2026)
- [TRIM-ReID: Duplication-Aware Token Reduction and Modality-Aligned Interaction for Multi-Modal Object Re-Identification](https://mlsanity.com/paper/2610.04361/) (2026)

## Abstract (arXiv)

Multi-modal object Re-IDentification (ReID) aims to retrieve specific objects by utilizing complementary information from various modalities. However, existing methods focus on fusing heterogeneous visual features, neglecting the potential benefits of text-based semantic information. To address this issue, we first construct three text-enhanced multi-modal object ReID benchmarks. To be specific, we propose a standardized multi-modal caption generation pipeline for structured and concise text annotations with Multi-modal Large Language Models (MLLMs). Besides, current methods often directly aggregate multi-modal information without selecting representative local features, leading to redundancy and high complexity. To address the above issues, we introduce IDEA, a novel feature learning framework comprising the Inverted Multi-modal Feature Extractor (IMFE) and Cooperative Deformable Aggregation (CDA). The IMFE utilizes Modal Prefixes and an InverseNet to integrate multi-modal information with semantic guidance from inverted text. The CDA adaptively generates sampling positions, enabling the model to focus on the interplay between global features and discriminative local features. With the constructed benchmarks and the proposed modules, our framework can generate more robust multi-modal features under complex scenarios. Extensive experiments on three multi-modal object ReID benchmarks demonstrate the effectiveness of our proposed method.