mlsanityData to 14 Oct 2026

MODAL: Multi-Modal Object Re-ID via Model-Driven Sparse Decoupling and Text-Image Differential Filtering

arXiv 2608.15096 ↗First posted 15 Aug 2026cs.CV eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-modal object re-identification (Re-ID) aims to facilitate cross-camera object retrieval in complex environments by leveraging complementary information from visual (e.g., RGB, NIR, TIR) and textual modalities. However, existing approaches often lack principled feature disentanglement and coherent multi-modal integration, leading to entangled representations that introduce cross-modal conflicts, obscure discriminative cues, and suffer distribution shift under modality-missing conditions. To tackle these challenges, we propose MODAL, a novel multi-modal object re-identification framework, grounded in coupled sparse coding theory and differential suppression principles. A core component of MODAL is a Multi-modal Feature Sparse Decoupling module, developed in a model-driven deep unrolling manner based on multi-modal coupled sparse coding. It explicitly decomposes multi-modal features into uni-modal specific, bi-modal and tri-modal shared representations, thereby achieving more transparent and effective feature disentanglement. Benefiting from the principled feature disentanglement, MODAL naturally mitigates performance degradation in incomplete-modality scenarios via a Modality-Aware Subspace Activation that selectively activates only the consistently shared subspaces. Moreover, we propose a Text-Image Differential Filtering module that leverages coarse-grained textual semantics to adaptively suppress task-irrelevant responses in the decoupled visual representations, thereby enhancing discriminative information. Extensive experiments on four datasets demonstrate that MODAL achieves state-of-the-art performance with superior transparency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 70 references that are in the map. First posted on arXiv 15 Aug 2026.

Builds on

33 of 70 references.

References · 33

  1. 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 786
  2. 2017Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)cited by 473
  3. 2021TransReID: Transformer-based Object Re-Identificationcited by 435
  4. 2019Omni-Scale Feature Learning for Person Re-Identificationcited by 295
  5. 2018Harmonious Attention Network for Person Re-Identificationcited by 211
  6. 2022CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labelscited by 181
  7. 2019Deep Convolutional Neural Network for Multi-modal Image Restoration and Fusioncited by 79
  8. 2022CLIP-Driven Fine-grained Text-Image Person Re-identificationcited by 79
  9. 2019Improving Description-based Person Re-identification by Multi-granularity Image-text Alignmentscited by 64
  10. 2018Multi-Level Factorisation Net for Person Re-Identificationcited by 58
  11. 2024Magic Tokens: Select Diverse Tokens for Multi-modal Object Re-Identificationcited by 35
  12. 2023TOP-ReID: Multi-spectral Object Re-Identification with Token Permutationcited by 32
21 more
  1. 2024DeMo: Decoupled Feature-Based Mixture of Experts for Multi-Modal Object Re-Identificationcited by 29
  2. 2025IDEA: Inverted Text with Cooperative Deformable Aggregation for Multi-modal Object Re-Identificationcited by 28
  3. 2017Learned Convolutional Sparse Codingcited by 26
  4. 2024MambaPro: Multi-Modal Object Re-Identification with Mamba Aggregation and Synergistic Promptcited by 20
  5. 2021Cluster-guided Asymmetric Contrastive Learning for Unsupervised Person Re-Identificationcited by 18
  6. 2018Coupled Dictionary Learning for Multi-contrast MRI Reconstructioncited by 17
  7. 2022Multi-spectral Vehicle Re-identification with Cross-directional Consistency Network and a High-quality Benchmarkcited by 17
  8. 2021Person Re-identification via Attention Pyramidcited by 12
  9. 2023Learning Feature Recovery Transformer for Occluded Person Re-identificationcited by 12
  10. 2022Learning to Purification for Unsupervised Person Re-identificationcited by 11
  11. 2023VGSG: Vision-Guided Semantic-Group Network for Text-based Person Searchcited by 11
  12. 2023Flare-Aware Cross-modal Enhancement Network for Multi-spectral Vehicle Re-identificationcited by 10
  13. 2025ICPL-ReID: Identity-Conditional Prompt Learning for Multi-Spectral Object Re-Identificationcited by 8
  14. 2022Dynamic Feature Pruning and Consolidation for Occluded Person Re-Identificationcited by 7
  15. 2025A Lightweight Deep Exclusion Unfolding Network for Single Image Reflection Removalcited by 7
  16. 2024Multiple Information Prompt Learning for Cloth-Changing Person Re-Identificationcited by 5
  17. 2024Relieving Universal Label Noise for Unsupervised Visible-Infrared Person Re-Identification by Inferring from Neighborscited by 5
  18. 2025Signal: Selective Interaction and Global-local Alignment for Multi-Modal Object Re-Identificationcited by 5
  19. 2020Receptive Multi-granularity Representation for Person Re-Identificationcited by 4
  20. 2022Mixed X-Ray Image Separation for Artworks with Concealed Designscited by 4
  21. 2026Homogeneous and Heterogeneous Consistency progressive Re-ranking for Visible-Infrared Person Re-identificationcited by 1

Built on by

Not cited yet.