# DeMo: Decoupled Feature-Based Mixture of Experts for Multi-Modal Object Re-Identification

arXiv: https://arxiv.org/abs/2412.10650 · HTML: https://mlsanity.com/paper/2412.10650/

## Key facts

- Cited by 29 papers in the map (data through 14 Oct 2026).
- Builds on 32 of its 46 references that are in the map.
- First posted on arXiv 14 Dec 2024.

## Builds on (most cited first, 30 of 32)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Learning Transferable Visual Models From Natural Language Supervision](https://mlsanity.com/paper/2103.00020/) (2021)
- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift](https://mlsanity.com/paper/1502.03167/) (2015)
- [Rethinking the Inception Architecture for Computer Vision](https://mlsanity.com/paper/1512.00567/) (2015)
- [Random Erasing Data Augmentation](https://mlsanity.com/paper/1708.04896/) (2017)
- [DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models](https://mlsanity.com/paper/2401.06066/) (2024)
- [In Defense of the Triplet Loss for Person Re-Identification](https://mlsanity.com/paper/1703.07737/) (2017)
- [Deep Learning for Person Re-identification: A Survey and Outlook](https://mlsanity.com/paper/2001.04193/) (2020)
- [Fine-tuning CNN Image Retrieval with No Human Annotation](https://mlsanity.com/paper/1711.02512/) (2017)
- [Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)](https://mlsanity.com/paper/1711.09349/) (2017)
- [TransReID: Transformer-based Object Re-Identification](https://mlsanity.com/paper/2102.04378/) (2021)
- [Bag of Tricks and A Strong Baseline for Deep Person Re-identification](https://mlsanity.com/paper/1903.07071/) (2019)
- [Omni-Scale Feature Learning for Person Re-Identification](https://mlsanity.com/paper/1905.00953/) (2019)
- [A Survey on Mixture of Experts in Large Language Models](https://mlsanity.com/paper/2407.06204/) (2024)
- [Harmonious Attention Network for Person Re-Identification](https://mlsanity.com/paper/1802.08122/) (2018)
- [Tutel: Adaptive Mixture-of-Experts at Scale](https://mlsanity.com/paper/2206.03382/) (2022)
- [Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identification](https://mlsanity.com/paper/2108.08728/) (2021)
- [Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Experts](https://mlsanity.com/paper/2405.11273/) (2024)
- [Multi-Level Factorisation Net for Person Re-Identification](https://mlsanity.com/paper/1803.09132/) (2018)
- [Multimodal Fusion on Low-quality Data: A Comprehensive Survey](https://mlsanity.com/paper/2404.18947/) (2024)
- [Watching You: Global-guided Reciprocal Learning for Video-based Person Re-identification](https://mlsanity.com/paper/2103.04337/) (2021)
- [Multi-scale Deep Learning Architectures for Person Re-identification](https://mlsanity.com/paper/1709.05165/) (2017)
- [Learning Progressive Modality-shared Transformers for Effective Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2212.00226/) (2022)
- [HAT: Hierarchical Aggregation Transformers for Person Re-identification](https://mlsanity.com/paper/2107.05946/) (2021)
- [Magic Tokens: Select Diverse Tokens for Multi-modal Object Re-Identification](https://mlsanity.com/paper/2403.10254/) (2024)
- [TOP-ReID: Multi-spectral Object Re-Identification with Token Permutation](https://mlsanity.com/paper/2312.09612/) (2023)
- [UniCat: Crafting a Stronger Fusion Baseline for Multimodal Re-Identification](https://mlsanity.com/paper/2310.18812/) (2023)
- [Robust Multimodal Learning via Representation Decoupling](https://mlsanity.com/paper/2407.04458/) (2024)
- [eMoE-Tracker: Environmental MoE-based Transformer for Robust Event-guided Object Tracking](https://mlsanity.com/paper/2406.20024/) (2024)

## Built on by (most cited first, 29 of 29)

- [IDEA: Inverted Text with Cooperative Deformable Aggregation for Multi-modal Object Re-Identification](https://mlsanity.com/paper/2503.10324/) (2025)
- [HAMoBE: Hierarchical and Adaptive Mixture of Biometric Experts for Video-based Person ReID](https://mlsanity.com/paper/2508.05038/) (2025)
- [Video-Level Language-Driven Video-Based Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2506.02439/) (2025)
- [Human-centered Interactive Learning via MLLMs for Text-to-Image Person Re-identification](https://mlsanity.com/paper/2506.11036/) (2025)
- [LATex: Leveraging Attribute-based Text Knowledge for Aerial-Ground Person Re-Identification](https://mlsanity.com/paper/2503.23722/) (2025)
- [SD-ReID: View-aware Stable Diffusion for Aerial-Ground Person Re-Identification](https://mlsanity.com/paper/2504.09549/) (2025)
- [MDReID: Modality-Decoupled Learning for Any-to-Any Multi-Modal Object Re-Identification](https://mlsanity.com/paper/2510.23301/) (2025)
- [NEXT: Multi-Grained Mixture of Experts via Text-Modulation for Multi-Modal Object Re-Identification](https://mlsanity.com/paper/2505.20001/) (2025)
- [GSAlign: Geometric and Semantic Alignment Network for Aerial-Ground Person Re-Identification](https://mlsanity.com/paper/2510.22268/) (2025)
- [Signal: Selective Interaction and Global-local Alignment for Multi-Modal Object Re-Identification](https://mlsanity.com/paper/2511.17965/) (2025)
- [On the Holistic Approach for Detecting Human Image Forgery](https://mlsanity.com/paper/2601.04715/) (2026)
- [Reliable Multi-Modal Object Re-Identification via Modality-Aware Graph Reasoning](https://mlsanity.com/paper/2504.14847/) (2025)
- [UGG-ReID: Uncertainty-Guided Graph Model for Multi-Modal Object Re-Identification](https://mlsanity.com/paper/2507.04638/) (2025)
- [When Person Re-Identification Meets Event Camera: A Benchmark Dataset and An Attribute-guided Re-Identification Framework](https://mlsanity.com/paper/2507.13659/) (2025)
- [STMI: Segmentation-Guided Token Modulation with Cross-Modal Hypergraph Interaction for Multi-Modal Object Re-Identification](https://mlsanity.com/paper/2603.00695/) (2026)
- [SAS-VPReID: A Scale-Adaptive Framework with Shape Priors for Video-based Person Re-Identification at Extreme Far Distances](https://mlsanity.com/paper/2601.05535/) (2026)
- [Collaborative Enhancement Network for Low-quality Multi-spectral Vehicle Re-identification](https://mlsanity.com/paper/2504.14877/) (2025)
- [View-Aware Semantic Alignment for Aerial-Ground Person Re-Identification](https://mlsanity.com/paper/2605.18192/) (2026)
- [Modality Unified Attack for Omni-Modality Person Re-Identification](https://mlsanity.com/paper/2501.12761/) (2025)
- [What really matters for person re-identification? A Mixture-of-Experts Framework for Semantic Attribute Importance](https://mlsanity.com/paper/2512.08697/) (2025)
- [DCG ReID: Disentangling Collaboration and Guidance Fusion Representations for Multi-modal Vehicle Re-Identification](https://mlsanity.com/paper/2601.02924/) (2026)
- [Decoupled Mixture-of-Experts for Parametric Knowledge Injection](https://mlsanity.com/paper/2606.14243/) (2026)
- [FUSE: Frequency-domain Unification and Spectral Energy Alignment for Multi-modal Object Re-Identification](https://mlsanity.com/paper/2606.20044/) (2026)
- [HiHR: Hierarchical Hyperbolic Representation for Aerial-Ground Person Re-Identification](https://mlsanity.com/paper/2607.09186/) (2026)
- [Multi-Modal Object Re-Identification with Prompt-S6 and Semantic-Aware Knowledge Guidance](https://mlsanity.com/paper/2607.23451/) (2026)
- [Multi-Modal Object Re-Identification with Dual Semantic Guidance and Global-Local Mutual Modulation](https://mlsanity.com/paper/2607.29207/) (2026)
- [Paths: Prompt-aware Spatio-temporal Transformer with Hierarchical Multi-modal Fusion for RGB-Event Video Person Re-Identification](https://mlsanity.com/paper/2608.13092/) (2026)
- [MODAL: Multi-Modal Object Re-ID via Model-Driven Sparse Decoupling and Text-Image Differential Filtering](https://mlsanity.com/paper/2608.15096/) (2026)
- [Incentive Noise and Structural Prior Infusion for Multi-modal Object Re-Identification](https://mlsanity.com/paper/2609.24539/) (2026)

## Abstract (arXiv)

Multi-modal object Re-IDentification (ReID) aims to retrieve specific objects by combining complementary information from multiple modalities. Existing multi-modal object ReID methods primarily focus on the fusion of heterogeneous features. However, they often overlook the dynamic quality changes in multi-modal imaging. In addition, the shared information between different modalities can weaken modality-specific information. To address these issues, we propose a novel feature learning framework called DeMo for multi-modal object ReID, which adaptively balances decoupled features using a mixture of experts. To be specific, we first deploy a Patch-Integrated Feature Extractor (PIFE) to extract multi-granularity and multi-modal features. Then, we introduce a Hierarchical Decoupling Module (HDM) to decouple multi-modal features into non-overlapping forms, preserving the modality uniqueness and increasing the feature diversity. Finally, we propose an Attention-Triggered Mixture of Experts (ATMoE), which replaces traditional gating with dynamic attention weights derived from decoupled features. With these modules, our DeMo can generate more robust multi-modal features. Extensive experiments on three multi-modal object ReID benchmarks fully verify the effectiveness of our methods. The source code is available at https://github.com/924973292/DeMo.