MCFNet: A Multimodal Collaborative Fusion Network for Fine-Grained Semantic Classification
Not on the map. Why?
Abstract (arXiv)
Multimodal information processing has become increasingly important for enhancing image classification performance. However, the intricate and implicit dependencies across different modalities often hinder conventional methods from effectively capturing fine-grained semantic interactions, thereby limiting their applicability in high-precision classification tasks. To address this issue, we propose a novel Multimodal Collaborative Fusion Network (MCFNet) designed for fine-grained classification. The proposed MCFNet architecture incorporates a regularized integrated fusion module that improves intra-modal feature representation through modality-specific regularization strategies, while facilitating precise semantic alignment via a hybrid attention mechanism. Additionally, we introduce a multimodal decision classification module, which jointly exploits inter-modal correlations and unimodal discriminative features by integrating multiple loss functions within a weighted voting paradigm. Extensive experiments and ablation studies on benchmark datasets demonstrate that the proposed MCFNet framework achieves consistent improvements in classification accuracy, confirming its effectiveness in modeling subtle cross-modal semantics.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 57 references that are in the map. First posted on arXiv 29 May 2025.
Builds on
31 of 57 references.
References · 31
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 377
- 2015Bilinear CNNs for Fine-grained Visual Recognitioncited by 228
- 2021TransFG: A Transformer Architecture for Fine-grained Recognitioncited by 132
- 2023Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrievalcited by 132
- 2021Seeing biodiversity: perspectives in machine learning for wildlife conservationcited by 130
- 2019Practice on Long Sequential User Behavior Modeling for Click-Through Rate Predictioncited by 118
- 2021Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identificationcited by 114
19 more
- 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Modelscited by 104
- 2024IMAGDressing-v1: Customizable Virtual Dressingcited by 100
- 2015Compact Bilinear Poolingcited by 97
- 2019Looking for the Devil in the Details: Learning Trilinear Attention Sampling Network for Fine-grained Image Recognitioncited by 95
- 2020The Devil is in the Channels: Mutual-Channel Loss for Fine-Grained Image Classificationcited by 64
- 2021Decoupling the Role of Data, Attention, and Losses in Multimodal Transformerscited by 64
- 2018Multi-Attention Multi-Class Constraint for Fine-grained Image Recognitioncited by 58
- 2024Boosting Consistency in Story Visualization with Rich-Contextual Conditional Diffusion Modelscited by 54
- 2025Long-Term TalkingFace Generation via Motion-Prior Conditional Diffusion Modelcited by 49
- 2023Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMscited by 47
- 2016Low-rank Bilinear Pooling for Fine-Grained Classificationcited by 42
- 2018Reasoning with Sarcasm by Reading In-betweencited by 38
- 2025IMAGGarment: Fine-Grained Garment Generation for Controllable Fashion Designcited by 36
- 2021RAMS-Trans: Recurrent Attention Multi-scale Transformer forFine-grained Image Recognitioncited by 34
- 2025Analyzing and Boosting the Power of Fine-Grained Visual Recognition for Multi-modal Large Language Modelscited by 31
- 2020TOAN: Target-Oriented Alignment Network for Fine-Grained Image Categorization with Few Labeled Samplescited by 13
- 2022Knowledge Mining with Scene Text for Fine-Grained Recognitioncited by 10
- 2017Integrating Scene Text and Visual Appearance for Fine-Grained Image Classificationcited by 9
- 2023OmniDialog: An Omnipotent Pre-training Model for Task-Oriented Dialogue Systemcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.