mlsanityData to 14 Oct 2026

MCSFF: Multi-modal Consistency and Specificity Fusion Framework for Entity Alignment

arXiv 2410.14584 ↗First posted 18 Oct 2024cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

Multi-modal entity alignment (MMEA) is essential for enhancing knowledge graphs and improving information retrieval and question-answering systems. Existing methods often focus on integrating modalities through their complementarity but overlook the specificity of each modality, which can obscure crucial features and reduce alignment accuracy. To solve this, we propose the Multi-modal Consistency and Specificity Fusion Framework (MCSFF), which innovatively integrates both complementary and specific aspects of modalities. We utilize Scale Computing's hyper-converged infrastructure to optimize IT management and resource allocation in large-scale data processing. Our framework first computes similarity matrices for each modality using modality embeddings to preserve their unique characteristics. Then, an iterative update method denoises and enhances modality features to fully express critical information. Finally, we integrate the updated information from all modalities to create enriched and precise entity representations. Experiments show our method outperforms current state-of-the-art MMEA baselines on the MMKG dataset, demonstrating its effectiveness and practical potential.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 16 of its 36 references that are in the map. First posted on arXiv 18 Oct 2024.

Builds on

16 of 36 references.

References · 16

  1. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  2. 2016Multilingual Knowledge Graph Embeddings for Cross-lingual Knowledge Alignmentcited by 128
  3. 2023Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversationscited by 47
  4. 2024Revisiting Multi-modal Emotion Learning with Broad State Space Models and Probability-guidance Fusioncited by 33
  5. 2024Revisiting Multimodal Emotion Recognition in Conversation from the Perspective of Graph Spectrumcited by 33
  6. 2023A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learningcited by 32
  7. 2022MEAformer: Multi-modal Entity Alignment Transformer for Meta Modality Hybridcited by 30
  8. 2023A Low-rank Matching Attention based Cross-modal Feature Fusion Method for Conversational Emotion Recognitioncited by 29
  9. 2023Masked Contrastive Graph Representation Learning for Age Estimationcited by 27
  10. 2023Graph Information Bottleneck for Remote Sensing Segmentationcited by 24
  11. 2023DER-GCN: Dialogue and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialogue Emotion Recognitioncited by 23
  12. 2024Efficient Long-distance Latent Relation-aware Graph Neural Network for Multi-modal Emotion Recognition in Conversationscited by 23
4 more
  1. 2024Contrastive Graph Representation Learning with Adversarial Cross-view Reconstruction and Information Bottleneckcited by 21
  2. 2024SpeGCL: Self-supervised Graph Spectrum Contrastive Learning without Positive Samplescited by 20
  3. 2024Masked Graph Learning with Recurrent Alignment for Multimodal Emotion Recognition in Conversationcited by 19
  4. 2023Universal Multi-modal Entity Alignment via Iteratively Fusing Modality Similarity Pathscited by 2

Built on by

Cited by year

Citing papers per year: 2024: 6; 2025: 2.

8 papers.