SASA: Semantic-Aware Contrastive Learning Framework with Separated Attention for Triple Classification
Not on the map. Why?
Abstract (arXiv)
Knowledge Graphs~(KGs) often suffer from unreliable knowledge, which restricts their utility. Triple Classification~(TC) aims to determine the validity of triples from KGs. Recently, text-based methods learn entity and relation representations from natural language descriptions, significantly improving the generalization capabilities of TC models and setting new benchmarks in performance. However, there are still two critical challenges. First, existing methods often ignore the effective semantic interaction among different KG components. Second, most approaches adopt single binary classification training objective, leading to insufficient semantic representation learning. To address these challenges, we propose SASA, a novel framework designed to enhance TC models via separated attention mechanism and semantic-aware contrastive learning~(CL). Specifically, we first propose separated attention mechanism to encode triples into decoupled contextual representations and then fuse them through a more effective interactive way. Then, we introduce semantic-aware hierarchical CL as auxiliary training objective to guide models in improving their discriminative capabilities and achieving sufficient semantic learning, considering both local level and global level CL. Experimental results across two benchmark datasets demonstrate that SASA significantly outperforms state-of-the-art methods. In terms of accuracy, we advance the state-of-the-art by +5.9% on FB15k-237 and +3.4% on YAGO3-10.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 47 references that are in the map. First posted on arXiv 19 Jan 2026.
Builds on
30 of 47 references.
References · 30
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
18 more
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
- 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
- 2020A Survey on Knowledge Graph-Based Recommender Systemscited by 170
- 2022SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Modelscited by 90
- 2023Making Large Language Models Perform Better in Knowledge Graph Completioncited by 48
- 2023Exploring Large Language Models for Knowledge Graph Completioncited by 43
- 2018Entity-Duet Neural Ranking: Understanding the Role of Knowledge Graph Semantics in Neural Information Retrievalcited by 33
- 2023Dipping PLMs Sauce: Bridging Structure and Text for Effective Knowledge Graph Completion via Conditional Soft Promptingcited by 33
- 2022Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completioncited by 32
- 2023Complex Logical Reasoning over Knowledge Graphs using Large Language Modelscited by 28
- 2024Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Modelscited by 25
- 2024Contextualization Distillation from Large Language Model for Knowledge Graph Completioncited by 18
- 2022SMiLE: Schema-augmented Multi-level Contrastive Learning for Knowledge Graph Link Predictioncited by 12
- 2024Universal Link Predictor By In-Context Learning on Graphscited by 12
Built on by
Not cited yet.