StructCoh: Structured Contrastive Learning for Context-Aware Text Semantic Matching
Not on the map. Why?
Abstract (arXiv)
Text semantic matching requires nuanced understanding of both structural relationships and fine-grained semantic distinctions. While pre-trained language models excel at capturing token-level interactions, they often overlook hierarchical structural patterns and struggle with subtle semantic discrimination. In this paper, we proposed StructCoh, a graph-enhanced contrastive learning framework that synergistically combines structural reasoning with representation space optimization. Our approach features two key innovations: (1) A dual-graph encoder constructs semantic graphs via dependency parsing and topic modeling, then employs graph isomorphism networks to propagate structural features across syntactic dependencies and cross-document concept nodes. (2) A hierarchical contrastive objective enforces consistency at multiple granularities: node-level contrastive regularization preserves core semantic units, while graph-aware contrastive learning aligns inter-document structural semantics through both explicit and implicit negative sampling strategies. Experiments on three legal document matching benchmarks and academic plagiarism detection datasets demonstrate significant improvements over state-of-the-art methods. Notably, StructCoh achieves 86.7% F1-score (+6.2% absolute gain) on legal statute matching by effectively identifying argument structure similarities.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 30 of its 55 references that are in the map. First posted on arXiv 2 Sep 2025.
Builds on
30 of 55 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2017Graph Attention Networkscited by 8,923
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2018Graph Convolutional Networks for Text Classificationcited by 345
- 2016Enhanced LSTM for Natural Language Inferencecited by 200
- 2018Graph Convolution over Pruned Dependency Trees Improves Relation Extractioncited by 146
18 more
- 2017Encoding Sentences with Graph Convolutional Networks for Semantic Role Labelingcited by 137
- 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 128
- 2017Bilateral Multi-Perspective Matching for Natural Language Sentencescited by 121
- 2019Semantics-aware BERT for Language Understandingcited by 112
- 2015Convolutional Neural Network Architectures for Matching Natural Language Sentencescited by 82
- 2019Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representationscited by 36
- 2023Time-aware Multiway Adaptive Fusion Network for Temporal Knowledge Graph Question Answeringcited by 27
- 2024Question Calibration and Multi-Hop Modeling for Temporal Question Answeringcited by 25
- 2022DABERT: Dual Attention Enhanced BERT for Semantic Matchingcited by 21
- 2023Dual Path Modeling for Semantic Matching by Perceiving Subtle Conflictscited by 21
- 2022Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusioncited by 18
- 2022Searching for Optimal Subword Tokenization in Cross-domain NERcited by 17
- 2022Robust Lottery Tickets for Pre-trained Language Modelscited by 16
- 2025Progressive Mastery: Customized Curriculum Learning with Guided Prompting for Mathematical Reasoningcited by 13
- 2025Not All Parameters Are Created Equal: Smart Isolation Boosts Fine-Tuning Performancecited by 13
- 2023Unleashing Potential of Evidence in Knowledge-Intensive Dialogue Generationcited by 11
- 2024Resolving Word Vagueness with Scenario-guided Adapter for Natural Language Inferencecited by 11
- 2024Comateformer: Combined Attention Transformer for Semantic Sentence Matchingcited by 9
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2026Why Supervised Fine-Tuning Fails to Learn: A Systematic Study of Incomplete Learning in Large Language Modelscited by 8
- 2026Where Does Long-Context Supervision Actually Go? Effective-Context Exposure Balancingcited by 4
- 2026MemGuard: Persisting Verifier Signals for LLM-Agent Memory Governancecited by 4
- 2026Sparse Growing Transformer: Training-Time Sparse Depth Allocation via Progressive Attention Loopingcited by 3
- 2025Tag-Enriched Multi-Attention with Large Language Models for Cross-Domain Sequential Recommendationcited by 0
- 2026Scope3Trace: Evidence-Based Identification and Extraction of Scope 3 GHG Emissions from Sustainability Reportscited by 0
- 2026AlignDiff: Exploiting Model-Intrinsic Information for Better Preference Data Selectioncited by 0
- 2026Counterfactual Rollout Replay: Forkable Environments as Free Process Rewards for Software Engineering Agentscited by 0
- 2026Counterfactual Rollout Replay: Forkable Environments as Free Process Rewards for Software Engineering Agents27 Sep 2026
- 2026AlignDiff: Exploiting Model-Intrinsic Information for Better Preference Data Selection5 Sep 2026
- 2026MemGuard: Persisting Verifier Signals for LLM-Agent Memory Governance22 Aug 2026
- 2026Scope3Trace: Evidence-Based Identification and Extraction of Scope 3 GHG Emissions from Sustainability Reports19 Jul 2026
- 2026Where Does Long-Context Supervision Actually Go? Effective-Context Exposure Balancing11 May 2026
- 2026Why Supervised Fine-Tuning Fails to Learn: A Systematic Study of Incomplete Learning in Large Language Models11 Apr 2026
- 2026Sparse Growing Transformer: Training-Time Sparse Depth Allocation via Progressive Attention Looping25 Mar 2026
- 2025Tag-Enriched Multi-Attention with Large Language Models for Cross-Domain Sequential Recommendation10 Oct 2025