mlsanityData to 14 Oct 2026

StructCoh: Structured Contrastive Learning for Context-Aware Text Semantic Matching

arXiv 2509.02033 ↗First posted 2 Sep 2025cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

Text semantic matching requires nuanced understanding of both structural relationships and fine-grained semantic distinctions. While pre-trained language models excel at capturing token-level interactions, they often overlook hierarchical structural patterns and struggle with subtle semantic discrimination. In this paper, we proposed StructCoh, a graph-enhanced contrastive learning framework that synergistically combines structural reasoning with representation space optimization. Our approach features two key innovations: (1) A dual-graph encoder constructs semantic graphs via dependency parsing and topic modeling, then employs graph isomorphism networks to propagate structural features across syntactic dependencies and cross-document concept nodes. (2) A hierarchical contrastive objective enforces consistency at multiple granularities: node-level contrastive regularization preserves core semantic units, while graph-aware contrastive learning aligns inter-document structural semantics through both explicit and implicit negative sampling strategies. Experiments on three legal document matching benchmarks and academic plagiarism detection datasets demonstrate significant improvements over state-of-the-art methods. Notably, StructCoh achieves 86.7% F1-score (+6.2% absolute gain) on legal statute matching by effectively identifying argument structure similarities.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 30 of its 55 references that are in the map. First posted on arXiv 2 Sep 2025.

Builds on

30 of 55 references.

References · 30

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  6. 2017Graph Attention Networkscited by 8,923
  7. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  8. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  9. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
  10. 2018Graph Convolutional Networks for Text Classificationcited by 345
  11. 2016Enhanced LSTM for Natural Language Inferencecited by 200
  12. 2018Graph Convolution over Pruned Dependency Trees Improves Relation Extractioncited by 146
18 more
  1. 2017Encoding Sentences with Graph Convolutional Networks for Semantic Role Labelingcited by 137
  2. 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 128
  3. 2017Bilateral Multi-Perspective Matching for Natural Language Sentencescited by 121
  4. 2019Semantics-aware BERT for Language Understandingcited by 112
  5. 2015Convolutional Neural Network Architectures for Matching Natural Language Sentencescited by 82
  6. 2019Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representationscited by 36
  7. 2023Time-aware Multiway Adaptive Fusion Network for Temporal Knowledge Graph Question Answeringcited by 27
  8. 2024Question Calibration and Multi-Hop Modeling for Temporal Question Answeringcited by 25
  9. 2022DABERT: Dual Attention Enhanced BERT for Semantic Matchingcited by 21
  10. 2023Dual Path Modeling for Semantic Matching by Perceiving Subtle Conflictscited by 21
  11. 2022Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusioncited by 18
  12. 2022Searching for Optimal Subword Tokenization in Cross-domain NERcited by 17
  13. 2022Robust Lottery Tickets for Pre-trained Language Modelscited by 16
  14. 2025Progressive Mastery: Customized Curriculum Learning with Guided Prompting for Mathematical Reasoningcited by 13
  15. 2025Not All Parameters Are Created Equal: Smart Isolation Boosts Fine-Tuning Performancecited by 13
  16. 2023Unleashing Potential of Evidence in Knowledge-Intensive Dialogue Generationcited by 11
  17. 2024Resolving Word Vagueness with Scenario-guided Adapter for Natural Language Inferencecited by 11
  18. 2024Comateformer: Combined Attention Transformer for Semantic Sentence Matchingcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 7.

8 papers.