mlsanityData to 14 Oct 2026

GCL-OT: Graph Contrastive Learning with Optimal Transport for Heterophilic Text-Attributed Graphs

arXiv 2511.16778 ↗First posted 20 Nov 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Recently, structure-text contrastive learning has shown promising performance on text-attributed graphs by leveraging the complementary strengths of graph neural networks and language models. However, existing methods typically rely on homophily assumptions in similarity estimation and hard optimization objectives, which limit their applicability to heterophilic graphs. Although existing methods can mitigate heterophily through structural adjustments or neighbor aggregation, they usually treat textual embeddings as static targets, leading to suboptimal alignment. In this work, we identify multi-granular heterophily in text-attributed graphs, including complete heterophily, partial heterophily, and latent homophily, which makes structure-text alignment particularly challenging due to mixed, noisy, and missing semantic correlations. To achieve flexible and bidirectional alignment, we propose GCL-OT, a novel graph contrastive learning framework with optimal transport, equipped with tailored mechanisms for each type of heterophily. Specifically, for partial heterophily, we design a RealSoftMax-based similarity estimator to emphasize key neighbor-word interactions while easing background noise. For complete heterophily, we introduce a prompt-based filter that adaptively excludes irrelevant noise during optimal transport alignment. Furthermore, we incorporate OT-guided soft supervision to uncover potential neighbors with similar semantics, enhancing the learning of latent homophily. Theoretical analysis shows that GCL-OT can improve the mutual information bound and Bayes error guarantees. Extensive experiments on nine benchmarks show that GCL-OT outperforms state-of-the-art methods, demonstrating its effectiveness and robustness.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 66 references that are in the map. First posted on arXiv 20 Nov 2025.

Builds on

35 of 66 references.

References · 35

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2017Graph Attention Networkscited by 8,923
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2017Inductive Representation Learning on Large Graphscited by 6,320
  6. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  7. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  8. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  9. 2018Deep Graph Infomaxcited by 1,106
  10. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
  11. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
  12. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
23 more
  1. 2019On Variational Bounds of Mutual Informationcited by 559
  2. 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 362
  3. 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 343
  4. 2020Graph Neural Networks with Heterophilycited by 202
  5. 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
  6. 2022Learning on Large-scale Text-attributed Graphs via Variational Inferencecited by 155
  7. 2021GraphFormers: GNN-nested Transformers for Representation Learning on Textual Graphcited by 143
  8. 2021Node Feature Extraction by Self-Supervised Multi-scale Neighborhood Predictioncited by 138
  9. 2023SimTeG: A Frustratingly Simple Approach Improves Textual Graph Learningcited by 73
  10. 2021Low-Rank Sinkhorn Factorizationcited by 67
  11. 2023Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothingcited by 67
  12. 2023Augmenting Low-Resource Text Classification with Graph-Grounded Pre-training and Promptingcited by 62
  13. 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
  14. 2024Efficient Tuning and Inference for Large Language Models on Textual Graphscited by 54
  15. 2024Multi-granularity Correspondence Learning from Long-term Noisy Videoscited by 34
  16. 2023ConGraT: Self-Supervised Contrastive Pretraining for Joint Graph and Text Embeddingscited by 32
  17. 2022Cross-Domain Graph Anomaly Detection via Anomaly-aware Contrastive Alignmentcited by 31
  18. 2023Integrating Graphs with Large Language Models: Methods and Prospectscited by 18
  19. 2024Exploring the Potential of Large Language Models for Heterophilic Graphscited by 10
  20. 2024High-Frequency-aware Hierarchical Contrastive Selective Coding for Representation Learning on Text-attributed Graphscited by 5
  21. 2024THESAURUS: Contrastive Graph Clustering by Swapping Fused Gromov-Wasserstein Couplingscited by 5
  22. 2025HeTGB: A Comprehensive Benchmark for Heterophilic Text-Attributed Graphscited by 5
  23. 2025Language Models as Messengers: Enhancing Message Passing in Heterophilic Graph Learningcited by 2

Built on by

Not cited yet.