Dual Refinement Cycle Learning: Unsupervised Text Classification of Mamba and Community Detection on Text Attributed Graph
Not on the map. Why?
Abstract (arXiv)
Pretrained language models offer strong text understanding capabilities but remain difficult to deploy in real-world text-attributed networks due to their heavy dependence on labeled data. Meanwhile, community detection methods typically ignore textual semantics, limiting their usefulness in downstream applications such as content organization, recommendation, and risk monitoring. To overcome these limitations, we present Dual Refinement Cycle Learning (DRCL), a fully unsupervised framework designed for practical scenarios where no labels or category definitions are available. DRCL integrates structural and semantic information through a warm-start initialization and a bidirectional refinement cycle between a GCN-based Community Detection Module (GCN-CDM) and a Text Semantic Modeling Module (TSMM). The two modules iteratively exchange pseudo-labels, allowing semantic cues to enhance structural clustering and structural patterns to guide text representation learning without manual supervision. Across several text-attributed graph datasets, DRCL consistently improves the structural and semantic quality of discovered communities. Moreover, a Mamba-based classifier trained solely from DRCL's community signals achieves accuracy comparable to supervised models, demonstrating its potential for deployment in large-scale systems where labeled data are scarce or costly. The code is available at https://github.com/wuanghoong/DRCL.git.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 67 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
44 of 67 references.
References · 44
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
- 2024Qwen2 Technical Reportcited by 2,120
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2016Variational Graph Auto-Encoderscited by 1,382
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
32 more
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
- 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 260
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
- 2024G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answeringcited by 223
- 2023GPT4Graph: Can Large Language Models Understand Graph Structured Data ? An Empirical Evaluation and Benchmarkingcited by 210
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 192
- 2024LLaGA: Large Language and Graph Assistantcited by 181
- 2021Node Feature Extraction by Self-Supervised Multi-scale Neighborhood Predictioncited by 138
- 2023Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learningcited by 133
- 2023MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adaptercited by 128
- 2023Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documentscited by 104
- 2019Symmetric Graph Convolutional Autoencoder for Unsupervised Graph Representation Learningcited by 94
- 2025jina-embeddings-v4: Universal Embeddings for Multimodal Multilingual Retrievalcited by 76
- 2022A Comprehensive Survey on Deep Clustering: Taxonomy, Challenges, and Future Directionscited by 73
- 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
- 2025Knowledge Graph Retrieval-Augmented Generation for LLM-based Recommendationcited by 57
- 2024GLBench: A Comprehensive Benchmark for Graph with Large Language Modelscited by 36
- 2023Jina Embeddings: A Novel Set of High-Performance Sentence Embedding Modelscited by 35
- 2024Alpaca against Vicuna: Using LLMs to Uncover Memorization of LLMscited by 33
- 2023Can LLMs Effectively Leverage Graph Structural Information through Prompts, and Why?cited by 31
- 2023Edgeformers: Graph-Empowered Transformers for Representation Learning on Textual-Edge Networkscited by 23
- 2022Modularity-Aware Graph Autoencoders for Joint Community Detection and Link Predictioncited by 22
- 2023DGCLUSTER: A Neural Framework for Attributed Graph Clustering via Modularity Maximizationcited by 21
- 2024Revisiting Modularity Maximization for Graph Clustering: A Contrastive Learning Perspectivecited by 18
- 2024Advancing Graph Representation Learning with Large Language Models: A Comprehensive Survey of Techniquescited by 16
- 2024UniGLM: Training One Unified Language Model for Text-Attributed Graph Embeddingcited by 14
- 2022SCGC : Self-Supervised Contrastive Graph Clusteringcited by 13
- 2024Deep Contrastive Graph Learning with Clustering-Oriented Guidancecited by 7
- 2024Leveraging Large Language Models for Effective Label-free Node Classification in Text-Attributed Graphscited by 6
- 2025Large Language Models Meet Text-Attributed Graphs: A Survey of Integration Frameworks and Applicationscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Interpretable Unsupervised Community Detection with LLM-Symbolized Structured Processes
- 2024Bridging Local Details and Global Context in Text-Attributed Graphs
- 2025LLMs Between the Nodes: Community Discovery Beyond Vectors
- 2026Reasoning-Based Refinement of Unsupervised Text Clusters with LLMs
- 2025SSTAG: Structure-Aware Self-Supervised Learning Method for Text-Attributed Graphs
- 2025Quantizing Text-attributed Graphs for Semantic-Structural Integration
- 2025LLM-driven Knowledge Distillation for Dynamic Text-Attributed Graphs
- 2024Similarity-based Neighbor Selection for Graph LLMs