mlsanityData to 7 Oct 2026

GS-Quant: Granular Semantic and Generative Structural Quantization for Knowledge Graph Completion

arXiv 2604.21649 ↗First posted 23 Apr 2026cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have shown immense potential in Knowledge Graph Completion (KGC), yet bridging the modality gap between continuous graph embeddings and discrete LLM tokens remains a critical challenge. While recent quantization-based approaches attempt to align these modalities, they typically treat quantization as flat numerical compression, resulting in semantically entangled codes that fail to mirror the hierarchical nature of human reasoning. In this paper, we propose GS-Quant, a novel framework that generates semantically coherent and structurally stratified discrete codes for KG entities. Unlike prior methods, GS-Quant is grounded in the insight that entity representations should follow a linguistic coarse-to-fine logic. We introduce a Granular Semantic Enhancement module that injects hierarchical knowledge into the codebook, ensuring that earlier codes capture global semantic categories while later codes refine specific attributes. Furthermore, a Generative Structural Reconstruction module imposes causal dependencies on the code sequence, transforming independent discrete units into structured semantic descriptors. By expanding the LLM vocabulary with these learned codes, we enable the model to reason over graph structures isomorphically to natural language generation. Experimental results demonstrate that GS-Quant significantly outperforms existing text-based and embedding-based baselines. Our code is publicly available at https://github.com/mikumifa/GS-Quant.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 52 references that are in the map. First posted on arXiv 23 Apr 2026.

Builds on

34 of 52 references.

References · 34

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2017Neural Discrete Representation Learningcited by 4,650
  4. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  5. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
  6. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
  7. 2016Complex Embeddings for Simple Link Predictioncited by 897
  8. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
  9. 2022Autoregressive Image Generation using Residual Quantizationcited by 706
  10. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  11. 2019Composition-based Multi-Relational Graph Convolutional Networkscited by 395
  12. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
22 more
  1. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
  2. 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
  3. 2019TuckER: Tensor Factorization for Knowledge Graph Completioncited by 290
  4. 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 273
  5. 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 235
  6. 2020Low-Dimensional Hyperbolic Knowledge Graph Embeddingscited by 195
  7. 2020A Survey on Knowledge Graph-Based Recommender Systemscited by 170
  8. 2019Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphscited by 125
  9. 2023Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Surveycited by 92
  10. 2021Knowledge Graph Reasoning with Relational Digraphcited by 91
  11. 2025Knowledge Graph Retrieval-Augmented Generation for LLM-based Recommendationcited by 56
  12. 2025Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and Opportunitiescited by 30
  13. 2024Multi-perspective Improvement of Knowledge Graph Completion with Large Language Modelscited by 20
  14. 2024MKGL: Mastery of a Three-Word Languagecited by 17
  15. 2024KG-FIT: Knowledge Graph Fine-Tuning Upon Open-World Knowledgecited by 16
  16. 2022I Know What You Do Not Know: Knowledge Graph Embedding via Co-distillation Learningcited by 15
  17. 2021WGCN: Graph Convolutional Networks with Weighted Structural Featurescited by 12
  18. 2025Self-supervised Quantized Representation for Seamlessly Integrating Knowledge Graphs with Large Language Modelscited by 11
  19. 2022Graph Component Contrastive Learning for Concept Relatedness Estimationcited by 6
  20. 2025Enhancing Large Language Model for Knowledge Graph Completion via Structure-Aware Alignment-Tuningcited by 4
  21. 2024Retrieval, Reasoning, Re-ranking: A Context-Enriched Framework for Knowledge Graph Completioncited by 3
  22. 2026Graph Tokenization for Bridging Graphs and Transformerscited by 3

Built on by

Not cited yet.