mlsanityData to 7 Oct 2026

A Fine-Tuning Approach for T5 Using Knowledge Graphs to Address Complex Tasks

arXiv 2502.16484 ↗First posted 23 Feb 2025cs.CLcited by 6

Not on the map. Why?

Abstract (arXiv)

With the development of deep learning technology, large language models have achieved remarkable results in many natural language processing tasks. However, these models still have certain limitations in handling complex reasoning tasks and understanding rich background knowledge. To solve this problem, this study proposed a T5 model fine-tuning method based on knowledge graphs, which enhances the model's reasoning ability and context understanding ability by introducing external knowledge graphs. We used the SQuAD1.1 dataset for experiments. The experimental results show that the T5 model based on knowledge graphs is significantly better than other baseline models in reasoning accuracy, context understanding, and the ability to handle complex problems. At the same time, we also explored the impact of knowledge graphs of different scales on model performance and found that as the scale of the knowledge graph increases, the performance of the model gradually improves. Especially when dealing with complex problems, the introduction of knowledge graphs greatly improves the reasoning ability of the T5 model. Ablation experiments further verify the importance of entity and relationship embedding in the model and prove that a complete knowledge graph is crucial to improving the various capabilities of the T5 model. In summary, this study provides an effective method to enhance the reasoning and understanding capabilities of large language models and provides new directions for future research.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 8 of its 23 references that are in the map. First posted on arXiv 23 Feb 2025.

Builds on

8 of 23 references.

References · 8

  1. 2024KICGPT: Large Language Model with Knowledge in Context for Knowledge Graph Completioncited by 36
  2. 2024Understanding Adam Optimizer via Online Learning of Updates: Adam is FTRL in Disguisecited by 23
  3. 2025Contrastive Learning for Cold Start Recommendation with Adaptive Feature Fusioncited by 11
  4. 2024LoRA-LiteE: A Computationally Efficient Framework for Chatbot Preference-Tuningcited by 10
  5. 2025Object Detection for Medical Image Analysis: Insights from the RT-DETR Modelcited by 10
  6. 2025Tree-based RAG-Agent Recommendation System: A Case Study in Medical Test Datacited by 9
  7. 2025A Structured Reasoning Framework for Unbalanced Data Classification Using Probabilistic Modelscited by 7
  8. 2024Neural Sequence-to-Sequence Modeling with Attention by Leveraging Deep Learning Architectures for Enhanced Contextual Understanding in Abstractive Text Summarizationcited by 4

Built on by

Cited by year

Citing papers per year: 2025: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Knowledge Graph-Infused Fine-Tuning for Structured Reasoning in Large Language Models
  2. 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph
  3. 2024An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration
  4. 2024Thinking with Knowledge Graphs: Enhancing LLM Reasoning Through Structured Data
  5. 2024Paths-over-Graph: Knowledge Graph Empowered Large Language Model Reasoning
  6. 2024Enhancing Logical Reasoning in Large Language Models through Graph-based Synthetic Data
  7. 2025Reliable Reasoning Path: Distilling Effective Guidance for LLM Reasoning with Knowledge Graphs
  8. 2023KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graph