Knowledge-Graph-Gated Defactualization for Style-Controllable and Fact-Preserving Generation in Agentic Conversational AI
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
also in 1 more
Abstract (arXiv)
Agentic large language models (LLMs) deployed in fact-sensitive applications such as customer support must simultaneously preserve factual correctness and generate responses in a controllable stylistic register. Activation steering enables fine-tuning-free style control by perturbing hidden representations, but it lacks an explicit mechanism for distinguishing verifiable facts from stylistic content, leading to semantic leakage. We address this challenge through Defactualize-Steer-Rehydrate (DSR), a knowledge-engineering framework that integrates a typed, salience-weighted knowledge graph (KG) with activation steering. DSR extracts salient entities using a layered regex or NER or lexical-classifier pipeline, replaces them with typed placeholders prior to steering, and deterministically restores verified values through salience-guided rehydration after generation. DSR is evaluated across six LLaMA-family models (1B--13B parameters) on 600 A2A-generated customer-support cases (1,200 generations), with a dedicated KG ablation study. DSR significantly increases verified-entity recovery relative to a steering-only baseline (Cohen's d=0.225, pBonf=1.0×10-4), though the absolute recovery rate remains modest, while preserving effective style control across diverse model families. Layer-wise separability and steering-strength diagnostics further show previously unexplored interactions between representation-level steering and factual grounding. hese results demonstrate that explicit knowledge engineering can systematically enhance trustworthy, controllable, and reproducible generative AI without requiring model fine-tuning. Code, cached steering vectors, and evaluation scripts are publicly released to support reproducibility.footnotehttps://github.com/Tanmay-IITDSAI/KG-Gated-Defactualization
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 34 of its 53 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
34 of 53 references.
Closest ancestors · 2
Same direction, newest first
- 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep
- 2023A Survey on Large Language Model based Autonomous Agents22 Aug
Other references · 32
- 2017Attention Is All You Needcited by 60,361
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
20 more
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 841
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 762
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
- 2023Function Vectors in Large Language Modelscited by 308
- 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 189
- 2020A Survey on Knowledge Graph-Based Recommender Systemscited by 170
- 2020Towards Controllable Biases in Language Generationcited by 112
- 2024Style Vectors for Steering Generative Large Language Modelcited by 56
- 2025Personalized Text Generation with Contrastive Activation Steeringcited by 34
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026τ-Knowledge: Evaluating Conversational Agents over Unstructured Knowledge
- 2025SEAL: Self-Evolving Agentic Learning for Conversational Question Answering over Knowledge Graphs
- 2026SAGE: A Service Agent Graph-guided Evaluation Benchmark
- 2026Controlling Chat Style in Language Models via Single-Direction Editing
- 2025KnowsLM: A framework for evaluation of small language models for knowledge augmentation and humanised conversations
- 2026Search for Truth from Reasoning: A Dynamic Representation Editing Framework for Steering LLM Trajectories
- 2026Beyond Refusal: Probing the Limits of Agentic Self-Correction for Semantic Sensitive Information
- 2025Agent-R: Training Language Model Agents to Reflect via Iterative Self-Training