Conversational Control with Ontologies for Large Language Models: A Lightweight Framework for Constrained Generation
Not on the map. Why?
Abstract (arXiv)
Conversational agents based on Large Language Models (LLMs) have recently emerged as powerful tools for human-computer interaction. Nevertheless, their black-box nature implies challenges in predictability and a lack of personalization, both of which can be addressed by controlled generation. This work proposes an end-to-end method to obtain modular and explainable control over LLM outputs through ontological definitions of aspects related to the conversation. Key aspects are modeled and used as constraints; we then further fine-tune the LLM to generate content accordingly. To validate our approach, we explore two tasks that tackle two key conversational aspects: the English proficiency level and the polarity profile of the content. Using a hybrid fine-tuning procedure on seven state-of-the-art, open-weight conversational LLMs, we show that our method consistently outperforms pre-trained baselines, even on smaller models. Beyond quantitative gains, the framework remains model-agnostic, lightweight, and interpretable, enabling reusable control strategies that can be extended to new domains and interaction goals. This approach enhances alignment with strategy instructions and demonstrates the effectiveness of ontology-driven control in conversational systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 68 references that are in the map. First posted on arXiv 6 Apr 2026.
Builds on
34 of 68 references.
References · 34
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
- 2020GeDi: Generative Discriminator Guided Sequence Generationcited by 377
- 2017Toward Controlled Generation of Textcited by 271
- 2024Let Your Graph Do the Talking: Encoding Structured Data for LLMscited by 112
- 2023Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Surveycited by 92
22 more
- 2023LLMs4OL: Large Language Models for Ontology Learningcited by 75
- 2023Evaluating Large Language Models on Controlled Generation Taskscited by 73
- 2023Retrieve-Rewrite-Answer: A KG-to-Text Enhanced LLMs Framework for Knowledge Graph Question Answeringcited by 64
- 2024Controllable Text Generation for Large Language Models: A Surveycited by 55
- 2023Knowledge Graph-Augmented Language Models for Knowledge-Grounded Dialogue Generationcited by 54
- 2021Plan-then-Generate: Controlled Data-to-Text Generation via Planningcited by 52
- 2020CoCon: A Self-Supervised Approach for Controlled Text Generationcited by 47
- 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answeringcited by 40
- 2020PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generationcited by 35
- 2021PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided MCTS Decodingcited by 32
- 2025Controlling Large Language Models Through Concept Activation Vectorscited by 27
- 2023Exploring Large Language Models for Ontology Alignmentcited by 26
- 2020Adapting a Language Model for Controlled Affective Text Generationcited by 22
- 2024Accounting for Sycophancy in Language Model Uncertainty Estimationcited by 18
- 2023An Integrative Survey on Mental Health Conversational Agents to Bridge Computer Science and Medical Perspectivescited by 16
- 2024From Tarzan to Tolkien: Controlling the Language Proficiency Level of LLMs for Content Generationcited by 15
- 2025LLM-Friendly Knowledge Representation for Customer Supportcited by 11
- 2024Plan-Grounded Large Language Models for Dual Goal Conversational Settingscited by 8
- 2022Plug-and-Play Recipe Generation with Content Planningcited by 5
- 2025Grammar Control in Dialogue Response Generation for Language Learning Chatbotscited by 2
- 2024Findings of the First Workshop on Simulating Conversational Intelligence in Chatcited by 1
- 2025GuideLLM: Exploring LLM-Guided Conversation with Applications in Autobiography Interviewingcited by 1
Built on by
Not cited yet.