mlsanityData to 7 Oct 2026

Conversational Control with Ontologies for Large Language Models: A Lightweight Framework for Constrained Generation

arXiv 2604.04450 ↗First posted 6 Apr 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Conversational agents based on Large Language Models (LLMs) have recently emerged as powerful tools for human-computer interaction. Nevertheless, their black-box nature implies challenges in predictability and a lack of personalization, both of which can be addressed by controlled generation. This work proposes an end-to-end method to obtain modular and explainable control over LLM outputs through ontological definitions of aspects related to the conversation. Key aspects are modeled and used as constraints; we then further fine-tune the LLM to generate content accordingly. To validate our approach, we explore two tasks that tackle two key conversational aspects: the English proficiency level and the polarity profile of the content. Using a hybrid fine-tuning procedure on seven state-of-the-art, open-weight conversational LLMs, we show that our method consistently outperforms pre-trained baselines, even on smaller models. Beyond quantitative gains, the framework remains model-agnostic, lightweight, and interpretable, enabling reusable control strategies that can be extended to new domains and interaction goals. This approach enhances alignment with strategy instructions and demonstrates the effectiveness of ontology-driven control in conversational systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 68 references that are in the map. First posted on arXiv 6 Apr 2026.

Builds on

34 of 68 references.

References · 34

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  6. 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
  7. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  8. 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
  9. 2020GeDi: Generative Discriminator Guided Sequence Generationcited by 377
  10. 2017Toward Controlled Generation of Textcited by 271
  11. 2024Let Your Graph Do the Talking: Encoding Structured Data for LLMscited by 112
  12. 2023Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Surveycited by 92
22 more
  1. 2023LLMs4OL: Large Language Models for Ontology Learningcited by 75
  2. 2023Evaluating Large Language Models on Controlled Generation Taskscited by 73
  3. 2023Retrieve-Rewrite-Answer: A KG-to-Text Enhanced LLMs Framework for Knowledge Graph Question Answeringcited by 64
  4. 2024Controllable Text Generation for Large Language Models: A Surveycited by 55
  5. 2023Knowledge Graph-Augmented Language Models for Knowledge-Grounded Dialogue Generationcited by 54
  6. 2021Plan-then-Generate: Controlled Data-to-Text Generation via Planningcited by 52
  7. 2020CoCon: A Self-Supervised Approach for Controlled Text Generationcited by 47
  8. 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answeringcited by 40
  9. 2020PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generationcited by 35
  10. 2021PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided MCTS Decodingcited by 32
  11. 2025Controlling Large Language Models Through Concept Activation Vectorscited by 27
  12. 2023Exploring Large Language Models for Ontology Alignmentcited by 26
  13. 2020Adapting a Language Model for Controlled Affective Text Generationcited by 22
  14. 2024Accounting for Sycophancy in Language Model Uncertainty Estimationcited by 18
  15. 2023An Integrative Survey on Mental Health Conversational Agents to Bridge Computer Science and Medical Perspectivescited by 16
  16. 2024From Tarzan to Tolkien: Controlling the Language Proficiency Level of LLMs for Content Generationcited by 15
  17. 2025LLM-Friendly Knowledge Representation for Customer Supportcited by 11
  18. 2024Plan-Grounded Large Language Models for Dual Goal Conversational Settingscited by 8
  19. 2022Plug-and-Play Recipe Generation with Content Planningcited by 5
  20. 2025Grammar Control in Dialogue Response Generation for Language Learning Chatbotscited by 2
  21. 2024Findings of the First Workshop on Simulating Conversational Intelligence in Chatcited by 1
  22. 2025GuideLLM: Exploring LLM-Guided Conversation with Applications in Autobiography Interviewingcited by 1

Built on by

Not cited yet.