mlsanityData to 7 Oct 2026

Context Matters: Pushing the Boundaries of Open-Ended Answer Generation with Graph-Structured Knowledge Context

arXiv 2401.12671 ↗First posted 23 Jan 2024cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

In the continuously advancing AI landscape, crafting context-rich and meaningful responses via Large Language Models (LLMs) is essential. Researchers are becoming more aware of the challenges that LLMs with fewer parameters encounter when trying to provide suitable answers to open-ended questions. To address these hurdles, the integration of cutting-edge strategies, augmentation of rich external domain knowledge to LLMs, offers significant improvements. This paper introduces a novel framework that combines graph-driven context retrieval in conjunction to knowledge graphs based enhancement, honing the proficiency of LLMs, especially in domain specific community question answering platforms like AskUbuntu, Unix, and ServerFault. We conduct experiments on various LLMs with different parameter sizes to evaluate their ability to ground knowledge and determine factual accuracy in answers to open-ended questions. Our methodology GraphContextGen consistently outperforms dominant text-based retrieval systems, demonstrating its robustness and adaptability to a larger number of use cases. This advancement highlights the importance of pairing context rich data retrieval with LLMs, offering a renewed approach to knowledge sourcing and generation in AI systems. We also show that, due to rich contextual data retrieval, the crucial entities, along with the generated answer, remain factually coherent with the gold answer.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 94 references that are in the map. First posted on arXiv 23 Jan 2024.

Builds on

32 of 94 references.

References · 32

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  6. 2020Scaling Laws for Neural Language Modelscited by 6,411
  7. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  8. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  9. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  10. 2022Scaling Laws for Reward Model Overoptimizationcited by 1,056
  11. 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 755
  12. 2023A Comprehensive Overview of Large Language Modelscited by 639
20 more
  1. 2023Instruction Tuning for Large Language Models: A Surveycited by 617
  2. 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 615
  3. 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 556
  4. 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 242
  5. 2022Leveraging Large Language Models for Multiple Choice Question Answeringcited by 199
  6. 2022Scaling Up Models and Data with textttt5x and textttseqiocited by 187
  7. 2023Self-contradictory Hallucinations of Large Language Models: Evaluation, Detection and Mitigationcited by 123
  8. 2020CTRLsum: Towards Generic Controllable Text Summarizationcited by 98
  9. 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 70
  10. 2023Knowledge Graph-Augmented Language Models for Knowledge-Grounded Dialogue Generationcited by 54
  11. 2023Are LLMs All You Need for Task-Oriented Dialogue?cited by 52
  12. 2023Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Datacited by 48
  13. 2023WebBrain: Learning to Generate Factually Correct Articles for Queries by Grounding on Large Web Corpuscited by 29
  14. 2016Attentive Pooling Networkscited by 28
  15. 2023Compress, Then Prompt: Improving Accuracy-Efficiency Trade-off of LLM Inference with Transferable Promptcited by 28
  16. 2023Retrieval Augmented Generation and Representative Vector Summarization for large unstructured textual data in Medical Educationcited by 10
  17. 2021CO2Sum:Contrastive Learning for Factual-Consistent Abstractive Summarizationcited by 9
  18. 2022Prompting for a conversation: How to control a dialog model?cited by 4
  19. 2022Structured Knowledge Grounding for Question Answeringcited by 2
  20. 2023Prompt Generate Train (PGT): Few-shot Domain Adaption of Retrieval Augmented Generation Models for Open Book Question-Answeringcited by 1

Built on by

Not cited yet.