mlsanityData to 7 Oct 2026

KnowTuning: Knowledge-aware Fine-tuning for Large Language Models

arXiv 2402.11176 ↗First posted 17 Feb 2024cs.CL cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

Despite their success at many natural language processing (NLP) tasks, large language models still struggle to effectively leverage knowledge for knowledge-intensive tasks, manifesting limitations such as generating incomplete, non-factual, or illogical answers. These limitations stem from inadequate knowledge awareness of LLMs during vanilla fine-tuning. To address these problems, we propose a knowledge-aware fine-tuning (KnowTuning) method to improve fine-grained and coarse-grained knowledge awareness of LLMs. We devise a fine-grained knowledge augmentation stage to train LLMs to identify difficult fine-grained knowledge in answers. We also propose a coarse-grained knowledge comparison stage to train LLMs to distinguish between reliable and unreliable knowledge, in three aspects: completeness, factuality, and logicality. Extensive experiments on both generic and medical question answering (QA) datasets confirm the effectiveness of KnowTuning, through automatic and human evaluations, across various sizes of LLMs. We further verify that KnowTuning generates more facts with less factual error rate under fine-grained facts evaluation.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 67 of its 113 references that are in the map. First posted on arXiv 17 Feb 2024.

Builds on

67 of 113 references.

References · 67

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  6. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  7. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  8. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  9. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  10. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  11. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  12. 2022Language Models (Mostly) Know What They Knowcited by 1,783
38 more
  1. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  2. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
  3. 2023Large Language Models are not Fair Evaluatorscited by 1,050
  4. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
  5. 2023AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedbackcited by 738
  6. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 734
  7. 2023RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignmentcited by 672
  8. 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 618
  9. 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 571
  10. 2019ELI5: Long Form Question Answeringcited by 567
  11. 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 486
  12. 2023Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervisioncited by 445
  13. 2023The Curse of Recursion: Training on Generated Data Makes Models Forgetcited by 343
  14. 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 329
  15. 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 316
  16. 2023From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuningcited by 301
  17. 2022Generate rather than Retrieve: Large Language Models are Strong Context Generatorscited by 296
  18. 2020The Pushshift Reddit Datasetcited by 289
  19. 2023Preference Ranking Optimization for Human Alignmentcited by 283
  20. 2023Fine-tuning Language Models for Factualitycited by 219
  21. 2021Generated Knowledge Prompting for Commonsense Reasoningcited by 213
  22. 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 204
  23. 2022Factuality Enhanced Language Models for Open-Ended Text Generationcited by 200
  24. 2021Hurdles to Progress in Long-form Question Answeringcited by 166
  25. 2023Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERTcited by 155
  26. 2022Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluationcited by 141
  27. 2019A Question-Entailment Approach to Question Answeringcited by 133
  28. 2019JEC-QA: A Legal-Domain Question Answering Datasetcited by 115
  29. 2023A Critical Evaluation of Evaluations for Long-form Question Answeringcited by 111
  30. 2023NEFTune: Noisy Embeddings Improve Instruction Finetuningcited by 99
  31. 2023Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answeringcited by 97
  32. 2023KoLA: Carefully Benchmarking World Knowledge of Large Language Modelscited by 85
  33. 2020Look at the First Sentence: Position Bias in Question Answeringcited by 83
  34. 2023Towards Mitigating Hallucination in Large Language Models via Self-Reflectioncited by 81
  35. 2023ChatGPT is a Knowledgeable but Inexperienced Solver: An Investigation of Commonsense Problem in Large Language Modelscited by 63
  36. 2023Making Large Language Models Better Reasoners with Alignmentcited by 63
  37. 2023Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-Intensive Taskscited by 62
  38. 2020Knowledge-Aware Language Model Pretrainingcited by 52

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 5; 2026: 2.

11 papers.

  1. 2025DeepShop: A Benchmark for Deep Research Shopping Agentscited by 42
  2. 2024MACPO: Weak-to-Strong Alignment via Multi-Agent Contrastive Preference Optimizationcited by 20
  3. 2026Large Language Model Reasoning Failurescited by 20
  4. 2024Towards a Unified View of Preference Learning for Large Language Models: A Surveycited by 17
  5. 2024Cognitive Biases in Large Language Models for News Recommendationcited by 6
  6. 2025KnowsLM: A framework for evaluation of small language models for knowledge augmentation and humanised conversationscited by 6
  7. 2024Financial Knowledge Large Language Modelcited by 3
  8. 2025Abstractive Visual Understanding of Multi-modal Structured Knowledge: A New Perspective for MLLM Evaluationcited by 3
  9. 2026MERLIN: Building Low-SNR Robust Multimodal LLMs for Electromagnetic Signalscited by 1
  10. 2025SmallPlan: Leverage Small Language Models for Sequential Path Planning with Simulation-Powered, LLM-Guided Distillationcited by 0
  11. 2025GOSU: Retrieval-Augmented Generation with Global-Level Optimized Semantic Unit-Centric Frameworkcited by 0