mlsanityData to 14 Oct 2026

DALK: Dynamic Co-Augmentation of LLMs and KG to answer Alzheimer's Disease Questions with Scientific Literature

arXiv 2405.04819 ↗First posted 8 May 2024cs.CL cs.AIcited by 50

Not on the map. Why?

Abstract (arXiv)

Recent advancements in large language models (LLMs) have achieved promising performances across various applications. Nonetheless, the ongoing challenge of integrating long-tail knowledge continues to impede the seamless adoption of LLMs in specialized domains. In this work, we introduce DALK, a.k.a. Dynamic Co-Augmentation of LLMs and KG, to address this limitation and demonstrate its ability on studying Alzheimer's Disease (AD), a specialized sub-field in biomedicine and a global health priority. With a synergized framework of LLM and KG mutually enhancing each other, we first leverage LLM to construct an evolving AD-specific knowledge graph (KG) sourced from AD-related scientific literature, and then we utilize a coarse-to-fine sampling method with a novel self-aware knowledge retrieval approach to select appropriate knowledge from the KG to augment LLM inference capabilities. The experimental results, conducted on our constructed AD question answering (ADQA) benchmark, underscore the efficacy of DALK. Additionally, we perform a series of detailed analyses that can offer valuable insights and guidelines for the emerging topic of mutually enhancing KG and LLM. We will release the code and data at https://github.com/David-Li0406/DALK.

Key facts. Cited by 50 papers in the map (data through 14 Oct 2026). Builds on 38 of its 70 references that are in the map. First posted on arXiv 8 May 2024.

Builds on

38 of 70 references.

References · 38

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  7. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  8. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  9. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
  10. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
  11. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
  12. 2024Self-Rewarding Language Modelscited by 681
26 more
  1. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  2. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 343
  3. 2024BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domainscited by 301
  4. 2023Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategiescited by 238
  5. 2023Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Modelscited by 184
  6. 2023Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMscited by 178
  7. 2023Almanac: Retrieval-Augmented Language Models for Clinical Medicinecited by 123
  8. 2023Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!cited by 119
  9. 2019ASER: A Large-scale Eventuality Knowledge Graphcited by 89
  10. 2023Clinical Camel: An Open Expert-Level Medical Language Model with Dialogue-Based Knowledge Encodingcited by 71
  11. 2024Can LLMs Learn from Previous Mistakes? Investigating LLMs' Errors to Boost for Reasoningcited by 69
  12. 2020To BERT or Not To BERT: Comparing Speech and Language-based Approaches for Alzheimer's Disease Detectioncited by 49
  13. 2023PiVe: Prompting with Iterative Verification Improving Graph-based Generative Capability of LLMscited by 44
  14. 2023Clinfo.ai: An Open-Source Retrieval-Augmented Large Language Model System for Answering Medical Questions using Scientific Literaturecited by 29
  15. 2021DISCOS: Bridging the Gap between Discourse Knowledge and Commonsense Knowledgecited by 26
  16. 2023Two Directions for Clinical Data Generation with Large Language Models: Data-to-Label and Label-to-Datacited by 26
  17. 2023TEILP: Time Prediction over Knowledge Graphs via Logical Reasoningcited by 23
  18. 2024TILP: Differentiable Learning of Temporal Logical Rules on Knowledge Graphscited by 22
  19. 2023Eliminating Reasoning via Inferring with Planning: A New Framework to Guide LLMs' Non-linear Thinkingcited by 19
  20. 2024SPARQL Generation: an analysis on fine-tuning OpenLLaMA for Question Answering over a Life Science Knowledge Graphcited by 19
  21. 2023Multi-level Contrastive Learning for Script-based Character Understandingcited by 15
  22. 2024GLaM: Fine-Tuning Large Language Models for Domain Knowledge Graph Alignment via Neighborhood Partitioning and Generative Subgraph Encodingcited by 11
  23. 2024KnowLA: Enhancing Parameter-efficient Finetuning with Knowledgeable Adaptationcited by 10
  24. 2023Large language models improve Alzheimer's disease diagnosis using multi-modality datacited by 9
  25. 2022Mining On Alzheimer's Diseases Related Knowledge Graph to Identity Potential AD-related Semantic Triples for Drug Repurposingcited by 7
  26. 2023DAIL: Data Augmentation for In-Context Learning via Self-Paraphrasecited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 14; 2025: 30; 2026: 6.

50 papers.

Sort:

By area:

  1. 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 494
  2. 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
  3. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
  4. 2025Preference Leakage: A Contamination Problem in LLM-as-a-judgecited by 125
  5. 2024KAG: Boosting LLMs in Professional Domains via Knowledge Augmented Generationcited by 67
  6. 2025Injecting Domain-Specific Knowledge into Large Language Models: A Comprehensive Surveycited by 51
  7. 2025In-depth Analysis of Graph-based RAG in a Unified Frameworkcited by 46
  8. 2025Evaluating Scoring Bias in LLM-as-a-Judgecited by 43
  9. 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMscited by 42
  10. 2024SMoA: Improving Multi-agent Large Language Models with Sparse Mixture-of-Agentscited by 30
  11. 2025KET-RAG: A Cost-Efficient Multi-Granular Indexing Framework for Graph-RAGcited by 29
  12. 2025ArchRAG: Attributed Community-based Hierarchical Retrieval-Augmented Generationcited by 28
38 more
  1. 2024Exploring Large Language Models for Feature Selection: A Data-centric Perspectivecited by 27
  2. 2025GraphRAG-Bench: Challenging Domain-Specific Reasoning for Evaluating Graph Retrieval-Augmented Generationcited by 24
  3. 2024BPO: Towards Balanced Preference Optimization between Knowledge Breadth and Depth in Alignmentcited by 20
  4. 2025RAG-Enhanced Collaborative LLM Agents for Drug Discoverycited by 18
  5. 2025BookRAG: A Hierarchical Structure-aware Index-based Approach for Retrieval-Augmented Generation on Complex Documentscited by 16
  6. 2025GraphRAG-R1: Graph Retrieval-Augmented Generation with Process-Constrained Reinforcement Learningcited by 12
  7. 2026Memory in the LLM Era: Modular Architectures and Strategies in a Unified Frameworkcited by 12
  8. 2024DLO: Dynamic Layer Operation for Efficient Vertical Scaling of LLMscited by 10
  9. 2025Quantifying and Improving the Robustness of Retrieval-Augmented Language Models Against Spurious Features in Grounding Datacited by 10
  10. 2025LAG: Logic-Augmented Generation from a Cartesian Perspectivecited by 10
  11. 2024Knowledge-Driven Feature Selection and Engineering for Genotype Data with Large Language Modelscited by 9
  12. 2024Time Matters: Examine Temporal Effects on Biomedical Language Modelscited by 7
  13. 2025Beyond Accuracy: The Role of Calibration in Self-Improving Large Language Modelscited by 7
  14. 2025GuiLoMo: Allocating Expert Number and Rank for LoRA-MoE via Bilevel Optimization with GuidedSelection Vectorscited by 6
  15. 2025From Promising Capability to Pervasive Bias: Assessing Large Language Models for Emergency Department Triagecited by 5
  16. 2025MedKGent: A Large Language Model Agent Framework for Constructing Temporally Evolving Medical Knowledge Graphcited by 5
  17. 2024Fostering Natural Conversation in Large Language Models with NICO: a Natural Interactive COnversation datasetcited by 4
  18. 2024Examining Imbalance Effects on Performance and Demographic Fairness of Clinical Language Modelscited by 4
  19. 2025Right Answer at the Right Time - Temporal Retrieval-Augmented Generation via Graph Summarizationcited by 3
  20. 2024Leveraging Social Determinants of Health in Alzheimer's Research Using LLM-Augmented Literature Mining and Knowledge Graphscited by 2
  21. 2024Assessing the Impact of Conspiracy Theories Using Large Language Modelscited by 2
  22. 2025KAQG: A Knowledge-Graph-Enhanced RAG for Difficulty-Controlled Question Generationcited by 2
  23. 2025MuseScorer: Idea Originality Scoring At Scalecited by 2
  24. 2025XGraphRAG: Interactive Visual Analysis for Graph-based Retrieval-Augmented Generationcited by 2
  25. 2025Generative Models for Synthetic Data: Transforming Data Mining in the GenAI Eracited by 2
  26. 2025A Dynamic Knowledge Update-Driven Model with Large Language Models for Fake News Detectioncited by 2
  27. 2025Reviewing Clinical Knowledge in Medical Large Language Models: Training and Beyondcited by 1
  28. 2025QM-ToT: A Medical Tree of Thoughts Reasoning Framework for Quantized Modelcited by 1
  29. 2025Toward Revealing Nuanced Biases in Medical LLMscited by 1
  30. 2025Enabling Few-Shot Alzheimer's Disease Diagnosis on Biomarker Data with Tabular LLMscited by 1
  31. 2025SmartChunk Retrieval: Query-Aware Chunk Compression with Planning for Efficient Document RAGcited by 1
  32. 2025Causal Cartographer: From Mapping to Reasoning Over Counterfactual Worldscited by 0
  33. 2025Graph-Guided Concept Selection for Efficient Retrieval-Augmented Generationcited by 0
  34. 2026DA-RAG: Dynamic Attributed Community Search for Retrieval-Augmented Generationcited by 0
  35. 2026EvoRAG: Making Knowledge Graph-based RAG Automatically Evolve through Feedback-driven Backpropagationcited by 0
  36. 2026UniD3: A Knowledge Graph-Enhanced RAG Framework for Drug-Disease Discovery and Reasoningcited by 0
  37. 2026Ten Headache Specialists versus Artificial Intelligence for Clinical Literature Summarization: A Critical Evaluation and Comparisoncited by 0
  38. 2026AISE-Bench: A Full-Cycle Curated Benchmark for Information Seeking on Academic Knowledge Graphscited by 0