mlsanityData to 7 Oct 2026

Grounding and Evaluation for Large Language Models: Practical Challenges and Lessons Learned (Survey)

arXiv 2407.12858 ↗First posted 10 Jul 2024cs.CL cs.AI cs.CVcited by 20

Not on the map. Why?

Abstract (arXiv)

With the ongoing rapid adoption of Artificial Intelligence (AI)-based systems in high-stakes domains, ensuring the trustworthiness, safety, and observability of these systems has become crucial. It is essential to evaluate and monitor AI systems not only for accuracy and quality-related metrics but also for robustness, bias, security, interpretability, and other responsible AI dimensions. We focus on large language models (LLMs) and other generative AI models, which present additional challenges such as hallucinations, harmful and manipulative content, and copyright infringement. In this survey article accompanying our KDD 2024 tutorial, we highlight a wide range of harms associated with generative AI systems, and survey state of the art approaches (along with open challenges) to address these harms.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 98 of its 133 references that are in the map. First posted on arXiv 10 Jul 2024.

Builds on

98 of 133 references.

References · 98

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  5. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  6. 2016Deep Learning with Differential Privacycited by 2,682
  7. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  8. 2020Learning to summarize from human feedbackcited by 2,562
  9. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  10. 2020Extracting Training Data from Large Language Modelscited by 2,144
  11. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  12. 2022Language Models (Mostly) Know What They Knowcited by 1,783
38 more
  1. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
  2. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  3. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
  4. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  5. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  6. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
  7. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
  8. 2023LIMA: Less Is More for Alignmentcited by 1,080
  9. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
  10. 2022Red Teaming Language Models with Language Modelscited by 983
  11. 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
  12. 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 788
  13. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  14. 2023Whose Opinions Do Language Models Reflect?cited by 759
  15. 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 743
  16. 2023Extracting Training Data from Diffusion Modelscited by 723
  17. 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 713
  18. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
  19. 2023Bias and Fairness in Large Language Models: A Surveycited by 626
  20. 2023Enabling Large Language Models to Generate Text with Citationscited by 584
  21. 2023Textbooks Are All You Needcited by 561
  22. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 478
  23. 2023Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervisioncited by 445
  24. 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 437
  25. 2019Learning the Difference that Makes a Difference with Counterfactually-Augmented Datacited by 428
  26. 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 374
  27. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
  28. 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 351
  29. 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 347
  30. 2019Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Settingcited by 346
  31. 2023Large Language Models for Information Retrieval: A Surveycited by 331
  32. 2023Explainability for Large Language Models: A Surveycited by 331
  33. 2023Data Selection for Language Models via Importance Resamplingcited by 322
  34. 2023Trusting Your Evidence: Hallucinate Less with Context-aware Decodingcited by 319
  35. 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 308
  36. 2023Evaluating Verifiability in Generative Search Enginescited by 297
  37. 2022Generate rather than Retrieve: Large Language Models are Strong Context Generatorscited by 296
  38. 2022Teaching language models to support answers with verified quotescited by 290

50 most cited of 98 All 98 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 9; 2026: 4.

20 papers.

Sort:

By area:

  1. 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agentscited by 102
  2. 2025The Scales of Justitia: A Comprehensive Survey on Safety Evaluation of LLMscited by 24
  3. 2024Mutual Theory of Mind in Human-AI Collaboration: An Empirical Study with LLM-driven AI Agents in a Real-time Shared Workspace Taskcited by 17
  4. 2024SciSafeEval: A Comprehensive Benchmark for Safety Alignment of Large Language Models in Scientific Taskscited by 17
  5. 2024Insights and Current Gaps in Open-Source LLM Vulnerability Scanners: A Comparative Analysiscited by 9
  6. 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Reviewcited by 8
  7. 2025A Principle-based Framework for the Development and Evaluation of Large Language Models for Health and Wellnesscited by 3
  8. 2026ComplianceNLP: Knowledge-Graph-Augmented RAG for Multi-Framework Regulatory Gap Detectioncited by 2
  9. 2024Bridging Today and the Future of Humanity: AI Safety in 2024 and Beyondcited by 1
  10. 2025CAP-LLM: Context-Augmented Personalized Large Language Models for News Headline Generationcited by 1
  11. 2025Multi-level Diagnosis and Evaluation for Robust Tabular Feature Engineering with Large Language Modelscited by 1
  12. 2024Keep on Swimming: Real Attackers Only Need Partial Knowledge of a Multi-Model Systemcited by 0
8 more
  1. 2024"Moralized" Multi-Step Jailbreak Prompts: Black-Box Testing of Guardrails in Large Language Models for Verbal Attackscited by 0
  2. 2024DSAI: Unbiased and Interpretable Latent Feature Extraction for Data-Centric AIcited by 0
  3. 2025TVS Sidekick: Challenges and Practical Insights from Deploying Large Language Models in the Enterprisecited by 0
  4. 2025Black-Box Guardrail Reverse-engineering Attackcited by 0
  5. 2025IRSDA: An Agent-Orchestrated Framework for Enterprise Intrusion Responsecited by 0
  6. 2026Saying More Than They Know: A Framework for Quantifying Epistemic-Rhetorical Miscalibration in Large Language Modelscited by 0
  7. 2026WhiteTesseract: Reframing the Interpretation of Cultural Heritage through XR and Conversational AIcited by 0
  8. 2026Grounded Skill Synthesis from Code at Scale for Agentic Intelligencecited by 0