mlsanityData to 7 Oct 2026

Improving Large Language Model (LLM) fidelity through context-aware grounding: A systematic approach to reliability and veracity

arXiv 2408.04023 ↗First posted 7 Aug 2024cs.CL cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

As Large Language Models (LLMs) become increasingly sophisticated and ubiquitous in natural language processing (NLP) applications, ensuring their robustness, trustworthiness, and alignment with human values has become a critical challenge. This paper presents a novel framework for contextual grounding in textual models, with a particular emphasis on the Context Representation stage. Our approach aims to enhance the reliability and ethical alignment of these models through a comprehensive, context-aware methodology. By explicitly capturing and representing relevant situational, cultural, and ethical contexts in a machine-readable format, we lay the foundation for anchoring a model's behavior within these contexts. Our approach leverages techniques from knowledge representation and reasoning, such as ontologies, semantic web technologies, and logic-based formalisms. We evaluate our framework on real-world textual datasets, demonstrating its effectiveness in improving model performance, fairness, and alignment with human expectations, while maintaining high accuracy. Furthermore, we discuss the other key components of the framework, including context-aware encoding, context-aware learning, interpretability and explainability, and continuous monitoring and adaptation. This research contributes to the growing body of work on responsible AI, offering a practical approach to developing more reliable, trustworthy, and ethically-aligned language models. Our findings have significant implications for the deployment of LLMs in sensitive domains such as healthcare, legal systems, and social services, where contextual understanding is paramount.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 17 of its 26 references that are in the map. First posted on arXiv 7 Aug 2024.

Builds on

17 of 26 references.

References · 17

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  3. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  4. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
  5. 2024OLMo: Accelerating the Science of Language Modelscited by 599
  6. 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 377
  7. 2016A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialoguescited by 174
  8. 2021FairFed: Enabling Group Fairness in Federated Learningcited by 114
  9. 2019Personalizing Dialogue Agents via Meta-Learningcited by 83
  10. 2023Contrastive Decoding Improves Reasoning in Large Language Modelscited by 71
  11. 2023AttentionViz: A Global View of Transformer Attentioncited by 50
  12. 2020Fairness Metrics: A Comparative Analysiscited by 45
5 more
  1. 2022Grounding Visual Representations with Texts for Domain Generalizationcited by 30
  2. 2024Towards Trustworthy AI: A Review of Ethical and Robust Large Language Modelscited by 21
  3. 2023Encoding Sentence Position in Context-Aware Neural Machine Translation with Concatenationcited by 6
  4. 2019Contextual Grounding of Natural Language Entities in Imagescited by 2
  5. 2016Context-aware Sentiment Word Identification: sentiword2veccited by 1

Built on by

Cited by year

Citing papers per year: 2024: 3; 2025: 5.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Context-DPO: Aligning Language Models for Context-Faithfulness
  2. 2025CASE-Bench: Context-Aware SafEty Benchmark for Large Language Models
  3. 2022CoDA21: Evaluating Language Understanding Capabilities of NLP Models With Context-Definition Alignment
  4. 2023Aligning Large Language Models with Human: A Survey
  5. 2025Towards Context-Robust LLMs: A Gated Representation Fine-tuning Approach
  6. 2024FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows"
  7. 2026LongHarness Bench: Stress-Testing Language Model Harnesses for Long-Context Reasoning
  8. 2025Alignment and Safety in Large Language Models: Safety Mechanisms, Training Paradigms, and Emerging Challenges