Semantic Grounding Index: Geometric Bounds on Context Engagement in RAG Systems
On the map: Retrieval-augmented generation → Generation and context integration
Abstract (arXiv)
When retrieval-augmented generation (RAG) systems hallucinate, what geometric trace does this leave in embedding space? We introduce the Semantic Grounding Index (SGI), defined as the ratio of angular distances from the response to the question versus the context on the unit hypersphere mathbbSd-1.Our central finding is semantic laziness: hallucinated responses remain angularly proximate to questions rather than departing toward retrieved contexts. On HaluEval (n=5,000), we observe large effect sizes (Cohen's d ranging from 0.92 to 1.28) across five embedding models with mean cross-model correlation r=0.85. Crucially, we derive from the spherical triangle inequality that SGI's discriminative power should increase with question-context angular separation θ(q,c)-a theoretical prediction confirmed empirically: effect size rises monotonically from d=0.61 -low θ(q,c), to d=1.27 -high θ(q,c), with AUC improving from 0.72 to 0.83. Subgroup analysis reveals that SGI excels on long responses (d=2.05) and short questions (d=1.22), while remaining robust across context lengths. Calibration analysis yields ECE=0.10, indicating SGI scores can serve as probability estimates, not merely rankings. A critical negative result on TruthfulQA (AUC=0.478) establishes that angular geometry measures topical engagement rather than factual accuracy. SGI provides computationally efficient, theoretically grounded infrastructure for identifying responses that warrant verification in production RAG deployments.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 23 of its 39 references that are in the map. First posted on arXiv 15 Dec 2025.
Builds on
23 of 39 references.
Closest ancestors · 2
Same direction, newest first
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks22 May
- 2020REALM: Retrieval-Augmented Language Model Pre-Training10 Feb
Other references · 21
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
- 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
9 more
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
- 2023The Internal State of an LLM Knows When It's Lyingcited by 644
- 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 402
- 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 329
- 2021Hurdles to Progress in Long-form Question Answeringcited by 166
- 2019Spherical Text Embeddingcited by 49
- 2025LettuceDetect: A Hallucination Detection Framework for RAG Applicationscited by 32
- 2024FaithBench: A Diverse Hallucination Benchmark for Summarization by Modern LLMscited by 24
- 2024Uncertainty Quantification in Large Language Models Through Convex Hull Analysiscited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ELITE: Embedding-Less retrieval with Iterative Text Exploration
- 2026GROUNDEDKG-RAG: Grounded Knowledge Graph Index for Long-document Question Answering
- 2025Towards Lighter and Robust Evaluation for Retrieval Augmented Generation
- 2025Grounding Long-Context Reasoning with Contextual Normalization for Retrieval-Augmented Generation
- 2026Taxonomy of the Retrieval System Framework: Pitfalls and Paradigms
- 2025Re-ranking the Context for Multimodal Retrieval Augmented Generation
- 2025SitEmb-v1.5: Improved Context-Aware Dense Retrieval for Semantic Association and Long Story Comprehension
- 2024SFR-RAG: Towards Contextually Faithful LLMs