mlsanityData to 7 Oct 2026

TrustScore: Reference-Free Evaluation of LLM Response Trustworthiness

arXiv 2402.12545 ↗First posted 19 Feb 2024cs.CLcited by 19

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have demonstrated impressive capabilities across various domains, prompting a surge in their practical applications. However, concerns have arisen regarding the trustworthiness of LLMs outputs, particularly in closed-book question-answering tasks, where non-experts may struggle to identify inaccuracies due to the absence of contextual or ground truth information. This paper introduces TrustScore, a framework based on the concept of Behavioral Consistency, which evaluates whether an LLMs response aligns with its intrinsic knowledge. Additionally, TrustScore can seamlessly integrate with fact-checking methods, which assesses alignment with external knowledge sources. The experimental results show that TrustScore achieves strong correlations with human judgments, surpassing existing reference-free metrics, and achieving results on par with reference-based metrics.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 22 of its 39 references that are in the map. First posted on arXiv 19 Feb 2024.

Builds on

22 of 39 references.

References · 22

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  3. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  4. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  6. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  7. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  8. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
  9. 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 713
  10. 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 486
  11. 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 394
  12. 2023GPTScore: Evaluate as You Desirecited by 357
10 more
  1. 2023Challenges and Applications of Large Language Modelscited by 251
  2. 2023LM vs LM: Detecting Factual Errors via Cross Examinationcited by 155
  3. 2020Logic-Guided Data Augmentation and Regularization for Consistent Question Answeringcited by 77
  4. 2022mFACE: Multilingual Summarization with Factual Consistency Evaluationcited by 42
  5. 2022Evaluating Factuality in Text Simplificationcited by 34
  6. 2022MENLI: Robust Evaluation Metrics from Natural Language Inferencecited by 18
  7. 2022Transformer-based Entity Typing in Knowledge Graphscited by 13
  8. 2022Context Generation Improves Open Domain Question Answeringcited by 7
  9. 2023KoRC: Knowledge oriented Reading Comprehension Benchmark for Deep Text Understandingcited by 7
  10. 2023Multi-view Contrastive Learning for Entity Typing over Knowledge Graphscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 8; 2025: 8; 2026: 3.

19 papers.

Sort:

By area:

  1. 2025Scalable Best-of-N Selection for Large Language Models via Self-Certaintycited by 182
  2. 2024Internal Consistency and Self-Feedback in Large Language Models: A Surveycited by 49
  3. 2024Atomic Fact Decomposition Helps Attributed Question Answeringcited by 21
  4. 2025Verifier-free Test-Time Sampling for Vision-Language-Action Modelscited by 21
  5. 2024How Reliable are LLMs as Knowledge Bases? Re-thinking Facutality and Consistencycited by 10
  6. 2024Self-Training Meets Consistency: Improving LLMs' Reasoning with Consistency-Driven Rationale Evaluationcited by 6
  7. 2025Aligning Large Language Models for Faithful Integrity Against Opposing Argumentcited by 6
  8. 2025To trust or not to trust: Attention-based Trust Management for LLM Multi-Agent Systemscited by 6
  9. 2024Evaluating and Safeguarding the Adversarial Robustness of Retrieval-Based In-Context Learningcited by 4
  10. 2025Long-Form Information Alignment Evaluation Beyond Atomic Factscited by 4
  11. 2024EVA-Score: Evaluating Abstractive Long-form Summarization on Informativeness through Extraction and Validationcited by 3
  12. 2025Decomposing and Revising What Language Models Generatecited by 2
7 more
  1. 2025Static Sandboxes Are Inadequate: Modeling Societal Complexity Requires Open-Ended Co-Evolution in LLM-Based Multi-Agent Simulationscited by 2
  2. 2026Blending Human and LLM Expertise to Detect Hallucinations and Omissions in Mental Health Chatbot Responsescited by 1
  3. 2026From Answers to Arguments: Toward Trustworthy Clinical Diagnostic Reasoning with Toulmin-Guided Curriculum Goal-Conditioned Learningcited by 1
  4. 2024On the Influence of Shape, Texture and Color for Learning Semantic Segmentationcited by 0
  5. 2024Contrast All the Time: Learning Time Series Representation from Temporal Consistencycited by 0
  6. 2025Evaluating and Improving Graph to Text Generation with Large Language Modelscited by 0
  7. 2026Reasoning Portability: Guiding Continual Learning for MLLMs in the RLVR Eracited by 0