mlsanityData to 7 Oct 2026

LegalCiteTrust: Benchmarking Citation Trustworthiness in Chinese Long-Form Legal Research Reports

arXiv 2607.20872 ↗First posted 23 Jul 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Long-form legal research reports increasingly rely on LLMs and agentic research systems, but their reliability depends not only on answering the task, but also on whether cited legal authorities are trustworthy. A citation can be risky even when it points to a real source: the report may omit limiting conditions, misdescribe the authority, or use it to support a stronger claim than the source allows. We introduce LegalCiteTrust, a benchmark for evaluating citation trustworthiness in Chinese long-form legal research reports. It contains 72 densely annotated report-level tasks and evaluates reports along three dimensions: Coverage, Support, and Citation Trustworthiness. Citation Trustworthiness is operationalized through citation-level Existence, Fidelity, and Applicability (E/F/A). Experiments on general-purpose LLMs, deep-research systems, and legal-specific systems show that task completion, evidence richness, citation density, and citation reliability expose different system behaviors. Retrieval tools can improve evidence support without reliably improving the Trust score, while E/F/A-based revision improves Trust and Final score more clearly than existence-only filtering. These results suggest that trustworthy legal research generation requires citation-aware evidence governance after retrieval: systems must not only retrieve legal authorities, but also select, describe, and apply them reliably.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 25 references that are in the map. First posted on arXiv 23 Jul 2026.

Builds on

16 of 25 references.

References · 16

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  3. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  4. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
  5. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
  6. 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
  7. 2023RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Modelscited by 272
  8. 2018CAIL2018: A Large-Scale Legal Dataset for Judgment Predictioncited by 168
  9. 2023LawBench: Benchmarking Legal Knowledge of Large Language Modelscited by 111
  10. 2024LegalAgentBench: Evaluating LLM Agents in Legal Domaincited by 56
  11. 2025ReportBench: Evaluating Deep Research Agents via Academic Survey Taskscited by 34
  12. 2025Deep Research Bench: Evaluating AI Web Research Agentscited by 31
4 more
  1. 2025DeepResearch Arena: The First Exam of LLMs' Research Abilities via Seminar-Grounded Taskscited by 24
  2. 2026PLawBench: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practicecited by 13
  3. 2026DREAM: Deep Research Evaluation with Agentic Metricscited by 7
  4. 2026LegalCiteBench: Evaluating Citation Reliability in Legal Language Modelscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025CLaw: Benchmarking Chinese Legal Knowledge in Large Language Models - A Fine-grained Corpus and Reasoning Analysis
  2. 2026Legal Research Bench: Measuring End-to-End Reliability in Long-Horizon Legal Research Agents
  3. 2024Evaluating LLM-based Approaches to Legal Citation Prediction: Domain-specific Pre-training, Fine-tuning, or RAG? A Benchmark and an Australian Law Case Study
  4. 2025SemanticCite: Citation Verification with AI-Powered Full-Text Analysis and Evidence-Based Reasoning
  5. 2026Is this Citation on Point?
  6. 2026CiteVQA: Benchmarking Evidence Attribution for Trustworthy Document Intelligence
  7. 2026DeepSciVerify: Verifying Scientific Claim--Citation Alignment via LLM-Driven Evidence Escalation
  8. 2025JuDGE: Benchmarking Judgment Document Generation for Chinese Legal System