mlsanityData to 7 Oct 2026

sui-1: Grounded and Verifiable Long-Form Summarization

arXiv 2601.08472 ↗First posted 13 Jan 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models frequently generate plausible but unfaithful summaries that users cannot verify against source text, a critical limitation in compliance-sensitive domains such as government and legal analysis. We present sui-1, a 24B parameter model that produces abstractive summaries with inline citations, enabling users to trace each claim to its source sentence. Our synthetic data pipeline combines chain-of-thought prompting with multi-stage verification, generating over 22,000 high-quality training examples across five languages from diverse sources including parliamentary documents, web text, and Wikipedia. Evaluation shows sui-1 significantly outperforms all tested open-weight baselines, including models with 3x more parameters. These results demonstrate that task-specific training substantially outperforms scale alone for citation-grounded summarization. Model weights and an interactive demo are publicly available.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 13 references that are in the map. First posted on arXiv 13 Jan 2026.

Builds on

11 of 13 references.

References · 11

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2020Longformer: The Long-Document Transformercited by 3,362
  4. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  5. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  6. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  7. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  8. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  9. 2023Enabling Large Language Models to Generate Text with Citationscited by 584
  10. 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 369
  11. 2024LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QAcited by 78

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systems
  2. 2025VERIRAG: A Post-Retrieval Auditing of Scientific Study Summaries
  3. 2026Cited but Not Verified: Parsing and Evaluating Source Attribution in LLM Deep Research Agents
  4. 2022Faithful to the Document or to the World? Mitigating Hallucinations via Entity-linked Knowledge in Abstractive Summarization
  5. 2025SCALAR: Scientific Citation-based Live Assessment of Long-context Academic Reasoning
  6. 2025Incentive-Aligned Multi-Source LLM Summaries
  7. 2026ScholarSum: Student-Teacher Abstractive Summarization via Knowledge Graph Reasoning and Reflective Refinement
  8. 2023Large Language Models are Not Yet Human-Level Evaluators for Abstractive Summarization