sui-1: Grounded and Verifiable Long-Form Summarization
Not on the map. Why?
Abstract (arXiv)
Large language models frequently generate plausible but unfaithful summaries that users cannot verify against source text, a critical limitation in compliance-sensitive domains such as government and legal analysis. We present sui-1, a 24B parameter model that produces abstractive summaries with inline citations, enabling users to trace each claim to its source sentence. Our synthetic data pipeline combines chain-of-thought prompting with multi-stage verification, generating over 22,000 high-quality training examples across five languages from diverse sources including parliamentary documents, web text, and Wikipedia. Evaluation shows sui-1 significantly outperforms all tested open-weight baselines, including models with 3x more parameters. These results demonstrate that task-specific training substantially outperforms scale alone for citation-grounded summarization. Model weights and an interactive demo are publicly available.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 13 references that are in the map. First posted on arXiv 13 Jan 2026.
Builds on
11 of 13 references.
References · 11
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
- 2023Enabling Large Language Models to Generate Text with Citationscited by 584
- 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 369
- 2024LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QAcited by 78
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systems
- 2025VERIRAG: A Post-Retrieval Auditing of Scientific Study Summaries
- 2026Cited but Not Verified: Parsing and Evaluating Source Attribution in LLM Deep Research Agents
- 2022Faithful to the Document or to the World? Mitigating Hallucinations via Entity-linked Knowledge in Abstractive Summarization
- 2025SCALAR: Scientific Citation-based Live Assessment of Long-context Academic Reasoning
- 2025Incentive-Aligned Multi-Source LLM Summaries
- 2026ScholarSum: Student-Teacher Abstractive Summarization via Knowledge Graph Reasoning and Reflective Refinement
- 2023Large Language Models are Not Yet Human-Level Evaluators for Abstractive Summarization