BillSum: A Corpus for Automatic Summarization of US Legislation
Not on the map. Why?
Abstract (arXiv)
Automatic summarization methods have been studied on a variety of domains, including news and scientific articles. Yet, legislation has not previously been considered for this task, despite US Congress and state governments releasing tens of thousands of bills every year. In this paper, we introduce BillSum, the first dataset for summarization of US Congressional and California state bills (https://github.com/FiscalNote/BillSum). We explain the properties of the dataset that make it more challenging to process than other domains. Then, we benchmark extractive methods that consider neural sentence representations and traditional contextual features. Finally, we demonstrate that models built on Congressional bills can be used to summarize California bills, thus, showing that methods developed on this dataset can transfer to states without human-written summaries.
Key facts. Cited by 117 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 20; 2023: 19; 2024: 30; 2025: 19; 2026: 16.
117 papers.
Sort:
By area:
- 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 402
- 2021Efficient Attentions for Long Document Summarizationcited by 342
- 2021SPoT: Better Frozen Model Adaptation through Soft Prompt Transfercited by 235
- 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
- 2022Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Modelscited by 187
- 2023BooookScore: A systematic exploration of book-length summarization in the era of LLMscited by 137
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2023LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarizationcited by 96
- 2023MeetingBank: A Benchmark Dataset for Meeting Summarizationcited by 81
- 2021Planning with Learned Entity Prompts for Abstractive Summarizationcited by 75
- 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
- 2023RewriteLM: An Instruction-Tuned Large Language Model for Text Rewritingcited by 67
38 more
- 2022ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcriptscited by 59
- 2022Legal Prompt Engineering for Multilingual Legal Judgement Predictioncited by 54
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
- 2022Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularitiescited by 47
- 2023LongForm: Effective Instruction Tuning with Reverse Instructionscited by 47
- 2022EUR-Lex-Sum: A Multi- and Cross-lingual Dataset for Long-form Summarization in the Legal Domaincited by 39
- 2021DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarizationcited by 34
- 2021An Exploratory Study on Long Dialogue Summarization: What Works and What's Nextcited by 28
- 2024Constructing Domain-Specific Evaluation Sets for LLM-as-a-judgecited by 28
- 2024Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLPcited by 27
- 2022How Far are We from Robust Long Abstractive Summarization?cited by 25
- 2024Prompt Leakage effect and defense strategies for multi-turn LLM interactionscited by 23
- 2021RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarizationcited by 19
- 2024Data Contamination Report from the 2024 CONDA Shared Taskcited by 19
- 2021Can Transformer Models Measure Coherence In Text? Re-Thinking the Shuffle Testcited by 17
- 2022ClassActionPrediction: A Challenging Benchmark for Legal Judgment Prediction of Class Action Cases in the UScited by 17
- 2022UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarizationcited by 15
- 2023Walking a Tightrope -- Evaluating Large Language Models in High-Risk Domainscited by 15
- 2021Meta-Transfer Learning for Low-Resource Abstractive Summarizationcited by 14
- 2022Make The Most of Prior Data: A Solution for Interactive Text Summarization with Preference Feedbackcited by 13
- 2022BudgetLongformer: Can we Cheaply Pretrain a SotA Legal Language Model From Scratch?cited by 13
- 2024Pruning as a Domain-specific LLM Extractorcited by 12
- 2021TLDR9+: A Large Scale Resource for Extreme Summarization of Social Media Postscited by 10
- 2021Robust Deep Reinforcement Learning for Extractive Legal Summarizationcited by 10
- 2024Evaluating the Factuality of Zero-shot Summarizers Across Varied Domainscited by 10
- 2024LawInstruct: A Resource for Studying Language Model Adaptation to the Legal Domaincited by 10
- 2023Can LMs Generalize to Future Data? An Empirical Analysis on Text Summarizationcited by 9
- 2023Legal Extractive Summarization of U.S. Court Opinionscited by 9
- 2024Turning Generative Models Degenerate: The Power of Data Poisoning Attackscited by 9
- 2025Benchmarking LLMs for Political Science: A United Nations Perspectivecited by 9
- 2022OTExtSum: Extractive Text Summarisation with Optimal Transportcited by 8
- 2022Computing and Exploiting Document Structure to Improve Unsupervised Extractive Summarization of Legal Case Decisionscited by 8
- 2023Translating Legalese: Enhancing Public Understanding of Court Opinions with Legal Summarizerscited by 8
- 2024Understanding Large Language Model Behaviors through Interactive Counterfactual Generation and Analysiscited by 8
- 2024OpenDebateEvidence: A Massive-Scale Argument Mining and Summarization Datasetcited by 8
- 2023An Analysis of Abstractive Text Summarization Using Pre-trained Modelscited by 7
- 2024Flexible and Adaptable Summarization via Expertise Separationcited by 7
- 2024LexSumm and LexT5: Benchmarking and Modeling Legal Summarization Tasks in Englishcited by 7
50 most cited of 117 All 117 (JSON)
- 2026Attention Function as an Intrinsic Inductive Bias: How Models' Behavior Diverges in Novel Contexts30 Sep 2026
- 2026Write Back the Delta: Revisiting the Same Tokens with Fresh Representations26 Sep 2026
- 2026Preserving What Matters: Semantic Scaffolds Beyond Saturation in Summarization Evaluation18 Sep 2026
- 2026Hierarchical Wasserstein Merging for Multi-Domain Multi-Task Learning: From Specialists to a Generalist6 Sep 2026
- 2026Domain-Agnostic Neural Topic Modeling with Contextual Token-Level Semantic Graph Representation17 Aug 2026
- 2026Measuring & Mitigating Over-Alignment for LLMs in Multilingual Criminal Law Courts22 Jun 2026
- 2026Efficient DP-SGD for LLMs with Randomized Clipping24 May 2026
- 2026DynaMiCS: Fine-tuning LLMs with Performance Constraints using Dynamic Mixtures11 May 2026
- 2026Diagnosing Capability Gaps in Fine-Tuning Data30 Apr 2026
- 2026LLM-ReSum: A Framework for LLM Reflective Summarization through Self-Evaluation28 Apr 2026
- 2026Analysis and Explainability of LLMs Via Evolutionary Methods27 Apr 2026
- 2026No Reader Left Behind: Multi-Agent Summaries Everyone Can Understand12 Apr 2026
38 more
- 2026GradPruner: Gradient-Guided Layer Pruning Enabling Efficient Fine-Tuning and Inference for LLMs27 Jan 2026
- 2026Evaluation of Large Language Models in Legal Applications: Challenges, Methods, and Future Directions21 Jan 2026
- 2026An Empirical Study on Preference Tuning Generalization and Diversity Under Domain Shift9 Jan 2026
- 2026Can LLMs Track Their Output Length? A Dynamic Feedback Mechanism for Precise Length Regulation5 Jan 2026
- 2025CourtPressGER: A German Court Decision to Press Release Summarization Dataset10 Dec 2025
- 2025EfficientXpert: Efficient Domain Adaptation for Large Language Models via Propagation-Aware Pruning25 Nov 2025
- 2025AugAbEx: Bridging Abstractive and Extractive Legal Summarization15 Nov 2025
- 2025ParliaBench: An Evaluation and Benchmarking Framework for LLM-Generated Parliamentary Speech11 Nov 2025
- 2025Charting the European LLM Benchmarking Landscape: A New Taxonomy and a Set of Best Practices28 Oct 2025
- 2025No Mean Feat: Simple, Strong Baselines for Context Compression23 Oct 2025
- 2025Balancing Rewards in Text Summarization: Multi-Objective Reinforcement Learning via HyperVolume Optimization22 Oct 2025
- 2025SAGE: A Realistic Benchmark for Semantic Understanding25 Sep 2025
- 2025PersonaMatrix: A Recipe for Persona-Aware Evaluation of Legal Summarization19 Sep 2025
- 2025Can Smaller LLMs do better? Unlocking Cross-Domain Potential through Parameter-Efficient Fine-Tuning for Text Summarization1 Sep 2025
- 2025DaMoC: Efficiently Selecting the Optimal Large Language Model for Fine-tuning Domain Tasks Based on Data and Model Compression1 Sep 2025
- 2025Let's Measure Information Step-by-Step: AI-Based Evaluation Beyond Vibes7 Aug 2025
- 2025Compliance-to-Code: Enhancing Financial Compliance Checking via Code Generation26 May 2025
- 2025PoliCon: Evaluating LLMs on Achieving Diverse Political Consensus Objectives26 May 2025
- 2025Toward Evaluative Thinking: Meta Policy Optimization with Evolving Reward Models28 Apr 2025
- 2025DUAL: Diversity and Uncertainty Active Learning for Text Summarization2 Mar 2025
- 2025Compressing Language Models for Specialized Domains25 Feb 2025
- 2025Benchmarking LLMs for Political Science: A United Nations Perspective19 Feb 2025
- 2025A Comprehensive Survey on Legal Summarization: Challenges and Future Directions29 Jan 2025
- 2024CaseSumm: A Large-Scale Dataset for Long-Context Summarization from U.S. Supreme Court Opinions30 Dec 2024
- 2024A Comprehensive Framework for Reliable Legal AI: Combining Specialized Expert Systems and Adaptive Refinement29 Dec 2024
- 2024Multi-LLM Text Summarization20 Dec 2024
- 2024All-in-One Tuning and Structural Pruning for Domain-Specific LLMs19 Dec 2024
- 2024Learning to Verify Summary Facts with Fine-Grained LLM Feedback14 Dec 2024
- 2024Generative Fuzzy System for Sequence Generation21 Nov 2024
- 2024The State and Fate of Summarization Datasets: A Survey7 Nov 2024
- 2024VERITAS: A Unified Approach to Reliability Evaluation5 Nov 2024
- 2024Unlocking Legal Knowledge: A Multilingual Dataset for Judicial Summarization in Switzerland17 Oct 2024
- 2024LexSumm and LexT5: Benchmarking and Modeling Legal Summarization Tasks in English12 Oct 2024
- 2024Enterprise Benchmarks for Large Language Model Evaluation11 Oct 2024
- 2024CoCoHD: Congress Committee Hearing Dataset4 Oct 2024
- 2024Salient Information Prompting to Steer Content in Prompt-based Abstractive Summarization3 Oct 2024
- 2024Constructing Domain-Specific Evaluation Sets for LLM-as-a-judge16 Aug 2024
- 2024Reconsidering Degeneration of Token Embeddings with Definitions for Encoder-based Pre-trained Language Models2 Aug 2024
50 newest of 117 All 117 (JSON)
- 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 402
- 2021Efficient Attentions for Long Document Summarizationcited by 342
- 2021SPoT: Better Frozen Model Adaptation through Soft Prompt Transfercited by 235
- 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
- 2022Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Modelscited by 187
- 2023BooookScore: A systematic exploration of book-length summarization in the era of LLMscited by 137
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2023LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarizationcited by 96
- 2023MeetingBank: A Benchmark Dataset for Meeting Summarizationcited by 81
- 2021Planning with Learned Entity Prompts for Abstractive Summarizationcited by 75
- 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
- 2023RewriteLM: An Instruction-Tuned Large Language Model for Text Rewritingcited by 67
12 most cited of 110 All 110 (JSON)
- 2026Attention Function as an Intrinsic Inductive Bias: How Models' Behavior Diverges in Novel Contexts30 Sep 2026
- 2026Write Back the Delta: Revisiting the Same Tokens with Fresh Representations26 Sep 2026
- 2026Preserving What Matters: Semantic Scaffolds Beyond Saturation in Summarization Evaluation18 Sep 2026
- 2026Hierarchical Wasserstein Merging for Multi-Domain Multi-Task Learning: From Specialists to a Generalist6 Sep 2026
- 2026Domain-Agnostic Neural Topic Modeling with Contextual Token-Level Semantic Graph Representation17 Aug 2026
- 2026Efficient DP-SGD for LLMs with Randomized Clipping24 May 2026
- 2026DynaMiCS: Fine-tuning LLMs with Performance Constraints using Dynamic Mixtures11 May 2026
- 2026Diagnosing Capability Gaps in Fine-Tuning Data30 Apr 2026
- 2026LLM-ReSum: A Framework for LLM Reflective Summarization through Self-Evaluation28 Apr 2026
- 2026Analysis and Explainability of LLMs Via Evolutionary Methods27 Apr 2026
- 2026No Reader Left Behind: Multi-Agent Summaries Everyone Can Understand12 Apr 2026
- 2026GradPruner: Gradient-Guided Layer Pruning Enabling Efficient Fine-Tuning and Inference for LLMs27 Jan 2026
12 newest of 110 All 110 (JSON)