Simplify Your Law: Using Information Theory to Deduplicate Legal Documents
Not on the map. Why?
Abstract (arXiv)
Textual redundancy is one of the main challenges to ensuring that legal texts remain comprehensible and maintainable. Drawing inspiration from the refactoring literature in software engineering, which has developed methods to expose and eliminate duplicated code, we introduce the duplicated phrase detection problem for legal texts and propose the Dupex algorithm to solve it. Leveraging the Minimum Description Length principle from information theory, Dupex identifies a set of duplicated phrases, called patterns, that together best compress a given input text. Through an extensive set of experiments on the Titles of the United States Code, we confirm that our algorithm works well in practice: Dupex will help you simplify your law.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 5 of its 37 references that are in the map. First posted on arXiv 2 Oct 2021.
Builds on
5 of 37 references.
References · 5
- 2021Deduplicating Training Data Makes Language Models Bettercited by 714
- 2021Measuring Law Over Time: A Network Analytical Framework with an Application to Statutes and Regulations in the United States and Germanycited by 17
- 2020Complex Societies and the Growth of the Lawcited by 12
- 2019The Long and the Short of It: Summarising Event Sequences with Serial Episodescited by 7
- 2017Efficiently Summarising Event Sequences with Rich Interleaving Patternscited by 5
Built on by
Citing papers per year: 2021: 1; 2022: 0; 2023: 0; 2024: 1.
2 papers.