mlsanityData to 14 Oct 2026

Scale-free Characteristics of Multilingual Legal Texts and the Limitations of LLMs

arXiv 2509.17367 ↗First posted 22 Sep 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a comparative analysis of text complexity across domains using scale-free metrics. We quantify linguistic complexity via Heaps' exponent β (vocabulary growth), Taylor's exponent α (word-frequency fluctuation scaling), compression rate r (redundancy), and entropy. Our corpora span three domains: legal documents (statutes, cases, deeds) as a specialized domain, general natural language texts (literature, Wikipedia), and AI-generated (GPT) text. We find that legal texts exhibit slower vocabulary growth (lower β) and higher term consistency (higher α) than general texts. Within legal domain, statutory codes have the lowest β and highest α, reflecting strict drafting conventions, while cases and deeds show higher β and lower α. In contrast, GPT-generated text shows the statistics more aligning with general language patterns. These results demonstrate that legal texts exhibit domain-specific structures and complexities, which current generative models do not fully replicate.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 30 references that are in the map. First posted on arXiv 22 Sep 2025.

Builds on

10 of 30 references.

References · 10

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2020Scaling Laws for Neural Language Modelscited by 6,586
  4. 2020Longformer: The Long-Document Transformercited by 3,413
  5. 2021MultiEURLEX -- A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfercited by 90
  6. 2018A standardized Project Gutenberg corpus for statistical analysis of natural language and quantitative linguisticscited by 64
  7. 2023MultiLegalPile: A 689GB Multilingual Legal Corpuscited by 60
  8. 2024Applicability of Large Language Models and Generative Models for Legal Case Judgement Summarizationcited by 23
  9. 2019Evaluating Computational Language Models with Scaling Properties of Natural Languagecited by 22
  10. 2018Taylor's law for Human Linguistic Sequencescited by 5

Built on by

Not cited yet.