LexLattice: Multilingual Extractive Summarization via Neural Cellular Automata on Document Hierarchies
Not on the map. Why?
Abstract (arXiv)
Faithfulness is a central concern in legal text summarization, which motivates extractive approaches that select verbatim content traceable to its source. Such methods typically rank paragraphs or other structural units in isolation, yet give little attention to consolidating evidence that is distributed across, and shares salience between, distant parts of a document. We introduce LexLattice, an extractive summarizer that reifies a legal act's hierarchy as a two-dimensional semantic lattice and consolidates over it with a masked 2D neural cellular automata before selection. LexLattice attains state-of-the-art ROUGE across all 24 languages of EUR-Lex-Sum in both multilingual and cross-lingual settings, surpassing instruction-tuned baselines with billions of parameters, despite concentrating all trainable capacity in a 1.8M parameter consolidator over a frozen multilingual encoder. A consolidator trained only on high-resource languages further transfers to unseen languages with near-lossless retention (0.99), indicating that the model operates on language-agnostic semantic geometry rather than surface form. Our results position explicit consolidation over document structure as a compact and traceable alternative to scale for multilingual legal summarization.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 34 references that are in the map. First posted on arXiv 22 Sep 2026.
Builds on
17 of 34 references.
References · 17
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
- 2019Text Summarization with Pretrained Encoderscited by 556
- 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 478
- 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 246
- 2021LongT5: Efficient Text-To-Text Transformer for Long Sequencescited by 232
- 2021BookSum: A Collection of Datasets for Long-form Narrative Summarizationcited by 184
- 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
- 2021PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarizationcited by 62
- 2022Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularitiescited by 47
5 more
- 2022EUR-Lex-Sum: A Multi- and Cross-lingual Dataset for Long-form Summarization in the Legal Domaincited by 40
- 2022HiStruct+: Improving Extractive Text Summarization with Hierarchical Structure Informationcited by 26
- 2025LeMAJ (Legal LLM-as-a-Judge): Bridging Legal Reasoning and LLM Evaluationcited by 10
- 2024LexSumm and LexT5: Benchmarking and Modeling Legal Summarization Tasks in Englishcited by 8
- 2024Summarizing long regulatory documents with a multi-step pipelinecited by 4
Built on by
Not cited yet.