Unlocking Legal Knowledge: A Multilingual Dataset for Judicial Summarization in Switzerland
Not on the map. Why?
Abstract (arXiv)
Legal research depends on headnotes: concise summaries that help lawyers quickly identify relevant cases. Yet, many court decisions lack them due to the high cost of manual annotation. To address this gap, we introduce the Swiss Landmark Decisions Summarization (SLDS) dataset containing 20K rulings from the Swiss Federal Supreme Court, each with headnotes in German, French, and Italian. SLDS has the potential to significantly improve access to legal information and transform legal research in Switzerland. We fine-tune open models (Qwen2.5, Llama 3.2, Phi-3.5) and compare them to larger general-purpose and reasoning-tuned LLMs, including GPT-4o, Claude 3.5 Sonnet, and the open-source DeepSeek R1. Using an LLM-as-a-Judge framework, we find that fine-tuned models perform well in terms of lexical similarity, while larger models generate more legally accurate and coherent summaries. Interestingly, reasoning-focused models show no consistent benefit, suggesting that factual precision is more important than deep reasoning in this task. We release SLDS under a CC BY 4.0 license to support future research in cross-lingual legal summarization.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 26 of its 56 references that are in the map. First posted on arXiv 17 Oct 2024.
Builds on
26 of 56 references.
References · 26
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,317
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
14 more
- 2024Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Researchcited by 483
- 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 407
- 2024DataComp-LM: In search of the next generation of training sets for language modelscited by 398
- 2024OLMoE: Open Mixture-of-Experts Language Modelscited by 301
- 2018Newsroom: A Dataset of 1.3 Million Summaries with Diverse Extractive Strategiescited by 294
- 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Functioncited by 288
- 2024Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokenscited by 153
- 2019BillSum: A Corpus for Automatic Summarization of US Legislationcited by 117
- 2022Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularitiescited by 47
- 2022EUR-Lex-Sum: A Multi- and Cross-lingual Dataset for Long-form Summarization in the Legal Domaincited by 40
- 2021Incorporating Domain Knowledge for Extractive Summarization of Legal Case Documentscited by 23
- 2022BudgetLongformer: Can we Cheaply Pretrain a SotA Legal Language Model From Scratch?cited by 13
- 2023MILDSum: A Novel Benchmark Dataset for Multilingual Summarization of Indian Legal Case Judgmentscited by 10
- 2023Legal Extractive Summarization of U.S. Court Opinionscited by 9
Built on by
Citing papers per year: 2025: 4; 2026: 3.
7 papers.
- 2025LEXam: Benchmarking Legal Reasoning on 340 Law Examscited by 54
- 2025Modeling Motivated Reasoning in Law: Evaluating Strategic Role Conditioning in LLM Summarizationcited by 3
- 2025Computational Law: Datasets, Benchmarks, and Ontologiescited by 2
- 2025CourtPressGER: A German Court Decision to Press Release Summarization Datasetcited by 1
- 2026Swiss-Bench SBP-002: A Frontier Model Comparison on Swiss Legal and Regulatory Taskscited by 1
- 2026Challenges and Recommendations for LLM-as-a-Judge in Multilingual Settings and for Low-Resource Languagescited by 1
- 2026SoK: Grading Open-Text Legal Answers, from Law School Exams to Trustworthy Rubric Judgescited by 0
- 2026SoK: Grading Open-Text Legal Answers, from Law School Exams to Trustworthy Rubric Judges14 Oct 2026
- 2026Challenges and Recommendations for LLM-as-a-Judge in Multilingual Settings and for Low-Resource Languages2 Jul 2026
- 2026Swiss-Bench SBP-002: A Frontier Model Comparison on Swiss Legal and Regulatory Tasks24 Mar 2026
- 2025CourtPressGER: A German Court Decision to Press Release Summarization Dataset10 Dec 2025
- 2025Modeling Motivated Reasoning in Law: Evaluating Strategic Role Conditioning in LLM Summarization30 Aug 2025
- 2025LEXam: Benchmarking Legal Reasoning on 340 Law Exams19 May 2025
- 2025Computational Law: Datasets, Benchmarks, and Ontologies6 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2023One Law, Many Languages: Benchmarking Multilingual Legal Reasoning for Judicial Support
- 2025A Data Science Approach to Calcutta High Court Judgments: An Efficient LLM and RAG-powered Framework for Summarization and Similar Cases Retrieval
- 2026Multi-Legal-Bench: Evaluating LLMs on Legal Reasoning Across Jurisdictions, Languages, and Legal Traditions
- 2025Evaluating the Limits of Large Language Models in Multilingual Legal Reasoning
- 2025Structured Definitions and Segmentations for Legal Reasoning in LLMs: A Study on Indian Legal Data
- 2023LawBench: Benchmarking Legal Knowledge of Large Language Models
- 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models
- 2026Gavel: Agent Meets Checklist for Evaluating LLMs on Long-Context Legal Summarization