mlsanityData to 14 Oct 2026

Automatic Anonymization of Swiss Federal Supreme Court Rulings

arXiv 2310.04632 ↗First posted 7 Oct 2023cs.CL cs.AI cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Releasing court decisions to the public relies on proper anonymization to protect all involved parties, where necessary. The Swiss Federal Supreme Court relies on an existing system that combines different traditional computational methods with human experts. In this work, we enhance the existing anonymization software using a large dataset annotated with entities to be anonymized. We compared BERT-based models with models pre-trained on in-domain data. Our results show that using in-domain data to pre-train the models further improves the F1-score by more than 5% compared to existing models. Our work demonstrates that combining existing anonymization methods, such as regular expressions, with machine learning can further reduce manual labor and enhance automatic suggestions.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 7 Oct 2023.

Builds on

25 of 44 references.

References · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  6. 2020Longformer: The Long-Document Transformercited by 3,413
  7. 2020Reformer: The Efficient Transformercited by 1,668
  8. 2019Cross-lingual Language Model Pretrainingcited by 1,090
  9. 2021When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Datasetcited by 201
  10. 2020German's Next Language Modelcited by 144
  11. 2022Should You Mask 15% in Masked Language Modeling?cited by 118
  12. 2020UNKs Everywhere: Adapting Multilingual Language Models to New Scriptscited by 113
13 more
  1. 2022Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Datasetcited by 113
  2. 2023LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domaincited by 68
  3. 2021Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction Benchmarkcited by 60
  4. 2023MultiLegalPile: A 689GB Multilingual Legal Corpuscited by 60
  5. 2020A Dataset of German Legal Documents for Named Entity Recognitioncited by 24
  6. 2022An Empirical Study on Cross-X Transfer for Legal Judgment Predictioncited by 16
  7. 2023One Law, Many Languages: Benchmarking Multilingual Legal Reasoning for Judicial Supportcited by 16
  8. 2022BudgetLongformer: Can we Cheaply Pretrain a SotA Legal Language Model From Scratch?cited by 13
  9. 2022LegalRelectra: Mixed-domain Language Modeling for Long-range Legal Text Comprehensioncited by 7
  10. 2023MultiLegalSBD: A Multilingual Legal Sentence Boundary Detection Datasetcited by 7
  11. 2023Anonymity at Risk? Assessing Re-Identification Capabilities of Large Language Modelscited by 7
  12. 2023German BERT Model for Legal Named Entity Recognitioncited by 6
  13. 2023Resolving Legalese: A Multilingual Exploration of Negation Scope Resolution in Legal Documentscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.