mlsanityData to 14 Oct 2026

Spanish Legalese Language Model and Corpora

arXiv 2110.12201 ↗First posted 23 Oct 2021cs.CL cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

There are many Language Models for the English language according to its worldwide relevance. However, for the Spanish language, even if it is a widely spoken language, there are very few Spanish Language Models which result to be small and too general. Legal slang could be think of a Spanish variant on its own as it is very complicated in vocabulary, semantics and phrase understanding. For this work we gathered legal-domain corpora from different sources, generated a model and evaluated against Spanish general domain tasks. The model provides reasonable results in those tasks.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 5 of its 12 references that are in the map. First posted on arXiv 23 Oct 2021.

Builds on

5 of 12 references.

References · 5

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,488
  3. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 915
  4. 2019PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase Identificationcited by 264
  5. 2018A Corpus for Multilingual Document Classification in Eight Languagescited by 42

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 5; 2025: 2; 2026: 1.

11 papers.

  1. 2024SaulLM-7B: A pioneering Large Language Model for Lawcited by 142
  2. 2023LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domaincited by 68
  3. 2023MultiLegalPile: A 689GB Multilingual Legal Corpuscited by 60
  4. 2024SaulLM-54B & SaulLM-141B: Scaling Up Domain Adaptation for the Legal Domaincited by 39
  5. 2023Leveraging Large Language Models for Topic Classification in the Domain of Public Affairscited by 13
  6. 2024LawInstruct: A Resource for Studying Language Model Adaptation to the Legal Domaincited by 10
  7. 2024LexSumm and LexT5: Benchmarking and Modeling Legal Summarization Tasks in Englishcited by 8
  8. 2025Whisper-LM: Improving ASR Models with Language Models for Low-Resource Languagescited by 5
  9. 2025Predicting potentially abusive clauses in Chilean terms of services with natural language processingcited by 1
  10. 2024Data Processing for the OpenGPT-X Model Familycited by 0
  11. 2026Retrieval-Augmented Detection of Potentially Abusive Clauses in Chilean Terms of Servicecited by 0